Building Bulletproof AI Applications: Lessons from Processing Billions of Tokens Daily
CTO of Astra AI Tjaž Silovšek shares engineering realities of production AI systems handling provider outages, rate limits, and failures at scale
Building Bulletproof AI Applications: Lessons from Processing Billions of Tokens Daily
Date: Thursday, October 9, 2025
Time: 6:00 PM - 8:00 PM CEST (Doors at 5:00 PM)
Location: Sportradar d.o.o., Litostrojska Cesta 52a, 1000 Ljubljana
Duration: 2 hours
About This Event
Join us for an insightful talk by Tjaž Silovšek, CTO at Astra AI, who will share real-world lessons from building and scaling production AI applications that process billions of tokens daily.
Building reliable LLM applications means handling the cascade of failures that emerge at scale. This talk covers the engineering realities of production AI systems: provider outages, flaky connections, rate limits, and more. Drawing from hands-on experience processing billions of tokens daily, Tjaž will provide practical insights into creating robust, production-ready AI applications.
This event is ideal for engineers, developers, CTOs, and technical leads working with or planning to implement LLM-based applications in production environments.
Speaker
Tjaž Silovšek is the Chief Technology Officer at Astra AI, where he leads the development of large-scale AI systems. With extensive experience in building production AI applications, Tjaž has navigated the challenges of handling billions of tokens daily and has developed deep expertise in ensuring reliability and performance at scale.
Talk Abstract
Building reliable LLM applications means handling the cascade of failures that emerge at scale. Drawing from experience processing billions of tokens daily, this talk covers the engineering realities of production AI systems: provider outages, flaky connections, rate limits and more.
Learn practical strategies for:
- Handling provider outages and service disruptions
- Managing rate limits and token quotas
- Building resilient retry mechanisms
- Monitoring and debugging production AI systems
- Ensuring reliability at scale
Event Details
- Venue: Sportradar d.o.o.
- Address: Litostrojska Cesta 52a, 1000 Ljubljana
- Language: English
- Networking: Opportunity to connect with AI professionals and developers
Registration
Register now to secure your spot at this valuable event!
Agenda
17:00 - 18:00 - Doors open, networking
18:00 - 19:00 - Building Bulletproof AI Applications: Lessons from Processing Billions of Tokens Daily
19:00 - 20:00 - Q&A and networking
This event is organized by Slovenia AI Meetup and represents our commitment to bringing practical AI expertise to Slovenia's growing tech community.