🌘 Large Language Models Are Breaking 20-Year-Old System Design Conventions ➤ From Stateless to Stateful: Why We Need New Routing Mechanisms? ✤ https://zknill.io/posts/llms-are-breaking-20-year-old-system-design/ For the past two decades, the core assumption of web architecture has been "stateless computing" and "database storage"
Large language models and AI agents are challenging traditional web architecture's stateless design, which relies on request-response cycles and database storage. Current methods for persistent AI execution, like those using Temporal or Inngest, still necessitate inefficient polling due to limitations in traditional routing mechanisms. The author proposes a new routing primitive based on persistent publish/subscribe channels to enable direct client-to-execution flow, bypassing the database bottleneck and improving performance and user experience. AI
IMPACT Proposes new routing primitives for AI applications, potentially improving performance and developer experience for stateful AI agents.