Boardroom Answers · Technology & Platform · Technical Architecture & Scalability
Serverless functions have hard time limits. Your AI analyses are slow by nature. So your platform dies by timeout exactly when it is doing its most valuable work — during my board meeting. Explain.?
The question a Chief Solutions Architect (Enterprise B2B SaaS) asks.
The short answer
Per-route budgets up to 300 seconds, background workers for long AI jobs, idempotent retries, and a cache that makes board-day rendering instant — the meeting consumes pre-computed work; it never waits on a model.
The full executive answer
You are describing a real serverless failure mode, and it is one we engineered around explicitly rather than discovered in production. Three layers. First, honest budgets: every route declares its own execution budget, sized to its work — standard endpoints run tight limits, and the heavy AI generation routes declare the maximum 300-second budget, with the heaviest, roadmap generation, explicitly annotated as such in the code. Nothing relies on a default it might outgrow.
Second, and more fundamentally, the architecture does not ask a user's request to wait on the slowest work. Long-running generation is decoupled: a scheduled generation worker runs AI jobs in the background, and webhook delivery likewise runs as its own worker off a durable queue — so the interactive request path stays fast, and heavy computation happens asynchronously with results landing when ready. Idempotency keys mean any retry of a submission cannot double-run an expensive job. This is precisely the AWS Well-Architected Serverless Lens prescription: decompose long work into asynchronous jobs rather than stretching synchronous timeouts.
Third, the board-meeting scenario specifically: the response cache means an analysis already produced renders instantly — no model call at all — and the meeting artefact itself, the board pack, is generated and exported ahead of the meeting. The demo you will see today runs live generation; a real board meeting runs on pre-generated, cached, exported material. The valuable work happens before the meeting; the meeting consumes it. That is not a workaround — it is how a governed decision product should treat a board meeting.
Grounded in: AWS Well-Architected Serverless Lens (asynchronous decomposition of long-running work)
The natural next questions
Related governed answers
- Your entire platform sits on Vercel, Supabase and Clerk — three venture-backed vendors. What is your concentration risk and what is my exit if one of them dies?
- Boards work on iPads in airplanes. What is your mobile and offline story — native apps or another responsive website?
- One database, all tenants. One missed WHERE clause and I am reading my competitor's board risks. Why is that impossible rather than merely unlikely?
Want this answered live, on your data?