Nirmalya Ghosh Applied AI | Technologist
Posts with the tag

Agentic Text-to-SQL

Build a system where multiple specialized agents collaborate to answer questions about your data safely. Not a SQL chatbot. A trusted data access layer.

Schema Pruning for Text-to-SQL: 93% Less Context, Zero LLM Calls

In Part 1, the naïve Text-to-SQL approach sent 8,414 tokens of schema context to generate 16 tokens of SQL - a 526:1 input-to-output ratio. This post engineers the fix: a deterministic schema pruner - context engineering at the schema layer - that selects only the tables relevant to each query, with no LLM dependency.

TTFT Optimisation: Practical Patterns

How to reduce TTFT in production: practical patterns, implementation strategies, and edge cases to watch for.