I recently built a project that started as a Text-to-SQL agent and evolved into a broader multi-source Agentic AI orchestration platform using LangGraph, Ollama, ChromaDB, FastAPI, and React. The goal was to let a business user ask a question in natural language and have the AI understand the intent, identify the right source, and return the answer. The platform can orchestrate across databases, policies, documents, web search, and media. The most interesting engineering challenge wasn’t connecting an LLM—it was designing how the system decides where to look for the answer. I built the orchestration around intent understanding, source identification, agent and tool selection, context retrieval, reasoning, validation, guardrails, and grounded responses. One of the key principles I followed was not letting the LLM control everything. The LLM handles reasoning and orchestration, while deterministic components handle critical operations like SQL validation, read-only execution, query controls, schema-aware retrieval, source attribution, and human confirmation where required. This creates a better balance between AI autonomy and enterprise control. The bigger vision is to build an AI system that can identify the right source and provide a grounded answer. This project has been a great hands-on exploration of Agentic AI, multi-source orchestration, RAG, Text-to-SQL, AI security and guardrails, and enterprise AI architecture, and I’m continuing to enhance it for real-world use cases.
Read More