Rahul Sunil
AI Platform & Agent Infrastructure Engineer
About Me
I work on the unglamorous half of applied AI.
Most of what makes an LLM system usable in an enterprise has very little to do with prompt tuning. It is whether the document you uploaded was actually parseable. Whether the citation in the output points at real text or at something plausible the model invented. Whether tenant A's evidence can ever surface in tenant B's assessment. Whether a run that takes twelve hours can be made to take one. Whether you can prove, before you cut over, that the new code path produces the same answers as the old one. That is the layer I architect.
At Certa, my primary responsibility was architecting the complete production system for Risk Agent — taking it from early concepts into a reliable, enterprise-grade compliance product. Rather than just focusing on model accuracy or prompt logic, I owned the overall system architecture: the agent orchestration, production infrastructure, service design, scalability, multi-tenant vector isolation, and operational reliability required to process vendor evidence at scale. Today, Risk Agent evaluates vendor SOC 2, PCI DSS, and pentest reports across 21 risk domains and 840 controls, replacing 10–12 hours of manual analyst review per assessment with under 10 minutes of automated execution. My contribution wasn't just making an AI capability accurate — it was architecting the complete production system that made that capability usable as a real enterprise product.
Working on Risk Agent, Contracts Agent, and helping architect Data Agent revealed a clear pattern: every new agent team was rebuilding the same foundational plumbing from scratch — separate ingestion pipelines, separate tenant isolation schemes, and separate operational infrastructure. Olympus was not created because someone explicitly requested it; it emerged from those production lessons as a platform-level engineering initiative. Designed to power more than six agents once live, Olympus provides production-grade capabilities — unified agent execution, tenant isolation, error taxonomies, and cost/usage telemetry — from Day One. Instead of spending months building infrastructure, Product and Engineering teams can take new agent ideas into production in weeks, focusing their effort on business logic and agent-specific behavior while building on a flexible, reusable foundation.
I applied that same end-to-end production ownership to Contracts Agent, taking it from an n8n proof-of-concept idea into a fully production-ready service in approximately 1.5 months. I owned the complete path to production: designing the standalone microservice architecture, implementing async job models with idempotency guards and bounded retries, building structural multi-tenant isolation in Qdrant, and establishing operational infrastructure for load balancing, monitoring, and uptime. The service was deployed directly into our first enterprise client's live contracting workflow, while a subsequent pipeline optimization cut LLM inference cost per contract by roughly 60%.
Earlier at Certa, my work on DesignAI marked a major turning point, helping pivot the company toward an AI-first direction that contributed to securing $35M Series B funding. Facing a fundamental architectural challenge in workflow automation, I tackled a monolithic, non-deterministic AI routing approach and transformed it into a deterministic logical routing system with well-defined classification. By taking an opaque prompt apart into three structured classification problems behind a routing layer, accuracy leaped from 62% to 97%. This work led to a patent filed in the US and India as sole inventor and earned a co-win of Certa's first-ever company-wide Genius Award, demonstrating my experience identifying fundamental AI architecture bottlenecks and making complex AI systems deterministic, structured, and controllable.
Before Certa, I was a research intern and project lead at Microsoft, leading a team engineering non-invasive wildlife-monitoring systems using unmanned ground vehicles — authoring long-range telemetry libraries and field robotics software. I also co-founded AgriVision, building early computer vision and data pipelines for crop-disease detection, and developed multi-tenant security microservices at Accubits.
I spoke at Google DevFest 2024 about running large language models in production, contributed to the PyCon India 2023 website, and serve as a member of the Kerala Police Cyberdome technology group.
I build the layer underneath AI agents — document ingestion and RAG, agent runtime, LLM routing, evals and multi-tenant isolation — so product teams ship prompts and business logic instead of rebuilding plumbing.
Architecture Principles & Tenets
Documents are tenant assets, not agent assets
Key documents by content hash plus tenant ID. Ingest, parse, and embed once so multiple agents can evaluate evidence without redundant pipelines, while isolating access strictly by tenant scope.
Take non-judgement tasks away from the model
When an AI output must be trustworthy, identify every subtask that does not require subjective reasoning — URL generation, citation grounding, schema validation — and enforce it deterministically in code.
Output-neutrality before cutover
For AI systems, the critical test is not "is the output good", it is "is the output identical to the system we already trust". Use golden-set recorded cassettes and dual-run CI harnesses before cutting over.
Cost anomalies are control-loop problems
A cost surge is rarely a pricing problem; it is a rate limit or timeout boundary collision showing up on an invoice. Mandatory token and cost telemetry on every call makes invisible spend visible.
Know when to reject generic orchestrators
General-purpose workflow engines excel at linear branching, but struggle with vector search, token streaming, and dynamic agentic loops. Standalone, purpose-built microservices often win on latency and debuggability.
The Arc — Four Acts
Foundations
Established testing pipeline (0 → 75% coverage), CI quality gates, and PR root-cause analysis. Introduced Portkey LLM gateway pattern company-wide. Evaluated Anthropic vs GPT-4 (~2× faster, ~11× cheaper).
Invention & Rigorous Rebuild
Invented Workflow Context Extractor and filed a patent in the US and India as sole inventor. When accuracy degraded to 62% under client scale, dismantled the monolithic prompt into 3 structured classification problems behind a logical routing layer, achieving 97% accuracy and building a CI eval harness. Keynote speaker at Google DevFest 2024 on running large language models in production.
Agents at Scale
Shipped 5 specialized compliance agents (PCI-DSS, Reflection, Generic, ISO V2, AI Governance). Migrated 2 services off serverless to FastAPI. Implemented deterministic citation grounding and owned the accuracy program. Awarded company-wide Certa-fied Genius Award.
Platform Leadership
Productionized Contracts Agent from n8n canvas into Python service deployed into the first enterprise client's live legal and contracting workflow; cut cost by roughly 60%. Throughput-modelled Azure to Bedrock migration at 10.6×. Authored and led Olympus AI Agent Platform across 5 milestones with org-wide sign-off; shipped M1 and deleted 2 bespoke LLM stacks.
Now — September 2026
Leading Milestone 2 of Olympus, our shared AI agent platform: the document platform layer, where ingestion, parsing and multi-tenant retrieval move out of individual agents and become shared infrastructure. Also scaling SOC 2 accuracy benchmarking across enterprise compliance datasets.
Skills & Expertise
Core & Backend Engineering
AI & Agent Systems
Evaluation & Observability
Cloud & Data Infrastructure
Education
B.Tech in Computer Science
APJ Abdul Kalam Technological University
8.37/10 • 2022
CBSE Computer Science - 12th Grade
Kendriya Vidyalaya, Pattom (2nd Shift)
87% • 2018
Key Achievements
- August 2025: Certa-fied Genius Award — Co-winner in the first-ever cycle; inducted into Hall of Fame for Workflow Context Extractor v2 (62% → 97% accuracy).
- Dec 2024: Certa Patent Program Award ($1,000) — Awarded as sole inventor of Workflow Context Extractor for GenAI Large Workflow Management.
- Dec 2024: Featured Speaker, Google DevFest 2024 — Delivered "Large Language Models in Production" keynote at GDG Technopark.
- Sep 2021: Winner, Hac'KP International Hackathon (5th Edition) — Kerala Police Cyberdome dark web intelligence hackathon winner (₹10 Lakh national prize).
- Jun 2021: Best Engineer '21 — Awarded by Indian Society for Technical Education.
- Mar 2021: Qualified GATE 2021 — Cleared the Graduate Aptitude Test in Engineering in third year of undergraduate study.
- Jan 2021: Winner, HackX — First prize at National Institute of Technology Calicut hackathon.
- Sep 2020: Best Project & Seed Funding — BitMedi — Won Best Project at Cisco ThingQbator India with a seed grant.
- Sep 2020: Top 15 International Projects — Recognized in Youth Tech Competition by startAD & Abu Dhabi Government.
- Jan 2020: KSCSTE State Research Grant Winner — Funded research project for IoT-based Accident Alert System.
Leadership & Community
Technical Lead — Olympus AI Agent Platform
Certa
2026 - PresentCyberdome Volunteer
Kerala Police Cyberdome
Feb 2021 - PresentChief Executive Officer
IEDC, MBCET
Oct 2021 - August 2022Chief Technical Officer
IEDC, MBCET
May 2021 - Jun 2022Artificial Intelligence Community Head
IEDC, MBCET
May 2019 - Sep 2020Vice Chairman
IEEE CS MBCET
Jan 2019 - Feb 2020