Skip to content
View aarora79's full-sized avatar

Highlights

  • Pro

Block or report aarora79

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
aarora79/README.md
Amit Arora. Agentic AI infrastructure, MCP, and agent evaluation. Principal Solutions Architect, AI/ML at AWS. Adjunct Professor, Georgetown University.

LinkedIn X Publications Talks AWS Blogs

I work on the infrastructure layer of enterprise agentic AI: the gateways and registries that let agents discover and call tools under real authentication and audit, and the benchmarks that tell you which model to trust for a given job. Most of it ships in the open, gets deployed by large enterprises, and then comes back as issues and pull requests that shape the next version.

Day job is Principal Solutions Architect for AI/ML at AWS, where I help some of the largest enterprises build and run their agentic platforms. Evenings I teach graduate students at Georgetown, where I created the applied generative AI course. I hold 26 patents from a prior decade in satellite telecommunications and applied machine learning.


Flagship open source

stars forks contributors

Lead architect, lead developer, and GTM lead. Enterprise MCP gateway and registry for AI assets: agents, MCP servers, and skills. OAuth and OIDC via Keycloak, Microsoft Entra ID, and Okta, dynamic tool discovery, and auditable tool access. Runs on Kubernetes, ECS, and Docker across AWS, Azure, and GCP, with 180+ enterprise deployments and integrations into Claude Code, Codex, and Kiro. Submitted to the AAIF for adoption.

stars

Co-author, ICLR 2026. The Holistic Agent Leaderboard (HAL), a standardized harness for evaluating AI agents, built with Princeton University researchers. Co-presented the paper at ICLR 2026.

stars

Creator. Foundation model benchmarking across hardware platforms and serving stacks, so teams can pick an instance and a model on measured cost and latency rather than intuition. Co-presented with Netflix at AWS re:Invent 2024 (NFX307).

stars

Creator. Measures how open weight and frontier models actually perform on long horizon coding tasks, across harnesses (Claude Code, pi, omp, Kiro CLI) and hosting paths (Amazon Bedrock, LiteLLM proxy, self hosted vLLM on EC2). 18 models over 21 real tasks from real repositories, reduced to a cost and quality Pareto frontier. Ships swe-router, a skill that reads the frontier and names the cheapest model clearing the quality bar: 45% lower cost for 4.6% less quality. Slides.

stars

Creator. An early MCP server, written weeks after the protocol shipped, that lets you ask plain language questions about your AWS spend. Widely forked as a reference for building real MCP servers.

stars

Creator. Turns an existing OpenAPI specification into a production ready MCP server, using an LLM to analyze the API surface and improve the generated tool definitions.

stars

Contributor. A gateway for separating tools from agent code, so the tool surface can evolve without redeploying agents.


Talks and papers

Available to speak on enterprise MCP architecture, agent evaluation methodology, agentic coding economics, and running open weight models in production. Slides and prior recordings on request.

2026

2025

  • AWS re:Invent · AIM3314, debug, trace, improve: observability for agentic applications (chalk talk)
  • AWS re:Invent · ISV325, securing AI agent ecosystems: MCP server and agent security at scale

2024

  • AWS re:Invent · NFX307, benchmarking FMs and LLMs across hardware platforms, with Netflix (CSAT 4.75)
  • AWS re:Invent · AIM307, reducing FM deployment cost and latency with Amazon SageMaker (CSAT 4.75)
  • AWS AI/ML Symposium · Joint presentation with an enterprise telecommunications customer

2023

  • AWS re:Invent · AIM305, building scalable RAG applications with Amazon Bedrock Knowledge Bases

2019

  • ScAINet and EARL · Applied machine learning in telecommunications networks

Also the holder of 26 granted patents in satellite telecommunications and applied machine learning.


Writing

Thirteen posts on the AWS blogs, four of them co-authored with the customer whose system they describe.

Earlier posts (2023 to 2024)

Teaching

I created and teach DSAN-6725, Applied Generative AI for AI Developers in Georgetown University's M.S. in Data Science and Analytics program, one of the first comprehensive generative AI courses offered in academia. It is now the most popular course in the program, runs in both Spring and Fall, and earned a perfect 5 out of 5 in student reviews for Spring 2026. I also teach DSAN-6000, Big Data and Cloud Computing, and am building a new graduate course on AI agents. 500+ graduate students so far.

Public course material and learning paths I maintain:

  • ai-learning-path · A self paced six week program to a working 200 level grasp of modern AI, three weeks of it on agents, with hands on Amazon Bedrock labs
  • k8s-100-to-mcp-gateway · Kubernetes from zero containers to two capstones, running the MCP Gateway Registry and serving an LLM locally, in 13 phases
  • ai-everyday-life · A weekend course on AI for people who do not write code
  • personal-knowledge-base · An LLM authored, interlinked wiki on generative AI, compiled from clipped primary sources

Currently building

  • my-ai-assets · Prompt and skill templates for systematic analysis work, including a Feynman technique framework for reading papers
  • claude-code-usage-analyzer · Cost and token accounting for coding agents, broken down by model and token type
  • simple-agentcore and pingmcp · Minimal reference deployments for Amazon Bedrock AgentCore, and a fast Go MCP server for load testing gateways
  • local-coding-assistants and coding-with-ai · Running coding agents on open models, and notes on what actually changes when you work this way

Stack

Languages Python, Go, R, C and C++, Scala, SQL

Agents and models MCP, A2A, Amazon Bedrock, Amazon Bedrock AgentCore, Amazon SageMaker, Anthropic Claude, Amazon Nova, Meta Llama, LangGraph, vLLM, LiteLLM, Unsloth, Ragas

Platform Kubernetes and EKS, ECS, Lambda, Keycloak, Microsoft Entra ID, Okta, OpenTelemetry, NGINX, Terraform, OpenSearch, DynamoDB

Data Polars, DuckDB, Spark, Kafka


Maryland, USA  ·  LinkedIn  ·  X

Pinned Loading

  1. agentic-community/mcp-gateway-registry agentic-community/mcp-gateway-registry Public

    Enterprise-ready MCP Gateway & Registry that centralizes AI development tools with secure OAuth authentication, dynamic tool discovery, and unified access for both autonomous AI agents and AI codin…

    Python 919 236