Observability & Infra — Agentic AI Landscape

Tracing, evaluation, and monitoring platform from the LangChain team.

Open-source LLM engineering platform for tracing, evals, and prompts.

ML platform for experiment tracking, plus Weave for LLM/agent observability.

↗ wandb.ai

Inference provider delivering extremely low-latency LLM serving on custom LPUs.

↗ groq.com

Serverless GPU/CPU cloud for running AI workloads and agent backends.

↗ modal.com

Unified API gateway routing requests across hundreds of models and providers.

Open standard for connecting agents to tools, data, and services.