Comet provides an end-to-end model evaluation platform for AI developers, with best in class LLM evaluations, experiment tracking, and production monitoring
Tracing a Google ADK agent in Opik takes two lines of code.
But, Google's ADK has a footgun: when one ADK agent hands off to another, ADK starts a new run, so one user message shows up as two traces.
We put together a little guide to fixing this with a single Opik call. We
New in Opik: describe the chart you want, and Ollie builds the dashboard widget.
Ask for something like "average hallucination score for the car-specs judge, by agent version, last 30 days." Under the hood, Ollie writes a read-only SQL query over your traces, spans, threads,
Want to train your own decision model? @anmorgan2414 just wrote a guide to help you out: comet.com/site/blog/trai…
Some details about the setup:
Abby fine-tuned Qwen3-0.6B two ways. With one gold label per question, the model came out overconfident (ECE 0.12).
Trained against
Sharing an update from our Engineering team: On October 26, 2026, Comet contained a security incident affecting Opik on comet[dot]com. No customer data, accounts, or API keys were accessed. Still, our team responded quickly and thoroughly. This post explains what happened, what was affected, and what we have done in response:
Cutting AI costs isn’t just about routing to cheaper models. Coding agents can waste tokens in plenty of other places.
Our CEO @gidim unpacks what we learned building Cost Intelligence in a @cerebral_valley deep dive.