Agents in Cloud

Google Cloud: grade agents on their tool-call logs, not their closing summary

Building its Developer plugin, Google Cloud says an LLM judge failed 3 of 11 prompts that tool-call logs showed had passed, and about half its key findings came from comparing live runs with plan-only runs.

Why it matters: Eval habits for anyone shipping agent plugins: score the trajectory, keep turn structure in telemetry, and keep expert-curated golden sets as models change.