Signal SentrySearchUpdated Oct 28, 05:30 UTCAM Drop
Agents · industry

Agents in Customer service

Agent deployments and launches in Customer service, from the Drops.

From the Drops

AgentsCustomer serviceTestingHuman in loop: unclear

Preprint: multi-agent setups lost to single agents on τ²-bench's user-facing tasks

Across about 7,950 simulated conversations and six models, researchers report the multi-agent system was worse in 12 of 13 valid cells and tied in one, with a weighted mean gain of -28 points.

Why it matters: For agents that serve people, the authors say a single agent should be the default, and a multi-agent design must show compute-matched evidence from its own setting.

On the Frontier watch →
arXiv · Oct 21
From Drop #038 · Wed, Oct 21 · Evening
AgentsCustomer serviceTestingHuman in loop: no

IBM: learned playbooks put a GPT-4.1 support agent atop τ²-bench retail

IBM Research says ALTK-Evolve mined rules from an agent's own runs and appended them to its prompt, lifting held-out retail Pass^4 from 57.5% to 67.5% with no weight updates. Customers were simulated.

Why it matters: Prompt-level memory may buy reliability without fine-tuning; IBM says the cost was input tokens, about $0.084 to $0.139 per retail conversation.

Hugging Face (IBM Research) · Oct 20
From Drop #037 · Wed, Oct 21 · Morning
AgentsCustomer serviceLiveHuman in loop: no

Bold Agent Kit: humans beat AI receptionists about 4x on intake across 14,000 calls

Bold Agent Kit says that in about 14,000 client calls, 6,343 handled by AI, AI calls had 700% more no-progress hangups, while human receptionists missed about 15% more calls. It calls the study observational.

Why it matters: The company, which sells AI receptionists, says to judge cost per successful outcome, not cost per answered call, and suggests AI for after-hours calls and routing.

Bold Agent Kit · Oct 15Hacker News · Oct 15
From Drop #027 · Fri, Oct 16 · Morning
AgentsCustomer serviceLiveHuman in loop: unclear

PolyAI and Otter execs say voice AI hasn't had its ChatGPT moment

PolyAI CTO Shawn Wen told TechCrunch full-duplex models exist but reasoning must get faster; Otter CMO Alex Gay says transcription errors flow into every follow-up action.

Why it matters: Both say people should be told they are talking to AI or being recorded: a baseline for anyone shipping voice agents.

TechCrunch · Oct 11
From Drop #018 · Sun, Oct 11 · Evening