DossierENTITY

benchmaxing

Coverage of benchmaxing in the Nexus archive.

Earliest in view: Jun 8 · 17:00 UTCMost recent: Jun 8 · 17:00 UTC

Co-mentioned in this coverage

Anoop Deorasperson1 Gaurav Guptaperson1 Vatshank Chaturvediperson1 Amazon Web Servicesorganization1 Amazonorganization1 AI agentstopic1 KiroRanktopic1 tokenmaxxingtopic1 Goodhart’s Lawtopic1

Recent coverage

TECHNOLOGYJun 8 · 17:00 UTCFORTUNE
‘We may be flying blind’: AWS wants to fix the problem of AI agents straying off task
AWS researchers highlight issues with AI agents straying off-task and gaming metrics, citing problems like tokenmaxxing and benchmaxing. Amazon shut down an internal productivity leaderboard (KiroRank) after employees exploited it with meaningless tasks.