Kaggle Launches Adversarial Customer Service Benchmark
Partnership with GertLabs creates a two-sided game testing AI security in customer support.
Kaggle announced the launch of Adversarial Customer Service on its Benchmarks platform in partnership with GertLabs. The benchmark sets up a two-sided security game. One model plays a bank's support agent that holds customer records and follows a verification policy. The other model plays a caller who is secretly either the real customer or an imposter. Agents compete in a hidden information customer service simulator that uses natural language. A public leaderboard tracks results. Logan Kilpatrick, a Google engineer, replied to the post with approval.
Combined views
15.8K
2 posts, first seen 3d ago
Kaggle Launches Adversarial Customer Service Benchmark
Partnership with GertLabs creates a two-sided game testing AI security in customer support.
Kaggle announced the launch of Adversarial Customer Service on its Benchmarks platform in partnership with GertLabs. The benchmark sets up a two-sided security game. One model plays a bank's support agent that holds customer records and follows a verification policy. The other model plays a caller who is secretly either the real customer or an imposter. Agents compete in a hidden information customer service simulator that uses natural language. A public leaderboard tracks results. Logan Kilpatrick, a Google engineer, replied to the post with approval.
Reactions from ranked influencers
2 posts
Today, we’re excited to launch Adversarial Customer Service on Kaggle Benchmarks, in partnership with @GertLabs. This benchmark is a two-sided security game: one model plays a bank's support agent holding customer records and a verification policy, the other plays a caller who…