Reaction
DeepMind says double-blind AI tests can keep both sides’ secrets
DeepMind says its Gemini pilot hides test prompts from Google and model weights from evaluators.
TLDR
KLdivergence pointed to DeepMind’s double-blind pilot after yoavgo argued that private tests expose questions to model providers. DeepMind says its setup uses Google Cloud’s Confidential Space to keep prompts hidden from Google and model weights hidden from evaluators. yoavgo welcomed the idea and asked whether it also works for multi-step agents.
Combined views
296
2 Sources, first seen ago

Comments