Choshen Says No LLM Handles This Translation
Leshem Choshen cites a mixed-language phrase as proof current translation benchmarks are too low.
TLDR
In a post, NLP researcher Leshem Choshen states that people think translation is solved only because evaluation standards dropped. He points to the phrase "She's a sexy fox 🦊 היא חתולה סקסית 😻" as an example no current LLM translation system can manage. Choshen notes that he and others run ongoing worldwide challenges to collect harder cases and invites readers to join the authors via the linked thread.
Combined views
1.4K
1 Source, first seen 27d ago