That feeling when you realize practitioners say “verifiable tasks” when they actually mean “easy tasks.”
8:48 AM · Jun 5, 2026 · 16.2K Views
Core Automation's Jerry Tworek argues that AI practitioners often conflate "verifiable" tasks with simpler, easily evaluated problems
This constraint directly shapes and limits AI benchmark design.
14253142615.8K
Sentiment
Many users dismissed 'verifiable tasks' as a rebrand for trivial benchmarks or non-scalable work that amounts to quick unit tests.
Pos
25.0%
Neg
75.0%
4 comments with sentiment.
Cluster Engagement
Posts from X
Most Activity
Most Activity
VIEWS358
Hunter Gon@gonlenidefi
@MillionInt ngl this is too real
reminds me of every sprint planning ive ever sat through
1dViews 358
BOOKMARKS2LIKES3
Anchit Gupta@anzhit
@MillionInt Word. The real hard tasks begin when even your verifiers need to evolve with the policy.
23hViews 278Likes 3Bookmarks 2
RETWEETS10
Jerry Tworek@MillionInt
That feeling when you realize practitioners say “verifiable tasks” when they actually mean “easy tasks.”
1dViews 16.2KLikes 255Bookmarks 26
Juggalos For Context🌴🥥@ebarcuzzi
@MillionInt Most verifiable tasks rapidly become easy if you throw machine learning at them.
1dViews 354Likes 1
Richa Sharma@richa_lq
@MillionInt oohhh snap.
23hViews 199
Strata@ChainZenit
@MillionInt Classic rebrand for stuff that doesn't actually scale. Typical.
1dViews 177
Logan Pierce@log_npierce
@MillionInt real talk. if you can't verify the output in 2 seconds it's not an easy task, it's a research project
1dViews 164
Logan Pierce@log_npierce
@MillionInt honestly verifiable is just a fancy word for "i can write a unit test for this in 2 seconds"
1dViews 139
Youssef El Manssouri@yoemsri
@MillionInt Verifiable just means we can check if the answer is right and easy tasks are the ones where we can check.
22hViews 80
jjh@jjh
@MillionInt Too soon!
20hViews 63
awfuck@DDhfrcycyf5vuf
@MillionInt No. See: Lean.
21hViews 41
Jeffrey Liu@jeffreyliu_05
@MillionInt
17hViews 31
Dhruv@dhruv2038
@MillionInt haha !
14hViews 18