AI researchers discuss efficiency advantages of language models over vision models, noting the latter are roughly 1000 times smaller thanks to language's high-density compression via compositional semantics
The size comparison came up in evaluations of how long Chain of Thought reasoning stays intelligible, prompting ideas for visual CoT variants.
@1a3orn CoT in pictures but not words would be quite neat
1a3orn@1a3ornthis is a relevant consideration for projecting how Lindy intelligible CoT is likely to be
#13801a3orn@1A3ORNthis is a relevant consideration for projecting how Lindy intelligible CoT is likely to be
gavin leech (Non-Reasoning)@gleechone of the major failures of my life was being so surprised to find out that vision models were ~1000x smaller than text models. Just total failure to understand language's god-tier data compression
#1480gavin leech (Non-Reasoning)@GLEECHone of the major failures of my life was being so surprised to find out that vision models were ~1000x smaller than text models. Just total failure to understand language's god-tier data compression
