Athul Paul Jacob

@apjacob03

co-founder & chief ai officer @percepta | @generalcatalyst | Ex: @mit_csail phd, @uwaterloo, @google, fair @metaai, @milaquebec | co-created cicero / diplodocus

following
followers

Spotlight's claimed linear computational cost and a potentially large constant factor

A user says each access touches nine cells, each a full d_k×d_v matrix per head.

9 Sources, 16d ago, updated 16d ago

Featured in

Spotlight's claimed linear computational cost and a potentially large constant factor

Featured in

Spotlight's claimed linear computational cost and a potentially large constant factor