DeepMind cofounder Shane Legg thinks that search is essential for a model to be genuinely creative.
Pre-trained base models can do incredible things. But Shane thinks this is just a matter of them mixing together existing concepts from their training data.
If he's right, coming up with genuinely novel ideas always involves searching a large space for "hidden gems".
Users agree with DeepMind cofounder Shane Legg's claim that search enables genuine AI creativity because it validates ideas they have discussed for months.
Watch the full interview here: https://www.dwarkesh.com/p/shane-legg
DeepMind cofounder Shane Legg thinks that search is essential for a model to be genuinely creative.
Pre-trained base models can do incredible things. But Shane thinks this is just a matter of them mixing together existing concepts from their training data.
If he's right, coming up with genuinely novel ideas always involves searching a large space for "hidden gems".
@dwarkesh_sp I think this is right. I’ve been banging on about this for months now and it’s good to have some validation.
@dwarkesh_sp for a moment i thought this was Dario 😂
DeepMind cofounder Shane Legg thinks that search is essential for a model to be genuinely creative.
Pre-trained base models can do incredible things. But Shane thinks this is just a matter of them mixing together existing concepts from their training data.
If he's right, coming up with genuinely novel ideas always involves searching a large space for "hidden gems".