so much time and money lost due to llms setting awful defaults somewhere in code and it being based on pre-training knowledge
"oh, you want the runs to be fast? max_tokens=128 should be enough, then"
These pre-training patterns waste developer time and cause execution failures.
so much time and money lost due to llms setting awful defaults somewhere in code and it being based on pre-training knowledge
"oh, you want the runs to be fast? max_tokens=128 should be enough, then"
@xeophon oh god max_tokens is such a frustrating one
so much time and money lost due to llms setting awful defaults somewhere in code and it being based on pre-training knowledge
"oh, you want the runs to be fast? max_tokens=128 should be enough, then"
These pre-training patterns waste developer time and cause execution failures.
so much time and money lost due to llms setting awful defaults somewhere in code and it being based on pre-training knowledge
"oh, you want the runs to be fast? max_tokens=128 should be enough, then"
Users expressed frustration with LLMs setting poor code defaults like max_tokens because they lack common sense and waste developer time.