The author also claims sampling models can scale inference, after initially doubting text-to-LoRA worked.
The author says they initially doubted text-to-LoRA but now believe it works. They claim they can predict entire LoRA distributions using only the model input and scale inference by sampling models.
3.9K
2 Sources, first seen ago
—
Not ranked yet
—
Not ranked yet
@RamonAstudill12I am going to be honest: I did not believe text-to-lora worked. Turns out it does!. Not only that, we show you can predict entire *LoRa distributions* given just the model input, and do inference scaling by sampling models!
@akyurekekinRT @RamonAstudill12: I am going to be honest: I did not believe text-to-lora worked. Turns out it does!. Not only that, we show you can pre…@RamonAstudill12I am going to be honest: I did not believe text-to-lora worked. Turns out it does!. Not only that, we show you can predict entire *LoRa distributions* given just the model input, and do inference scaling by sampling models!@akyurekekinRT @RamonAstudill12: I am going to be honest: I did not believe text-to-lora worked. Turns out it does!. Not only that, we show you can pre…@RamonAstudill12I am going to be honest: I did not believe text-to-lora worked. Turns out it does!. Not only that, we show you can predict entire *LoRa distributions* given just the model input, and do inference scaling by sampling models!@akyurekekinRT @RamonAstudill12: I am going to be honest: I did not believe text-to-lora worked. Turns out it does!. Not only that, we show you can pre…@RamonAstudill12I am going to be honest: I did not believe text-to-lora worked. Turns out it does!. Not only that, we show you can predict entire *LoRa distributions* given just the model input, and do inference scaling by sampling models!@akyurekekinRT @RamonAstudill12: I am going to be honest: I did not believe text-to-lora worked. Turns out it does!. Not only that, we show you can pre…
