The Future is Fine Tuned (with Dev Rishi, Predibase)

Dev Rishi is the founder and CEO of Predibase, the company behind Ludwig and LoRAX. Predibase just released LoRA Land, a technical report showing 310 models that can outcompete GPT-4 on specific tasks through fine-tuning. In this episode, Dev tries (pretty successfully) to convince me that fine-tuning is the future, while answering a bunch of interesting questions, like:
  • Is fine-tuning hard?
  • If LoRAX is a competitive advantage for you, why open-source it?
  • Is model hosting becoming commoditized? If so, how can anyone compete?
  • What are people actually fine-tuning language models for?
  • How worried are you about OpenAI eating your lunch?
I had a ton of fun with Dev on this one. Also, check out Predibase’s newsletter called fine-tuned (great name!) and LoRA Land.
The Future is Fine Tuned (with Dev Rishi, Predibase)
Broadcast by