40:I[185,["/_next/static/chunks/3xnt26d00_zk-.js","/_next/static/chunks/1s-yni1uf2lwd.js","/_next/static/chunks/42spz6paskvb6.js","/_next/static/chunks/06x30xgfe6iur.js","/_next/static/chunks/3b4qrzgkt_l12.js","/_next/static/chunks/15lgs8s22dk5l.js"],"SendEmailButton"] 42:I[63625,["/_next/static/chunks/3xnt26d00_zk-.js","/_next/static/chunks/1s-yni1uf2lwd.js","/_next/static/chunks/42spz6paskvb6.js","/_next/static/chunks/06x30xgfe6iur.js","/_next/static/chunks/3b4qrzgkt_l12.js","/_next/static/chunks/15lgs8s22dk5l.js"],"AddToLibraryButton"] 43:I[29721,["/_next/static/chunks/3xnt26d00_zk-.js","/_next/static/chunks/1s-yni1uf2lwd.js","/_next/static/chunks/42spz6paskvb6.js","/_next/static/chunks/06x30xgfe6iur.js","/_next/static/chunks/3b4qrzgkt_l12.js","/_next/static/chunks/15lgs8s22dk5l.js"],"ShareButton"] 45:I[45269,["/_next/static/chunks/3xnt26d00_zk-.js","/_next/static/chunks/1s-yni1uf2lwd.js","/_next/static/chunks/42spz6paskvb6.js","/_next/static/chunks/06x30xgfe6iur.js","/_next/static/chunks/3b4qrzgkt_l12.js","/_next/static/chunks/15lgs8s22dk5l.js"],"SignupCTA"] 3a:["$","div",null,{"className":"flex flex-wrap items-center gap-x-4 gap-y-1 font-mono text-[12px] uppercase tracking-[0.1em] text-[color:var(--fg-3)]","children":[["$","time",null,{"dateTime":"2023-05-11T19:51:09.000Z","children":"May 11, 2023"}],null,null,false]}] 41:T49d,

Patrick and Jacob sit down with Mike Conover, Staff Software Engineer at Databricks and Co-Creator of Databricks Dolly, the world’s first truly open instruction-tuned LLM, to discuss the magic behind Dolly, Alpaca and other instruction-tuned LLMs, the unreasonable effectiveness of fine-tuning, how they got all Databricks employees to help them curate the Dolly dataset (hint: google forms), and more.

(0:00) - Intro

(5:54) - The birth of Dolly

(12:03) - Data curation at Databricks

(15:34) - Advice for building LLMs

(24:10) - The future of instruction-tuning datasets

(30:43) - UI innovation

(38:16) - The future of machine learning infrastructure

(42:05) - How SkipFlag would be different with the tools we have today

(47:01) - What Mike has learned since Dolly

With your co-hosts:

@jasoncwarner

- Former CTO GitHub, VP Eng Heroku & Canonical

@ericabrescia

- Former COO Github, Founder Bitnami (acq’d by VMWare)

@patrickachase

- Partner at Redpoint, Former ML Engineer LinkedIn

@jacobeffron

- Partner at Redpoint, Former PM Flatiron Health