44:I[185,["/_next/static/chunks/08z4tkzvltetr.js","/_next/static/chunks/121~yigv24_j6.js","/_next/static/chunks/0a~e7k..h6jfc.js","/_next/static/chunks/0za7dr7c2y81~.js","/_next/static/chunks/03klviw01y.ih.js","/_next/static/chunks/0gx_3vy1-syt4.js","/_next/static/chunks/0i6hzvr84kc1r.js"],"SendEmailButton"] 46:I[63625,["/_next/static/chunks/08z4tkzvltetr.js","/_next/static/chunks/121~yigv24_j6.js","/_next/static/chunks/0a~e7k..h6jfc.js","/_next/static/chunks/0za7dr7c2y81~.js","/_next/static/chunks/03klviw01y.ih.js","/_next/static/chunks/0gx_3vy1-syt4.js","/_next/static/chunks/0i6hzvr84kc1r.js"],"AddToLibraryButton"] 47:I[29721,["/_next/static/chunks/08z4tkzvltetr.js","/_next/static/chunks/121~yigv24_j6.js","/_next/static/chunks/0a~e7k..h6jfc.js","/_next/static/chunks/0za7dr7c2y81~.js","/_next/static/chunks/03klviw01y.ih.js","/_next/static/chunks/0gx_3vy1-syt4.js","/_next/static/chunks/0i6hzvr84kc1r.js"],"ShareButton"] 49:I[45269,["/_next/static/chunks/08z4tkzvltetr.js","/_next/static/chunks/121~yigv24_j6.js","/_next/static/chunks/0a~e7k..h6jfc.js","/_next/static/chunks/0za7dr7c2y81~.js","/_next/static/chunks/03klviw01y.ih.js","/_next/static/chunks/0gx_3vy1-syt4.js","/_next/static/chunks/0i6hzvr84kc1r.js"],"SignupCTA"] 3e:["$","div",null,{"className":"flex flex-wrap items-center gap-x-4 gap-y-1 font-mono text-[12px] uppercase tracking-[0.1em] text-[color:var(--fg-3)]","children":[["$","time",null,{"dateTime":"2023-05-11T19:51:09.000Z","children":"May 11, 2023"}],null,null,false]}] 45:T49d,

Patrick and Jacob sit down with Mike Conover, Staff Software Engineer at Databricks and Co-Creator of Databricks Dolly, the world’s first truly open instruction-tuned LLM, to discuss the magic behind Dolly, Alpaca and other instruction-tuned LLMs, the unreasonable effectiveness of fine-tuning, how they got all Databricks employees to help them curate the Dolly dataset (hint: google forms), and more.

(0:00) - Intro

(5:54) - The birth of Dolly

(12:03) - Data curation at Databricks

(15:34) - Advice for building LLMs

(24:10) - The future of instruction-tuning datasets

(30:43) - UI innovation

(38:16) - The future of machine learning infrastructure

(42:05) - How SkipFlag would be different with the tools we have today

(47:01) - What Mike has learned since Dolly

With your co-hosts:

@jasoncwarner

- Former CTO GitHub, VP Eng Heroku & Canonical

@ericabrescia

- Former COO Github, Founder Bitnami (acq’d by VMWare)

@patrickachase

- Partner at Redpoint, Former ML Engineer LinkedIn

@jacobeffron

- Partner at Redpoint, Former PM Flatiron Health