46:I[185,["/_next/static/chunks/08z4tkzvltetr.js","/_next/static/chunks/121~yigv24_j6.js","/_next/static/chunks/0a~e7k..h6jfc.js","/_next/static/chunks/0za7dr7c2y81~.js","/_next/static/chunks/03klviw01y.ih.js","/_next/static/chunks/0gx_3vy1-syt4.js","/_next/static/chunks/0i6hzvr84kc1r.js"],"SendEmailButton"] 48:I[63625,["/_next/static/chunks/08z4tkzvltetr.js","/_next/static/chunks/121~yigv24_j6.js","/_next/static/chunks/0a~e7k..h6jfc.js","/_next/static/chunks/0za7dr7c2y81~.js","/_next/static/chunks/03klviw01y.ih.js","/_next/static/chunks/0gx_3vy1-syt4.js","/_next/static/chunks/0i6hzvr84kc1r.js"],"AddToLibraryButton"] 49:I[29721,["/_next/static/chunks/08z4tkzvltetr.js","/_next/static/chunks/121~yigv24_j6.js","/_next/static/chunks/0a~e7k..h6jfc.js","/_next/static/chunks/0za7dr7c2y81~.js","/_next/static/chunks/03klviw01y.ih.js","/_next/static/chunks/0gx_3vy1-syt4.js","/_next/static/chunks/0i6hzvr84kc1r.js"],"ShareButton"] 4a:I[58016,["/_next/static/chunks/08z4tkzvltetr.js","/_next/static/chunks/121~yigv24_j6.js","/_next/static/chunks/0a~e7k..h6jfc.js","/_next/static/chunks/0za7dr7c2y81~.js","/_next/static/chunks/03klviw01y.ih.js","/_next/static/chunks/0gx_3vy1-syt4.js","/_next/static/chunks/0i6hzvr84kc1r.js"],"ProcessEpisodeButton"] 4b:I[45269,["/_next/static/chunks/08z4tkzvltetr.js","/_next/static/chunks/121~yigv24_j6.js","/_next/static/chunks/0a~e7k..h6jfc.js","/_next/static/chunks/0za7dr7c2y81~.js","/_next/static/chunks/03klviw01y.ih.js","/_next/static/chunks/0gx_3vy1-syt4.js","/_next/static/chunks/0i6hzvr84kc1r.js"],"SignupCTA"] 3f:["$","h1",null,{"className":"max-w-[22ch] font-display text-[clamp(32px,4.5vw,48px)] font-medium leading-[1.05] tracking-[-0.02em] text-[color:var(--fg-1)] text-balance","children":"Ep 12: EleutherAI's Aran Komatsuzaki on Open-Source Models' Future and Thought Cloning"}] 40:["$","div",null,{"className":"flex flex-wrap items-center gap-x-4 gap-y-1 font-mono text-[12px] uppercase tracking-[0.1em] text-[color:var(--fg-3)]","children":[["$","time",null,{"dateTime":"2023-07-19T19:44:41.000Z","children":"July 19, 2023"}],null,null,false]}] 47:T440,

Jacob and Jordan sit down with EleutherAI's Aran Komatsuzaki to discuss the future of open-source models, thought cloning, his work on GPT-J and more.

0:00 intro

01:06 Aran’s background

02:58 starting work on gpt-j

05:49 gathering data for Lion and gpt-j

08:51 history of EleutherAI

11:16 open vs. closed-source models

19:06 how will open-source models be used going forward

21:33 thought cloning

25:51 building AI models that understand video

29:35 one model to rule them all

31:58 influence of academia in the LLM space

34:33 over-hyped/under-hyped

38:01 Aran’s thoughts on AGI

With your co-hosts:

@jasoncwarner

- Former CTO GitHub, VP Eng Heroku & Canonical

@ericabrescia

- Former COO Github, Founder Bitnami (acq’d by VMWare)

@patrickachase

- Partner at Redpoint, Former ML Engineer LinkedIn

@jacobeffron

- Partner at Redpoint, Former PM Flatiron Health

@jordan_segall

- Partner at Redpoint