42:I[185,["/_next/static/chunks/08z4tkzvltetr.js","/_next/static/chunks/121~yigv24_j6.js","/_next/static/chunks/0jo3du-icy6v2.js","/_next/static/chunks/15cy49d~_zsjj.js","/_next/static/chunks/0..ktetnpeix7.js","/_next/static/chunks/08cz-ztcfuxe..js","/_next/static/chunks/0i6hzvr84kc1r.js"],"SendEmailButton"] 44:I[63625,["/_next/static/chunks/08z4tkzvltetr.js","/_next/static/chunks/121~yigv24_j6.js","/_next/static/chunks/0jo3du-icy6v2.js","/_next/static/chunks/15cy49d~_zsjj.js","/_next/static/chunks/0..ktetnpeix7.js","/_next/static/chunks/08cz-ztcfuxe..js","/_next/static/chunks/0i6hzvr84kc1r.js"],"AddToLibraryButton"] 45:I[29721,["/_next/static/chunks/08z4tkzvltetr.js","/_next/static/chunks/121~yigv24_j6.js","/_next/static/chunks/0jo3du-icy6v2.js","/_next/static/chunks/15cy49d~_zsjj.js","/_next/static/chunks/0..ktetnpeix7.js","/_next/static/chunks/08cz-ztcfuxe..js","/_next/static/chunks/0i6hzvr84kc1r.js"],"ShareButton"] 46:I[58016,["/_next/static/chunks/08z4tkzvltetr.js","/_next/static/chunks/121~yigv24_j6.js","/_next/static/chunks/0jo3du-icy6v2.js","/_next/static/chunks/15cy49d~_zsjj.js","/_next/static/chunks/0..ktetnpeix7.js","/_next/static/chunks/08cz-ztcfuxe..js","/_next/static/chunks/0i6hzvr84kc1r.js"],"ProcessEpisodeButton"] 47:I[45269,["/_next/static/chunks/08z4tkzvltetr.js","/_next/static/chunks/121~yigv24_j6.js","/_next/static/chunks/0jo3du-icy6v2.js","/_next/static/chunks/15cy49d~_zsjj.js","/_next/static/chunks/0..ktetnpeix7.js","/_next/static/chunks/08cz-ztcfuxe..js","/_next/static/chunks/0i6hzvr84kc1r.js"],"SignupCTA"] 3c:["$","div",null,{"className":"flex flex-wrap items-center gap-x-4 gap-y-1 font-mono text-[12px] uppercase tracking-[0.1em] text-[color:var(--fg-3)]","children":[["$","time",null,{"dateTime":"2026-03-17T09:32:00.000Z","children":"March 17, 2026"}],["$","span",null,{"aria-hidden":true,"children":"·"}],["$","span",null,{"children":"00:09:43"}],false]}] 43:T526,

Standard residual connections have been the "gradient highway" for every major LLM, but they have a hidden flaw: they treat every layer as equally important. In this video, we break down Attention Residuals (AttnRes), a new architecture from the Kimi Team that replaces fixed additive residuals with learned, input-dependent softmax attentionover the depth of the model.By treating the "depth" of a model like the "sequence" of a Transformer, AttnRes solves the "PreNorm dilution" problem where early-layer information gets buried as models get deeper. The result? A 1.25x compute advantage and massive gains in complex reasoning and coding tasks.For a technical deep dive into the scaling laws, Block AttnRes optimizations, and the "Sequence-Depth Duality," check out our full podcast episode:

The Sequence-Depth Breakthrough: Inside Kimi Team's Attention Residuals

Stay ahead of the curve:

Follow us on X: @neuralintelorg

Visit our website: neuralintel.org