Episodes
Newest firstAll episodes
Don't Build Slop: The 4 Levels of AI Agent Maturity
3w ago00:06:34Tap to summarizeEN IT PDFhttps://www.patreon.com/posts/en-it-pdf-dont-4-158887432?utm_medium=clipboard_copy&utm_source=copyLink&utm_campaign=postshare_creator&utm_content=join_link
Transcribe →Don't Build Cascaded Pipelines: The Rise of Native "Any-to-Any" Multimodal Agents
3w ago00:06:19Tap to summarizeEN IT PDFhttps://www.patreon.com/posts/en-it-pdf-dont-158887968?utm_medium=clipboard_copy&utm_source=copyLink&utm_campaign=postshare_creator&utm_content=join_link
Transcribe →Don't Build Cascaded Pipelines: Skilling Up Coding Agents for System Observability
3w ago00:06:51Tap to summarize[EN IT PDF]https://www.patreon.com/posts/en-it-pdf-dont-158888273?utm_medium=clipboard_copy&utm_source=copyLink&utm_campaign=postshare_creator&utm_content=join_link
Transcribe →Google I/O 2026 Comprehensive Review: Entering the Agentic Gemini Era
3w ago00:02:55Tap to summarizeEN IT PDFhttps://www.patreon.com/posts/en-it-pdf-google-158887215?utm_medium=clipboard_copy&utm_source=copyLink&utm_campaign=postshare_creator&utm_content=join_link
Transcribe →Mapping the Humanoid Robotics Value Chain: The "ChatGPT Moment" for Physical AI
3w ago00:04:27Tap to summarizeMapping the Humanoid Robotics Value Chain: The "ChatGPT Moment" for Physical AIThe convergence of large foundation models and physical automation is driving a major transition in industrial robotics. According to Morgan Stanley's newly launched "Humanoid 100" index, the embodied AI sector is reaching a scientific inflection point comparable to the historical integration of electricity and magnetism.This system-level mapping segments the global value chain into three critical layers: 1️⃣ The "Brain" (Software and Semiconductors): Dominated by Western software infrastructure (Alphabet, Meta, Palantir) and semiconductor giants (NVIDIA, TSMC, Samsung Electronics), this layer defines the foundational autonomy models and spatial compute. 2️⃣ The "Body" (Industrial Components): Actuators, thermal management systems, high-precision rollers, and specialized gears form the core hardware. While traditional European, American, and Japanese suppliers dominate high-end precision components, Chinese suppliers (Top集团, 三花智控, 双环传动) are closing the efficiency and precision gap rapidly. 3️⃣ The "Integrators" (Full-Machine Assembly): The consolidation point for diverse manufacturing giants across automotive (Tesla, Toyota, BYD), consumer electronics (Xiaomi), and e-commerce (Amazon) sectors.Long-term macro forecasts project massive addressable markets by 2050: 📈 United States: Over 62 million humanoid units adopted, impacting roughly 3 trillion USD in cumulative labor wages (primarily in production, maintenance, and food preparation). 📈 China: Over 59 million new units adopted, representing an equipment market exceeding 6 trillion RMB.Understanding this three-part value chain is key for strategic capital allocation and supply chain planning in the era of embodied intelligence.pdf: https://www.patreon.com/posts/mapping-humanoid-158618477?utm_medium=clipboard_copy&utm_source=copyLink&utm_campaign=postshare_creator&utm_content=join_link All my links: https://linktr.ee/learnbydoingwithsteven#HumanoidRobots #EmbodiedAI #MorganStanley #ValueChain #RoboticsSupplyChain #IndustrialAutomation #Semiconductors #FutureOfWork #HardwareEngineering #learnbydoingwithsteven
Transcribe →The One-Person Company (OPC) Paradigm: AI-Driven Industrial Re-Architecture
3w ago00:05:10Tap to summarizeThe One-Person Company (OPC) Paradigm: AI-Driven Industrial Re-ArchitectureThe definition of entrepreneurship is undergoing a fundamental structural transition. Driven by advanced generative AI frameworks and automated operational pipelines, the "One-Person Company" (OPC) is no longer a simple legal designation, but the core building block of the modern digital economy.An objective analysis of the 2026 China OPC landscape reveals critical structural trends: 1️⃣ Scale and Velocity: By mid-2025, China's active one-person limited liability companies exceeded 16 million, representing over 25% of all national business entities. This supply-side explosion is highly concentrated in digital-native sectors like autonomous agent development and specialized digital media. 2️⃣ The Institutional Sandbox: Over 20 major municipalities have established targeted support frameworks, shifting from basic rent-free physical spaces to deep infrastructure provisioning, including computing power vouchers, desk registration protocols, and dedicated micro-seed funding. 3️⃣ Severe Revenue Polarization: Despite ultra-low startup barriers, commercialization remains highly competitive. The revenue profile is sharply pyramidal, with roughly half of exploration-phase founders earning under 7,000 RMB monthly, while a tiny elite of domain-specific, asset-reusable builders achieve multi-million RMB annual run rates. 4️⃣ Organizational Inertia: Large technology corporations are struggling to adapt their enterprise service pipelines to cater to this highly decentralized micro-client market, leaving a critical gap in lightweight API access and distribution support.As the industry enters its secondary phase of development, the priority for solo builders must shift from superficial tool experimentation to the validation of concrete commercial orders, converting individual labor into reusable, long-term digital assets.Source Report: https://www.opcquan.com All my links: https://linktr.ee/learnbydoingwithsteven#OnePersonCompany #ArtificialIntelligence #StartupEcosystem #DigitalEconomy #BusinessInsights #Automation #TechPolicy #AIAgents #Entrepreneurs #learnbydoingwithsteven
Transcribe →🚀 Scaling LLMs is no longer just about more GPUs—it's about the geometry of the cluster-Stanford's CS336 Lecture 8
May 900:07:08Tap to summarize🚀 Scaling LLMs is no longer just about more GPUs—it's about the geometry of the cluster.In Stanford's CS336 Lecture 8, we dive deep into the parallelization strategies that make training trillion-parameter models possible. From Zero Redundancy Optimizers (ZeRO) to 4D parallelism, the complexity is staggering.Key Takeaways: 🔹 ZeRO-3 (FSDP) allows sharding parameters "almost for free" on high-speed networks. 🔹 Tensor Parallelism is mandatory for intra-node scaling but relies on massive bandwidth. 🔹 Pipeline Parallelism is the bridge for cross-node training, now improved with "Zero-Bubble" techniques. 🔹 Expert Parallelism (MoE) decouples MLP layers for sparse routing efficiency.The golden rule? Use all sharding methods until the model fits in memory, then scale with Data Parallelism.Check out the full technical summary and transcripts in our repo! All my links: https://linktr.ee/learnbydoingwithsteven#learnbydoingwithsteven #LLM #AIResearch #DistributedComputing #MachineLearning #DeepLearning #StanfordCS336 #GPU #TPU #ModelParallelism #DataParallelism
Transcribe →Scale or Fail! 🌐 Just summarized Stanford CS336 Lecture 7: Distributed Computing, GPU Parallelism, and Collective Operations.
May 800:06:10Tap to summarizeScale or Fail! 🌐 Just summarized Stanford CS336 Lecture 7: Distributed Computing, GPU Parallelism, and Collective Operations.Deep dive into:3D Parallelism (Data, Tensor, Pipeline)Collective Ops: All-Reduce, All-to-AllHardware Topology: NVLink & RDMAOvercoming the communication bottleneckAll my links: https://linktr.ee/learnbydoingwithsteven#CS336 #DistributedComputing #GPUParallelism #DeepLearning #LearnByDoingWithSteven #AIInfrastructure #LLM #AITraining #NVLink #RDMA
Transcribe →Stanford CS336 Lecture 6: Mastering GPU Programming Models, Performance, and Triton Kernels
May 500:10:21Tap to summarize🚀 Deep dive into GPU architecture! Just summarized Stanford CS336 Lecture 6: Mastering GPU Programming Models, Performance, and Triton Kernels.⚡️ Key takeaways:Memory hierarchy: Registers > Shared Memory > HBMKernel Fusion to beat the Memory WallTiling strategies for MatMulWhy Triton is a game-changer for custom kernelsFull video in my channels.linktr.ee/learnbydoingwithsteven#GPUProgramming #TritonKernels #StanfordCS336 #DeepLearning #CUDA #PerformanceOptimization #LanguageModeling #LearnByDoingWithSteven #StevenDataTalk #AIInfrastructure #LLM
Transcribe →How GPUs Actually Drive LLM Scaling: Insights from Stanford CS336 L5 2026
May 300:06:05Tap to summarizeHow GPUs Actually Drive LLM Scaling: Insights from Stanford CS336Ever wondered why the "Memory Wall" is the biggest hurdle in AI training? Stanford's CS336 (Lecture 5) dives deep into the hardware foundations that make today’s large language models possible.Key takeaways on system-level optimization:Compute vs. Memory: GPU throughput is outpacing HBM bandwidth. Modern AI engineering is more about managing memory movement than raw calculation.The Power of Low-Precision: Moving to FP8 and FP4 isn't just about saving space; it's about maximizing hardware utilization through specialized matrix units.FlashAttention's Secret: It’s not just a faster algorithm; it’s a masterclass in tiling and operator fusion that avoids the quadratic memory bottleneck.Understanding the underlying hardware—from SMs to warps to shared memory—is essential for anyone building or scaling next-gen AI systems.All my links: https://linktr.ee/learnbydoingwithsteven #learnbydoingwithsteven #AI #GPU #Hardware #DeepLearning #FlashAttention #Stanford #CS336 #LLM #SystemOptimization #ComputerArchitecture #AIInfrastructure
Transcribe →