SUMMARY: How real-time power flow optimization at the edge is helping data centers and the electrical grid handle surging AI energy demands more efficiently. By unlocking hidden capacity and dynamically managing power systems, we explain how existing infrastructure can support significantly more compute without massive new buildouts.

GUEST: Marissa Hummon, CTO Utilidata

SHOW: 1021

SHOW TRANSCRIPT: The Reasoning Show #1021 Transcript

SHOW VIDEO: https://youtu.be/ItcpU8UjOFE

SHOW SPONSORS:

Nasuni - Activate your data for AI and request a demo
ShareGate - ShareGate Protect. Microsoft 365 Governance, we got this!

SHOW NOTES:

KEY TOPICS:

Differences between grid power dynamics vs. AI workloads
Edge AI for real-time power flow optimization
Unlocking stranded capacity in existing infrastructure
“4-to-make-3” vs. “4-to-make-4” data center design
AI training vs. inference power consumption patterns
Role of NVIDIA-powered edge compute modules
Grid modernization and coordination with utilities
Security and resilience in critical infrastructure

KEY MOMENTS:

From centralized AI models to edge-based decision-making
Defining efficiency: utilization vs. thermal performance
Why AI workloads aren’t as constant as they seem
NVIDIA partnership and edge compute in power systems
Using redundancy to increase usable capacity
Increasing density of AI compute and hidden capacity
Data center vs. utility responsibilities
Addressing data center bottlenecks and scaling challenges
Customer landscape: hyperscalers to enterprise
Security, resilience, and critical infrastructure

KEY INSIGHTS:

AI workloads are dynamic, not constant: Training and inference create fluctuating power demands that can be optimized.
Edge intelligence is critical: Real-time sensing and decision-making at the edge unlock efficiency gains not possible with centralized models.
Hidden capacity exists: Many data centers have up to 2x unused power capacity due to lack of visibility and control.
Software-defined power is the future: Faster control loops allow systems to safely exceed traditional design limits.
Efficiency = utilization: The biggest gains come from better use of existing infrastructure, not just improving hardware efficiency.

TAKEAWAYS:

AI infrastructure growth is as much an energy challenge as a compute challenge
Real-time, edge-based control systems are key to scaling sustainably
Existing grid and data center investments can go further with smarter orchestration
The future of AI scaling depends on aligning compute innovation with energy intelligence

FEEDBACK?

Email: show @ reasoning dot show
Bluesky: @reasoningshow.bsky.social
Twitter/X: @ReasoningShow
Instagram: @reasoningshow
TikTok: @reasoningshow

The Grid’s Breaking Point: Can AI Save the Infrastructure It’s About to Crash?