Loading summary
Brian McCullough
Welcome to the TechMe ride home for Monday, November 25th, 2024. I'm Brian McCullough today is Sony about to get back into the mobile gaming hardware business? Is Blue sky in the doghouse with the eu, Nvidia's new AI model? Is intel not going to get as much money as it hoped for? And the rise of AI superclusters? Here's what you missed today in the world of tech. Hey, it looks like at long last we might finally get a successor to the good old Vita. Sources say Sony is in the early stages of developing a portable console to play PS5 games, building on the PlayStation portal, although its launch is still probably years away. Quoting Bloomberg the idea builds on the PlayStation Portal, an 8 inch handheld device Sony released in 2023 that allows users to play PS5 games by streaming them over the Internet. Tokyo based Sony initially had intended for it to function as a standalone device like Valve's Steam Deck. The people said building a mobile device that's capable of directly playing PS5 games would potentially make Sony's software more accessible and appealing to a wider audience. The company has taken several steps in recent times in that direction, including making a bigger push into mobile and PC gaming as well as live service titles. Mobile gaming, which brings in the bulk of the industry's revenue each year, is today dominated by smartphones. Nintendo's Switch console has carved out a lucrative niche for itself by offering the versatility of being playable both on the move and connected to a TV set. Its successor is expected to be released in 2025 and will retain compatibility with Nintendo's rich library of existing Switch titles, potentially sparking an upgrade cycle among users of the nearly eight year old console. Sony and Microsoft have not competed with their own portable gaming hardware for years, following popular but ultimately unsuccessful products like the PS Vita and PlayStation Portable, which were discontinued a decade ago. End quote this is sort of out of left field. The EU says Blue sky is in breach of its rules for not disclosing key details about itself. They've asked 27 governments to see, quote, if they can find any trace of Bluesky. Quoting the FT all platforms in the EU have to have a dedicated page on their website where it says how many users they have in the EU and where they are legally established, said Commission spokesperson Thomas this is not the case for Bluesky. As of today, this is not followed. The intervention comes as thousands of users, including Commission President Ursula von der Leyen, have opened Blue sky accounts in recent weeks. Renegier said the Commission, the EU's executive arm had written to the 27 national governments to see if they can find any trace of Blue sky, such as identifying an EU based office. It has not yet contacted the company directly, he added. BlueSky is a US public benefit company led by digital rights activist and software engineer Jay Graber. It was founded in 2019 for the purpose of developing a single standard or protocol upon which social platforms and other developers could build their own operations. It has come to resemble X, with users posting short messages and images. The EU move comes as regulators are increasing scrutiny over potential breaches of the digital rules by Musk's X. Brussels has been investigating his social media platform since last year over accusations of non compliance with its landmark Digital Services act, mainly in relation to the alleged spread of illegal content and misinformation. Fresh probes on other platforms are also likely. Last month, EU regulators sent questions and requests for official documents to YouTube, TikTok and Snap on how the online platforms are monitoring the use of artificial intelligence in their algorithms over concerns that it could lead to illegal and fake content. Online companies found in breach of the law face penalties of up to 6% of their global annual revenues. Repeat offenders could even be banned from the block. The Commission cannot regulate BlueSky directly as it does not yet reach the threshold of more than 45 million monthly users in the EU to be designated a very large online platform. But Reniger says that if member states could identify an EU based representative for the company, Brussels would reach out to BlueSky. Nvidia has unveiled Fugato, a new AI model for generating music and audio that can modify voices and make novel sounds trained on open source data. Quoting Reuters, Nvidia, the world's largest supplier of chips and software used to create AI systems, said it does not have immediate plans to publicly release the technology, which it calls Fugato, short for Foundational Generative Audio Transformer Opus 1. The new model generates sound effects and music from a text description, including novel sounds such as making a trumpet bark like a dog. What makes it different from other AI technologies is its ability to take in and modify existing audio. For example, example by taking a line played on a piano and transforming it into a line sung by a human voice, or by taking a spoken word recording and changing the accent used and the mood expressed. If we think about synthetic audio over the past 50 years, music sounds different now because of computers, because of synthesizers, said Brian Catanzaro, vice president of Applied Deep Learning Research at Nvidia. I think that generative AI is going to bring new capabilities to music to video games and to ordinary folks that want to create things. End quote End Quoting in gadgets, Nvidia calls it a Swiss army knife for sound. The company listed some possible real world scenarios wherein Fugato could be of use in its announcement. Music producers, it suggested, could use the technology to quickly generate a prototype for a song idea, which they can then easily edit to try out different styles, voices and instruments. People could use it to generate materials for language learning tools in the voice of their choice, and video game developers could use it to create variations of pre recorded assets to fit changes in the game based on the player's choices and actions. In addition, the researchers found found that the model can accomplish tasks not part of its pre training with some fine tuning, it could combine instructions that it was trained on separately, such as generating speech that sounds angry with a specific accent or the sound of birds singing during a thunderstorm. The model can generate sounds that change over time as well, like the pounding of a rainstorm as it moves across the land. Sources say intel, the biggest recipient of CHIPS act money, will see its funding drop to less than $8 billion from the $8.5 billion that the US announced earlier in 2024. Doesn't sound like much on first blush, but that is $500 million, and given the situation intel is in lately, they probably need every dime, you would think. According to the Times, the change in terms takes into account a $3 billion contract that intel has been offered to produce chips for the US military. 2 the government's decision to reduce the size of the grant follows Intel's move to delay some of its planned investments in chip facilities in Ohio. The company now plans to finish that project by the end of the decade instead of 2025. The chip maker has been under pressure to reduce costs after posting its biggest quarterly loss in the company's 56 year history. The move by the Biden administration also takes into account Intel's technology roadmap and customer demand. Intel has been working to improve its technological capacity to catch up to rivals like Taiwan Semiconductor, but it has struggled to convince customers that it can match TSMC's technology. Intel's troubles have been a blow to the Biden administration's plans to rev up the domestic chip manufacturing. In March, President Biden traveled to Arizona to announce Intel's multibillion dollar award and said the company's manufacturing investments would transform the semiconductor industry. Intel's investment was at the forefront of the administration's ambition to return chip manufacturing to the United States from Asia. The CHIPS Act, a bipartisan bill passed in 2022 provided $39 billion in funding to subsidize the construction of facilities, helped the United States reduce its reliance on foreign production of the tiny, critical electronics that power everything from iPads to dishwashers. To prevent taxpayer money from being wasted, Commerce Department officials set milestones for the companies to meet in order to get funds. The benchmarks included building a plant, producing chips, and signing up customers to buy domestically produced products. Intel, which lobbied aggressively for the bill's passage, was long seen as the law's biggest beneficiary, but its business struggles complicated its negotiations over its final award. The Commerce Department had granted the initial award to support Intel's expansion of operations in Arizona, New Mexico, and Oregon, as well as the construction of two plants in Ohio Some guys just want to look good without calling attention to themselves. That me, Mack Weldon Apparel gives me that understated good look for understated confidence in all situations. Mack Weldon shirts are my go to work casual style. They're not flashy, just classic. Always in style and made from the world's most comfortable performance materials, Mack Weldon clothes are designed to fit your style and the demands of modern life. They look like regular clothes but feel like the latest in modern comfort. Mack Weldon thinks about clothing as a secret weapon. Timeless classic style that's infused with performance fabrics and hidden details like their famous air knit underwear, breathable underwear that keeps you cool and dry and comfy all day, and their crazy cut comfortable but elevated sweatpants. The Ace Collection. Get timeless looks with modern comfort from Mack weldon. Go to mackweldon.com and get 25% off your first order of $125 or more with promo code Brian. B R I a n that's m a c w e l d o n.com promo code Brian Think of a password. Now add a number and a special character. No, not that one, a different one. And make it eight characters. Sorry, I mean great. Now remember that forever and do it 100 more times. Impossible, right? 1Password can do all of that for you and more. Look, I know you take care of your passwords. Complex, no dupes, all that good stuff. How much do you want to bet that everyone in your company is doing the same thing? That's why you need 1Password. I can't live without it. 1Password makes strong security, easy for your people, and gives you the visibility you need to take action when you need to. All you have to remember is the one strong account password that protects everything else. Your logins, your credit cards, secure notes or the Office WiFi password 1Password's award winning password manager is trusted by millions of users and over 100,000 businesses from IBM to Slack. It beat out 40 other options to become Wirecutter's top pick for password managers. Right now, my listeners get a free two week trial at 1Password.com Ride for your growing business. That's two free weeks at 1Password.com Ride don't let security slow your business down. Go to 1Password.com Ride something to put on our collective radars for next year IPOs yes, IPOs might be back and soon. In the run up to an expected IPO of its own, klarna reported around $1.85 billion in Q1 to Q3 2024 revenue up 23% year on year, a pre tax loss down 99% to only around $180,000 and Q3 net income up 57% year on year to around 19.7. If Klarna does go out the door sometime in the spring, it could lead the way for other fintechs like Trustly, Chime, Zilch, Plaid, Revolut, Zopa, Brex and Ramp. Quoting Bloomberg. How fast these companies come to market and where they choose to list could be influenced by how Klarna fares. Klarna's much anticipated filing could presage an uptick in fintech public offerings after a relatively slow period, said Mark Palmer, senior research analyst for fintech and digital assets at the benchmark company. The recent an upward surge in fintech stock prices and valuations bodes well for new public offerings in the space, as do investors expectations of a more fintech friendly regulatory regime during the new Trump administration. Klarna Zilch Trustly trustee majority owner Nordic Capital, Revolut, Plaid, Brex and Chime declined to comment or did not respond to requests for comment for the story. A Zopa bank spokesperson said an IPO is not an immediate priority, but that it continues to work toward one, preferably in the UK when the time is right, a Ramp spokesperson said. We have ambitions to be a public company but aren't actively planning for it at the moment. Klarna confidentially filed for an IPO with the U.S. securities and Exchange Commission, it said in a statement last week. While the company provided no financial details, analysts last month put Klarna's implied valuation at about $14.6 billion after shareholder Christalis Investments increased the value of its stake. That would mark an improvement from the $6.7 billion valuation it garnered in its last funding round in 2022, but is still much lower than the $45.6 billion valuation Klarna boasted in 2021. The industry needs liquidity and valuations need to come back to earth, said Sydney Thomas, a founding general partner at Symphonic Capital. She called Klarna's private valuation decline reasonable and its current estimated valuation still exceptional. Given what the industry has been through. I hope Klarna's IPO gives other founders the courage to pursue an exit, even if it means doing so at a lower valuation, thomas said. End quote. But there's another one to be on the lookout for too. Coreweave, which could be the first big IPO of this AI era, and big just generally, as they are apparently aiming for a valuation of over $35 billion. They're likely to target raising more than $3 billion if it does go public around the second quarter of next year, Quoting Reuters Funding for private AI and cloud startups in the US, Europe and Israel is rising after three years of decline and is estimated to touch $79.2bn by the end of this year, venture capital Fir Cell said in October. Core Weave offers access to data centers and high powered chips for AI workloads primarily supplied by Nvidia, one of the company's main backers. It competes against larger cloud computing service providers such as Microsoft and Amazon's AWS. Core Weave recently completed a $650 million secondary share sale which valued it at $23 billion. Investors led by Jane Street, Magnatar Fidelity Management and Macquarie Capital participated in the secondary stock deal, Bloomberg reported in Novemb. Core Weave has tapped investment banks for its IPO preparations. Speaking of the Journal had an interesting piece this weekend taking a look at the rise of so called superclusters that use around 100,000 Nvidia GPUs for training giant AI models and the new engineering challenges arising from such clusters. QUOTE Elon Musk's Xai built a supercomputer it calls Colossus with 100,000 of Nvidia's Hopper AI chips in Memphis in a matter of months. Meta Chief Executive Mark Zuckerberg said last month that his company was already training its most advanced AI models with a conglomeration of chips he called bigger than anything I've seen reported for what others are doing. A year ago, clusters of tens of thousands of chips were seen as very large. OpenAI used around 10,000 of Nvidia's chips to train the version of ChatGPT it launched in late 2022. UBS analysts estimated a push toward larger superclusters could help Nvidia sustain a growth trajectory that has seen it rise from about $7 billion of quarterly revenue two years ago to more than $35 billion today. That jump has helped make it the world's most valued publicly listed company, with a market capitalization of more than 3.5 trillion. The continuation of the AI boom for Nvidia also depends in great measure on how the largest clusters of chips pan out. The trend promises not only a wave of buying for its chips, but also fosters demand for Nvidia's networking equipment, which is fast becoming business and brings in billions of dollars of sales each year. Nvidia Chief Executive Jensen Huang said in a call with analysts following its earnings Wednesday that there was still plenty of room for so called AI foundation models to improve with larger scale computing setups. Huang said that while the biggest clusters for training for giant AI models now top out at around 100,000 of Nvidia's current chips, the next generation starts at around 100,000 black wells, and so that gives you a sense of where the industry is moving. Wang marveled on a podcast last month at the speed with which Musk had built his Colossus cluster and affirmed that more larger ones were on the way. He pointed to efforts to train models distributed across multiple data centers. Do we think that we need millions of GPUs? No doubt, Huang said. That is a certainty now, and the question is how do we architect it from a data center perspective? Unprecedented superclusters are already getting airplay Musk posted last month on his social media platform x that his 100,000 chip Colossus Supercluster was soon to become a 200,000 chip cluster in a single building. He also posted in June that the next step would probably be a 300,000 chip cluster of Nvidia's newest chips next summer. The rise of superclusters comes as their operators prepare for the Blackwell chips, which are set to start shipping out in the next couple of months. They are estimated to cost around $30,000 each, meaning a cluster of 100,000 would cost $3 billion, not counting the price of the power generation infrastructure and IT equipment around the chips. Those dollar figures make building up superclusters with ever more chips something of a gamble, industry insiders given that it isn't clear that they will improve AI models to a degree that justifies their cost. New engineering challenges also often arise with larger clusters. Meta researchers said in a July paper that a cluster of more than 16,000 of Nvidia's GPUs suffered from unexpected failures of chips and other components routinely as the company trained an advanced version of its llama model over 54 days. Keeping Nvidia's chips cool is a major challenge as clusters of power hungry chips become packed more closely together, industry executives say. Part of the reason there is a shift toward liquid cooling, where refrigerant is piped directly to chips to keep them from overheating, and the sheer size of the superclusters require a stepped up level of management of those chips when they fail. Mark Adams, chief executive of Penguin Solutions, a company that helps set up and operate computing infrastructure, said elevated complexity in running large clusters of chips inevitably throws up problems. When you look at everything that can go wrong, you could be utilizing half of what your capital expenditure was because of all of these things that can break down, he said. End quote. But the market still seems to think this is where the action is. I was reading over the weekend about the biggest stock on the Nikkei index this year. Apparently it's Japan's Fujikura, which is up more than 400% in 2024. What does it do? It specializes in fiber optic cable for, you guessed it, AI data centers. Nothing more for you today. Talk to you tomorrow.
Techmeme Ride Home: Detailed Summary of Mon. 11/25 – Return Of The Vita?
Hosted by Brian McCullough, Techmeme Ride Home for Monday, November 25th, 2024, delves into the latest developments in the tech world. This episode covers Sony’s potential comeback in mobile gaming, the European Union’s regulatory actions against Bluesky, Nvidia’s groundbreaking AI model Fugato, Intel’s funding challenges under the CHIPS Act, emerging IPO opportunities in fintech and AI, and the escalating trend of AI superclusters. Below is an in-depth summary of the key discussions, insights, and conclusions from the episode.
Sony appears poised to re-enter the mobile gaming hardware market with a new portable console designed to play PS5 games. Building on the PlayStation Portal—an 8-inch handheld device released in 2023 that streams PS5 games over the Internet—Sony is in the early stages of developing a standalone device akin to Valve's Steam Deck.
Key Points:
Notable Quote:
"Building a mobile device that's capable of directly playing PS5 games would potentially make Sony's software more accessible and appealing to a wider audience."
— Bloomberg Source [03:20]
Implications: Sony’s return to portable gaming could reignite competition in the handheld console market, challenging established players and reviving interest in Sony’s gaming ecosystem after the discontinuation of the PS Vita and PlayStation Portable a decade ago.
The European Union has initiated measures against Bluesky, a US-based public benefit company led by Jay Graber, for failing to disclose essential operational details. The EU has requested assistance from its 27 member governments to locate any EU-based presence of Bluesky, which currently lacks a dedicated page detailing its EU user base and legal establishment as mandated by EU regulations.
Key Points:
Notable Quote:
"If member states could identify an EU based representative for the company, Brussels would reach out to BlueSky."
— Commission Spokesperson Thomas Reniger [07:45]
Implications: The EU's intervention underscores its commitment to enforcing digital regulations, potentially leading to heightened oversight and compliance requirements for social platforms operating within its jurisdiction. Companies failing to meet these standards face substantial penalties, including fines up to 6% of global revenues or even bans.
Nvidia has introduced Fugato (Foundational Generative Audio Transformer Opus 1), an innovative AI model designed to generate and modify music and audio. Unlike existing AI technologies, Fugato can transform existing audio inputs, offering unprecedented flexibility in audio production.
Key Points:
Notable Quotes:
"Generative AI is going to bring new capabilities to music, to video games, and to ordinary folks that want to create things."
— Brian Catanzaro, VP of Applied Deep Learning Research at Nvidia [12:30]
"Nvidia calls Fugato a Swiss army knife for sound… enabling rapid prototyping and versatile audio manipulation."
— Reuters Report [13:00]
Implications: Fugato represents a significant advancement in AI-driven audio technology, potentially revolutionizing creative industries by providing tools that enhance and streamline the production of complex audio content. This innovation positions Nvidia as a key player in the burgeoning field of generative AI.
Intel, the largest beneficiary of the US CHIPS Act, is experiencing a reduction in its funding from $8.5 billion to below $8 billion. This adjustment reflects Intel’s delayed investments in chip manufacturing facilities and its ongoing financial struggles.
Key Points:
Notable Quote:
"Intel's investment was at the forefront of the administration's ambition to return chip manufacturing to the United States from Asia."
— Analysis of Intel's CHIPS Act Funding [25:15]
Implications: The reduction in funding signifies challenges in Intel’s ability to scale chip production effectively and meet government expectations. It highlights the competitive pressure from companies like Taiwan Semiconductor (TSMC) and raises questions about the sustainability of domestic chip manufacturing initiatives under the current financial climate.
The episode highlights potential Initial Public Offerings (IPOs) from fintech giant Klarna and AI-focused Coreweave, signaling a possible resurgence in tech IPO activities.
Klarna has filed confidentially for an IPO with the US Securities and Exchange Commission, aiming to capitalize on increased revenue and improved financial health.
Key Points:
Notable Quotes:
"The industry needs liquidity and valuations need to come back to earth… Klarna's IPO gives other founders the courage to pursue an exit."
— Sydney Thomas, Founding General Partner at Symphonic Capital [35:50]
Implications: Klarna’s successful IPO could rejuvenate the fintech sector, encouraging more companies to seek public markets and contributing to an uptick in technology-focused public offerings.
Coreweave, specializing in data centers and high-powered chips for AI workloads, is also eyeing a significant IPO, potentially raising over $3 billion with a valuation exceeding $35 billion.
Key Points:
Implications: Coreweave’s IPO could mark a pivotal moment in the AI industry, attracting significant investment and highlighting the increasing demand for specialized AI infrastructure.
A major focus of the episode is the burgeoning trend of AI superclusters utilizing massive numbers of Nvidia GPUs, driven by leading tech figures and companies. These superclusters are essential for training advanced AI models but present significant engineering and financial challenges.
Key Points:
Notable Quotes:
"While the biggest clusters for training giant AI models now top out at around 100,000 of Nvidia's current chips, the next generation starts at around 100,000 Blackwell chips."
— Jensen Huang, CEO of Nvidia [45:10]
"The question is how do we architect it from a data center perspective?"
— Jensen Huang during analyst call [46:00]
Engineering Challenges:
Implications: The expansion of AI superclusters underscores the relentless pursuit of more powerful AI models but also highlights the substantial engineering and financial hurdles that must be overcome. Nvidia’s pivotal role in supplying the necessary hardware positions it advantageously to benefit from this trend, although the sustainability of such massive investments remains uncertain.
The episode concludes with a spotlight on Fujikura, a Japanese company specializing in fiber optic cables for AI data centers, which has achieved a remarkable 400% increase in its stock value in 2024. This surge reflects the critical infrastructure demand driven by the expansion of AI and data centers globally.
Key Points:
Implications: Fujikura’s success exemplifies the broader market opportunities arising from the AI infrastructure surge, indicating robust demand for specialized components essential for AI and data center operations.
Conclusion
This episode of Techmeme Ride Home encapsulates significant movements within the technology sector, from Sony’s strategic maneuvers in gaming hardware to the EU’s regulatory actions, Nvidia’s AI advancements, and the evolving landscape of tech IPOs. Additionally, the rise of AI superclusters represents both opportunities and challenges, signaling the future trajectory of AI development and infrastructure demands. Investors and industry watchers alike should monitor these developments closely, as they are poised to shape the technological and financial landscape in the coming years.