Loading summary
Transcript17 lines
- [00:00]
Amazon Representative
Amazon Q Business is the Generative AI Assistant from aws. Because business can be slow, like wading through mud. But Amazon Q helps streamline work, so tasks like summarizing monthly results can be done in no time. Learn what Amazon Q Business can do for you@aws.com LearnMore welcome to Tech News Briefing.
- [00:23]
James Rundle
It's Friday, December 27th. I'm James Rundle for the Wall Street Journal. We're hearing from our reporters and columnists about some of the biggest companies, trends, people and tech and what could be in store for 2025. Coming up on today's show, artificial intelligence is everywhere, propelled by the runaway success of OpenAI's ChatGPT and other models. But the tech behind generative AI is far more than just the engine for a fancy chatbot. Researchers are exploring how the technology might be used to create bacteria that eats plastic, self driving cars or potential cures for cancer. Our tech columnist Christopher Mims joins us to talk about how the bleeding edge of AI research may go mainstre next year. Christopher Many people have become familiar with AI as essentially a conversational search tool in recent months. Thanks to ChatGPT and other platforms, however, the underlying technology has greater applications. Tell us about the transformer and why it's so important.
- [01:22]
Christopher Mims
So in 2017, some researchers at Google DeepMind, which is their AI outfit, published a paper called attention is all you need. And that started this supernova explosion of AI that we've seen since. And what was key about that paper was introduced a suite of algorithms which give us a new model for how to create in a computer a universal learner, something which can extract from any large body of data that has inherent structure in it, like language, the sort of underlying order of that data. And it's the reason that we have ChatGPT, for example. But what's interesting is the world is full of structured data which we can apply the transformer architecture or algorithms to. And the result is kind of a GPT for all kinds of things, right? For drug discovery, for, for synthetic biology, for self driving cars, for robots, et cetera.
- [02:35]
James Rundle
So what are the ways in which companies are hoping this can be used in 2025?
- [02:40]
Christopher Mims
Companies are using it to, for example, create new molecules. And the analogy here is when you're using ChatGPT, you're not really having a conversation with an AI. It's like you're in the same Google Doc and you are collaborating, you're writing a collaborative story, but the narrative is it's a chat, so you write some than the robot write some etc. And in biology, what people have done is instead of feeding these transformer models, all of the text on the Internet, which is what it took to get ChatGPT, they've fed them every organic molecule which has ever been characterized in a scientific paper. And everything we know about that molecule, what it does in the real world, its function. And so then you go to that kind of bio GPT and you prompt it with, well, I want a molecule that does this, you know, it treats this particular cancer. And just like ChatGPT, it continues the dialogue, it auto completes what might come next, which is instead of a sentence, it's a proposed sequence of molecules which would make up this new drug potentially, or it could be a new enzyme that would go into bacteria to digest all the plastic in the great Pacific garbage patch. So this is to me one of the most interesting and compelling examples. But in this same vein, people are taking these transformers and feeding them tons of actions that a robot could take. And then they can help power robots which can teach themselves how to perform certain tasks. And that's been kind of a holy grail of robotics. So the end result is a company called Physical Intelligence has been showing off a robot that can fold your laundry. Turns out this is probably the hardest problem in robotics right now. It's even harder than the Boston Dynamics robot doing parkour. And what's key about that is it basically learned on its own how to fold laundry. It wasn't a series of scripted actions.
- [04:43]
James Rundle
So a lot of highly specialized GPTs, for want of a better word, going into development. What are some of the limitations that researchers are running into?
- [04:51]
Christopher Mims
The biggest limitation when you are trying to create a new transformer model is always data. So it's not a coincidence that the world's first GPT was in language, because of course the Internet is just full of text and you can go and scrape it all. And it's a legal gray area about whether you're allowed to do that or not. But there isn't a similar gigantic free library of actions that a robot could take or decisions that a self driving car could make in various situations. So getting that data, having that data, that's the real differentiator. That's the moat between startups and big companies that are able to leverage transformers to do these kind of miraculous new things and those that can't.
- [05:41]
James Rundle
I think that's a really interesting point because on the surface it seems like magic. These algorithms can do incredible things. But how important is it to separate hype from reality? In your column you describe what transformers do in essentially being able to ingest the totality of data that's given to it and make reasonable assumptions about, for instance, the keywords in a sentence or what comes next. That's not the same as truly comprehending languages or truly making decisions on its own.
- [06:07]
Christopher Mims
Yeah, these models absolutely aren't intelligent in any real sense of that word. They are incredibly good at fooling us into thinking that they might be intelligent because of course they can auto complete any chain of text that we can give them. It's good at taking huge amounts of data and using all of the implicit relationships of that data. You might call it knowledge to try to maybe reason by analogy or something in a very primitive way, but it doesn't have what psychologists call a world model. It doesn't have anything approaching human or animal sentience. It really is proof, as one AI researcher put it to me, that you can have really facile, fluid communication with zero intelligence behind it. Now that doesn't mean it's not useful, because something that can ape human intelligence, can copy, it, can simulate, it can do a lot of really low level knowledge work tasks very quickly and replace a lot of the drudge work that humans are doing. And that's why you're seeing it show up in customer service chatbots or systems which do back office drudge work like processing invoices or something like that.
- [07:34]
James Rundle
Coming up after the break, we'll Hear more about AI's promises and pitfalls. Stay with us.
- [07:46]
Amazon Representative
Amazon Q Business is the new generative AI assistant from aws because many tasks can make business slow, as if wading through mud help. Luckily, there's a faster, easier, less messy choice. Amazon Q can securely understand your business data and use that knowledge to streamline tasks. Now you can summarize quarterly results or do complex analysis in no time. Q got this. Learn what Amazon Q Business can do for you@aws.com LearnMore.
- [08:20]
James Rundle
As the world embraces AI, as companies look at different ways it can be used, what other considerations are there around AI? For instance, the environmental impact of data centers, the privacy concerns with data, and everything else that goes into what's being.
- [08:33]
Christopher Mims
Used, my top three concerns with AI are number one, over reliance on it. I mean, this is the subject of countless science fiction novels and, and now we're seeing it happen in the real world. If we hand over decision making to these AIs and we don't have sufficient knowledge about how they actually make decisions, we can get ourselves into a world of trouble. There are countless examples of this, and there will be many, many more as we try to automate more tasks and hand them over to AIs where AIs are systematically making bad or biased decisions. That's my number one concern. Number two is the environmental impact of AI, because of course, it's incredibly energy hungry now. I mean, that will change over time as it gets more optimized. But there's also some evidence that the more we ask of AI, the more energy it's going to take to answer our questions. So we seem to have, as with so many other things, an infinite Appetite. So today's AIs might become way more efficient as computer scientists optimize those algorithms. But in the future, that probably will just mean we'll use more AI, or we'll have the AI talking to itself more in order to do more reasoning on our behalf. The third thing that I'm worried about with AI is essentially mal investment. You know, we're clearly in a bubble right now of spending and investment in AI. But it's very likely that at some point in the next few years, you're going to see a lot of AI startups go belly up. There could be another sort of AI winter. There's going to be a lot of big companies that are going to make big investments in certain types of AI and ultimately find that they don't yield the productivity boosts they were hoping for.
- [10:26]
James Rundle
Continuing that thought, since the advent of generative AI in particular, development seems to have proceeded at a breakneck pace. Do you expect that to continue or do you expect that it will plateau at some point, given the challenges we've spoken about in terms of access to data, environmental concerns, everything else.
- [10:42]
Christopher Mims
In terms of the capabilities of today's chatbot style, generative AIs in particular, we're definitely hitting a wall in terms of improvements in their performance. What we're entering now is what one economic historian calls the installation phase of a technology, which is you go from the early adopters to okay, now, how does it really work for real people? How does it help people in the real world? And how can they figure out how to work it into their everyday? And that process can take decades. So even though the capability of the models seems to have plateaued for now, we're going to have decades of people figuring out how to make it a part of their lives and their businesses, just as we did with the PC or the mobile phone, or 4G and the cloud and all of that.
- [11:33]
James Rundle
That was our tech colobist, Christopher Mims. And that's it. For Tech News Briefing. Today's show was produced by Julie Chang. I'm your host. James Rundle. Jessica Fenton and Michael Lavalle wrote our theme music. Our supervising producer is Katherine Milsop. Our development producer is Ayesha Al Muslim. Scott Soloway and Chris Sinsley are the deputy editors, and Falana Patterson is the Wall Street Journal's head of newsweem. Thanks for listening.
- [12:06]
Amazon Representative
Amazon Q Business is the new Generative AI Assistant from AWS because many tasks can make business slow, as if wading through mud help. Luckily, there's a faster, easier, less messy choice. Amazon Q can securely understand your business data and use that knowledge to streamline tasks. Now you can summarize quarterly results or do complex analysis in no time. Q Got this? Learn what Amazon Q Business can do for you@aws.com learnmore.