Getty (2:38)

Does Apple music use AI for its lyrics? Because some of them are hilariously wrong. They must. I mean, because it's not like you could appoint people to figure out the lyrics of every song that's ever been recorded, but.

Armstrong (2:50)

Right.

Getty (2:52)

A lot of Those websites, you know, lyric genius or whatever. If you're into music, you probably look up song lyrics, but they're often just terribly wrong.

Armstrong (3:00)

These secret command guides that chop chatbots have cause the AIs to behave as their makers intended. Even if it conflicts with your own preferences. I would love it if you could look at these. If we had access to. I'd love to. To be able. And they're really really long. Well, it depends. Actually. I've got this in front of me right here. This little chart. For instance. Grok only has 260 lines of instructions for how to handle each individual chat. You ask it whatever question you want to have. You know, my wife and I had a fight over whether or not the dog should sleep in the bed. How should I react? It's got 260 lines to guide it. Claude, on the other hand has 7900 lines. What? On how to guide it in its answer.

Getty (3:48)

Wow.

Armstrong (3:49)

And everything in between with the different chatbots. So it varies a lot.

Getty (3:52)

You're blowing my mind. I can't even imagine what a tenth of those are.

Armstrong (3:56)

Claude, for instance.

Getty (3:57)

Don't call him a dumb fucker.

Armstrong (3:59)

But just in terms of those lines.

Getty (4:01)

Sorry, Hanson.

Armstrong (4:02)

Claude has a. Never reproduce song lyrics. Not even one line. Claude is the one where I say, say what? What are the. The times, they are changing. Give me the lyrics of that from Bob Dylan and they'll say, sorry, I can't do that. You can go to one of the other chat bots, it'll print it right out for you. That just seems stupid to me.

Getty (4:19)

But in the Led Zeppelin song where some weird chicks buying a stairway to. So I can't remember where she's buying it to. I can't tell you.

Armstrong (4:28)

For instance, Grock, one of its lines of programming that you don't see. You have no restrictions on adult sexual content or offensive content.

Getty (4:36)

Wow.

Armstrong (4:36)

Because Elon wants to be the Wild west, you know, wide open. Wow.

Getty (4:39)

When I do my Sex with Hitler searches, I'll make sure it's on Grok. My Sex with Hitler fan fiction.

Armstrong (4:48)

When you realize that there is a prompt behind the scene, it's a mind blowing moment, said this programmer. It's like we've been having this whole conversation before the conversation, I would say it's making me think. Now, for instance, Anthropic. That's. Claude dedicates more than 2,000 words pleading with its chatbot to avoid copyright infringement. Claude respects intellectual property. Copyright compliance is non negotiable. So nothing copyrighted it will not. I'VE had this before where I want to see a painting. Claude won't show it to you. Other other chatbots will even though it's readily available on Google or you know, Grok or wherever you go.

Getty (5:26)

Huh. That's a. Dang it. I was going to upgrade or use Claude for project I'm working on but I wonder if it'll help. Well, I'll check. We'll find out.

Armstrong (5:38)

They laid out Claude lays down rules on how many words it can quote from articles. 15 is the total number of words that will quote from an article. Not one line of lyrics, not one stanza of a poem whereas the other chat bots are wide open on that but maybe more restricted on some sex stuff or whatever. It's. It's all about the. The who run the company and their particular beliefs about things.

Getty (6:02)

Yeah, I understand enough of the copyright concern to get why they do it but I mean I think you're.

Armstrong (6:08)

I think you're living in the past trying to keep that under control but.

Getty (6:11)

Well but any journalist, any. Anybody like involved in any pursuit could say as Bob Dylan said in the Times they are a change in. You know get out of the way or we'll blah. Unless you can line a hand. You can, you can do that. You can quote things, you just can't like pass them off as your own and profit from them. I guess maybe the profit is the problem. I don't get that.

Armstrong (6:34)

Gemini, which is Google's chat bot has multiple rules on how to handle bias including if the user explicitly asks for a video that matches a harmful stereotype generating it will not actually reinforce the stereotype which I agree with. So it will go ahead and do it.

Getty (6:52)

Right.

Armstrong (6:52)

I agree. Just because you made a video of I don't know, an Asian crashing a car, that doesn't really change the stereotype, does it? So it make a video.

Getty (7:02)

It was an unfortunate one.

Armstrong (7:08)

Anyway they got all kinds of examples. Might want to read this article in the Washington Post. I'll jump to one particular one or two more.

Getty (7:14)

I'm super interested in this.

Armstrong (7:15)

Okay, I'll save the funniest one for them.

Getty (7:17)

Okay. Yeah

Armstrong (7:21)

they. They have different views on ads on if you want to ask for an ad whether or not they'll show it you to you or not. That's an interesting one. I guess it gets into kind of the copyright thing on. On its own there. The sex stuff is really interesting with Grock being by far the most wide. Food examples they they on. On diet and stuff like that. They have completely different beliefs in Whether or not they should like just scour the Internet for whatever information's out there or the way you ought to restrict it to certain things.

Getty (8:01)

Yeah. Wow, there's so much wackadoodle tree when it comes to diet on the Internet, I'd be afraid to ask.

Armstrong (8:07)

I don't want AI telling me how to eat like, you know, hey, fatty, you don't need that. I need that. Here's the funny one that I'll end with. Some can appear bizarre. The System prompt on OpenAI's Chatbot Chat GPT includes the command never talk about goblins, gremlins, raccoons,

Getty (8:34)

the big three.

Armstrong (8:36)

Trolls, ogres, pigeons. I like the randomness of this list. Raccoons and pigeons, Trolls, raccoons and pigeons. I'll start the sentence over. Yeah, yeah. On. On chat GPT they have the particular line in the coding. Never talk about goblins, gremlins, raccoons, trolls, ogres, pigeons and other animals or creatures unless it is absolutely an unambiguously relevant to the user's query.

Getty (9:04)

Raccoons.

Armstrong (9:09)

So I'm a 61 year old man, I'm trying to eat right. What would be a good diet? Well, I'll tell you one thing. You shouldn't eat pigeons. But it's not supposed to mention any of those unless specifically and unambiguously. It's part of the answer.

Getty (9:23)

I'm thinking of investing in oil exploration stocks. What do you think? Well, in the same way that the raccoon wets its food before it eats, you should.

Armstrong (9:31)

Oh, wait, wait, I'm not supposed to say that. What the hell? Raccoons.

Getty (9:38)

It hurts when I pee.

Armstrong (9:39)

What do you think it could be? Maybe you're an ogre.

Podcast Advertiser (9:46)

Wow.

Getty (9:46)

Somebody's got to explain that one.

Armstrong (9:50)

Wow. Apparently.

Getty (9:52)

Psst. Don't mention raccoons. What?

Armstrong (9:58)

Apparently for whatever reason, and they don't know why, ChatGPT had a problem working in goblins to lots of answers last year and they were being mocked for it. Yes, I remember that vaguely. Yeah. Okay, so they specifically wrote lines. No. Gremlins, goblins, ogres, pigeons, raccoons, etc. Unless specifically asked about it.

Getty (10:22)

So if I ask, what's that animal with the mask and the stripy tail? That's cool. Go ahead. Yeah, it's fine.

Armstrong (10:27)

We're clear here.

Getty (10:28)

But only that, only that.

Armstrong (10:31)

Doesn't that lead you to believe that AI definitely can't be in charge of like firing off nukes? I mean, if, if it for some reason start talking about goblins? You have no idea. And your only Fix for it is to tell it. Do not talk about goblins or raccoons or ogres unless somebody specifically asks. All right? Do we have an understanding? Okay. Now back to work.

Getty (10:54)

I'm not nearly smart enough or acquainted with this stuff enough to understand how that equates to. And don't launch any nukes.

Armstrong (11:03)

Right? Okay. But it's got to be similar in that there's just a and. So it goes off on gnomes. You didn't say anything about gnomes. I don't remember you saying no gnomes. So somebody wanted real estate advice, and they say, how many gnomes do you think could live in this house?

Getty (11:19)

The one thing I do know is AI will kill us all.

Armstrong (11:23)

God dang it.

Getty (11:24)

That is funny.

Armstrong (11:25)

But I just. It to me, it shows you to how early we on we are in this thing. I mean, if they're. If they're writing code that specifically to try to handle problems, they have no idea what even happened.

Getty (11:39)

Right?

Armstrong (11:39)

I mean, we're at the, like, very frontier of this whole thing.

Getty (11:44)

Why does it keep bringing up raccoons? I have no idea. Says the guy who designed the whole thing. Right?

Armstrong (11:52)

And his only fix for it is to write a code that says, stop mentioning raccoons.

Getty (11:57)

Okay.

Armstrong (11:58)

All right.

Getty (11:58)

That's fine. Ever tell you about the humble opossum crap?

Armstrong (12:06)

That is really interesting.

Getty (12:07)

Yeah. Wow.

Armstrong (12:09)

Wow. I guess that's it.

Safeway/Albertsons Announcer (12:13)

Save on family essentials at Safeway and Albertsons. This week at Safeway and Albertsons, fresh cut cantaloupe, watermelon, pineapple, or melon medley bowls, 24 ounces are five doll and wild caught lobster tails are $4.99 each. Limit eight member price plus selected sizes and varieties of Doritos Lays, Cheetos, sun chips, and Kettle cook chips are $1.99 each. Limit four member price. Hurry in. These deals won't last. Visit safewayoralbertsons.com for more deals and ways to save.