Transcript
A (0:00)
Study and play come together on a Windows 11 PC. And for a limited time, college students get the best of both worlds. Get the unreal college deal everything you need to study and play with select Windows 11 PCs. Eligible students get a year of Microsoft 365 Premium and a year of Xbox Game Pass ultimate with a custom color Xbox wireless controller. Learn more@windows.com studentoffer while supplies last ends June 30th terms at aka mscollegepc.
B (0:30)
Happy Monday morning everybody. David Shapiro here with another video. Let me go ahead and introduce today's topic. So I posted on the OpenAI forum, just say, hey, bring me your research and business problems and I'll see what I can do. And so Anna R. Mills is an expert in constructing arguments and asked me to take a look at doing this with GPT3. So I'll show you the data in a second. But the most important thing is the instructions that she gives her, I guess, students. And it's basically teaching them how to construct critical arguments against something. So write a thorough summary and critical assessment of the argument. The summary should describe the key ideas of the argument, including the main claim, key reasons, counter arguments, rebuttals, and limits. The assessment should discuss the strengths and weaknesses of the argument. What was compelling, persuasive, troubling, unclear, or problematic. Choose phrases like elegant argues throughout to show that the writer's purpose to show the writer's purpose at each point, write most of the essay in your own words, but consider using the occasional direct quote where original word choice is critical. The introductory paragraph should include the title of the argument, the author's full name, the argument's main claim, and your overall assessment of the argument's validity. Okay, so this might sound like one task, but this is actually many, many, many tasks. And so let me show you some of the data that she sent over to show you what I mean. And so this is, this is one reason that a lot of people think that, like, oh, GPT3 is really stupid, because you ask it to do, like, all these things at once and it only does one of the things. And that is because what we need to do is we need to break these things down into separate cognitive tasks. So here's the instructions that she gives. And really, this is a procedure, right? It says do this, this, this, this is how it should look. GPT3 will be able to get some of this. But let me show you an example of one of the inputs. So here's one of the, here's one of the essays. It is 1600 characters long. And then we go get the, the critique. Look how long the critique is. The critique is way longer than the, than the, than the actual essay. It's 5,800 characters long. Okay, so that's, that's a lot of critique. Unfortunately, this is probably a little bit too long to fit in, in a single prompt, which is another reason this. So let's see how many tokens this is. Oh, only 1500 tokens. Okay, never mind. So this could actually fit in original DaVinci. However, what we're doing here is, is basically I'm going to break it down into prompt chaining. So with all that said, we are going to. I've already got the repo created, so let's go ahead and clone this down and let's get clone. Yes, I fat fingered that. There we go. Okay, so then we've got our brand new repo here. Critical argument. Yep, that looks good. And then we'll open another one. Increasingly verbose bot copy my git, ignore and OpenAI key. Okay. And then increasingly verbose, just go ahead and copy a script over. I'll rename it paste. Okay, so this will be Critical Argument. I'll just call it Critical Argument. So what we're going to do within this though is we're going to set up prompt chaining. So the first thing we need to do is let's look at the instructions. Write a thorough summary and critical assessment of the argument. That is the highest order instruction. And then this describes the summary. The summary should describe the key ideas, including the main, main claim, blah, blah, blah. Okay, so we'll say this is, this is subordinate to the first instruction. Right? Let's see. The assessment should discuss the strengths and weaknesses of the argument. What was compelling, persuasive, troubling, clear and problematic throughout. Okay, so the throughout is. Global instructions. Write most of the essay in your own words. Also global instructions. Let's see. The introductory paragraph should include the title of the argument, main claim in your overall. Okay. Okay. So basically what I'm doing here is I kind of chopped up the instructions to show that it's like, let's see that it, like it's, it's separate tasks. I don't, I don't think I'm wording this correctly, but I hope that by showing you. So like there's an order of operations. Basically the introductory paragraph, right, should include this. Choose phrases like elegant, argues throughout to show the writer's purpose. Actually, I wonder if this should be subordinate because this first instruction is kind of the global Purpose, right? That is what this paper is, right? Most of the essay in your own words. Okay, yeah, I think that's good. And then. Yeah, okay, so the reason that I'm chopping it up this way is just to show how the mind, how your mind might organize this. Because the instructions that she gives kind of talk about this part and this part and this part. But what, what happens in your mind as you build it up is you're kind of constructing an image. So our brains are kind of like object oriented coding where you know, it's like, okay, so you start with this primary idea and then you attach a new feature to it or a new, or a new characteristic and then you modify that characteristic and then you add a new, you know, value or whatever or a new function to it. And so you keep operating on this object in your mind, which is constructing this argument. Now before we do that, let's just do an experiment because right now I'm operating off of intuition. So it's like, what if I'm wrong? Right? What if, what if GPT3 can handle, can handle this just sight unseen. So let's go and test that real quick. So write a thorough summary and critical assessment and then argument actually here. Now we don't even need that. Just go grab it. Sh. Critique. Add some more new lines. Okay, critic, let's see. We'll say summary and critical assessment. Now this is DaVinci02. So, okay, not bad. May contain sensitive content. Alright, so in Wouldn't We All Cross the border? Yep. Anna Mills argues that illegal immigration is not inherently wrong or unethical. Mills points out that if most people or in a situation where their children are starving and they had a chance to get to the US they would take it regardless of the legal consequences. Therefore, Mills concludes that we must find a border policy that treats migrants with empathy and respect. This is a compelling argument that highlights the human side of illegal immigration. Oh, that's still really hot. Mills effectively uses hypothetical situations to illustrate her point that most people would do whatever it takes to get their families to safety. However, the argument does not address some of the more practical concerns around illegal immigration, such as national security. Overall, this is a thought provoking piece that challenges readers to consider the issue from a different perspective. I would say that is a phenomenal opening paragraph. However, let me show you how long this is in comparison. And part of the reason that it's shorter is because we're using text davinci02 so text davinci02 is fine tuned on the instruct series data. So it's basically saying, okay, I'm going to put out, you know, one sentence, a couple paragraphs. Sometimes you get run on stuff. But with DaVinci O2, its output is generally very short, especially compared to some other ones. So this is, this is what GPT3 put out. And then this was what a professional wrote. I don't know if Anna wrote it or if, if a student wrote it. But you see like, okay, so we've got, let's see, 906 character response versus 5,800 character response. So we're not quite there. But the quality of this response, phenomenal, right? This, this, I would say like the construction of this, it is very obvious that someone is responding, that this author is responding directly to this essay. Whereas you say like, you know, the, the response title was Contested Territory. Okay, that's not even the same title, right? In recent years, like someone is just kind of summarizing it. But honestly, this, I don't, I don't think that this is as good of an opening because someone is like, whoever wrote this, they're not actually saying that this is what Anna Mills claims. They're just stating this as a fact. And so it's not clear that this is actually a critical response just from the get go. So that's my personal opinion. I'm not an expert in this. This is just, I'm reading this and if this was an art, like if I saw this as like a blog and someone was like, you know, critiquing someone else's blog, I'd be like, what are you, who are you? Like contested Territory. Okay, I would search for contested territory. Like, is that what you're responding to? The second paragraph seems spot on. Mills questions the ethics of enforcing immigration laws. That was, you know, GPT3 picked up on that as well. While the essay argues for empathy, it limits the scope of its argument from offering comprehensive vision. Okay, so we've got all the different components. So for the opening paragraph, it seems like if we just use this whole thing, that's fine, but what I'm wondering is if we can break it up into sections. So first let's just copy this prompt down because it worked. So we'll do essay summary and critical assessment. Okay, so we'll save this as prompt 01. So we'll use this to generate the opening paragraph. Let's run it again just to see if it produces something similar. So I'm guilty of this. Sometimes, like I see one good output and I'm like, oh, it's good. This it almost identical. Okay. Yeah. So the output is darn near identical. Let's turn up the temperature just to see if it gets really weird. So one thing is that the quality of the instructions, you know, you see, like, there's a whole paragraph of instructions. Whoops. That actually can sometimes help. Sometimes if the instructions are not clear or if you're trying to do too many things, it'll get confused. Okay, so let's see. Anna Mills challenges the morality. Yeah. She appeals to the reader's empathy, asking to them to imagine strengths is lioness emotional appeal and examine examination of moral implications. Yeah, okay, so we've got that. But because we. So there's a few. There's a few, like, universal rules. Right. So what we want to do is break it down into smaller parts because, you know, I think we do have weakness. Oh, nope. It didn't address the weaknesses. So here's what I typically do when I want to deconstruct something is I'll break it down into smaller and smaller parts. And so what I'll do is let's. Well, here, let me make sure I've got a copy of the instructions. No. Okay, got the instructions here. And let's close that. We don't need that. Here's where I deconstructed it. I actually don't like that. Let me close that. I made a mess of it. Don't need that. Okay, we'll get back to the script once we do some prompt engineering. Yes. So the key ideas, including the main claim, key reasons, counter arguments, rebuttals, and limits. All right, Let me now copy all this into a new prompt. And all we're going to do is we're going to. We're going to pare this down. So we want to summarize. Well, here, I'll borrow the same language that Annie is. So we'll say. Write a summary of the following essay. While focusing on the counter arguments, rebuttals, and limits. Assess the strengths and weaknesses of the argument. Okay, So now let's take this and we're going to assessment of strengths and weaknesses. And if it's not apparent yet what I'm doing. Oh, here, let's just grab this. Yeah, we can grab the whole thing and then we'll go grab the. Oops, I closed it, didn't I? Go back here. So by breaking it down into smaller parts, I'm basically going to say, okay, write each section separately. So let's see what this does. Let's see if this works. It might not. Let's turn this back down to zero.