Loading summary
A
This is Maximum Lawyer with your host, Tyson Mutrix. Today, we're diving into a framework that's going to change the way you're going to run your law firm. And it's called the Evaluator Optimizer Framework. And this is the third in the series of four that we're going to cover. I do want to say that you're going to be using probably all four of these. This is one of the many that's going to help transform your. Transform your practice. So don't think that you're gonna use one and not the others. You're probably gonna end up using all of them. But on this one, once you start using it, you're definitely not gonna go back. This is the loop that improves everything from your client emails to court filings, from social media posts to your pleadings. It's gonna be everything. Before I jump into this episode though, if you benefit from our podcast in any way, please do me a favor and leave us a review. And more importantly, subscribe. Over 80% of our listeners are not subscribed, which is a shocking number to me, and I'd really love to get that number down under 50% by the end of the year. So if you don't mind, please hit the subscribe button. This lets the algorithms know that this is a show worth showing to more people. Thank you so much for doing that. All right, now that I've got that out of the way, let's jump in. At its core, the Evaluator Optimizer framework is a simple feedback loop. It's extremely powerful, though. It helps you take a rough draft from you, your team, or even AI and really polish it until it is ready to go. So think of it sort of like this. You don't have to hit a home run on the first swing, which is kind of nice. I didn't hit many of them. You just need a batting cage that adjusts the pitch until you're ready to really knocking it out of the park every single time. So you get lots of shots at it. And that's exactly what this framework does. You get lots of swings. So let's take a cue from companies like Netflix and Amazon. Netflix uses feedback loops like this to fine tune their recommendations. So 75% of what people watch comes from those suggestions. Amazon, they 35% of their revenue comes from refining what people see and buy based on real time feedback. So they're, they have these, all these feedback loops built in. They're not guessing, they're constantly learning. And you can do the Same inside your firm. That's what's so amazing about this. So here's how this works. I'm going to show you one of the ones that I've built out and there's many examples. This one is just simply an article. It's an article writer that you can use for your website or for drafting pleadings. You can use this, the one I'm going to show you in a lot of different ways. So let's go and show this to you. This is. And for those of you that are just listening, I'm going to, I'm going to walk you through it. What it really is, it's a series of agents that are doing different things. The first one is simply, it's. Well, before I get to the first agent. But the first thing that you're going to do is you're going to use a chat message to really create a. Whatever thing you're going to do. So let's say that you are a criminal defense attorney and you wanted to write an article about a theft case or a burglary case. You just type that in there. And then the first agent creates an outline for it. The next in line, the outline editor drafts an outline for it. An outline for the. Or, I'm sorry, edits the outline. So you're drafting the outline. The first agent, agent, second agent is, is going to edit that outline. And then what you're going to do is it's. There's a little. You don't need to really know what this is at this point, but there's something in here to help edit the fields after that the article is written. Then you've got a title that is drafted based on the article that's written. I like to have the article first and then the title. That's just because you don't want it. You want them to match. And it's more likely to match if it's based on what was written as opposed to what you're going to write. So you've got the article writer, then you've got the title drafter, and then you've got the meta tag. And that's so you can post it to your website if you want to do that first. You can also have this go into, let's say like Google Docs or something like this. And then it's evaluated. You're at this fork. You can either post it right away to WordPress or you can send it to Google Docs or wherever else you want it to go. Or, or, and here's where the, the evaluator comes in, you have an evaluator agent. It goes through and it just, it decides whether or not it's, it's, it's what needs to change with it. So you've got these evaluator, that's the fork, the evaluated. It's being evaluated, says not quite ready. Evaluator goes in and says, okay, these are the things that need to change about it. And then it goes back all the way up through the edit fields node and then the article writer again. So it just keeps getting drafted over and over and over again. So that's what this looks like. Okay, so, so it's a simple basic loop that you're doing here. So step one, and I'm gonna get this to you in really simple terms. So step one, generate a first draft that could be a demand letter, it could be a client email, it could be marketing copy. Step two, you're gonna evaluate that draft and you can, and I'm making a simple one for you by the way, as opposed to what I just showed you. So you're going to evaluate that draft. So use, you're going to use clear criteria. So tone, clarity, structure, persuasion. Do you want it written in a certain tone based on a certain person? And you can do this manually or you can do it with AI so you can give it those instructions. Let me give you a little pointer. Use the AI, put it in there and give it instructions. Strip. Step three, what you're going to do is you're going to optimize it. So you're going to take the feedback, going to make the revisions and you're going to run it through again. That's what's going to happen. And you're going to keep looping until it meets your standard. Whatever your standard is, that's what it is. So it'll keep going until it meets that standard. It's, and it's not just editing. That's what's cool about this. It's a system that builds excellent excellence into every single process. You can do this to build processes, really, if you want to, if you want proof that it works, just look outside the legal world. That's why I like, I really like to look outside to see what other people are doing, what other industries are doing. Look at Unilever. So Unilever built an AI powered content hub called UStudio. And what they do is they use it to evaluate and improve ad performance in real time. And it, what it's done, it's cut their campaign planning time in half. I mean, imagine that. And it boosted engagement by 35%. So imagine if you had this marketing machine that did that, did the same thing. Duo. Duolingo. Duolingo, very similar. They, they process over a billion exercises a day, which is just amazing. Their system, what it does, it adjusts future lessons instantly based on how people perform. So it's not like, it's like the set plan, it's somewhat of a structure, but then it's revised based on the interactions with the person. So like if, if they can do unilever, if they can do that with shampoo and Spanish verbs, duolingo, then you can do it with pleadings, you can do it with client communications, you can do with your marketing. So how is this something that you implement? Well, first you're going to define what great looks like to you, right? You have to figure out what that standard is and you're going to set those clear standards for your content or your documents. Just as if you would do this for one of your associates or one of your marketing people, you do the same thing. And then second, you're going to set up your system. That's an important part of this. You have to set up the system who or what creates the draft, who or what evaluates it, who or what optimizes it. And I would say make all those what's as opposed to who's. So the who not how has now become the what not how, because the what's can do this work as opposed to the who's. Third, automate the loop, right? So you're going to use tools like N8N. You can use make, you can use Zapier, you know, there's many of them, but use those to connect the dots. And if, like I said in the previous episode, start small with this, you're going to, you're going to want to use it for things like intake emails, maybe engagement letters and really lower level stuff and just refine the process and then scale it up. So let's talk some numbers. So firms using continuous improvement processes, they see an average return of about $6,000 per employee. It's pretty crazy. AI generated content gets more engagement too, which is pretty interesting. So 5.87% versus 4.82% for human only content, which what that means is it's cheaper because the AI is going to be cheaper and it's going to get better performance. Is it knocking out of the park that much better? No, but it's better. Better than what you're paying for now. So in here, let's have a feedback loop. So they have been shown to reduce correction time by about 70% in software testing. So that's a pretty cool thing. And that's some, that's, that's something the software companies have been dealing with for years. So for law firms that's going to mean fewer mistakes, faster delivery and hopefully what we're talking about is better client outcomes. And some people might be saying, okay, well you know, because I want to go through some of these concerns that maybe you have. Well, isn't AI just going to amplify its own mistakes? Well, it's only if you let it. Right. That's why human oversight is really, really important here. You let the AI move fast, but you give it bumpers. That's important. Another question that we always get, do I always need a human involved? Not always. I would say for high stakes tasks, AI is going to give you the speed, but humans are going to add that nuance. That's really important. But the combination is what's going to work best. I would say on any of the things you build, include a human in it at the beginning at least, and then go from there. Another question is, is what should I start with? And that's a really, that's a really tough one. But from software to tasks or whatever. But when it comes from to tasks, pick tasks that are, that are repetitive and they have clear success markers. So things like engagement letters, follow up emails, client updates, things that aren't just a simple automation, they are, they require a little bit of thinking. Start with those. Next question. We get a lot is how do I know if it's working? Well, what you're going to see is fewer revisions where you, you'll go through all the logs and you'll see, you're going to start to see fewer revisions. You're also going to see faster turnaround times and then you're also going to start seeing better, better feedback from clients. Hopefully is what you're going to start to see in more money, lower, lower expenses, things like that. You're going to see the difference. You'll hopefully feel the difference. Your team is going to tell a massive difference. Every law firm has systems. Some people have bad ones, but, but not every firm has systems that get better with time. This is something that, that certainly will if you set up right. And this is what this framework gives you exactly. It gives you that, an ability to do that. So you're gonna be able to cut waste without cutting any corners. You're gonna get more done with less stress you're gonna be able to do better work every single time. I'd say almost every single time in improvement. That's the goal here. You've got this loop. The more you run it, the better you're gonna get at it. And so I hope you get something from this episode. This is a really, really important one. It's one of the best of the three, so make sure. Make sure you implement this. It's. It's such a valuable tool you're gonna be able to use. So as a reminder, if there's a topic you want me to cover, though, on future episodes, shoot me a text. 314-501-9260 Save that to your phone so you can shoot me a text. I got some good text this week that I'm gonna share on a future episode. Got lots of great ideas, so. And I'd love to hear yours. So until next time, though, remember that consistent action is the blueprint that turns your goals into. Into reality. Take care, everybody.
Maximum Lawyer Podcast: Episode Summary
Title: The System Netflix and Amazon Use And Why Your Law Firm Should Too
Host: Tyson Mutrux
Release Date: June 21, 2025
In this insightful episode of Maximum Lawyer, host Tyson Mutrux delves into the Evaluator Optimizer Framework, the third installment in a four-part series designed to revolutionize the management of law firms. Mutrux elucidates how this powerful feedback loop can transform various aspects of legal practice, drawing parallels with the sophisticated systems employed by industry giants like Netflix and Amazon.
Mutrux introduces the Evaluator Optimizer Framework as a comprehensive feedback mechanism aimed at refining drafts—be it client communications, court filings, or marketing materials—until they reach optimal quality. He likens the framework to a batting cage where multiple attempts are made to perfect each “swing,” ensuring consistent high performance.
[00:05] Tyson Mutrux: "The Evaluator Optimizer Framework is a simple feedback loop that's extremely powerful. It helps you take a rough draft from you, your team, or even AI and really polish it until it is ready to go."
To illustrate the framework’s efficacy, Mutrux references how Netflix and Amazon utilize similar feedback loops:
Netflix: Utilizes feedback loops to refine content recommendations, with 75% of user viewings driven by these suggestions.
[04:20] Tyson Mutrux: "Netflix uses feedback loops like this to fine-tune their recommendations. So 75% of what people watch comes from those suggestions."
Amazon: Generates 35% of its revenue through real-time refined product recommendations based on continual learning.
[04:30] Tyson Mutrux: "Amazon... gets 35% of their revenue from refining what people see and buy based on real-time feedback."
These examples underscore the potential for law firms to implement similar systems to enhance client interactions and operational efficiency.
Mutrux outlines a step-by-step approach to adopting the framework within a law firm:
Define Standards: Determine what “great” looks like for your firm’s documents and communications.
[09:15] Tyson Mutrux: "First, you're going to define what great looks like to you. You have to figure out what that standard is and set those clear standards for your content or your documents."
Set Up the System: Establish a process where drafts are created, evaluated, and optimized using automated tools, favoring automated workflows over manual oversight wherever possible.
[10:45] Tyson Mutrux: "Set up the system—who or what creates the draft, who or what evaluates it, who or what optimizes it. Make all those what's as opposed to who's."
Automate the Loop: Utilize automation platforms like N8N, Make, or Zapier to connect and manage the workflow seamlessly.
[11:30] Tyson Mutrux: "Automate the loop. Use tools like N8N, Make, or Zapier to connect the dots."
Mutrux emphasizes starting with manageable tasks—such as intake emails or engagement letters—that are repetitive and have clear success metrics, allowing for gradual refinement and scaling of the system.
Highlighting successful implementations outside the legal sector, Mutrux cites:
These examples demonstrate the versatility and effectiveness of feedback loop systems in enhancing productivity and engagement.
[16:50] Tyson Mutrux: "Unilever built an AI-powered content hub called UStudio... it boosted engagement by 35%."
Implementing the Evaluator Optimizer Framework offers numerous advantages:
Increased Efficiency: Firms using continuous improvement processes report an average return of $6,000 per employee.
[19:10] Tyson Mutrux: "Firms using continuous improvement processes see an average return of about $6,000 per employee."
Enhanced Content Performance: AI-generated content achieves better engagement rates (5.87%) compared to human-only content (4.82%).
Error Reduction: Similar systems in software testing have reduced correction time by 70%, translating to fewer mistakes and faster delivery in legal services.
[20:30] Tyson Mutrux: "They have been shown to reduce correction time by about 70% in software testing."
Improved Client Outcomes: Faster turnaround times and higher-quality work result in better client satisfaction and outcomes.
Mutrux proactively addresses potential apprehensions regarding AI integration:
Amplification of Mistakes: He cautions that without proper oversight, AI can perpetuate errors. However, with human supervision, these risks are mitigated.
[21:45] Tyson Mutrux: "It's only if you let it. That's why human oversight is really, really important here."
Role of Human Involvement: For high-stakes tasks, the combination of AI speed and human nuance yields the best results, advocating for initial human involvement in system setup.
[22:30] Tyson Mutrux: "The combination is what's going to work best."
To initiate the framework, Mutrux advises selecting tasks that are both repetitive and have clear success indicators. Success can be measured through:
[24:50] Tyson Mutrux: "You'll also be able to cut waste without cutting any corners. You'll get more done with less stress. You're gonna be able to do better work every single time."
Mutrux concludes by reiterating the transformative potential of the Evaluator Optimizer Framework for law firms. By establishing and automating robust feedback loops, firms can achieve continuous improvement, reduce errors, and enhance client satisfaction.
[28:10] Tyson Mutrux: "This framework gives you the ability to cut waste without cutting any corners. You're gonna get more done with less stress. You're gonna be able to do better work every single time."
He encourages listeners to implement the framework and share topics for future episodes, emphasizing the value of consistent action in turning goals into reality.
Key Takeaways:
This episode serves as a pivotal guide for law firm professionals aiming to harness advanced feedback systems to elevate their practice’s effectiveness and client service.