Transcript
A (0:03)
Hello everyone, this is Tommy Wren and I'm here today with Dan Guido, the CEO of Trail of Bits, for a Risky Business news sponsor interview. G', day Dan. How are you?
B (0:13)
I'm doing great.
A (0:14)
So Dan, you're telling me that you're going all in on AI and I was kind of shocked. Oh really? I was looking at your Claude code plugins, just looking at the titles. It seems to be very specific things where you can get maybe not yes or no answers, but you know that there's a particular problem that you're trying to solve. You're not just talking to it, trying to get an answer. Like my impression is that if you give an adversary the ability to talk to LLM, there's a fair chance they'll convince it to do something that it shouldn't. But these plugins are not that at all like dealing with defined problems where you want. I'm not sure if you have an algorithm or a set of steps that you want to be able to go through.
B (1:05)
So I would say these are specific bite sized pieces of behavioral guidance that you give to Claude because the LLM is already trained on the entire universe of knowledge. Like you're not going to teach it something new by like for instance, one of our, one of our skills is about interpreting dwarf binaries and we're not going to give it the entire dwarf binary like reference manual because it already knows that it read that in the pre training. Instead what you're do, what you're, you're doing is you're reminding it like, oh, here's how to use that information, here's how to operationalize it, here's the tools that you can call, here's what you should do with the output, here's how I want you to use it in order to be most effective for the task that I'm trying to work on.
A (1:44)
Right. What is a dwarf binary?
B (1:46)
It's just like a executable format. It doesn't really matter. It's just, it's a complicated binary format and I could waste millions of tokens repeating back exactly how that binary format works to the LLM, but it already knows it. But what it doesn't know is it doesn't know what tools are installed on my computer. It doesn't know how I want it to be used. It doesn't know the workflow process that I'm going through in order to reverse engineer a binary. And, and the skill is a pack of knowledge, a knowledge pack that guides it to use that knowledge the right way. So here's the thing, all these Claude skills, they are a phenomenal contribution to the public and to everyone else's ability to get security tasks done with especially Claude code, but also all the other agents that interpret this format. But this is the output of a systematic process at Trail of Bits, where we are adapting the company to be AI native. And there is an entire process internally, a whole workflow, whole system, a whole interlocking series of process steps that are helping us rapidly adopt the latest technologies to make them safe to use for privacy sensitive engagements with clients and to build the trust and rigor into them so we know that they work correctly. And as we discover what those techniques and what those outcomes are, we polish them up and we publish them. And that's the output that you see on the trail of its cloud Skills Repo. So this is existential for me. I am fully bought in that the entire industry is going to change over the next year and, and consulting especially is going to have some dramatic effects, you know, placed on it that the difference in output from a consultant that uses AI and one that doesn't is going to be very easy to see over the course of 2026. And I want to make sure we're at the front riding that wave so that we can justify our continued existence. So that's, that's really like where all this stuff is coming from. And it's the most important thing that I'm working on right now.
