Loading summary
Grugq
Foreign.
Tom Uren
This is Tom Uren, I'm here with the Gruk and another between two nodes discussion. G', day, how are you?
Grugq
G', day, Tom. Finding yourself very well?
Tom Uren
This week's edition is brought to you by Socket Socket helps developers manage all their supply chain dependencies. Find them@ Socket.dev so this week Google released a new AI threat report. It went through basically that adversaries or cyber criminals, threat actors are using AI at pretty much every step in the, I don't know, the cyber criminal life cycle. So way back in November, which is a lifetime ago in terms of AI, there was a similar report by Anthropic and they said they had discovered a Chinese threat actor who was using Claude to organize a. I guess it was a campaign, but it was like Claude was doing all the grunt work and it would basically come back to the whoever was in charge and say, you know, here's what I found. Do you want me to go back out? It was like the worker bees and management was sitting back seeing the results of Claude. And at that time I wrote that AI powered cyber espionage will favor China. I think that was maybe, that was the title of my piece. And that was because if you're going to YOLO it, at the time it seemed like, you know, AI would be great for that, you can do it, get a lot more done, but the risks are higher. And that seemed to suit some people
Grugq
with a high risk appetite.
Tom Uren
That's right, Right. Yeah. And my thinking was this is something that organization like NSA or ASD or the Five Eyes won't do because they want to get things right, not screw up and get outed. There's a very high premium on correctness.
Grugq
Right.
Tom Uren
So not that long ago I had an sponsor interview with Dan Guido, who's CEO of Trail of Bits, which is a, a sort of specialist consulting cybersecurity company perhaps would be one way to describe them. And he was talking about how they were using AI and in fact it was to add a lot more robustness to processes to actually make them more secure. And this is my take anyway. The way that they were doing that was breaking down longer chains of work into smaller processes that you could be very confident that an AI machine would do it correctly because it wasn't go and write me some malware. It was do this little thing and then we'll have a check that it's right or wrong. And so for example, they were using it to write test cases that they'd never written before because it was just way too much work.
Grugq
Dull. Yeah.
Tom Uren
Yeah. And it struck me that if you can use it to do test cases, well, you're in a better position.
Grugq
Right, right.
Tom Uren
Because you never had them before. Even if it somehow manages to stuff up well, you know, you've not lost anything, so that seemed like a win. I'm sure Dan's take is more sophisticated
Grugq
than mine, but that was my nuanced. I'm sure there's probably a lot more going on then that was my take. We're leading the charge and we have AI, Right. Tests. That's our value add right there. So I suspect that there's more going on, but I don't think that that's wrong. I think that that's probably where AI adds the most value right now, given the state. It's that sort of thing.
Tom Uren
Yeah. So I'm starting to come around to the idea that even the cyber behemoths. Behemoths. Cyber giants like NSA will benefit from AI, and it's because they already have processes where, you know, a bigger job is broken down into lots of different tasks. And a while back, you sent me a kind of job breakdown of. I think it was. Was it a cyber exploitation role?
Grugq
Yeah. So it was. As I recall, I was looking for the. So, like, the military occupation, specialty, number of an offensive cyber operator, probably because I just wanted to make a joke on Twitter, and I thought it would be good to have that specific detail. And I ended up stumbling across this website, which listed all of the roles, and then it went into, like this, the core skills, the core knowledge, the abilities that you need to have for each of the subsets that they had within offensive cyber. And so I saved that because that was very, very interesting.
Tom Uren
Yeah. So in my file system, you must have sent that to me in 2024, which is, like, so long ago in AI terms. And the document's got. What is that, one, two, three, seven different roles. And each of those roles has, you know, skills, abilities and tasks. So they've spent a lot of time coming up with these lists.
Grugq
Yeah. Like, to be fair, some of them are like, ability to think critically.
Tom Uren
Yep.
Grugq
Ability to evaluate information for reliability, validity and relevance. It's the very army thing of taking, like, stuff that is implicitly obvious and writing it as like, this is a critical thing that you need to do.
Tom Uren
Yeah, yeah. So what was interesting about the list, looking at it today, is that those abilities, many of them were things that I thought I would not trust an AI to do today.
Grugq
Right. Thinking critically, for example, just to pick one.
Tom Uren
But many there's a whole list of knowledges. Knowledge, knowledge requirements, I guess. And so for this one, what is that? That's like 50 different dot points for the Cyber operations planner. And looking at those, for example, knowledge of computer networking concepts and protocols, knowledge of risk management processes, yada yada, yada, yada, I thought, yeah, I would actually think an AI could maybe not understand it, but compellingly regurgitate those principles in a way that it makes you think that it understands them.
Grugq
Yeah. So my take on that is actually if I were in that role, I would want an AI to just double check my work to see if I missed anything.
Tom Uren
Right, yeah, right.
Grugq
If I'm doing a risk assessment and I think I've covered all my bases, I would say, you know, Claude, do a risk assessment with these parameters, blah, blah, blah. And then once that comes back, I say, claude, given these two risk assessments, compare and contrast. And I'd see did it come up with an angle I hadn't thought of or did I have a comprehensive thing? Because it's basically free. Right. And maybe you get something out of it and if you don't, you've lost nothing. So yeah, that's how I would see it being valuable. I think we agree on this. I wouldn't say, Claude, do the risk assessment and then turn that in. Right, like that.
Tom Uren
Yes. I think there's a question about how good it gets and whether you would get it to do the risk assessment and then say, okay, have you missed anything? Or do it the other way around.
Grugq
Right, right, right, right, yeah.
Tom Uren
And so there's the knowledge where it seemed okay, yes, you train a computer on all of human knowledge and it will have knowledge, the skills and abilities I'm less convinced about. But you can see when you break it down into all these different tasks, the small tasks, where I think AI could be helpful and it's certainly within the capability of intelligence agencies to get models that are private, like self hosted models.
Grugq
Right.
Tom Uren
So for example, there's a recent blow up between Anthropic and the US Department of. I still call it Defense.
Grugq
Yes.
Tom Uren
Because Anthropic said they wanted to place limits on what you could do, which to me actually sounded pretty reasonable, like you couldn't surveil American citizens and you. I think the other one was you couldn't use AI to launch lethal attacks all by itself.
Grugq
This is absolutely outrageous. I mean they're just hampering the ability of the US to defend itself in this complex, you know, ever changing threat landscape of. Yeah, I mean, come on, that's part
Tom Uren
of that blow up. The DoD wanted to label anthropic with some really punitive label, which was like, you know, supply chain risk or something like that.
Grugq
Which means that no element of the DoD supply chain can use anthropic.
Tom Uren
Yeah.
Grugq
Otherwise it's like it's a transitive property. So it would basically freeze them out of the entire defense contractor.
Tom Uren
Yeah, yeah. But in that argument, it came out that I think it was Claude, but I don't know if that was the label they used it. But some anthropic product was used in the raid on Maduro or the raid to capture Maduro. So I thought that was very interesting.
Grugq
Yeah. So, I mean, plan a Delta strike to kidnap a world leader, make no mistakes,
Tom Uren
Use the discombobulator. Maybe that's why the discombobulator was used. Claude just said, and we'll deploy the discombobulator. What's that? I don't know.
Grugq
I'm going to tell you one of the reasons why I wouldn't trust Claude to do some of these tasks, because I took that cyber roles list that we had and I pasted into Claude and I said, which one of these would be best for AI versus worst for AI? And it came back and said the six roles are 1, 2, 3, 4, 5, 6, 7.
Tom Uren
So one of the roles I actually do think makes a fair bit of sense for AI, though.
Grugq
The six roles are
Tom Uren
Cyber Operations Planner, Exploitation Analyst, Mission Assessment Specialist, Partner Integration Planner, Target Developer, Target Network Analyst, and the seventh missing role is Warning analyst.
Grugq
The seven of six is warning. It just sort of right off the bat, anything with the word planner in it is just, it's bad for AI because these are, these are things where you want a human to be making human judgments. This is very much weighing up the balance of risks, plus everything I know, plus the political pressures that we're under and all of these other dynamics. What makes sense for us to do, given where we are right now?
Tom Uren
Yeah, I think that planning is an inherently political process and to understand the political pressures, you need to be a person because.
Grugq
Right.
Tom Uren
That's. That's a. That's what people do.
Grugq
So, yeah, like there's that, but then there's the things that we tend to forget about because they're just such boring roles. What they have here as warning analyst. Right.
Tom Uren
Yep.
Grugq
Like that is. It's, it's a. It's absolutely vital and it's absolutely dull. Right.
Tom Uren
So the sort of potted description develops unique cyber indicators to maintain constant awareness of the status of the Highly dynamic operating environment, collects, processes, analyze and disseminates cyber warning assessments. So that is a very like cyber focused description, but for something like the Maduro operation, you can imagine there's a kind of less narrowly cyber like, but exactly the same job.
Grugq
Right. And so what you're looking for is basically from a cyber role. What you'd be looking for is indications that you're about to get burned. So for example, what we saw when we were looking at the Chinese report of those NSA operations, how every time a file was modified on disk that the NSA operators would then go in and try and understand why. Yeah, why did the environment change? What was the reason behind it? Is it that like, did they do a forensics image of the disk and then start it up again? Did they install like antivirus now? Or, you know, are there other indicators that the environment has changed in a way that's more hostile to us and it could indicate we're about to be discovered. So that's the sort of like vital role that you need, but it's also not the most exciting role you can imagine, like monitoring email, monitoring traffic.
Tom Uren
Some of the abilities in the job description, ability to think like threat actors. So I guess there's the sort of surface, I guess I would call it the tactical warning analyst, where you're looking at what's coming in right now and you're making a decision right now about what does that mean? Is the operation blown and you're sort of just alerting someone else to make a decision about what to do about that. And then I think there's a kind of deeper. How would we, what would tell us that we've been pinged?
Grugq
Right.
Tom Uren
Like what are the, you know, the indicators that we need? What do we need to look for
Grugq
in the first place? That would be indicators that they are looking for us.
Tom Uren
Yeah. So I could see like the, something like Claude would be very good at the what's happening right now.
Grugq
Right.
Tom Uren
Based on what we already know. What does that mean? And they would. Right. It would probably do that faster and more reliably than a person would because
Grugq
and could do it 247 without a problem. Right. But you know, to me what that means is it means that the human in that role can now do more and a more refined task because they don't have to waste cycles on the grunt work part. They can have Claude do that and they can focus on the thinking like the other side and then trying to figure out what would be an indication that they're doing something which would be
Tom Uren
yeah, And I think, like, I mean, obviously you'd say to Claude or whatever, AI, you know, what would be the indicators? And you'd look at that and you'd sort of. Did Claude get it right? And is there anything else?
Grugq
Or.
Tom Uren
I think it would be a good baseline, but there's not. I wouldn't rely on it solely, I suppose.
Grugq
No, no.
Tom Uren
But I guess the point of this discussion is that even in somewhere like nsa, there's a role for it and they will be using it, I'm assuming.
Grugq
Yeah. And similarly, the target network analyst, it's not a role I would have thought would be broken out, but apparently they have. And so my understanding is that once you get access to a network, like once you've made your initial breach or whatever, this person would then go in and look around and try and figure out what the best path forward is. In order for us to get to the juicy data that we want, there's network segmentation that we need to defeat. But based on this, we can get access to the admin lan by going through this particular box. So how can we get on that box? Well, and so they sort of plan out, like, given the environment that we're in and the goals that we have, our objectives, how can we do that? And to a degree, part of that is like just path mapping, but also part of it is looking at what's vulnerable compared to the exploits that you have or the capabilities that you have on hand. And that's very much just a database lookup against two things, which, again, AI would be pretty good at. Right.
Tom Uren
It seems a bit to me like kind of like a Google Maps, except for getting around a network with different parameters or whatever.
Grugq
Yeah, pretty much. And again, it's the sort of thing, I think that, like, the way I'm seeing it is a lot of these are sort of free to give to AI, because if AI comes back and says, here's a way to do it, you're going to look at it and you're going to say, okay, this is a good path, and then you do it. Or you're going to say, this is not the best path. I'm sure I could find a better one. And you're going to look for it, which you would have had to do anyway.
Tom Uren
Yep, yep, yep.
Grugq
Right. And it's. It's basically going to be like, if it finds a good one, you're good. If it finds a bad one, you look anyway. And if it can't find one, you're good, you look anyway. And so all you do is you, you save having to find it the first time or else you do what you would have done anyway.
Tom Uren
So, yeah, so I guess to contrast a, you know, YOLO cyber threat actor, they would probably go, well, find me a path, press button, let's go.
Grugq
So they will be quick and then
Tom Uren
do it, but maybe riskier as well. Whereas I suppose the real intelligence agency will be faster.
Grugq
The professionals, if we're going to talk about it. I mean, unlike those sort of day trader, you know.
Tom Uren
So the professionals will still get benefits. Yes, it's just they'll be more cautious about deploying those benefits or maybe more management oversight is perhaps the way to think about it.
Grugq
Yeah, I agree. And I think that it's important to sort of see AI here as adding capabilities that will allow one person to do a better job as opposed to replacing that person. Because from my perspective, all of the roles that AI is good for have a level of grunt work that, that a human can sort of get bored with and start, you know, like, they'll glaze over or whatever. And so I see it as being able to bring like a level of vigilance that you might not get normally.
Tom Uren
Right. Yeah. So for defined jobs where there's pretty clear yes or no answer. Fantastic. Right, but because planning the operations involves decisions about risk that are inherently right. Political or maybe contextual.
Grugq
Yes, I was going to say there's sort of a lot of implicit assumptions and understandings that sort of go on. Like if, if your commander is giving you a mission, but you can send, you can read his body language and see that, like, he really doesn't like this, that's the sort of thing that you can incorporate but you can't explain when you're trying to, like if you're trying to explain to a planner that, you know, his eyes seemed shifty and his body was a little bit, you know, turned inwards, they couldn't experience it in a way and you couldn't describe it in a way that would convey what's actually happening. So it would just be impossible to give that context. But yeah, also to a degree it's things like an AI is probably not going to be thinking about your career. And like, very honestly, like these people, like, it's a job, but it's also a job. Like they do want promotions, they do want raises, they do want to like, you know, do other things. So when they look at it and they go like, this is a very, very important thing. I need to make sure it works, you're going to Move heaven and earth to make sure it works. Whereas this is something that no one cares about. I mean, maybe you don't put your best effort in and you try and do something that's got a higher profile somewhere else.
Tom Uren
Right, right, Yeah. I mean, that sort of fundamentally changes what you do to be good at a job. Like, I think if much of the mundane stuff can be done by computers, and I think mundane is the wrong word in that. Thinking back, the people I knew who did some of these jobs, there were some that were just head and shoulders above everyone else.
Grugq
Right.
Tom Uren
And they did that by basically knowing a lot of stuff and knowing how to apply it. But it seems that my thinking now is that AI will be able to know a lot of the stuff and be able to apply it. So that's not what will separate the best from. Or will it? I don't know.
Grugq
Well, I see. I think that that's. That's how it presented, but I think that there's some sort of quality that's ineffable underneath that, that it, like, it shows up as. That they know a lot of stuff and they know how to use it, but really there's something else below that
Tom Uren
that they just really insulted them.
Grugq
Well, like, yeah, like they're smart people and that means that they learn more stuff and they know how to apply it. But if you take that having to know a lot of stuff in this domain out of their. Out of their specific job role and allow them to do something slightly above it, they're just going to take that cleverness and apply it to the new role and still be head and shoulders above people. Right, right.
Tom Uren
So it might be something like knowing how to get the best out of the computer rather than.
Grugq
Right, yeah. It's probably going to be like knowing a lot of stuff and then guiding the AI to make sure that it's, you know. Well, for now at least, it might be, you know, guiding the AI to make sure that it covers everything. Right.
Tom Uren
Yep.
Grugq
Properly. So, like, I. I'm starting to finish some of my side projects now because I'm using Claude code, and I find that it helps a lot that I know how to program already because, like, it'll sometimes make judgments that are completely wrong. Like, it'll say, you know, I'm going to have to do this really, really complicated thing because the toolkit we're using doesn't have, like, menu items. And I'll be like, yes, it does. And it goes, okay, let me check the docs. Yes, the docs. Oh, my God. Like, wouldn't you have done that time? Why would you just come out and say it doesn't do this before you actually check? And then it goes ahead and does it. So that's great. But on the other hand, it can do things that I would find super tedious and wouldn't get around to doing. So I could say I want this to have themes. And it says, okay, themes are now implemented. Then I go out and I find a palette and I'm like, okay, so here's Tokyo Night. And it's like two minutes later it's like, okay, now you can select Tokyo Night theme. I would never do that. That's a huge pain in the ass and too much dull work. But the fact that I can think of themes and now have them implemented means that I have a different role than I would have had if I was just doing the development right.
Tom Uren
One thing I was thinking about is that one of the uses I've heard that other threat actors do is they basically code up malware really quickly. And that to me seems like for a professional outfit, they tend to have long lasting malware where they put a lot of effort in. And I guess I'm thinking of like Russia used the same, you know, evolution of malware for 20 years.
Grugq
Yeah. If you have 20 years of use, does it really matter that much how fast you code it the first time?
Tom Uren
That's right. And it seems like they'll put a lot of effort in to make it stealthy and hard to detect and flexible. And so test cases, things like that, that would help doing that. But you're right, like, you know, the payoff if you amortize it over a long time, it doesn't matter. Or there may be cases where they'll go, okay, for a particular operation, we want to spin up something new and different that has different look and feel, and in that case it'll help them anyway. And so, you know.
Grugq
Yeah, exactly. So, like, what I where I see it being very useful in this specific subset is like, for ideal opsec, every operation would have its own unique tooling. Now, on the other hand, for actual manageability, that's the last thing you want, because you don't want to have 50 operations with 50 different unique tool sets. But if what you could do is have 50 iterations of different strains of implants that each provide effectively the same functionality, that you could then feed through 50 different C2s that then come back to an interface that's identical and can do the same stuff like that would be too much development. Work to do in house with your actual developers because you want them doing other things, not just writing different malware strains for one shot things. But now you could do that, which would mean that it'd be much more difficult to link operations together based on the malware strains that are discovered. So that could be.
Tom Uren
The rise of AI is actually the death of attribution.
Grugq
Well, it absolutely could be. Right. How could you?
Tom Uren
Well, it makes technical indicators less useful, perhaps.
Grugq
Right, right. So, for example, like when, when Cobalt Strike was basically everyone was just using made identifying who was who from beacons not necessarily impossible, but extremely difficult because everyone was using the same beacon. Now you're going to have now. Or you could have a different problem where the same threat actor uses different beacons for every target.
Tom Uren
Yep.
Grugq
I think that could be interesting. Like that could be an interesting way to use it. I don't know if it will be the way that people do use it, but it's certainly. It's an opportunity there to increase your opsec. Maybe it's not practical just yet, but.
Tom Uren
Yeah. So this seems like one example where I've actually changed my mind in a relatively short period of time. From what, November to February? What's that, six months?
Grugq
Right. Not even that, basically. I mean, you were right the first time and now the world has changed and you're right the second time.
Tom Uren
I like that. Thanks a lot.
Grugq
Thanks a lot, Tom.
Risky Bulletin – Between Two Nerds: How NSA Will Use AI Podcast by Risky Business Media | February 23, 2026
This episode of "Between Two Nerds" features cybersecurity experts Tom Uren and the Grugq (“Gruk”) discussing how major intelligence agencies—particularly the NSA—will use AI in their cyber operations. Drawing on new threat reports and their own experiences, they reflect on both the current and future value of AI in offensive and defensive cyber roles, how workflows might shift, and what roles AI can (and can't) usefully fill for state-level professionals.
AI is Pervasive in Adversary Operations
AI Favors Risk-Tolerant Adversaries
Professional Agencies Prioritize Correctness
AI for Process Robustness
Area of Maximum Value
Intelligence Agencies’ Modular Workflows
AI as a Double-Check
Private Models for Sensitive Use
Critical Judgments, Human-Only
Warning Analyst – Mundane Yet Vital
Human-AI Teaming
Target Network Analyst – Mapping and Pathfinding
Contrast: Professional vs. YOLO Threat Actors
Augmentation, Not Replacement
What Makes 'The Best' Special?
Attackers Already Use AI for Fast Malware Dev
For Professionals – Longevity > Speed
Custom Tools at Scale—Opportunity for OpSec
Death of Attribution?
On How Pros Use AI:
AI’s Limits:
Re: AI-Enabled Mass Malware Customization:
On Human-AI Teaming and Careerism:
Attribution and the Role of AI:
Tom Uren and Grugq agree that as AI matures, even cautious, process-driven agencies like the NSA will find opportunities for AI to augment their teams—especially in repetitive, testable, or data-intensive roles. AI will not replace seasoned operators, but will free up their time, allowing humans to focus on risk, judgment, and higher-level planning. The rise of AI could challenge attributions and technical indicators in cyber operations, presaging a new phase in both cyber offense and defense.
End of summary.