← Big Ideas Lab
Loading summary
Transcript64 lines
- [00:03]
Narrator
The storm hits before anyone is ready. Rain turns to torrents. Torrents turn to rivers. Strong waters pull away everything with them. Cars, trees, homes, entire lives swept away in minutes. And for the rescuers who go in after them, every second is a risk. When disaster strikes or danger is present, humans can't always go in first. So another kind of responder takes the lead. Self driving vehicles advance slowly, scanning for signs of life. Amidst the chaos of debris strewn streets above. A self piloted aircraft maps the damage from the sky, spotting movement beneath the surface. Autonomous underwater systems cut through currents, scanning hidden waterways for survivors. And together they act as one coordinated force. Land, air and water, all increasing the chances of security and survival.
- [01:10]
James Remmer
That's really rewarding to see how that could actually make a huge difference for a lot of lives.
- [01:14]
Narrator
This is the world of autonomous sensing at Lawrence Livermore National Laboratory. Where science advances quickly, adapts constantly and technology navigates where humans can't go, but drones can.
- [01:38]
Podcast Host
Welcome to the Big Ideas lab.
- [01:40]
Narrator
Your exploration inside Lawrence Livermore National Laboratory.
- [01:44]
Podcast Host
Hear untold stories, meet boundary pushing pioneers and get unparalleled access inside the gates. From national security challenges to computing revolutions, discover the innovations that are shaping tomorrow. Today, Join a team where expertise makes a difference. Lawrence Livermore National Laboratory is hiring for a safety basis analyst, a full stack developer, a and a target diagnostics engineer. And the list of open positions doesn't end there. There are more than 100 job openings across science, engineering, IT, HR and the skilled trades. This is more than a job. It's an opportunity to help shape the future. Explore all open positions and start your next career adventure today@llnl.govcareers. that's llnl.govcareers.
- [02:53]
Narrator
Autonomous sensing systems, or drones gather data and make decisions in real time without the need for manual human control. They appear in everyday life, hovering above baseball games, capturing aerial real estate pictures and bringing amusement to concerts and festival crowds. But drones aren't just novelty gadgets. At Lawrence Livermore National Laboratory, the autonomous sensing program drives rapid drone innovation that pushes the limits of what technology can achieve. The drones they create act as advanced threat detectors, scanning for natural and man made dangers oftentimes at the national level. And it all starts with sensing.
- [03:37]
Brian Weil
We do a lot of work with small unmanned systems, mostly on the sensing side.
- [03:41]
Narrator
That's Brian Weil, the associate program lead for autonomous sensors.
- [03:45]
Brian Weil
We're marrying this capability of drones with very unique and exquisite sensors that we develop oftentimes in house.
- [03:52]
Narrator
Before a drone can act, it has to understand what it's seeing. Sensors allow drones to scan beneath the ground map terrain through forests and detect objects invisible to the human eye. And to be mission ready, they have to do this outside the lab under challenging conditions where failure isn't theoretical. Lawrence Livermore tests each system to a technology readiness level, or trl, a measure of whether the drone is ready to perform in the real world.
- [04:25]
Brian Weil
It's getting these things to not only work, but work in a relatively reliable and consistent way. You want people to trust it and you want it to be robust.
- [04:33]
Narrator
In one case, that readiness was tested far from controlled conditions.
- [04:37]
Brian Weil
We committed to going to this event before we even had the sensor built.
- [04:40]
Narrator
It was an advanced sensor created to detect and analyze radio frequency signals.
- [04:45]
Brian Weil
We went from a concept of a very complex RF sensor and then in about three months we had a fielded system that was high enough TRL and go test the thing.
- [04:55]
Narrator
The test environment a small boat in Palau had halfway across the world after a monsoon.
- [05:03]
Brian Weil
We were literally on a small 15 foot flat bottom boat going across the Pacific after a monsoon had hit somewhere and just crazy waves. I was literally sitting on top of our pelican cases trying to keep them from going. And I was nervous. I was like, we just built this stuff. I don't know if it's strong enough to survive this trip. And I remember our program leader was with us and he turned around and looked at me and I think he said to someone else, oh, does he get boat sick? And he's like, no, I think he's just terrified that we're going to lose the equipment. So we got out there and the systems worked exactly how we wanted to and expected. It was great for the technology.
- [05:36]
Narrator
That's what readiness looks like. And it's the standard Lawrence Livermore uses to turn complex sensing problems into working systems.
- [05:45]
James Remmer
Every day we're tackling problems that haven't been solved before, which is really exciting.
- [05:49]
Narrator
James Remmer is a mechanical engineer in the autonomous sensors program that develops sensors that scan, map and, and interpret the world in real time.
- [05:59]
James Remmer
A lot of the features we want to bring to the field are going to be advanced because they just haven't been done before. That's something we really try to focus on. It's something industry hasn't got yet that we think is valuable to the end user and we want to deploy it into the field.
- [06:13]
Narrator
One of their most critical tools is a custom ground penetrating radar built in house at Lawrence Livermore.
- [06:20]
James Remmer
We use this for explosive hazard detection. This is something we've tested at many different events and are training end users how to use that sensor as well.
- [06:29]
Narrator
This sensor is designed to see what humans can't and give them the information they need to act quickly and safely. The team is also working on technology that reaches underground, detecting hidden pipelines and abandoned oil wells.
- [06:44]
James Remmer
We can use sensors like magnetometers, so these search for the magnetic signature of metallic objects. So with large pipes, we can pick these up pretty clearly. And then with a lot of our sensor data, we can take that data in and then apply AI and machine learning to that data and make detections of where we think an object might be customized.
- [07:04]
Narrator
Drone sensors can detect threats more accurately and efficiently than traditional methods. Where human inspection may be slow, dangerous, or impossible. The same can be true in time critical situations such as search and rescue. Using tools like lidar light detection and ranging, which creates detailed 3D maps of terrain. Using laser pulses, we can map the.
- [07:27]
James Remmer
Terrain and look if there's any evidence of where there might be a man made object or protection rescue. If we're trying to find if somebody's car was left near a trail and they wandered off on a hiking trail into the forest, we can maybe identify that car with the lidar underneath the trees.
- [07:41]
Narrator
The technology isn't limited to search and rescue.
- [07:44]
Brian Weil
One of our jobs is to keep a thumb on the pulse of what are the technology needs for national security.
- [07:50]
James Remmer
For one of our sensor projects, we had the sensor mounted onto an all terrain ground vehicle. In just about six weeks. We designed our whole own autonomous system that could drop in to a pretty full size all terrain vehicle and then have a user operate the vehicle remotely, then also upload missions to that vehicle. And the vehicle would drive by itself through different terrains, different conditions, and it was very reliable, it had a lot of safety features and it just pretty much worked right away after only about.
- [08:20]
Brian Weil
Six weeks of work.
- [08:21]
James Remmer
Because we want to move these vehicles to work together collaboratively, so almost have a swarm of these vehicles, then also have these vehicles operate missions and not just be controlled by a remote controller, but are actually moving autonomously. Some of these operations could be dangerous and how it's taking our warfighters out of harm's way, that's really rewarding to see how that could actually make a huge difference for a lot of lives of Americans.
- [08:42]
Narrator
Across land, air and sea. Drones have become the fastest way to put sensing where humans can't go. But as these systems move from experiments to missions, a new problem emerges. One drone can sense a location. One drone can cover a path. One drone can respond to a three threat. But real world missions rarely stay that small. As the area grows, time compresses, conditions change. Sensing stops being a single drone problem. The solution? A swarm.
- [09:21]
Podcast Host
Looking for a career that challenges and inspires. Lawrence Livermore National Laboratory is hiring for a safety basis. Analyst, research scientist, cell biology, and an electrical designer, along with many other roles in science, technology, engineering, and beyond. At the lab, every role contributes to groundbreaking projects in national security, advanced computing, and scientific research, all within a collaborative, mission driven environment. Discover Open positions@llnl.gov careers where big ideas come to life.
- [10:09]
Narrator
A swarm isn't simply a collection of drones. It's a single coordinated system, each drone working toward a common mission together. Some may scan for heat, others map terrain, while another group detects signals. Together, they move as one, covering more ground and accomplishing missions no single drone could achieve. In 2024, Lawrence Livermore's autonomous sensing team received federal approval to test swarms at a larger scale than ever.
- [10:45]
James Remmer
We got the certificate of authorization from the FAA a couple years ago and became, as far as we know, one of the first federal facilities to have the capability to fly 100 drones with one pilot in command for swarm exercises.
- [10:57]
Narrator
At this level, swarms stop being a research curiosity and start becoming an operational reality. But testing swarms of this size requires a special environment.
- [11:09]
Brian Weil
We have a drone pen, a netted structure that allows us to do riskier testing, and things that maybe not be allowed in open airspace by FAA practices, but are really important to what we're trying to do.
- [11:19]
Narrator
But scale changes the problem. Once dozens or hundreds of drones are in the air, it's no longer about what each one can do on its own.
- [11:29]
Brian Weil
Every one agent in that swarm might be able to do something, but when you start putting them together and they have complex interactions and start making decisions, that swarm is going to have its own, what we call emergent behaviors. That is much more and sometimes unpredictable compared to what a single agent can do.
- [11:45]
Narrator
Out of simple rules and shared information, something unexpected takes shape. Instead of managing an individual aircraft, drone operators issue a mission, and the swarm decides how to execute it.
- [12:02]
Brian Weil
What you really want to get to is this idea of force multiplication, which is, okay, I can go do something else, or I can tell other things to do things at a bigger scale and trust that they're going to go do it.
- [12:12]
Narrator
It's like an orchestra tuning itself on the fly. Each drone follows simple rules, but together they create a symphony of motion, each working together to create a melody.
- [12:24]
James Remmer
You can apply it to almost any problem that could be dangerous or repetitive. Some examples would be search and rescue. You can be a Huge force multiplier. Having a lot of drones searching the same area with really high quality sensors. When you're in something so time critical, it could really help if you wanted to save somebody's life.
- [12:43]
Brian Weil
When you start putting them together, you start caring about how do they interact. That again, allows them to do more than just one thing. What kind of information are they sharing with each other? How are they coordinating between each other? When something happens to one, what is the other one doing or deciding to do differently? Now it's very focused on the interaction between those two things versus what their single capability is, because again, that's when you're going to start getting more value of the swarm.
- [13:05]
Narrator
But increasing drone numbers doesn't only multiply impact, it multiplies complexity. And managing that complexity is part of the challenge.
- [13:15]
James Remmer
When you scale up and do bigger tests, you need a lot more personnel out of the field. You need to have more of a plan if something goes wrong. It can take more time if you were to troubleshoot across a lot of platforms rather than just a single platform. One of the challenges when you're starting to build out your swarm, you need to figure out what kind of comms you want between the drones and also how the drones are communicating, if they're going to communicate in between each drone or if they're going to talk back to a base station. Or another option would be if you had like a mothership drone that's also flying in the swarm. So that drone could be above or below the rest of your drones and be talking to those drones with different comm links.
- [13:53]
Narrator
At this scale, failure isn't surprising. It's part of the equation. The real question is whether a system and the team behind it can absorb that failure and keep moving. That's where the autonomous sensing program at Lawrence Livermore thrives.
- [14:10]
Brian Weil
We are a very vertically integrated team that has all the different types of science and engineering skill sets that allows us to put a system together from end to end.
- [14:17]
Narrator
They act as a single coordinated team.
- [14:20]
Podcast Host
And they move at a pace few can match.
- [14:23]
Brian Weil
We have people with skill sets that pretty much can do everything we need. And if we identify new ones as new projects or new things change, we try to find people to fill those out. And then we also are pretty unique in the lab and what we have from a physical resource. So our building pretty much has everything we need in it, including a machine shop so that we actually cut metal and build things in our own building. We don't farm it out to other parts of the lab. And we don't farm it out outside the lab unless we need to.
- [14:48]
Narrator
That allows them to test early and break things intentionally.
- [14:53]
Brian Weil
We can design it, we build it, we go out, we test it, we break it somewhat intentionally, right? And then we come back and we do that all again. And the goal is do that as many times as you can, as fast as you can to start answering those unknowns. You're always trying to critique your process and improve it is huge in driving forward very fast because you're always going to be improving yourself.
- [15:12]
Narrator
As technology continues to advance, drones may not just follow instructions. They could collaborate, adapt and make decisions together. They could share information instantly respond to unexpected dangers, and cover vast landscapes with precision. In moments like floods, fires or conflict. Resilience keeps a mission alive. When conditions collapse, we take on things.
- [15:39]
Brian Weil
That are inherently risky. We're really trying to take things that a lot of times we're like, we don't know if we can do this or we don't know if we can do this with the constraints we have, but let's start trying to do it as fast as we can.
- [15:48]
Narrator
This is what it takes to build drones that can sense, adapt and operate together under real conditions at scale in only a few months. So when a mission spans land, air and sea, when environments are unstable, and when people can't safely go first, these drones are ready to.
- [16:24]
Podcast Host
Looking for a career that challenges and inspires, Lawrence Livermore National Laboratory is hiring for a safety basis, analyst, research scientist, cell biology, and an electrical designer, along with many other roles in science, technology, engineering and beyond. At the lab, every role contributes to groundbreaking projects in national security, advanced computing, and scientific research, all within a collaborative, mission driven environment. Discover Open positions@llnl.gov careers where big ideas come to life. Thank you for tuning in to Big Ideas Lab. If you loved what you heard, please.
- [17:14]
Narrator
Let us know by leaving a rating and review.
- [17:17]
Podcast Host
And if you haven't already, don't forget.
- [17:19]
Narrator
To hit the Follow or Subscribe button.
- [17:21]
Podcast Host
In your podcast app to keep up.
- [17:23]
Narrator
With our latest episode. Thanks for listening.