← NVIDIA AI Podcast
NVIDIA AI Podcast
Safer, Faster Public Transportation: AC Transit’s AI-Powered Upgrade with Hayden AI - Ep. 290
00:29:25
Loading summary
Transcript68 lines
- [00:00]
A
Foreign.
- [00:11]
B
Welcome to the Nvidia AI Podcast. I'm Noah Kravitz. Join us at the world's premier AI conference. GTC San Jose is online and in person March 16th through the 19th. From physical AI and AI factories to agentic AI and inference, GTC 2026 will showcase the breakthrough shaping every industry. Learn more and Register now@Nvidia.com GTC today we're diving into the future of public transit safety and efficiency. I'm excited to be joined by two guests who are at the forefront of this transformation. Asan Begs, CTO of AC Transit, the third largest bus operator in California and main bus operator for the East Bay region of the San Francisco Bay Area. Shut out Alameda county. And Marty Beard, CEO of Hayden AI, a San Francisco based company that's using technology to make roads safer and public transit better. Hassan Marty, thank you both so much for taking the time to join the AI Podcast.
- [01:10]
C
Welcome. Thank you.
- [01:11]
A
Thanks for the opportunity.
- [01:12]
B
So maybe we can start with a little bit about what AC Transit does and then we'll get to what Hayden does. And Hasan, you can speak just a little bit about your role as cto. And then as we go, we'll get into the collaboration that brought you guys together and brought us here today.
- [01:27]
A
Thank you.
- [01:27]
C
Yeah, sure.
- [01:27]
A
Thank you so much, Noah. Thanks for the opportunity. Hasan Bey Chief Technology Officer Alameda Contra Costa Counties Transit so a lot of time people think AC is only Alameda. So we do serve in Alameda and Contra Costa County. So basically we are a two county public transit system. I just want to clarify also we are a bus only, as you mentioned, Nohavi, the third largest in the state and we are the largest bus only in the in the Northern California region. Our pre Covid daily ridership was about 200,000 people. So roughly about, you know, when you look into on an annual basis, you're talking about 55 to 57 million riders on an annual basis. I mean that's a fairly significant mobility domain area if you want to look from that perspective. Our mission at AC Transit is safe, secure, reliable in sustainable public transit. AC Transit is really kind of a unique that our board is an elected board. It's different from many other public transit agencies. There are only possibly, I think three public transit agencies in the country. They have elected boards.
- [02:41]
B
Oh, is that right?
- [02:42]
A
What it really means, Noah, is that it basically these the board members, elected board members are sort of really the people who are passionate about public transit and about mobility services. So I'm really, you know, proud of part of the team. I've been here for almost eight years managing the technology programs, innovation program, and, you know, love my job and really I'm passionate about providing those services to my customers in the East Bay.
- [03:09]
B
Well, as one of your East Bay customers, we appreciate you helping us get around safely and quickly. Marty, tell us a little bit about Hayden.
- [03:17]
C
Sure. Yeah. It's great to be on. So Hayden is a transit, a company that's focused heavily on AI technology to try to improve transit. So our, you know, our mission every day is really bringing together all the technology required to work with folks like Hasan and really try to improve public transit. And by that we mean, you know, trying to help buses move faster, trying to reduce collisions, trying to make it a lot more safe for people that need help getting on the bus, et cetera. So we're a San Francisco based AI company. We're experts in AI, but really we're experts in transit and the system of technology that you need to bring together to help do some of the things that I'm sure we'll get into.
- [04:01]
B
How long has Hayden AI been around?
- [04:03]
C
Company was formed in 2019.
- [04:06]
B
Okay. A lifetime in the current AI industry.
- [04:09]
C
Yeah, that is right, exactly. And you know, at this point, we're on over 2,100 vehicles nationally and working in 10 major cities across. Across the country. And we're also expanding internationally as well. So.
- [04:24]
B
Excellent.
- [04:25]
C
We've been doing this for a while.
- [04:27]
B
So how did Hidden AI and AC Transit come together? Did it start from a problem AC Transit needed to solve? What was the genesis of the collaboration?
- [04:37]
A
Yeah, I guess I can jump in, Noah. So as a part of my job is always looking for innovative solutions and technology that can solve some of our business problems, bring efficiency, improve safety, improve reliability. And I'm of course, as a technologist, I'm a firm believer that if you have the right technology and you're attacking on the right business problem, you can make it happen. You know, we always hear and talk about people process technology. Technology is part of the. Part of the. Of course, this whole solution. So, yeah, we have been looking into redeployed our dedicated bus lane system, which we call BRT Bus Rapid Transit connecting Oakland to San Leandro. So there's a dedicated bus lane. One of the challenges we had is that we had always illegally parked cars in those dedicated lanes. And we have been using legacy technology where it was requiring our operators to press a button to take the picture of illegally parked car in a dedicated bus lane and their whole manual process downloaded. Downloading the video Taking it to the sheriff's office. Sheriff is reviewing the video and typically it really was creating sort of a stress for our operators because our success rate was less than 5%. So you're capturing all these videos and images, but your success from the citation perspective was less than 5%. So that was a major business problem. Losing the effectiveness. We had the legislation. So we work with many different transit partners and we went to the legislative in the state and basically we work with our partners in crafting the new legislation, which is AB917 that authorizes us to use the automation automated lane enforcement technology. And one of the interesting things we did was not only we enabled this legislation to deploy this automation technology, leveraging AI not only for the dedicated bus lane, but also the bus stops. So that's where I was looking for a solution I found about Hayden. I say this is exactly what I'm looking for. So how can we work together? And we started the whole journey starting with five buses and a pilot. And during the whole process we found they are the best partner and the solution provider at the time. So we decided to move forward. And then we went to the board and got all the approvals. And now we have been working for almost more than two years now.
- [07:14]
B
Okay, and so when you first started working together, was the idea originally to use camera based systems and. Well, I'll stop there. Was that the original idea?
- [07:24]
A
That is true.
- [07:25]
B
Okay, and then when you first started deploying them, what were some of the early challenges? This is I guess a couple of years ago now. But what were some of the early challenges you had to get past putting the camera based systems on public transit vehicles?
- [07:39]
A
I think the major challenge was of course making sure that it does the job with accuracy. Accuracy requirement was more than 90%. I was not getting the same accuracy with my legacy system. So that's number one. Our success rate was far less, as I said, less than 5%. So we were looking into image quality, lighting conditions, angle, I mean the typical things you look for when you're looking for the lane enforcement and camera technology and computer vision and leveraging the AI and the entire end to end from the time to capture illegally parked car from at the dedicated lane to the bus stop or the bus stop at the end. The sheriff reviewing, sheriff's office reviewing the citation and issuing the citation. We were looking for the entire process to be automated, not manual. And of course improving some of those key performance indicators. You know what I mentioned. And the other thing we were looking into is the privacy. We wanted to make sure. That the privacy is part of the whole design. So we are not capturing information just arbitrarily and keeping it that of course we went through the whole privacy design criteria, making sure that no data stays on our system or our edge, which is inside the buses. So yeah, so those are some of the key, I guess, success factors. We defined node during the initial launch and of course it's not only just the technology, it's of course, maintenance, operations, educating our operators, sharing with our riders what we're trying to do, showing the benefits. So it was a pretty good, pretty good, you know, whole process that took some time.
- [09:18]
B
But before we dig further into the process, Marty, can you talk a little bit about how this system works?
- [09:23]
C
Yeah, sure, Yeah. I mean it's composed of hardware, software and let's call it implementation services. So at super high level, the hardware cameras and as Asan mentioned, the camera go on the inside of the bus. So it's literally on the inside looking through the windshield out into the right into the bus lane of the bus stop area, the curb. And so those cameras are optimized exactly for the use case that he just described.
- [09:50]
A
Right.
- [09:50]
C
That then feeds into a. Think of it as a control box that is not that big, that's inside the bus. That's where the magic happens. That's where the AI algorithms and obviously it's all running on Nvidia and we're huge, huge fans of Nvidia and leverage Nvidia's Edge products a lot.
- [10:11]
B
Appreciate it.
- [10:12]
C
But anyway, you've got this control, that's where the AI is running and that's looking for the violation. Right. That's optimized for that.
- [10:22]
B
And that's Asan mentioned, that's running. It's an Edge based system.
- [10:25]
C
It's all edge. It's literally mobile. Right. It's inside the bus, the bus is moving, the camera's looking, it sees a car that's blocking a bus lane or maybe blocking a bus stop that is captured. So that image is captured and quote processed. And by that it means the algorithm says, is that a car where it shouldn't be? Has it been there longer than it should be? Now I need to package that video and package that information and send that to the right place to actually be reviewed and ultimately an enforcement sent out. So that's really, the fancy term is called sensor fusion, which is really computer vision that's just looking for objects, but also location. So you need to be very, very clear about where a car is when it's there. And you need to be very precise. I mean this is obviously we're trying to change behavior, which is ideally, we don't see any cars. Right. In the bus lane. Right. So it's got to be precise, it's got to be accurate. But those are the parts, it's the hardware, the cameras, it's the control box. The AI apps is a way to think about it and then packaging all that in a way that's very private, very secure, and then sending it out to be processed.
- [11:34]
B
Right. And at the end of the, the workflow when it's processed, is it like, does it go as far as deciding whether or not to issue a citation and then issuing the citation automatically?
- [11:46]
C
Yeah, we, and then Hasan can take this as well. But we, we package what we believe is a, is a violation. Right. Based on all the evidence and everything that we've pulled together. But that then does get sent for kind of ultimate review by somebody to say, yeah we, we agree. And now a citation could be sent out.
- [12:05]
B
Got it.
- [12:06]
C
But we're not, we're only sending out what we believe to be highly accurate. Of course, captured enforcement. Yeah.
- [12:12]
B
Hasan, you mentioned a moment ago talking about educating, educating the public, educating everybody on the use of these systems. How has that been going? How have the drivers and the operators responded? How's the public responded so far to deploying these automated systems?
- [12:29]
A
I mean, from the operator's perspective, Noah, of course it's a big blessing that they don't keep pressing the button. And I mean one of the things we always try to do is, as I mentioned, safety is the core principle we follow and we adopt and we promote for our riders and for our operators, for our employees. So for operators to continuously monitoring whenever they're driving, but also paying attention to these illegally parked cars and making sure when to press the button and when not to press the button. What are the lighting conditions and things like those, some of those details. Now this whole implementation has taken that whole responsibility away because everything is now pretty much automatic.
- [13:14]
B
Yeah.
- [13:14]
A
So operators feedback has been very positive. They like it now. I think the one thing which you know is very important from the writer's perspective is we are seeing improvement in the on time performance. We are seeing, you know, we are still collecting the data and we're still going through the whole, you know, sort of this hundred bus pilot project. So we still need to develop a lot of KPIs and working with Hayden very closely. But we are already seeing significant improvement, you know, from the like, you know, first time offender. We are seeing reduction 70%. So we're not seeing those, you know, know, keep repeating. We are seeing improvements in the, even the on time performance. We are seeing the improvement in the accessibility where an illegally parked car at the bus stop was blocking our bus to park and enabling our, you know, accessible needs rider to get on the bus. So a lot of those metrics and KPIs, you know, we are, we are in the process of mining a lot of this data, comparing with our historical data, what was those, some of those challenges and even seeing the accuracy, you know, from our sheriff's office perspective because of this whole automation what Marty was talking about, we are seeing an uptick in the improvement on the accuracy of the information. So I think altogether it's going into the right direction.
- [14:35]
B
That's great. Being a public agency, as you mentioned at the beginning, the work that you do is subject to obviously following legislation, new legislation being passed, board approval, all of that. What do you think's important for the general public, the riders of the transit system, but also the policymakers who set get these laws and rules to follow. What's important for them to understand about using this kind of technology the way you are?
- [15:00]
C
Yeah, I can dive in. Well, please.
- [15:01]
B
Yeah.
- [15:02]
C
Most importantly, and given how much experience we have, it works, right? So the focus is on improving the transit rider experience. At the end of the day, that's the customer. Right. And we see that. So if you have, if buses are moving faster through a network that has a huge impact on people's lives, right. Just in terms of on time arrival, in terms of getting from point A to point B faster, et cetera, and then you get reduced collisions and you're increasing access and safety. So all those metrics that Asan mentioned, we track those religiously and it works. That's what motivates us. Right? It works. I think the second thing is when you talk about AI and cameras, I mean people immediately just back up and go, okay, that's, that's creepy. And it's kind of like, okay, yeah, just step back for a second. This is not looking at people. There are no people identified. Right. This is only looking at vehicles and only vehicles that are where they shouldn't be. Right. And at the end of the day, and so I think we have to educate sometimes. Like, look, even if somebody asked me for information about identity, I don't have that. We don't keep that nothing stored. It's Hayden doesn't. I don't have that. Right. So all I have is I have the vehicle, I have the enforcement criteria. That was given to us. And so I think that's, we have to educate on that. Just given and I understand, right. I mean I get it, it's an emotional issue around privacy and so forth.
- [16:28]
B
Yeah, it's complex, sure.
- [16:29]
C
Yeah, it's complex and it should be and we should think deeply about it. But I think in this case it's very use case specific what we're talking about and it works. Right?
- [16:40]
A
So yeah, I mean I think, yeah, that's our responsibility. But you know, whenever we are adopting new technology or new tool, you know, we need to make sure as a public entity, public organization that you know, we, we have ample education, you know, knowledge sharing, information sharing and we do this through of course our legislative process. So you know, when we decided to move forward after the whole, you know, request for information, looking into the entire industry who can provide really those specific elements, what AC Transit was looking for, we checked the market, we published the whole request for information. We got, you know, proposals. As a result of the whole evaluation process we went through, we decided to go move forward with this, you know, this specific technology from Hayden and we took it to the board and we educated them, we presented to them like some of the things Marty was talking about specific to like a privacy and we wanted to make sure that we are in compliance with our local privacy policies and not capturing any information about like you know, faces or users or riders or people. This is all forward facing. This is all about license plate and only under certain conditions, parameters defined by us and even within that specific, like for example buses stop, you know, we implemented these bus stops as almost like a digital twin in the system. So if someone is parking and my bus is approaching, that's like not good for our buses to demonstrate the on time performance. So we capture this information and so and the same thing with the state legislation, you know, if you look into the AB917 that was adopted by the state of California, our Assembly and our Senate and then eventually signed by our governor, it was kind of a fairly rigorous process to demonstrate with the data that you know, how is it going to be helpful? And you know, I'm really proud of our legislative team. They've worked extensively and they're still, you know, asking the information and the data for us to provide because this existing legislation is set to expire in 2027. So we have to continuously demonstrate the value of this technology and provide this information in a very specific form, what they're looking for so that they can educate public and we can educate our lawmakers. Policymakers.
- [19:07]
B
I'm speaking with Asan Beg and Marty Beard. Ahsan is the Chief Technology Officer at AC Transit, California's third largest operator of buses and the largest operator in the East Bay region of the San Francisco Bay area, where I call home. And Marty is CEO of Hayden AI, a San Francisco based technology company that's been working in AI and transit, improving efficiency and safety for public transit systems and riders for the better part of a decade. Now I want to sort of take a step back and look at the broader picture. And Asan, maybe I'll start with you from your perspective as a cto. You know, we talked a little bit about the specific problems that you were looking to solve and how you started working with, with Hayden. How does a project like this fit into your broader purview as CTO of AC Transit and kind of the bigger picture for AC Transit's roadmap, if you will, for digital transformation and embracing technology, Leading edge technology.
- [20:08]
A
Yeah, I mean that's a great question, Noah. So as I mentioned earlier about chief Technology officer and I talk about the elected board, so that's sort of like an advantage I guess we have as a technology practitioners that our board firmly believes in technology as a core integral part of the services delivery what we do. And my general manager, my boss is a firm believer in technology as well. So we always found that they're very, very supportive for these kind of initiatives. So when this whole issue came up about looking into really modern AI centric technology, we went through the whole step by step process which is conducting the whole POC5 buses, demonstrating the value and looking into technology, looking into security, looking into cybersecurity, I mean all multi dimensional evaluation, but more importantly, tying to the business. You know, I don't believe in deploying any technology or a technical solution if it is not solving my business problem. So.
- [21:15]
B
Right.
- [21:15]
A
So I basically partner with my chief operating officer at the time, you know, cio, I mean CTO and CEO coming together and trying to solve this problem with a vendor partner, partner like Hayden. That was really, you know, sort of a success. So yeah, so in broader, I guess, spectrum, we always look for these opportunities where, you know, we can find, you know, cutting edge technology may not be even fully proven, but you know, sometimes you have to take those kind of a risk. So I think we believed in it, we saw that the value and you know, we went through the whole process and really I think it's been working out pretty, pretty good so far.
- [21:52]
B
Marty, from Hayden's perspective, you can comment on the AC transit relationship, specifically, if you like. But also, what else are you seeing? What else are you working on? How do you see AI shaping public transit and transit kind of more broadly?
- [22:08]
C
Yeah, no, huge. Well, I mean, we're able to work with innovative folks like Hasan and his team, and that helps a ton because I like this comment that at the end of the day, I could talk about some ethereal strategy about AI, but it's really just, can we practically apply it to help cities perform better? In this case, we're focused on transit, and so that easily extends into bike lanes. Can you help manage bike lanes and try to get people feeling safer and able to leverage biking? What about parking more generally? What about other assets in a city? So recently we've been working on what's called roadworks identification, where construction zones. Right. Which have a massive impact in a city the size of like an Oakland or like a New York or something, where, you know, it just has a huge impact on people getting from point A to point B, for sure. And these cameras identify accurately a construction zone. Is it permitted? Did they get the permit? Not the permit. So these type things are starting to kind of logically come up because we sort of have this mobile AI going through an urban environment and capturing more and more information. Right. So it's very logical extensions of what we do. We talk a lot here about practical AI. Practical AI. I hear people come up with expressions like cognitive cities and things like, it's like, I don't know what that means. Right. But I do know that we can help manage assets. We can help transit, we can help buses, we can help bikes, we can help parking vehicles, et cetera. So that's when I look out. It's kind of like practically extending where it makes sense and adds value ultimately for the city managers.
- [23:50]
B
If we could collab and rig up some kind of a pothole filler that we could attach to the back of the AC buses that go a long way in my neighborhood right now, but that's a separate conversation.
- [23:59]
C
As a cyclist, I would definitely agree with that.
- [24:01]
B
Yeah, right, right. Hasan, public agencies, transit agencies often operate under, you know, just more restrictions, more constrictions than, say, a startup or a privately funded agency might. You have budget, procurement, policy constraints and boards to deal with. And as you said, it's an advantage, but also things that you have to cope with. What advice would you give to other public agencies, your counterpart CTO at a public agency somewhere else, considering tech initiatives like this?
- [24:32]
A
Yeah, I think definitely there's a. That's a Challenge, you're right, working in the public sector, but I think I found that public transit is really at the crossroads where we have the big responsibility to provide the mobility services. And technology is playing a very critical role in providing those mobility services. Whether you're talking about a long stretch, you're talking about the middle mile, or even if you're talking about the last mile, my advice is to really always focus on the business problem. What is the challenge, what is the issue? What is the core mission? I'm trying to continue making it happen with the technology and with the technical solution. I guess I'm lucky that I'm in the Valley, in Silicon Valley and I find companies like Hayden startups and I think I have, as I said, you know, I'm lucky that I have this wonderful board and great executive team that they believe in technology and they believe in trials and POCs and pilots to really fail fast, solidify strategy that you need to try and you need to see what is going to stick and what is going to work under certain criteria. So I've been lucky. I think there are lots of opportunities, there are lots of national organizations and public transit is kind of a really, you know, very well connected community. And one good thing about public transit and public sector is nothing proprietary, nothing, you know, intellectual property that I'm holding. So if I have success, if I have good methodology, good finding and the way to make it happen, you know, we all share. So I think just be bold, just to try out, you know, and really shoulder to shoulder with the business. I think that to me is the most important thing.
- [26:25]
B
Marty learnings from Hayden's side, either that could be applied to, you know, someone in a public agency somewhere else or to other, you know, practitioners using AI to try to solve transit problems.
- [26:38]
C
I mean, yeah, I think Assad said it really well, which is, what's the business? What's the problem? Right? What is the business problem you're trying to solve? I mean, coolest thing about public transit is and we're talking about thousands and thousands and thousands of vehicles providing millions and millions and millions of trips, right? It has a massive impact on our country and our states and our cities. So I love being in the middle of like, okay, what's the biggest challenge that we're facing here? And how can technology, whether it's AI or machine learning or whatever you want to call it, how can it help? And the cool part is it can, right? So I think it's fun to go out and kind of quote, sell the vision because, you know, it can work. So you kind of come in with confidence and you're sort of like, let me show you some data and let me show you some real activity. So I think versus being in a lab and working on AI, just kind of ethereally and sort of thinking through it. It's fun to be out in a physical space like a bus or kind of like, okay, what can we do here to try to add value for sure. So it's got some great positive attributes. It's a fantastic place where new tech like AI is kind of meeting reality.
- [27:45]
B
Right.
- [27:46]
C
And actually figuring out how to help. That's what I love about it.
- [27:49]
B
Awesome. For listeners who would like to learn more about the specific collaboration, about other work, AC Transit, hidden AI are up to websites, social media accounts. Where would you direct listeners to go? Asan, I'll start with you.
- [28:04]
A
Actransit.org, that's the best place, best location to find all the information about AC Transit.
- [28:09]
B
Easy enough.
- [28:09]
C
And Marty, yeah, I think we have a very active LinkedIn site, but also obviously our website at Hayden AI.
- [28:17]
B
Excellent. Hasan. Marty, guys, thank you so much. As the host of the show, obviously, but as a resident, a constituent, appreciate the work you guys are doing to help all of us get around faster, more efficiently, more safely. Best of luck with all of it.
- [28:32]
A
Thank you so much.
- [28:33]
C
Great. Thank you.