Loading summary
Ricky Enger
When you're using technology to get things done, it can be hard to know which tool to pull out of the toolbox. In this episode, Steve Kelly and Eric Boklage join us to share tips on choosing the right tool for the task. I'm Ricky Enger and this is Hadley Presents. Welcome to the show.
Steve Kelly
Hey, Ricky.
Eric Boklage
Hi, Ricky. Hi, Steve. How are you?
Ricky Enger
It is wonderful to have you both back in the same virtual room. We did a podcast a bit ago and talked about kind those new services or vision professionals, things that you should know about if you are new to vision loss. And wow, did we ever cover a lot in that. It's certainly worth going back to listen to. And this time I'm happy to have you both back to talk about technology. It's a place that we all sort of love to be and could talk about it for hours. So we're really going to have to struggle with not to do that. But before we get into that, let's just get a brief intro from each of you. So, Steve, we'll start with you.
Steve Kelly
Thanks. I'm one of the practical help specialists here at Hadley and I do several discussion groups.
Ricky Enger
And Eric, your intro is going to be a little different this time than it was in your previous podcast. Some things have changed for you. So at that time you were on the way to becoming a vision loss professional. But perhaps I shouldn't steal your thunder. Go ahead, Eric.
Eric Boklage
Thank you, Ricky, for those kind words. So, yes, a lot has changed. I've recently acquired both my CVRT Certified Vision Rehab Therapist and catis, which is certified Assistive Technology Instructional Specialist certifications. I now work here at Second Sense, which is a vision rehab agency here in Metro Chicago. And I get to spend my day helping people learn how to use the technology that helps them thrive in their normal daily lives.
Ricky Enger
It is. So as we were talking about putting this podcast together, we were kind of going through the tools that either we use personally or that come up as we're talking to others, because I think we're all in that unique position of both being on both sides of the desk, so to speak. So we all work with people who have vision loss and we are low vision or blind ourselves. And so we wanted to go through a lot of these tools that we either use ourselves or tell people about, often both, and figure out which one to use at any given time. But I think what helps to get that conversation started is to actually give a brief description of what each of these tools actually is. So now we get to practice our elevator pitch and See just how concise and accurate we can be as we describe each of these things. So, Steve, you get to start us off. Seeing AI is our first tool in the toolbox. What is that?
Steve Kelly
Seeing AI is an app that's made by Microsoft. It's available for both Android and the iPhone or iPad. And basically it will read what it sees. Not only does it read, but sometimes it will read labels and it does some object identification based on artificial intelligence AI. And that's what it does. It's super handy.
Ricky Enger
And, Eric, you have a tool, and that is Be My Eyes. Off you go.
Eric Boklage
Thank you. Yes, Be My Eyes is also an app that's available on both the Android and Apple platforms. What uses the camera on the phone to allow you to interact with what's around you? Initially it was how do I call somebody for help? Since then, they've also added an AI function to it.
Ricky Enger
Yes, for sure. And we actually have a podcast on Be My Eyes, and we have workshops, so teaching you how to use Seeing AI. So we've got those resources for you. And next up is my tool to talk about that is aira. So Aira is also an option that can use your camera, and it works a little similarly to Be My Eyes in that you are borrowing someone's eyes. But the difference is that these are trained professionals, as opposed to volunteers who might be answering your call on a lunch break. So these trained professionals are able to assist you in perhaps navigation or anything that you can think of. It also does have an AI component to describe images that you send to it. The human portion of AIRA is a paid version and the AI version is free. All right, and our next tool is Meta Glasses. And my goodness, do we ever get a lot of calls about this. And Steve, I'm going to throw this to you first because you've fairly recently gotten a pair of these. And so you get to speak from the newbie perspective. What are these and what do they do?
Steve Kelly
Yeah, essentially they're ray Ban glasses, and you can have your prescription lenses put in, or in my case, it's a nice pair of sunglasses and they have a camera on the right hand side of it. They've got some great speakers inside of it. They were designed by Meta or Facebook for users to take pictures of what is going on around them, to put on Facebook and to listen to various things. They weren't really designed for folks with a vision loss, although we of course discovered them and said, hey, the artificial intelligence on these can do things like describe a scene in front of US so they can be really handy in that regard. And in terms of price, they're far less expensive than some of the other smart glasses that we've used.
Ricky Enger
Right. And in addition to those features, I appreciate the fact that they are open ear so you can listen to whatever it is that you're listening to, whether it is navigation instructions or just music. As you're strolling along, you can still hear what's going on in your environment. I also appreciate that you can access both Be My Eyes and, and AIRA from these glasses. So it gives you a hands free option to take advantage of those services as well. Eric, is there anything that we didn't cover about Meta glasses? I know you're, you're fairly new to that as well, but maybe you've had a client or two mention something they really appreciate about them.
Eric Boklage
I think you, you hit on it when you said hands free. The other three tools we've talked about are ones that are primarily done through a cell phone. And the fact that you can take the MetaGL and utilize either Be My Eyes or AIRA through the lens, if you will, that's in the camera of the glasses. Instead of having to hold your phone, that sort of hands free activity really helps. So if you're trying to examine something, you don't have to both hold the phone and hold whatever it is you're trying to examine all at the same time. So it almost acts like, if you will, a multiplier effect or the Be My Eyes and the AIRA apps.
Ricky Enger
Before we go into specific things, I'm wondering if there's like a general rule of thumb that you tell people and believe me, I'm listening carefully because I want to know this. How do people think in general about which tool to choose? Are there criteria that you can mention that might help in that decision making process?
Eric Boklage
So I think one of the key things is that it's user dependent. So each person's vision loss is their own and how they need supports and assistance is different from the next person. And that's not just a function of do they still have residual vision or not, but all sorts of varieties in that. Right. So what I recommend to my clients is that they use each of these in different environments so that they can see how well they work for them them and then use that experience of their own to help define which tool they're going to use in what scenario. Because sometimes people find one interface easier to work than the other one, or they may find that their day to day usage needs require something different from the other one. So I have them explore each of these when they can and make a decision from there.
Ricky Enger
I really like how you put that because we all have these wonderful conversations with those of you listening, and it tends to go something like what is the best? And then followed by whatever question it is. And when the question comes up that way, it implies that there is one right answer and there really isn't. There's one right answer for you. And so that's why I think it's helpful to explore this, both figuring out what these tools are and then doing exactly what Eric said, trying them in your own environment and seeing what you prefer. So now we are at the point where I've just put together a list of things that we all do every day and I want to talk about where these tools might fit with each of those scenarios. So here is one of my least favorite jobs. Sorting the mail. And just a brief tip from each of you, which tool might you use for this and kind of give why you chose that?
Steve Kelly
My go to is a 5x Bausch and loam slide magnifier that's about the size of a silver dollar. I do not leave the house without it or even it's always with me because I use it for everything. That said, however, there are a lot of times when I pick up a piece of mail and it just doesn't do the trick. So the next thing is I take the Android phone and I'll just open the camera and just pinch it and make it a little bit larger and read it that way. The last thing I'll do is I'll go to like Seeing AI or Google Lookout and have it read it to me.
Ricky Enger
Eric, what about you?
Eric Boklage
I really like being able to use the Seeing AI read function, so it would just read any kind of print that was in a short, concise form.
Ricky Enger
And that is my answer as well. As someone who has no residual vision, I'm going to reach for Seeing AI every time because it does exactly what I want it to do, which is read the text precisely as it appears on that envelope. Now, if I'm in a hurry, I might say to the meta glasses, you know, hey, meta, read what's in front of me and it will give a summary as opposed to reading that precise bit of text. And the same thing is true for Be My Eyes. So seeing AI wins this one for me.
Eric Boklage
The thing that I would throw out there though, is it will also read script. So I know this is spring as opposed to the holiday season, but if it's holiday season and people are getting in holiday cards as an example, or things of that nature that have handwritten or hand addressed, if the writing's neat enough, it can actually be identified by seeing AI.
Ricky Enger
And even if it's not, my mom has notoriously bad handwriting. And Seeing AI still gets it. So our next little scenario is reading an important document. So maybe I have to sign to get that Publisher's Clearinghouse or whatever other scam, or it could be something legitimately important. What are we going to use to read that important document? Does your answer change from just sorting the mail?
Eric Boklage
Well, I will start off by saying that I think Seeing AI is actually the tool to do that because it's got an OCR optical character recognition component that's built right into it. And it will also help guide you to the point of you hold the camera or the phone over the document, and it'll guide you how far up you need to go in order to get all four corners in the picture and which way you might need to shift your ants. And then once you've got the full document, it's right there for you to be able to read it. And that includes multiple pages, too.
Ricky Enger
And you can save it as well, which is really nice.
Eric Boklage
Exactly. So it guides you through the process and it facilitates you being able to get the entire thing in very good precision. Because if it can only see the left half of the page, it's only going to read the left half of the page. So it wants to guide you to where you get all four corners first.
Ricky Enger
That's right. So, Steve, what about you? Are you still going to be using your little handheld or are you going to use something else to read a larger page?
Steve Kelly
So what I'll do is I'll pull out the Bausch and loam, I'll look at it, first word, second word, then I'll move over to different lighting and try to get the third word. And then finally, I'll do exactly what Eric suggests. We'll pull out the seeing AI. But I got to go through the other steps first just to prove to myself that I really can't read this.
Ricky Enger
And that's going to be a very relatable statement. Statement to many, many people, I think. Okay, so how about you drop something? Now, there are techniques that you can use, and in fact, we have a workshop on how to find things that you've dropped. But let's say you've tried those things. You know, you've kind of gotten down on the floor right in Place and you're using that grid pattern to find what it is and it bounced somewhere. What tool are you going to use? And I guess I should say, what tech tool are you going to use to find that thing?
Steve Kelly
You know, I do use the grid pattern and I think at this point I'm accustomed to it, so I'll systematically look in place. The reality is, if it gets to the point, I will ask a human being. That said, however, I have used on occasion Be My Eyes and found that that was super helpful and I'll probably use it a little bit more in the future just because it's really good at that, having somebody look through the camera and just give you some cardinal directions.
Ricky Enger
And that is my answer as well, is getting a human involved. And Be My Eyes is the perfect way to do that. It's free. And I think speaking for myself anyway, and perhaps you as well, it can feel a little awkward, like I don't want to bother someone to help me find this thing. I'm the one who lost it, I should figure it out or whatever it is. And what I will say is, having spoken to a number of volunteers for Be My Eyes, they've put the app on the phone knowing that two things. One, I can answer that call when I have time and I don't have to, I'm not obligated to. And two, the other thing they know is this is really going to help someone when I do pick up that phone and do this brief little thing. And it makes me feel good too. So it is. For those people who have volunteered, it's not out of a sense of obligation. They genuinely want to help. And it can sometimes be just that quick 30 second call. Oh, here's the earring, you know, now we move on with our day. It's efficiency and everyone feels good at the end of it.
Eric Boklage
You know, hearing you both talk, you're talking about using the calling a volunteer, or in the case of aira, calling one of their representatives so that the human being is using the camera on the phone. But I've also known that on seeing AI, for example, there is a Find My Things channel. And that Find My Things channel can be programmed to look for something that you find really important. Like if you've got a small pocketbook that holds all of your credit cards and your main information, you can train it to know to look for just that thing so that you can then use the camera to point it around, pan around the room, you know it's in that room somewhere and it will look for that item too.
Ricky Enger
Yes. You can train that to look for it. And it's a wonderful feature.
Steve Kelly
You know what's so interesting about this question, and maybe this is just for me too, but I think that for those of us who are in relationships or families and stuff, where you have people who have, you know, better vision, it can be really challenging, you know, as you as a person asking that family member repeatedly to find something or to assist or something like that. And it can get wearing on them as well.
Ricky Enger
Yeah. And we're all works in progress when it comes to that kind of thing.
Steve Kelly
And say that again.
Ricky Enger
But I do think it helps to have these discussions, not only just to bring that out into the open, that maybe it is wearing on the people around you if you do it too often, and then acknowledging, well, if that's the case, what other options do I have? And so that's why we want to explore these things. So here's another one that is something I struggle with and this is probably one that I will ask family members more often than anything else. What is this mystery box in the pantry or you know, the mystery bottle in the fridge? Is there a good way that the two of you have for doing this using maybe one of these tech tools?
Eric Boklage
I do, and it's actually a two part answer. So a lot of those products have either barcodes or QR codes on them that you can use the product identifier in seeing AI to be able to see. And if it will read that, then it works for you. And if it can't read it, it'll tell you that it can't read it. Well, at that point you can just switch channels and use the read function and it will read whatever is on that particular container or box.
Ricky Enger
That's right. And seeing AI wins again. Because this is what I do when I feel like I have a little more than 10 seconds. Because sometimes it is a challenge to find that barcode or, or to read the text on that round can. And this again goes back to efficiency. Do you opt for the I'm going to do this with AI or optical character recognition or what have you, or do I involve a human? Now the one thing that I do is meta glasses and this is something they're surprisingly good at for a tool that was not built for this purpose. It will use a combination of looking, maybe it glimpses a part of the logo and it glimpses a bit of the text and it will put that together to make a pretty good guess of what this product is that you're holding. So that would be just saying, hey, meta, what's in front of me or what product am I holding? And the fact that it's hands free makes that a really nice option as well.
Steve Kelly
You know, over the years, I've used a number of different code readers, and like you, Ricky, I think I found them challenging in the sense that you either have to spin it around a couple of times, you've got to be able to see, at least have a general idea where the code is, and they've gotten much faster again to repeat. The usefulness of that has been particularly good with that. And like Eric was saying, just with the read function, you know, you catch a couple words and boom, you know, it's a. It's a can of soup and it's tomato soup.
Ricky Enger
So once you have figured out what this product is, now you got to figure out how to use it. So, product directions. And I'll take this one first. This one is definitely one where I want a human. Because while seeing AI can be used theoretically anyway, read the product directions, if you have scanned that code, it has a more info area. And assuming that the manufacturer has included this information, you can read the product directions right there. But if that's not available, I would much rather have the assistance of a human through be my eyes or Aira telling me, number one, this is where the directions are. Sometimes they're on the side, sometimes they're on the back, sometimes it's on the front. And also they can be written in columns or there's additional text that you pick up as you're trying to read the directions. And for efficiency's sake, or I'm really hungry, I want to cook this thing. Now I'm going to enlist the assistance of a human. How about the two of you?
Steve Kelly
You know, Ricky, that's so interesting because you bring up a really good point, especially with the column stuff. So, for example, when I'm looking at a product, I can generally get an idea of where I'm going to find either the cooking instructions or the ingredients, you know, and of course, what I'm looking for is the cooking instructions. Basically, once I've gotten that, it used to be that I would just use the camera to enlarge it, but that was so slow. And that this is where seeing AI comes in. And Google look out for me because I'm an Android user, but I've been using that primarily for product instructions for quite some time because, you know, you snap a picture and it begins reading it back to you and there are Times when it's like, oh, gee, I did get the instruction, I did get the ingredients instead of the instructions, or vice versa. So, yeah, you know, moving forward, it might be helpful to use something like be my eyes as a first step.
Eric Boklage
I would tend to piggyback on your point about the way that the materials are printed on the packaging is going to affect what you end up hearing being read to you. I've seen a couple of scenarios and columns as one example, but let's face it, the packaging is designed by people in marketing. They're trying to get your attention, right? So certain words are going to be in larger font than in others. And when you're trying to read a specific set of instructional kind of pieces of information. And a lot of times these days, those instructions will also include, I don't know if this is the right term, pictographs, where they try to convey as much information through a little stencil type of picture. And that can be very difficult and awkward for any tool that's AI driven to be able to pick up and understand. So I tend to agree with you that if it's something you need to follow very specific instructions, you're better off getting some human advice to go along with whatever you might be able to see through the camera view of the AI.
Ricky Enger
Makes a lot of sense. All right, so now we've decided I took too long figuring out how to cook this thing in my pantry. I just want to go out to eat instead. So now there's the issue of reading a menu. And it is worth mentioning that a lot of menus can be viewed online, or you can use apps like uber eats and DoorDash that do delivery as a part of that, they have the menus listed there in their apps, so you can read it in whatever way is comfortable on your phone. But let's say that for whatever reason, you can't do that. You're in a restaurant, there's a printed menu in front of you. What do you do?
Eric Boklage
If they do have residual vision, Then I often would recommend the magnifier app on their phone because of the fact that you can modify the amount of magnification you need. You can turn on the light that's on the back of it as a flashlight. So a lot of restaurants are dimly lit, and you can have the ability to turn that light on to be able to give you additional lighting. And you can also often change the video around. So if you happen to be someone who has to have things in reverse, video, white print on black background, kind of things for your ease of use. You can do those sorts of filters or even color filters using magnifier apps. Barring that, there are backups, but that would be my go to for anyone who has residual vision.
Ricky Enger
So I want to talk a little bit about shopping. And for grocery shopping, we do offer a number of tips in our podcast about that, and we'll have that in the show Notes. I'm wondering if you're not using an app like Instacart or Shipt to have those things delivered or to place your order and then get transportation to pick that up. Maybe you're just going in for a couple of things. Is that where you would typically use your magnifier or is there another tool that you think will works? If you kind of have a general idea of, hey, I know where this is, but I just need to make sure I grab the right thing. What are you going to use?
Steve Kelly
You know, generally speaking, I'm grocery shopping with somebody. If I'm not, if I'm just getting dropped off to pick up a few things, I always say, okay, well, you know, give me some extra time. Because it's true it's going to take a little extra time, especially if the store is unfamiliar. But I'm just remembering one time when I was there looking for specific type of cheese for something that we were going to make. And, you know, I was by myself and thank goodness the dental hygienist was walking down the aisle, saw me in the store because I had, you know, both doors open and I've got my face pressed up there, and I'm looking around and she's like, oh, Steve, how are you? What are you looking for? I was like, I'm looking for the sliced cheddar, blah, blah, blah. And she goes, oh, it's right here. And I'm like, bingo. That's what I needed. I'm out of here. But the magnifying glass or stuff like that, even the monocular, it's not really helpful. What's helpful sometimes is, like, when you're trying to compare something, like, let's say you've got a couple of cans of beans or you're checking ingredients. Yeah. Then seeing AI is particularly good. But if the store is unfamiliar, there will be a point when, when I'll, I'll. I'll just need to go up to customer service and probably get, you know, sighted assistance if, if I'm not going with a friend or something like that, just to get me pointed in the right direction. But I think that that can be a really tricky sort of environment without having, like, you know, one of the store assistants help out.
Eric Boklage
So I have a question for you, Steve. When you're doing that and you're using the Seeing AI app as an example, my concern is that it reads everything and everything that's in view of the camera. So trying to isolate it on one particular can or one particular box or something along that line, it also picks up on all the other writing that's around it. Has that gotten in your way when you try to do this? And if so, is there a tool among these that you would prefer to use to get around that?
Steve Kelly
You know, there's probably a better way, particularly in that situation, because you're right, you get an awful lot of extraneous stuff. I mean, you could use the read function, but again, it's going to be really hit or miss, just the way that works. But, you know, it brings up another thing that as folks with a vision impairment, like it or not, I think we have developed patients while gritting our teeth that sometimes these things take a little bit longer. And it does. You just kind of have to quietly wait. And it's like, come on, come on, come on. I need to go. But that's. That's the technology. And like I said, there, you know, there are probably folks who are a little bit more experienced. I've had 20, 25 years to adjust to it. Right. So you would. You would think I'd get. I'd be better at some of these things than I am, but, you know, that's my excuse. It's like, you know, it is. It's a work in progress. There's probably a better way to do it, and I'll meet somebody who tips me off on that. But for now, it's a little bit of a patience thing.
Eric Boklage
And, Ricky, how about the meta glasses? Do those help you to isolate on something in particular versus other extraneous writing that's around it?
Ricky Enger
So here's how the meta glasses help me, and this is what I would use in a scenario like this. I would never go shopping for, say, a full grocery haul, just walking around the store and doing all of that, because it isn't going to be an efficient use of my time. I'll be able to do that better with an app. But if I'm going to pick up a couple of things, I am going to use my metaglasses, and it will either be grabbing that product off the shelf, kind of turning away a little bit and looking down the aisle, but having it in front of me and saying, hey, Meta, what is this? Or what am I holding? Or I'm going to take advantage of that hands free opportunity and again, contact Aira or be my eyes. And for a grocery store trip, I'm probably going to use Aira. And the reason is that these are trained agents who are accustomed to giving very specific navigation directions or being able to assist in directing where the camera should point in order for them to get that right glimpse of the product. Whereas a volunteer may have the best of intentions, but they're not accustomed to describing move the camera slightly upward, you know, move it to the right a little. All they know is, yeah, I can't quite see it and I don't know, maybe bring it closer, that kind of thing. So for efficiency's sake, that's where the Meta glasses are going to play into this for me. But you do have to be mindful that it's going to catch a lot of info. I did have a person who that I was chatting with and he chose his cereal by standing in front of the aisle and he asked Meta, tell me from left to right what the cereal boxes are on the shelf at my eye level. And with that very specific prompting, he got exactly what he was after.
Steve Kelly
Just out of curiosity, do you find that would you choose Aira or be my eyes or something like that over just going through with a shopper's assistant?
Ricky Enger
No, It's a really good question. And it comes down for me to the store assistants are often not there exclusively to assist people who are blind or low vision to get around and shop. They're there to ask, to answer a question or two. And they may also be stocking the shelves or doing any number of other things. And so I genuinely do feel like if I haven't sort of made an arrangement that they're going to help me. I feel like I'm taking time that they haven't budgeted for. Whereas if I'm calling be my eyes or Aira, it is a transaction that both parties know they have entered into willingly. So identifying currency, identifying money is one that I have here. And I'm pretty sure that seeing AI is going to win on this one because it does have a function. Specifically for this. I will say, Meta, glasses can do this at least they've gotten much better at doing this than they once were. So I have just a couple others here and the one I want to touch on, well, two actually describing things. So whether this is a garment or a picture that someone has sent you, whatever it is you need to get information that your vision is just not giving you enough. How are you going to get this object described, whatever it is?
Steve Kelly
Yeah, I'll take it quickly because again, that one's kind of an interesting thing, particularly for those of us with low vision, because for the most part I'm going to use magnification and it could be like the camera on my phone. I might take a picture of an object and enlarge it or something like that. But I also recognize too, at least for me at this stage, sometimes colors are not accurate and so on and so forth. So there are times when. And again, this is when a human comes in handy. I will have to say to the human, so is that yellow or is this what I'm looking at? But for the time being, mostly it's magnification.
Eric Boklage
I think that the AI tool that's in both Seeing AI and Be My Eyes are good. Both of them have issues with color, primarily due to lighting, because depending upon how bright or how dim the lighting is, brown can come across as black, for example, and things of that nature. But if you're looking for a robust description of a scene or a room or even of a person, I have found that the Be My Eyes description tends to be more detailed and more robust than the Seeing AI one. And both of them allow you the option to ask questions, if you will, to follow up. But when it comes to things like identifying a specific color or whether or not things match, the AI can't really help you to the degree that a human being might be able to do so.
Steve Kelly
When you said Be My Eyes, were you talking about the AI version of it?
Eric Boklage
Yes. The Be My AI channel of the Be My Eyes app gives you very robust descriptions of something. If you take a picture of will give you a very detailed description and then you can ask follow up questions of that you can either dictate or type in. And of course, if they're connected to the metaglasses, then you could probably do the same thing just with your vocal descriptions. But I find that their descriptions on the Be My AI channel of the Be My Eyes app to be a bit more robust and detailed than is the Describe option that's available on Seeing AI.
Ricky Enger
Yes, it tends to be a bit more brief with with Seeing AI than it is with Be My AI and what I really There are two things I love about this and the first is kind of going back to that feeling of not wanting to impose on people to get some information. If I want to ask be my AI 68 questions about whatever this thing is that I've got a picture of. I can do that. I can spend as much time as I want, and the AI is not going to get tired of describing it for me. And the other thing I love about this is sometimes you do need that verification. So maybe the AI has described something and maybe it's an outfit that you're trying to match and you think that it matches, but you can't be absolutely certain if the AI has detected the difference between navy blue and black, for example, and whether it's be my AI or even Aira has an AI component. And both of these have the ability to verify with a human. And so you can call that human from right there in the app. It's like, do you want to verify what I just told you? Well, here, connect with someone and you can. So, wow. We've really covered a ton of things, both from a practical perspective and I think just exploring some of those thought processes that we go through when we're trying to figure out which tool to choose. And that really brings us to, you know, is there anything that we haven't covered? Are there things that you would tell someone if they're listening to this and they've never tried any of these, or maybe they've tried one or two and it just hasn't worked out that well, or whatever it is. If someone is feeling overwhelmed by all of these options, what do you do to kind of reduce the stress of finding the right thing? Is there a good place to start or a good way to approach this initially?
Eric Boklage
Well, I'm going to go back to my comment at the very beginning. It's all going to be person dependent. And I really do recommend to people that they try any of these and all of these and get a comparison and a feel for how they might work. And they need to do that at a point in time when they're not under a time crunch or under any kind of stress, just to play with it and figure out which one of these they seem to be more comfortable comfortable with. I mean, pick a can of soup out of your pantry and use two or three different tools to see which one of these gives me what I need to know to be able to make my selections. And then in the future, you know which one you can be more comfortable with.
Ricky Enger
That's a really good point to do this when you're not under a time crunch. If you go into it feeling pressure already, the likelihood that things are going to go downhill is pretty high. Right. So, you know Just have that moment of curiosity and hey, I'm just playing with this. And if it doesn't work today, well, it doesn't matter. There's nothing at stake. Steve, anything to add?
Steve Kelly
Yeah, I was just going to say, Eric, I think you're so right. The whole person dependent thing is really critical because there are a lot of tools out there and we're all different. So you know, these tools are going to work differently for different people. And the thing to do is to figure out, you know, which one works best for you. And you know, the last thing I, I would add is as I was looking over the list and thinking back through, you know, like the, you know, how I've, I've done things in the past, I just realized that there, you know, as somebody who had pretty decent vision for, for quite a while, there's a certain amount of this that really touched my self esteem, you know, so I was really reluctant sometimes to try some of this stuff that, you know, the handheld magnifier or some of the other, even some of the, the smartphone stuff out in public around people at a cash register or whatever. And you know, I, I just realized today it's like, you know, just like that, I'll just say, oh, you know, I don't see, well, can you read that to me? Can you, can you prompt me or you know, give me some guidance or something like that. And that's so dramatically different than what it was like say 15 or 20 years ago. So you know, kind of again, what, what you were both saying, it's like, relax, take a breath and you know, we all do these things in different ways and it's okay, you know, just figure out your, your own way and don't, don't let it steal your self esteem. That's the other important thing.
Ricky Enger
Yeah, so very important because no one wants to stand out. We don't want to look different, different. And at the end of the day, it's figuring out how to do what you need to do efficiently and still be able to figuratively look at yourself in the mirror and be okay with it all. And I think the final thing I would say is that while seeing AI did come out a lot ahead in some of these things, Be My Eyes was a big winner in others and meta glasses made their appearance and magnifiers continued to be here. So the thing I would say to sum up is that there isn't one right magic tool that if you just use this, it kind of solves all of the practical things that you're struggling with. It's good to know about all of them so that you can pick the right one at any given point and.
Eric Boklage
They continue to evolve. These tools and these devices. The AI that's inherent in all of them continues to improve and to to build out. So don't let one experience with it cause you to walk away and not use them again. Be a little bit adventurous and check it out again. If it didn't work well before, that doesn't mean it won't work for you again.
Ricky Enger
Yeah, things are constantly changing. Great point. Well, thank you both so much. This has been such an informative discussion and I've had a wonderful time. I hope you all have as well. If you're listening and you have questions about any or all of these tools, either where to find information about them or how to get started, or you just, you know, want to talk some of it through, we hope that you will contact us here at Hadley and we're happy to help. Thank you all so much for listening. Got something to say? Share your thoughts about this episode of Hadley Presents or make suggestions for future episodes. We'd love to hear from you. Send us an email@podcastadleyhelps.org that's P O D C A S tadleyhelps.org or leave us a message at 847-784-2870. Thanks for listening.
Hadley Presents: A Conversation with the Experts
Episode: Artificial Intelligence (AI) and Vision Loss
Release Date: July 3, 2025
Host: Ricky Enger
Guests: Steve Kelly and Eric Boklage
In the July 3, 2025 episode of Hadley Presents: A Conversation with the Experts, host Ricky Enger delves into the intersection of artificial intelligence (AI) and vision loss. Joining him are Steve Kelly, a Practical Help Specialist at Hadley, and Eric Boklage, a Certified Vision Rehab Therapist and Certified Assistive Technology Instructional Specialist at Second Sense in Metro Chicago. The trio explores various technological tools designed to assist individuals with vision impairment, discussing their functionalities, applications in daily tasks, and personal experiences using them.
Ricky Enger sets the stage by highlighting the challenge of selecting the right technological tool from a myriad of options available to those with vision loss. He emphasizes the dual perspective of the guests, who not only assist others but also personally navigate vision impairment.
Ricky Enger [00:01]:
"When you're using technology to get things done, it can be hard to know which tool to pull out of the toolbox."
The discussion begins with a concise introduction to four key assistive technologies:
Steve Kelly [03:16]:
"Seeing AI is an app that's made by Microsoft. It's available for both Android and the iPhone or iPad. And basically, it will read what it sees... It does some object identification based on artificial intelligence AI."
Seeing AI leverages AI to read text, recognize objects, and identify labels through a smartphone camera, making it a versatile tool for various tasks.
Eric Boklage [03:46]:
"Be My Eyes is also an app that's available on both the Android and Apple platforms. It uses the camera on the phone to allow you to interact with what's around you... they've also added an AI function to it."
Originally designed to connect users with sighted volunteers for assistance, Be My Eyes now incorporates AI functionalities to enhance user support.
Ricky Enger [04:05]:
"Aira is also an option that can use your camera... the human portion of AIRA is a paid version and the AI version is free."
Aira distinguishes itself by providing access to trained professionals for real-time assistance, complementing its AI-driven features with reliable human support.
Steve Kelly [05:34]:
"They're Ray-Ban glasses with a camera and speakers. Designed by Meta for users to take pictures and listen to various things... they can describe a scene in front of you using AI."
Originally not intended for vision-impaired users, Meta Glasses offer hands-free access to Be My Eyes and Aira, allowing for seamless integration of assistance services.
The experts stress that selecting an appropriate tool is highly individualistic, contingent on the specific needs and residual vision capabilities of each user.
Eric Boklage [08:20]:
"One of the key things is that it's user dependent. So each person's vision loss is their own and how they need supports and assistance is different from the next person."
Ricky emphasizes the absence of a one-size-fits-all solution, advocating for personalized experimentation to determine the most effective tool.
Ricky Enger [09:14]:
"There's one right answer for you. So that's why I think it's helpful to explore this... trying them in your own environment and seeing what you prefer."
The trio examines practical applications of these tools across various everyday scenarios:
Steve Kelly [10:32]:
"My go-to is a 5x Bausch and Lomb slide magnifier... When that doesn't work, I use Seeing AI or Google Lookout to have it read it to me."
Eric Boklage [11:11]:
"I really like being able to use the Seeing AI read function, so it would just read any kind of print that was in a short, concise form."
Ricky Enger [11:58]:
"Seeing AI wins this one for me."
Eric Boklage [12:53]:
"Seeing AI has an OCR component... it guides you on how to position the camera to capture the entire document, even multiple pages."
Steve Kelly [13:54]:
"I'll try magnifiers first, but ultimately, I'll use Seeing AI when other methods fall short."
Ricky Enger [14:51]:
"Be My Eyes is the perfect way to involve a human assistant for finding dropped items."
Steve Kelly [15:23]:
"Be My Eyes has been super helpful for getting cardinal directions from volunteers."
Ricky Enger [21:10]:
"I would much rather have the assistance of a human through Be My Eyes or Aira to read complex instructions."
Eric Boklage [23:23]:
"Packaging often includes pictographs which AI struggles to interpret, making human assistance more reliable."
Eric Boklage [25:20]:
"If there's residual vision, I recommend a magnifier app with adjustable features for better readability."
Steve Kelly [26:55]:
"Grocery shopping is challenging alone; Seeing AI helps in comparing products, but human assistance is often necessary in unfamiliar stores."
Ricky Enger [29:56]:
"Meta Glasses, paired with Aira, offer efficient, hands-free assistance tailored for quick shopping tasks."
Ricky Enger [32:24]:
"Seeing AI is the preferred tool for identifying currency due to its specific functionality."
Eric Boklage [34:11]:
"Be My Eyes offers more detailed and robust descriptions compared to Seeing AI, especially for verifying colors and matching items."
Ricky Enger [36:30]:
"Be My Eyes allows for extended interaction without the pressure of a human assistant getting tired."
The conversation acknowledges the emotional aspect of relying on technology and human assistance, addressing concerns about burdening others and self-esteem.
Steve Kelly [18:49]:
"Asking family members repeatedly can wear on them, highlighting the importance of having alternative options."
Ricky Enger [39:33]:
"Don't let it steal your self-esteem. It's okay to figure out your own way."
Steve Kelly [39:58]:
"It's different than it was 15 or 20 years ago. Relax, take a breath, and don't let it affect your self-esteem."
The experts conclude with advice for users feeling overwhelmed by the plethora of available tools, emphasizing experimentation and adaptability.
Eric Boklage [38:55]:
"Try any or all of these tools in a stress-free environment to see which one you’re comfortable with."
Steve Kelly [39:58]:
"Don’t let one experience cause you to walk away. These tools are evolving, and your preferences may change over time."
Ricky Enger [42:22]:
"There isn't one magic tool that solves all practical challenges. Knowing about multiple tools allows you to pick the right one for each situation."
Both Steve and Eric encourage users to remain open to evolving technologies, as AI and assistive devices continue to improve and expand their capabilities.
Ricky Enger wraps up the episode by highlighting the importance of understanding and utilizing various assistive technologies to enhance independence and efficiency for individuals with vision loss. He invites listeners to reach out to Hadley for further assistance and support.
Ricky Enger [42:46]:
"Things are constantly changing. Great point. Thank you both so much. This has been such an informative discussion."
Listeners are encouraged to share their experiences and seek guidance to navigate the ever-growing landscape of assistive technologies.
This episode of Hadley Presents serves as a comprehensive guide for individuals navigating vision loss, offering insights into how AI-driven tools can be effectively integrated into daily life to foster greater independence and confidence.