Visual technologies leveraging AI and cameras are once again driving new innovation. The talking camera app 'Seeing AI,' which captures and verbalizes scenes from the world we often take for granted, is now available for Android.
The app has been available for iOS and iPadOS since 2019, but with this latest release, it is now also accessible via the Google Play Store. Currently supporting 18 languages, the app is set to expand to 36 languages by 2024.
Towards the Future of Support for the Visually Impaired
'Seeing AI' utilizes your smartphone camera to recognize surrounding environments and provides information through audio narration. This enables individuals with visual impairments to read emails, identify products, and listen to descriptions of photographs.
Powered by Microsoft's Cognitive Services, the app delivers real-time results, allowing users to instantly access information about their surroundings. As a result, people with visual impairments can engage with the world in real time through their smartphones.
© Microsoft
Leveraging AI-driven cognitive capabilities to convert visual information into audio, 'Seeing AI' can recognize text, documents, barcodes, people, scenes, currency, colors, and light. Notably, features such as 'Short Text,' 'Person,' 'Color,' and 'Light' recognition are available even offline. The app also incorporates new functionality powered by OpenAI's ChatGPT, enabling document text recognition results to be analyzed via ChatGPT.
Photography as a Cognitive Device
This development transcends the traditional role of photography as a mere recording device. 'Seeing AI' highlights the evolving nature of photography, focusing on mechanisms for perceiving information through images. As a cognitive device that transforms visual information into auditory cues, it is expected to address longstanding accessibility challenges faced by the visually impaired.
A Longstanding Commitment to Accessibility
Microsoft has provided accessibility-related services for over 30 years, and 'Seeing AI' is a continuation of this commitment. The app is designed with simplicity in mind, allowing users to operate it accurately even without sight once they are familiar with it, and consolidates a wide range of features into a single application.
Such accessibility-focused apps support various daily activities for people with visual impairments and, through their convenience, offer new opportunities for social participation. As AI-driven accessibility solutions become increasingly vital with technological progress, Microsoft's initiatives are making a significant impact. Looking ahead to the future of support for the visually impaired, 'Seeing AI' is pioneering a new era of accessibility.
