Newton Eyes
Newton Eyes is an AI-based application designed to aid individuals with visual impairments. The application leverages AI technology to improve accessibility for...
Last verified:
What is Newton Eyes?
Newton Eyes is an AI-powered vision companion designed specifically for visually challenged users. The app transforms smartphones into powerful visual interpreters by using the camera to capture photos and providing detailed, accurate descriptions of surroundings. Users can perceive the world in new ways by identifying objects, reading text, and understanding complex environments through voice feedback.
Key features include AI-driven descriptions that generate detailed photo analyses, voice-powered interactivity that eliminates typing by allowing users to ask questions through voice input, and multi-language support covering English plus six Indian languages (Hindi, Telugu, Tamil, Malayalam, Kannada). The app also works with accessibility features like Android Talkback and provides audio feedback for every interaction.
Newton Eyes is intended for visually impaired individuals, people with low vision, and anyone who needs assistance navigating their environment. The intuitive interface is designed with accessibility as the primary focus, making it easy for all users to operate. The app acts as a virtual guide, providing voice feedback to ensure a seamless and enriching experience for the visually challenged community.
The app is free to use with no monetization plans, though the developer seeks cloud sponsorship to sustain server and AI service costs. Over 200 visually challenged users rely on it daily for real-time descriptions in multiple Indian languages.
Newton Eyes pricing
Pricing model: Free
The app is completely free to use with no paid plans. The developer does not intend to monetize the app in any way. However, running the servers and using AI services from cloud providers costs money, so the developer is seeking cloud sponsorship to make the app sustainable. Users who want to sponsor the app can email the developer.
Newton Eyes pros
- Completely free to use with no monetization intent
- Supports 6 languages including English and 5 Indian languages
- Works with Android Talkback accessibility feature
- Voice input eliminates need for typing
- Voice feedback for every app interaction
- Provides detailed AI-driven photo descriptions
- Identifies objects and reads text in images
- Allows follow-up questions about captured images
- Intuitive accessibility-focused interface design
- Can use camera or gallery to select images
- Verbosity slider controls how much the app speaks
- Toggle option to enable or disable describe pic feature
- Real-time environment description capability
- Asks follow-up questions by clicking and holding image
- Over 200 daily active visually challenged users
- Developer actively seeks community feedback for improvements
- No authentication or account setup required to use
Newton Eyes cons
- Server availability issues when servers go down
- Rate limiting after excessive usage beyond fair use
- Only supports 6 languages currently
- No cloud sponsorship yet for sustainability
- Verbosity setting only applies to initial description
- Verbosity does not apply to follow-up questions
- Device speaker voice must be changed externally
- Requires JavaScript to function properly
Frequently asked questions about Newton Eyes
How to use the app?
On the home screen, click the camera icon in the first half of the page to click a picture. Click the mic icon in the second half of the page to start recording a question. Click the mic icon again to stop recording. In the settings page, you can change the verbosity of the app and enable or disable the describe pic feature. You can also toggle if you want to use the camera or the gallery to select an image.
What happens when Describe Pic is enabled?
When Describe Pic is enabled, the app will describe the image as soon as you select it. You can then ask follow-up questions by clicking and holding the image.
How to change the speaker voice?
The speaker voice can be changed from the settings of your device. On Android, you need to access your device settings to modify the speaker voice.
What is Verbosity?
Verbosity is the amount of words the app speaks. You can change it using the slider in settings. This applies only to the initial description of the image and does not apply to follow-up questions.
I get a message that the app is unable to reach the servers. What should I do?
Either the app servers are down, or you have been rate limited as you have used the app beyond its fair use limits. Please check back later. If you think you have been rate limited unfairly, email the developer.
Is this app free?
Yes, the app is free to use. However, it costs money to run the servers and to use the AI services of cloud providers. The developer is yet to figure out a way to procure cloud sponsorship for this app to allow it to be sustainable and does not intend to monetize the app in any way.
Who is Newton?
Newton is the name of the developer's Betta fish. He is a great listener and a great friend.
How to request deletion of your account and info?
Click the link provided on the website to request deletion of your account and info.
What languages does the app support?
The app currently supports English, Telugu, Hindi, Tamil, Malayalam, and Kannada languages.
Does the app work with accessibility features?
Yes, Newton Eyes works with accessibility features like Talkback on Android devices, making it fully accessible for visually impaired users.