What if your smartphone could see for you, the same way it tells time, takes pictures, crushes candy, and occasionally calls people for you?
BlindTool, by Joseph Paul Cohen, a PhD Candidate at the University of Massachusetts Boston, is a free Android app that helps the blind and visually impaired navigate the world. Using computer vision technology — a robot analogue of human vision, in which computers analyze visual information on video — it identifies objects it “sees” through the camera lens and describes them in robotic monotone. If you point your phone at a chair, it says “chair;” if you point at a banana, it says “banana.”
Though it’s far from perfect — BlindTool identified a quarter as a ping-pong ball and an image of Chewbacca from Star Wars as a Yorkshire Terrier — it’s an application of computer vision technology that has the potential to change lives. Cohen is currently raising funds on Kickstarter for BlindTool version 2, which will have more accurate object recognition and personalization. (As of now, its visual vocabulary is limited to 1,000 things, hence the Yorkshire Terrier confusion.)
Cohen’s dream for BlindTool is total scene recognition, for it to “identify all objects in any given scene as if a sighted person was telling you about them.” This made me curious: Could BlindTool, or technology like it, someday aid in efforts to help the blind “see” visual art? Could it lead to a kind of talking Shazam for art? Cohen says that, theoretically, it could.
What would it take to get BlindTool to be able to recognize and identify works of art? Just a little art-historical training, Cohen answers. With a huge data set of images, “you could train this app to recognize all the famous fine artists and artistic styles, and it could speak those things aloud when they’re recognized. If you showed it a bunch of Picasso paintings, you could then take some random piece of art by an anonymous artist and it could say, ‘This artwork is 20% in Picasso’s style.’”
In recent years, after the 25th anniversary of the Americans with Disabilities Act, art museums have put a greater emphasis on programming for blind visitors. Some, like the Museum of Modern Art, the Whitney, and the Minneapolis Institute of Art, offer “Touch Tours,” allowing blind visitors to touch specific sculptures in order to understand their contours and textures. Others, like Florence’s Uffizi Gallery and Madrid’s Museo del Prado, offer 3D models of certain paintings for visitors to touch.
Perhaps someday, an app like BlindTool could help the visually impaired “see” art even when such programs aren’t available. A better current alternative is an app called “Be My Eyes,” which lets volunteers serve as surrogate eyes for the visually impaired via video chat, describing the person’s surroundings in great detail.
The prospect of BlindTool waxing poetic about an Impressionist landscape is exciting but still a ways off. As of now, the app “kind of objectively looks at the world,” Cohen says. “It takes things completely out of context and will tell you what an object statistically looks like.” It’s still learning, and has yet to develop the human eye’s ability to detect subtle cues like depth perception or variations in light and color. “BlindTool is a more naive viewer,” adds Cohen. “I liken it to a baby, because it makes mistakes when identifying things.”
BlindTool V2 is fundraising on Kickstarter through February 6.
h/t Fast Company
A total of 24 board members stepped down from their posts after the art center’s parent company allegedly attempted to terminate 12 of their colleagues.
A group of artists and writers denounced the center for hosting Philippines President Ferdinand Marcos Jr., son of the country’s former dictator.
This new kunsthaus in Potsdam shows modern and contemporary works of art from East Germany in what was once a terrace restaurant.
Xenobia Bailey, Jeffrey Gan, Elizabeth G. Greenlee and N.E. Brown, Siera Hyte, Maru López, and Olivia Quintanilla will contribute to a Hyperallergic Special Issue on underrepresented craft histories in 2023.
An investigation by Forensic Architecture and Al-Haq into the killing of Shireen Abu Akleh looked at previously unseen footage and unpublished autopsy reports, among other evidence.
The Philadelphia organization offers artists on-site access to recovered materials, studio space, construction equipment, a $1,000 stipend, and more.
This week, a Keith Haring drawing from his bedroom, reflecting on Theresa Hak Kyung Cha, you’re not descended from Vikings, the death of cursive, and more
Eros Rising at New York’s Institute for Studies on Latin American Art demonstrates that eroticism might be closer to the cosmic than to the terrestrial in its infinite manifestations.
Drawn to Life at the Ackland in Chapel Hill, North Carolina, showcases 17th-century Dutch drawings of landscapes, portraits, preparatory studies, and biblical and historical scenes.
I was curious to see Casteel’s first exhibition since her New Museum show. I was not disappointed.
Stephanie Syjuco’s exhibition Double Vision points to the role that museums play in perpetuating narratives about the people, places, and events of the American West.
This is what happens when boozed-up patrons party next to priceless mosaics, statues, and vases.