Adding a baseball diamond to a St. Louis lot on the Penny artificial intelligence map system (all screenshots by the author for Hyperallergic)
Using available census data and satellite imagery, researchers trained an artificial intelligence (AI) called “Penny” to predict the median household income of neighborhoods in New York City and St. Louis. Created by researchers at Carnegie Mellon University with Stamen Design, Penny analyzes DigitalGlobe imagery in its neural network, resulting in algorithms that recognize repetitive architecture and baseball diamonds as low-income areas, and glass skyscrapers and plenty of green space as high-income.
Adding Stuyvesant Town to New York City’s Columbus Circle lowers the Penny AI classification
Users can add digital objects to the maps and then run Penny for a new classification. Some of these additions are a bit whimsical, such as a huge ship or the Statue of Liberty (which I found raised the income of the Upper East Side when plunked on its streets); others respond to patterns of neighborhoods, like a high rise which tends to raise the income, or train yard that will lower it.
Penny is imperfect in its predictions. The information for both St. Louis and New York can’t be applied to other urban areas with accuracy. Robbie Gonzalez at Wired pointed out that adding a helipad to Trump Tower actually lowers its income classification (maybe it thinks the building is a hospital). I also discovered in exploring Penny’s classifications for Brooklyn that gentrified neighborhoods including Williamsburg and some of Park Slope were low-income, perhaps due to their uniform, sometimes industrial, architecture. However, it’s more an experiment in machine learning, as well as a demonstration of how the planning of cities can so regularly under-serve certain income levels that even satellite imagery can see it.
The results may not be surprising, but it’s interesting to see researchers combine existing data sets through machine learning. The project is a reminder of how much our world is now “seen” by satellite imagery. Penny’s developers state that their goal is to “spark a conversation about artificial intelligence, machine learning, cities, infrastructure, satellite imagery, and big data.”
Income classification predictors on Penny AI
Adding a skyscraper to a vacant lot in St. Louis raises the Penny AI classification
Penny is available online through Stamen Design, DigitalGlobe, and Carnegie Mellon University.
