You may be quick to identify a portrait unveiled this week in Amsterdam as a never-before-seen painting by Rembrandt. With a calm gaze, mouth slightly parted, and wearing a frilled collar with a wide-brimmed hat, the man resembles the sitters the Dutch painter so frequently depicted. Rather than dabs of paint, however, this portrait consists of pixels — 148 million of them, to be exact, all created by machines and captured in a 3D-printed painting.
The artwork, dubbed “The Next Rembrandt,” is the result of 18 months of research and experimentation by a team of scientists, developers, engineers, and experts on the painter to use data collected from Rembrandt’s oeuvre to compose an entirely new painting. The final computer-generated work is strictly faithful to his hand and aesthetic, replicating the artist’s rendering of facial features, the colors and brushes he would have used, his typical geometric composition, and his careful shading and use of light.
“It’s not about mimicking Rembrandt,” project spokeswoman Jessica Hartley told Hyperallergic. “It’s more about trying to predict what he would do next on the basis of data. The painting is not made by Rembrandt, but it’s 100% Rembrandt because every decision that’s been made is based on data of his work.”
The project arose out of a request from ING Bank, as part of its sponsorship of Dutch art and culture, to conduct an experiment in innovation beyond the world of finance. The Amsterdam branch of advertising agency J. Walter Thompson took on the task, deciding it would teach a computer, armed with artificial intelligence, to learn from Rembrandt’s works to produce something new.
“We were seeing how far data and technology could take us,” the agency’s executive creator director Bas Korsten told Hyperallergic. “The outcome was highly unsure and unpredictable. We didn’t know if we would have a painting at the end, and what it would look like. One of the more surprising outcomes was how we, on a facial feature-by facial-feature basis, started to reconstruct a face. We could have ended up easily with a Mr. Potato Head.
“If I look at the painting now, I see a person with a soul, and he’s looking at me, and something’s happening behind the eyes. And I think that’s the most amazing thing that I’ve encountered.”
The team scanned the paintings they had access to and examined high-resolution images of other works held in private collections, creating a massive pool of data. Breaking down the demographics of Rembrandt’s subjects revealed that the painter mostly painted — unsurprisingly — white men between the ages of 30 and 40 who wore dark clothes with a white collar and were turned slightly to the viewer’s right. The researchers then designed a software system that incorporated facial recognition technology to identify the most common aspects of the artists’ paintings. Algorithms generated wholly new features and assembled them into a face and bust, all dictated by proportions in original Rembrandts, with systems calculating distances between features to churn out new, appropriate measurements that were rotated and scaled before being set in place. To add dimension, the team identified textures on the surface of all the canvases and with the help of engineers from Delft University of Technology, transformed the information into a “height map,” which determines the layers of paint in “The Next Rembrandt.” Based on this map, a 3D printer laid down paint-based UV ink on a surface to produce a Rembrandt realistic both in appearance and to the touch.
The team is currently looking at options for where its creation may go on public display. Art historians, according to Korsten, have already suggested the possibility of adopting this technology to restore paintings — using what he describes as “predictive modeling” to recreate lost fragments of works. Most of the algorithms used in the project will be available for public use, and he is eager to see how people may use the information. While some may bemoan machines’ increasing ability to replicate human touch and expression, Korsten is quick to reject the notion that such technologies are replacing our creativity.
“We taught a computer to look at existing Rembrandts, and it created a new work out of that,” Korsten said. “But we had to feed him with the creativity of Rembrandt. So as soon as the computer starts creating artwork by itself — and artwork that we actually like — then maybe it enters the territory of creativity, which I think is still unique to human beings. As soon as the computer starts innovating — and I think we’re not there yet by a long shot — then I think we can start worrying.”
Three Looted Antiquities at the Met Repatriated to Turkey
Nine other repatriated works were seized from Met Trustee Shelby White, whose collection was subject to a criminal investigation.
This week, the world’s lightest paint, Pakistan’s feminist movement, World Puppy Day, and were some of Vermeer’s paintings created by his daughter?
The Wider World and Scrimshaw
On March 28, join the New Bedford Whaling Museum online and in-person for a symposium on global carving traditions from across the Pacific Rim.
Who Will Decide on the Future of a Miami Native Burial Ground?
Native activists say sacred remains and objects dug up from a Brickell construction site should remain there, but mega-developer Jorge Pérez is pushing back.
How Can a Curator Approach South Asian Futurisms?
How do I acknowledge my shortcomings while reckoning with obscured histories and the exclusion of subaltern narratives in the fine art landscape? A working checklist for curators.
MCA Chicago Presents On Stage: Frictions
Will Rawls, Shamel Pitts | TRIBE, and Barak adé Soleil explore Blackness, queerness, movement, and dance in performances at the Museum of Contemporary Art Chicago.
The Complicated Legacy of Camilo Egas
The Ecuadorian painter, a leading figure of Latin America’s Indigenismo art movement, has been both praised and scorned for his representation of Indigenous peoples.
Tom Jones Zeroes in on Ho-Chunk Visibility
“I think about the young kids, the teenagers, and I think being able to see yourself represented in art is so powerful,” says the artist.
Haggerty Museum of Art Presents Tomás Saraceno in Dialogue With Dr. Somesh Roy
The artist and researcher will explore soot’s effects on climate change and public health in this online conversation.
Hundreds of Artworks by NYC Teenagers Go on View at the Met
The talented seventh through twelfth-grade students are recipients of the 2023 Scholastic Art and Writing Awards.
NYC’s Flatiron Building Sells for a Whopping $190M
The sale to outsider bidder Jacob Garlick puts an end to the protracted legal battle between the iconic skyscraper’s five former owners.
McKnight Visual Artist Fellows Discussion Series at the Minneapolis Institute of Art
The series features 2021 Fellows David Bowen, Mara Duvra, Rotem Tamir, Ben Moren, and Dyani White Hawk in conversation with renowned curators and critics.
The Best Memes Roasting the “We ❤️ NYC” Campaign
A graphic designer on Twitter created a hilarious send-up of the universally reviled logo, and the rest is history.
Did You Know These Museums Were Free for New Yorkers?
The “Free Admission” campaign is advocating to make ticket pricing information more transparent to visitors, who may be confused or misled by institutions’ language.
Guess it would be very easy for a computer to mimic more simple, graphic styles….what would a “next” Keith Haring, Pollock or Matisse look like using this technique?
But have to say the “new” Rembrandt is missing the magic of a real Rembrandt. Very flat and dull…
Have you actually seen “The New Rembrandt”? (Up close and personal?)
Perhaps it is the photograph that is “Very flat and dull . . . “
Comparing photos of real Rembrandt paintings to this computerized “next” version Rembrandt, the “next” version is missing the Rembrandt magic.
Of course, the team who produced this “next” never claimed to make a ‘great’ Rembrandt, only an ‘average’ Rembrandt. Can you at least give them that? If not, perhaps “the Rembrandt magic” is in the eye of the beholder.
I have to say that I’m pretty impressed, especially as they didn’t produce a Mr Potato Head, which was mentioned in the article. (If they had, I suspect we’d never have seen it. Then again . . . maybe we would have.)
Comments are closed.