Artificial intelligence (AI) image generators have been quite busy lately, from producing spooky art, strange videos, and a terrifying creation called “Loab” to helping a Colorado artist win a blue ribbon at the state fair this summer.
Generators like Midjourney and DALL-E normally use text prompts — along with their vast encyclopedias of imagery from the Internet — to formulate results. Now, Stable Diffusion’s AI allows users to create images from other pictures, drawn on the spot. That’s right: Input your napkin doodles and half-sketched masterpieces and AI will produce a complete image. (Well, sort of.)
Stable Diffusion is an open-AI platform, meaning that users can manipulate and change the code to achieve their desired results. One of those projects, called “Diffuse the Rest,” adds action, detail, and stylization to drawings and uploaded pictures. The tool is based on the work of Suraj Patil and comprises a set of collaboratively-created GitHub code. (Stable Diffusion’s own beta program, called “Dreamstudio,” also includes an image-to-image generator, but there is no drawing option.)
Users can draw or upload an image and then add a text prompt. In one example, Stable Diffusion turned a bad drawing of a horse into a better one, and following the text prompt “galloping,” placed the new rendering in motion.
We also fed Diffuse the Rest an image of a stormy Loch Ness Lake in Scotland, and following the simple text prompt “Loch Ness monster,” the generator added the storied creature to the photograph. Pairing the prompt “style of Picasso” with the Mona Lisa also produced realistic results.
In a video, TikTok user Eric Hu explains the new feature and its potential application for design. He shows a sketch of a dog transformed into an impressive illustration, then a plug-in that turns a sketch of sneakers into a 3D-modeled illustration that looks ready to shop. Created by Antonio Cao, who posted the sneaker demo on Twitter, the plug-in is for design software Figma and utilizes the Stable Diffusion AI.
Using the Diffuse the Rest generator, a photograph of a sailboat coupled with the prompt “whales jumping” created a very strange image of whales flying through the sky like seagulls. Just like DALL-E, Stable Diffusion isn’t perfect, but it’s a fascinating example of the way in which AI is evolving to create increasingly sophisticated — and increasingly bizarre — content.
Memories So Fair and Bright
Kimetha Vanderveen’s paintings are about the interaction of materiality and light, the bond between the palpable and ephemeral world in which we live.
Artists Contemplate Sovereignty in Santa Fe
The Santa Fe Art Institute’s 2024 International Thematic Residency focuses on what sovereignty means for artists from across the world.
When I Am Empty Please Dispose of Me Properly
Ayanna Dozier, Ilana Harris-Babou, Meena Hasan, Lucia Hierro, Catherine Opie, Chuck Ramirez, and Pacifico Silano explore the myths of the American Dream at Brooklyn’s BRIC House.
How Did Early Modern European Craftspeople Pass On Their Knowledge?
A new book about object making critically examines a written history of working with materials.
Dual Portrait of Old Master Rachel Ruysch Holds a Trove of Secrets
The Metropolitan Museum of Art has just acquired the rare painting, which depicts the Dutch artist at work surrounded by her signature flora.
Pratt’s 2023 Fine Arts MFA Thesis Exhibition Is On View in Brooklyn
The two-part exhibition features the work of 41 graduating artists across disciplines, including painting, sculpture, printmaking, and integrated practices.
Did Van Gogh’s Disdain for the Eiffel Tower Inspire “Starry Night”?
Art historian James Hall argues that van Gogh replaced the Eiffel Tower with a towering cypress tree and its inaugural light shows with the night sky.
Greek Museum Welcomes Dogs For World Stray Animal Day
Furry friends and their pawrents can visit Athens’s National Museum of Contemporary Art for free this weekend.
The Milton Resnick and Pat Passlof Foundation Presents The Feminine in Abstract Painting
Curated by Jennifer Samet and Andrea Belag, this group exhibition in NYC explores the feminine through aesthetics, as opposed to identity or gender.
Ai Weiwei Recreates Monet’s “Water Lilies” Using 650,000 LEGOS
It’s the artist’s largest LEGO artwork to date.
Did a Simpsons Episode Predict the Florida “David” Outrage?
The episode, which aired 30 years ago, made a dark prediction about conservative politics in 2023.
NYU Steinhardt Opens 2023 MFA Thesis Exhibitions
Taking place at 80WSE Gallery in New York’s Greenwich Village, Part I is on view from late March through April while Part II opens in May.
Coasting the Topography of South Asian Futurisms
As part of Hyperallergic’s Emily Hall Tremaine Journalism Fellowship for Curators, Sadaf Padder presents an exhibition to offer insight into her curatorial process.
I’m a Florida Drag Queen and I’m Scared
I’m truly at a loss for what to do for work and what kind of life I can expect to live.