Skip to main content

Artificial Intelligence Brings to Life Figures from 7 Famous Paintings: The Mona Lisa, Birth of Venus & More

Denis Shiryaev is an AI wizard who has liberally applied his magic to old film—upscaling, colorizing, and otherwise modernizing scenes from Victorian England, late Tsarist Russia, and Belle Époque Paris. He trained machines to restore the earliest known motion picture, 1888’s Roundhay Garden Scene and one of the most mythologized works of early cinema, the Lumière Brothers 50-second Arrival of a Train at La Ciotat Station.

Shiryaev’s casual distribution of these efforts on YouTube can make us take for granted just how extraordinary they are. Such recreations would have been impossible just a decade or so ago. But we should not see these as historic restorations. The software Shiryaev uses fills in gaps between the frames, allowing him to upscale the frame rate and make more naturistic-looking images. This often comes at a cost. As Ted Mills wrote in an earlier Open Culture post on Shiryaev’s methods, “there are a lot of artifacts, squooshy, morphing moments where the neural network can’t figure things out.”

But it’s an evolving technology. Unlike wizards of old, Shiryaev happily reveals his trade secrets so enterprising coders can give it a try themselves, if they’ve got the budget. In his latest video, above, he plugs the NVIDIA Quadro RTX 6000, a $4,000 graphics card (and does some griping about rights issues), before getting to the fun stuff. Rather than make old film look new, he’s “applied a bunch of different neural networks in an attempt to generate realistic faces of people from famous paintings.”

These are, Shiryaev emphasizes, “estimations,” not historical recreations of the faces behind Leonardo’s Mona Lisa and Lady with an Ermine, Botticelli’s model for The Birth of Venus, Vermeer’s for Girl with a Pearl Earring, or Rembrandt’s The Night Watch. In the case of American Gothic, we have a photo of the model, artist Grant Wood’s sister, to compare to the AI’s version. Frida Kahlo's Self-Portrait with Thorn Necklace and Hummingbird gets the treatment. She left perhaps a few hundred photographs and some films that probably look more like her than the AI version.

The GIF-like “transformations,” as they might be called, may remind us of a less fun use of such technology: AI’s ability to create realistic faces of people who don’t exist for devious purposes and to make “deep fake” videos of those who do. But that needn’t take away from the fact that it’s pretty cool to see Botticelli’s Venus, or a simulation of her anyway, smile and blink at us from a distance of over 500 years.

Related Content:

Watch Scenes from Czarist Moscow Vividly Restored with Artificial Intelligence (May 1896)

Watch AI-Restored Film of Laborers Going Through Life in Victorian England (1901)

Iconic Film from 1896 Restored with Artificial Intelligence: Watch an AI-Upscaled Version of the Lumière Brothers’ The Arrival of a Train at La Ciotat Station

The Earliest Known Motion Picture, 1888’s Roundhay Garden Scene, Restored with Artificial Intelligence

Josh Jones is a writer and musician based in Durham, NC. Follow him at @jdmagness

Artificial Intelligence Brings to Life Figures from 7 Famous Paintings: The Mona Lisa, Birth of Venus & More is a post from: Open Culture. Follow us on Facebook, Twitter, and Google Plus, or get our Daily Email. And don't miss our big collections of Free Online Courses, Free Online Movies, Free eBooksFree Audio Books, Free Foreign Language Lessons, and MOOCs.



from Open Culture https://ift.tt/37Kt9HZ
via Ilumina

Comments

Popular posts from this blog

When Albert Einstein & Charlie Chaplin Met and Became Fast Famous Friends (1930)

Photo via Wikimedia Commons “You do not really understand something unless you can explain it to your grandmother,” goes a well-known quote attributed variously to Albert Einstein, Richard Feynman, and Ernest Rutherford. No matter who said it, “the sentiment… rings true,” writes Michelle Lavery , “for researchers in all disciplines from particle physics to ecopsychology.” As Feynman discovered during his many years of teaching , it could be “the motto of all professional communicators,” The Guardian ’s Russell Grossman writes , “and especially those who earn a living communicating the tricky business of science.” Einstein became one of the world’s great science communicators by choice, not necessity, and found ways to explain his complex theories to children and the elderly alike. But perhaps, if he’d had his way, he would rather have avoided words altogether, and preferred acrobatic feats of silent daring to get his message across. We might at least conclude so from his reverence f...

1,100 Delicate Drawings of Root Systems Reveals the Hidden World of Plants

We know that plants can inspire art. If you, personally, still require convincing on that point, just have a look at Elizabeth Twining’s Illustrations of the Natural Orders of Plants , the drawings of Ernst Heinrich Haeckel , Elizabeth Blackwell’s  A Curious Herbal , and Nancy Anne Kingsbury Wollstonecraft’s Specimens of the Plants and Fruits of the Island of Cuba — not to mention the paintings of Georgia O’ Keeffe — all previously featured here on Open Culture. But those works concern themselves only with plant life as it exists above ground. What goes on down below, underneath the soil? That you can see for yourself — and without having to pull up one of our fine flowering (or non-flowering) friends to do so — at Wageningen University’s online archive of root system drawings . “The outcome of 40 years of  root system excavations in Europe,” says that site, the collection contains 1,180 diagrams of species from  Abies alba (best known today as a kind of Christmas t...

Zamrock: An Introduction to Zambia’s 1970s Rich & Psychedelic Rock Scene

The story of popular music in the late 20th century is never complete without an account of the explosive psychedelic rock, funk, Afrobeat, and other hybrid styles that proliferated on the African continent and across Latin American and the Caribbean in the 1960s and 70s. It’s only lately, however, that large audiences are discovering how much pioneering music came out of Kenya, Ghana, Nigeria, and other postcolonial countries, thanks to UK labels like Strut and Soundway (named by The Guardian as “one of the 10 British Labels defining the sound of 2014” and named “Label of the Year” in 2017). Germany’s Analogue Africa , a label that reissues classic albums from the era, puts it this way: “the future of music happened decades ago.” Only most Western audiences weren’t paying attention—with notable exceptions, of course: superstar drummer Ginger Baker apprenticed himself to Fela Kuti and became an evangelist for African drumming; Brian Eno and Talking Heads’ David Byrne ( who ...