Skip to main content

Iconic Film from 1896 Restored with Artificial Intelligence: Watch an AI-Upscaled Version of the Lumière Brothers’ The Arrival of a Train at La Ciotat Station

Machine learning keeps, well, learning in leaps and bounds, and at Open Culture we have watched developments with a fascinated, sometime wary eye. This latest advance checks off a lot of Open Culture boxes: traveling back in time through the power of film; homegrown ingenuity; and film history.

YouTuber Denis Shiryaev took the latest advances in AI tech and turned them onto one of the earliest works of film: The Arrival of a Train at La Ciotat Station, shot by the Lumière Brothers in 1896. There are plenty of urban legends around this 50 second short: that it was the first ever Lumière film (it wasn’t, they had a selection of previous shorts); and that audiences were terrified, thinking the train would hit them (they were amazed, no doubt, but they weren't that naive).

You might want to watch the original below before watching Shiryaev’s 4K upscaling and AI “smoothed” version to get a sense of the marvel at the top of the post.

What we are seeing is not a traditional “restoration,” however. Instead, Shiryaev is using a commercial image-editing software called Gigapixel AI. (If you have the processing power, you can try it out). The original film was not shot at 60-frames-per-second. Instead, neural networks are looking at the original frames and “filling in” the data in between, creating what you can see is a more naturalistic effect. People on and off the train move like they do in real life. It looks like it was shot yesterday.

Now, this isn’t perfect. There are a lot of artifacts, squooshy, morphing moments where the neural network can’t figure things out. But hey, this is just one guy on his computer. It’s an experiment. The computer code will get better.

The Gigapixel AI was developed by Topaz Labs originally to help photographers upscale their pics by 600 percent without losing detail. It didn’t take long to apply this to video, but be warned, it can take hours of processing power to render a couple of seconds. Still it hasn’t stopped people from experimenting, even with similar neural network programs:

Here’s a clip from Nirvana’s “Heart Shaped Box” video upscaled to 4K with Gigapixel AI:

User AkN upscaled A-Bomb footage from the 1950s:

Some clips from Home Alone:

You get the idea. As with any technology, there are also some horrific examples out there too where it just does not work. But I have a feeling that Shiryaev’s first dive into film history is not going to his, or the internet’s, last.

Related Content:

Dramatic Color Footage Shows a Bombed-Out Berlin a Month After Germany’s WWII Defeat (1945)

Pristine Footage Lets You Revisit Life in Paris in the 1890s: Watch Footage Shot by the Lumière Brothers

Immaculately Restored Film Lets You Revisit Life in New York City in 1911

Ted Mills is a freelance writer on the arts who currently hosts the artist interview-based FunkZone Podcast and is the producer of KCRW's Curious Coast. You can also follow him on Twitter at @tedmills, read his other arts writing at tedmills.com and/or watch his films here.

Iconic Film from 1896 Restored with Artificial Intelligence: Watch an AI-Upscaled Version of the Lumière Brothers’ The Arrival of a Train at La Ciotat Station is a post from: Open Culture. Follow us on Facebook, Twitter, and Google Plus, or get our Daily Email. And don't miss our big collections of Free Online Courses, Free Online Movies, Free eBooks, Free Audio Books, Free Foreign Language Lessons, and MOOCs.



from Open Culture https://ift.tt/2Sn43Yu
via Ilumina

Comments

Post a Comment

Popular posts from this blog

Ishkur’s Guide to Electronic Music: An Interactive, Encyclopedic Data Visualization of 120 Years of Electronic Music

In a very short span of time, the descriptor “electronic music” has come to sound as overly broad as “classical.” But where what we (often incorrectly) call classical developed over hundreds of years, electronic music proliferated into hundreds of fractal forms in only decades. A far steeper quality curve may have to do with the ease of its creation, but it’s also a factor of this accelerated evolution. Music made by machines has transformed since its early 20th-century beginnings from obscure avant-garde experiments to massively popular genres of global dance and pop. This proliferation, notes Ishkur—designer of Ishkur’s Guide to Electronic Music —hasn't always been to the good. Take what he calls “trendwhoring,” a phenomenon that spawns dozens of new works and subgenera in short order, though it’s arguable whether many of them should exist. Ishkur, describes this process below in an excerpt from his erudite, sardonic “Frequently Unasked Questions”: If fart noises were sudde...
Post a Comment
Read more

A 10 Billion Pixel Scan of Vermeer’s Masterpiece Girl with a Pearl Earring: Explore It Online

We admire Johannes Vermeer’s  Girl with a Pearl Earring   for many reasons , not least that it looks exactly like a girl with a pearl earring. Or at least it does from a distance, as the master of light himself no doubt stepped back to confirm countless times during the painting process, at any moment of which he would have been more concerned with the brushstrokes constituting only a small part of the image. But even Vermeer himself could have perceived only so much detail of the painting that would become his masterpiece. https://www.youtube.com/watch?v=cKaZYTwmjwU Now, more than 350 years after its completion, we can get a closer view of Girl with a Pearl Earring  than anyone has before through a newly released  10 billion-pixel panorama . At this resolution, writes Petapixel’s Jason Schneider , we can “see the painting down to the level of 4.4-microns per pixel.” Undertaken by Emilien Leonhardt and Vincent Sabatier of 3D microscope maker Hirox Europe ...
Post a Comment
Read more

Drunk History Takes on the Father of Prohibition: The Ban on Alcohol in the U.S. Started 100 Years Ago This Month

There may be plenty of good reasons to restrict sales and limit promotion of alcohol. You can search the stats on traffic fatalities, liver disease, alcohol-related violence, etc. and you’ll find the term “epidemic” come up more than once. Yet even with all the dangers alcohol poses to public health and safety, its total prohibition has seemed “so hostile to Americans’ contemporary sensibilities of personal freedom,” writes Mark Lawrence Schrad at The New York Times , “that we struggle to comprehend how our ancestors could have possibly supported it.” Prohibition in the United States began 1oo years ago-- on January 17, 1920--and lasted through 1933. How did this happen? Demand, of course, persisted, but public support seemed widespread. Despite stories of thousands rushing bars and liquor stores on the evening of January 16, 1920 before the 18th Amendment banning alcohol nationwide went into effect, “the final triumph of prohibition was met with shrugs…. The United States had...
Post a Comment
Read more