Skip to main content

Iconic Film from 1896 Restored with Artificial Intelligence: Watch an AI-Upscaled Version of the Lumière Brothers’ The Arrival of a Train at La Ciotat Station

Machine learning keeps, well, learning in leaps and bounds, and at Open Culture we have watched developments with a fascinated, sometime wary eye. This latest advance checks off a lot of Open Culture boxes: traveling back in time through the power of film; homegrown ingenuity; and film history.

YouTuber Denis Shiryaev took the latest advances in AI tech and turned them onto one of the earliest works of film: The Arrival of a Train at La Ciotat Station, shot by the Lumière Brothers in 1896. There are plenty of urban legends around this 50 second short: that it was the first ever Lumière film (it wasn’t, they had a selection of previous shorts); and that audiences were terrified, thinking the train would hit them (they were amazed, no doubt, but they weren't that naive).

You might want to watch the original below before watching Shiryaev’s 4K upscaling and AI “smoothed” version to get a sense of the marvel at the top of the post.

What we are seeing is not a traditional “restoration,” however. Instead, Shiryaev is using a commercial image-editing software called Gigapixel AI. (If you have the processing power, you can try it out). The original film was not shot at 60-frames-per-second. Instead, neural networks are looking at the original frames and “filling in” the data in between, creating what you can see is a more naturalistic effect. People on and off the train move like they do in real life. It looks like it was shot yesterday.

Now, this isn’t perfect. There are a lot of artifacts, squooshy, morphing moments where the neural network can’t figure things out. But hey, this is just one guy on his computer. It’s an experiment. The computer code will get better.

The Gigapixel AI was developed by Topaz Labs originally to help photographers upscale their pics by 600 percent without losing detail. It didn’t take long to apply this to video, but be warned, it can take hours of processing power to render a couple of seconds. Still it hasn’t stopped people from experimenting, even with similar neural network programs:

Here’s a clip from Nirvana’s “Heart Shaped Box” video upscaled to 4K with Gigapixel AI:

User AkN upscaled A-Bomb footage from the 1950s:

Some clips from Home Alone:

You get the idea. As with any technology, there are also some horrific examples out there too where it just does not work. But I have a feeling that Shiryaev’s first dive into film history is not going to his, or the internet’s, last.

Related Content:

Dramatic Color Footage Shows a Bombed-Out Berlin a Month After Germany’s WWII Defeat (1945)

Pristine Footage Lets You Revisit Life in Paris in the 1890s: Watch Footage Shot by the Lumière Brothers

Immaculately Restored Film Lets You Revisit Life in New York City in 1911

Ted Mills is a freelance writer on the arts who currently hosts the artist interview-based FunkZone Podcast and is the producer of KCRW's Curious Coast. You can also follow him on Twitter at @tedmills, read his other arts writing at tedmills.com and/or watch his films here.

Iconic Film from 1896 Restored with Artificial Intelligence: Watch an AI-Upscaled Version of the Lumière Brothers’ The Arrival of a Train at La Ciotat Station is a post from: Open Culture. Follow us on Facebook, Twitter, and Google Plus, or get our Daily Email. And don't miss our big collections of Free Online Courses, Free Online Movies, Free eBooksFree Audio Books, Free Foreign Language Lessons, and MOOCs.



from Open Culture https://ift.tt/2Sn43Yu
via Ilumina

Comments

Popular posts from this blog

When Albert Einstein & Charlie Chaplin Met and Became Fast Famous Friends (1930)

Photo via Wikimedia Commons “You do not really understand something unless you can explain it to your grandmother,” goes a well-known quote attributed variously to Albert Einstein, Richard Feynman, and Ernest Rutherford. No matter who said it, “the sentiment… rings true,” writes Michelle Lavery , “for researchers in all disciplines from particle physics to ecopsychology.” As Feynman discovered during his many years of teaching , it could be “the motto of all professional communicators,” The Guardian ’s Russell Grossman writes , “and especially those who earn a living communicating the tricky business of science.” Einstein became one of the world’s great science communicators by choice, not necessity, and found ways to explain his complex theories to children and the elderly alike. But perhaps, if he’d had his way, he would rather have avoided words altogether, and preferred acrobatic feats of silent daring to get his message across. We might at least conclude so from his reverence f...

A 10 Billion Pixel Scan of Vermeer’s Masterpiece Girl with a Pearl Earring: Explore It Online

We admire Johannes Vermeer’s  Girl with a Pearl Earring   for many reasons , not least that it looks exactly like a girl with a pearl earring. Or at least it does from a distance, as the master of light himself no doubt stepped back to confirm countless times during the painting process, at any moment of which he would have been more concerned with the brushstrokes constituting only a small part of the image. But even Vermeer himself could have perceived only so much detail of the painting that would become his masterpiece. https://www.youtube.com/watch?v=cKaZYTwmjwU Now, more than 350 years after its completion, we can get a closer view of Girl with a Pearl Earring  than anyone has before through a newly released  10 billion-pixel panorama . At this resolution, writes Petapixel’s Jason Schneider , we can “see the painting down to the level of 4.4-microns per pixel.” Undertaken by Emilien Leonhardt and Vincent Sabatier of 3D microscope maker Hirox Europe ...

The History of the Fisheye Photo Album Cover

Like gothic script in heavy metal, the fisheye album cover photo seems like a naturally occurring feature of certain psychedelic strains of music. But it has a history, as does the fisheye photograph itself. The Vox video above begins in 1906 with Johns Hopkins scientist and inventor Robert Wood, a somewhat eccentric professor of optical physics who wanted to duplicate the way fish see the world: “the circular picture,” he wrote, “would contain everything within an angle of 180 degrees in every direction, i.e. a complete hemisphere.” Rather than putting them to underwater use, later scientists employed Wood’s ideas in astronomical observation. Their next stop was the professional photography market: the first mass-produced fisheye lens, made by Nikon, cost $27,000 in 1957. From academic journals to the pages of Life magazine: mass media brought fisheye photography into popular culture. An affordable, consumer-grade lens in 1962 brought it within the reach of the masses. For t...