Connect with us

Filmmaking

The metaverse has been heavily hyped – but it could enable entirely new ways of screen production

Published

on

The metaverse has been heavily hyped – but it could enable entirely new ways of screen production


Screen production was hit hard by the pandemic, with delayed releases and interrupted or cancelled production. One day we might even get to see Mission Impossible 7.

But, like your typical screen hero, it might just be the metaverse to the rescue. Let us explain.

What is the metaverse, why it is important?

Mark Zuckerberg, CEO of Meta (formally Facebook) presents the metaverse as the future of human interaction where
the alignment of virtual and augmented realities (VR and AR) allows us to work, rest and play via a second virtual life that can be accessed by a screen or overlaid (via special glasses) onto the real world.

But how does this help us make our favourite screen content during a pandemic? Or the next global emergency?

What we can do now

Traditional production relies on cast and crew being in the same location at the same time. The past two years have shown there is a strong need to be able to either shoot films where the cast/crew are in separate locations, or where the production space is partly or wholly in a virtual space (such as The Lion King remake).

What we can do now, even with a nascent metaverse, is significant. The current tools of the trade include technology such as deepfakes that uses machine learning techniques to seamlessly stitch anyone in the world into a video or photo and production computer programs (such as Unreal Engine) that create locations and avatars.

Disney studio The Volume, home to The Mandalorian, uses this latest technology to brilliant effect. In The Mandalorian, high-definition digital screens are attached to the walls and roof, providing background, perfect perspective and light, using a mixture of real and wholly computer-generated imagery.

Working with the caveat that money is no object, here’s how these technologies can currently be deployed when tackling the two most pressing production problems in a post-COVID world.

The Mandalorian (Pedro Pascal) and The Child in Season 2 of The Mandalorian on Disney+.
Disney+

Problem 1: the director in one location, the cast and crew in another

If this was The Lion King remake, director John Favreau could just access the virtual environment remotely using his VR device from his home media room. For other productions, the director can interact with the actor via AR glasses the actor puts on between takes to make it seamlessly appear the director is in the room.

In this way the function of the media room evolves, becoming a home communications hub with an array of cameras and displays. This is already happening and is something big tech is looking to accelerate. Products such as Microsoft’s Mesh for Teams are being rapidly rolled out, where mixed-reality allows for three-dimensional holographic interaction for meetings and collaboration.

Problem 2: the director, star and co-star all in different locations

As of today, we can:

(a) film each actor separately with different crews in front of a green screen, and then match the backgrounds (but the actors will have no interaction).

(b) use AR glasses for the actors to see each other, then digitally remove them as Justice League did with Henry Cavill’s moustache.

(c) use two human stand-ins and use deepfake technology to modify their faces. This is useful if the actors need to touch.

However, all have drawbacks – or, in fact, the same drawback. The actor.

Until we can perfect both the realism of the person and the performance, (just look at the brilliant but not-quite-good-enough Mark-Hamill-less Luke Skywalker in The Book of Boba Fett) the Metaverse will never quite fulfil its potential as a true alternative environment for screen production.

The latest iteration of the young Luke Skywalker was generated from a combination of physical actor (not Mark Hamill) and deepfake technology. It looked physically perfect, but not when “Luke” began talking. This necessitated most of the dialogue to be spoken off-camera. There was also a strong sense of the uncanny valley about the performance, originally named for the negative emotional response towards robots that seem ‘almost’ human.

A de-aged Mark Hamill as Luke Skywalker in Disney’s The Book of Boba Fett.
Disney+

Forward to the future

The day of perfect human avatars could be coming very soon. It was foreseen by novelist/futurist Michael Crichton – not in Westworld or Jurassic Park, but his obscure 1981 film Looker. The story concerns technology that scans and animates actors, allowing them to retire and simply manage their image rights.

In this proposed near future, COVID is not a concern, nor the death of an actor during production. All films can be made like The Lion King, in a virtual environment.

Actors will remote-in from their media rooms to control their avatars, or perhaps not. In the future, Mark Hamill can have two prices: one where he turns up, another where just his digital twin is used, one that can procedurally generate his performance by watching all of his films to work out what acting choices to mimic.

Just because we can, should we?

History shows us new technology is not usually taken up wholesale and old technology never completely dies. Think vinyl. What is more probable is a certain reverse snobbery. Many shows will fully use the metaverse, enabling them to keep shooting despite real-world calamities.

Perhaps a whole new hybrid genre will be formed. Films that might have once been animation can now be photorealistic – call them “live-animations”.

But in a future where most of us will be eating meat grown in a laboratory, only the top restaurants will still be using living animals. The same is likely for screen production: the ultimate prestige picture will be made old-school, real actors really acting against each other in real environments, pandemics and the metaverse be damned.



Source link

Continue Reading
Click to comment

Leave a Reply

Filmmaking

‘Reel justice’: a unique collaboration between university filmmakers and police

Published

on

By

‘Reel justice’: a unique collaboration between university filmmakers and police


How can universities build better relationships with the communities around them? Academia is increasingly considering this question. And finding innovative ways to demonstrate value and connect with wider society.

This was on my mind when I learnt about a fascinating collaboration between the police and aspiring, young filmmakers at the University of Sunderland, which shows the power of research as a tool for public good.

I work for Universal Impact, The Conversation’s commercial subsidiary, and we recently travelled to the northeast to give a training course to University of Sunderland researchers on how to identify, and communicate with, different audiences for their work.

Whenever we work with academics, I’m reminded of the quality and diversity of research taking place all around us – stretching, in this case, from preventing liver damage to boosting performance in modern pentathlon.

After the course, we built on the training with a mentoring programme for a group of researchers including Adelle Hulsmeier, who leads the university’s screen performance BA programme.

Adelle Hulsmeier’s project brings together filmmaking and policing.
University of Sunderland/David Wood

I’m a bit of a movie buff. So I was interested to learn about the unique initiative Adelle runs, bringing together young people and police around an unexpected common ground – film.

Here’s how it works. Northumberland Police suggests themes, students make short films inspired by those themes, and the films are then used as education and training resources.

Like many of my favourite directors, Adelle believes it’s possible to address some of the most pressing social issues through storytelling.

A new approach

The project comes as public trust in the police is in decline, particularly among members of Gen Z (broadly, those born between 1996 and 2010).

Children and young people are also disproportionately affected by crime, often as victims of the most serious offences. But these films offer an opportunity to change the narrative.

And as the Labour government is proposing “respect orders” to address the UK’s 6.7 million annual offences — which cost taxpayers £58.9 billion in 2023-24 — this novel approach seems particularly timely.

Over the past 11 years, more than 1,000 students have worked on at least 50 films, covering topics such as sexual exploitation, domestic violence, male rape and “county lines” drugs trafficking.

The films’ influence extends far beyond the university. They have been integrated into training programmes for police officers, healthcare workers, teachers and other professionals.

Community engagement

The collaboration was born of a desire to make issues of crime and policing widely accessible, with Adelle striving to bridge the gap between academic learning and societal impact.

In 2019, the project received the Collaborative Award for Teaching Excellence from Advance Higher Education, recognising the initiative’s outstanding contribution to education and community engagement.

The programme has also been praised by former Labour MP and Victims’ Commissioner Dame Vera Baird, who described the films as an effective way for the police to “transmit messages in a way that we cannot”.


Looking for something good? Cut through the noise with a carefully curated selection of the latest releases, live events and exhibitions, straight to your inbox every fortnight, on Fridays. Sign up here.


Meanwhile, the project is also an opportunity for students to develop critical skills and gain invaluable industry experience.

By empowering students to tackle real world social issues, the University of Sunderland is not only preparing them for the future but also helping to shape a safer, more empathetic world.

This partnership is a testament to the mutual benefits that come from universities and public sector organisations working collectively towards common goals that support their local communities.


At Universal Impact, we offer specialist training, mentoring and research communication services – donating profits back to The Conversation, our parent charity. If you’re a researcher or research institution and you’re interested in working together, please get in touch – or subscribe to our weekly newsletter to find out more.



Source link

Continue Reading

Filmmaking

Blurry, morphing and surreal – a new AI aesthetic is emerging in film

Published

on

By

Blurry, morphing and surreal – a new AI aesthetic is emerging in film


Type text into AI image and video generators, and you’ll often see outputs of unusual, sometimes creepy, pictures.

In a way, this is a feature, not a bug, of generative AI. And artists are wielding this aesthetic to create a new storytelling art form.

The tools, such as Midjourney to generate images, Runway and Sora to produce videos, and Luma AI to create 3D objects, are relatively cheap or free to use. They allow filmmakers without access to major studio budgets or soundstages to make imaginative short films for the price of a monthly subscription.

I’ve studied these new works as the co-director of the AI for Media & Storytelling studio at the University of Southern California.

Surveying the increasingly captivating output of artists from around the world, I partnered with curators Jonathan Wells and Meg Grey Wells to produce the Flux Festival, a four-day showcase of experiments in AI filmmaking, in November 2024.

While this work remains dizzyingly eclectic in its stylistic diversity, I would argue that it offers traces of insight into our contemporary world. I’m reminded that in both literary and film studies, scholars believe that as cultures shift, so do the way we tell stories.

With this cultural connection in mind, I see five visual trends emerging in film.

1. Morphing, blurring imagery

In her “NanoFictions” series, the French artist Karoline Georges creates portraits of transformation. In one short, “The Beast,” a burly man mutates from a two-legged human into a hunched, skeletal cat, before morphing into a snarling wolf.

The metaphor – man is a monster – is clear. But what’s more compelling is the thrilling fluidity of transformation. There’s a giddy pleasure in seeing the figure’s seamless evolution that speaks to a very contemporary sensibility of shapeshifting across our many digital selves.

Karoline Georges’ short film ‘The Beast.’

This sense of transformation continues in the use of blurry imagery that, in the hands of some artists, becomes an aesthetic feature rather than a vexing problem.

Theo Lindquist’s “Electronic Dance Experiment #3,” for example, begins as a series of rapid-fire shots showing flashes of nude bodies in a soft smear of pastel colors that pulse and throb. Gradually it becomes clear that this strange fluidity of flesh is a dance. But the abstraction in the blur offers its own unique pleasure; the image can be felt as much as it can be seen.

2. The surreal

Thousands of TikTok videos demonstrate how cringey AI images can get, but artists can wield that weirdness and craft it into something transformative. The Singaporean artist known as Niceaunties creates videos that feature older women and cats, riffing on the concept of the “auntie” from Southeast and East Asian cultures.

In one recent video, the aunties let loose clouds of powerful hairspray to hold up impossible towers of hair in a sequence that grows increasingly ridiculous. Even as they’re playful and poignant, the videos created by Niceaunties can pack a political punch. They comment on assumptions about gender and age, for example, while also tackling contemporary issues such as pollution.

On the darker side, in a music video titled “Forest Never Sleeps,” the artist known as Doopiidoo offers up hybrid octopus-women, guitar-playing rats, rooster-pigs and a wood-chopping ostrich-man. The visual chaos is a sweet match for the accompanying death metal music, with surrealism returning as a powerful form.

Doopiidoo’s uncanny music video ‘Forest Never Sleeps’ leverages artificial intelligence to create surreal visuals.
Doopiidoo

3. Dark tales

The often-eerie vibe of so much AI-generated imagery works well for chronicling contemporary ills, a fact that several filmmakers use to unexpected effect.

In “La Fenêtre,” Lucas Ortiz Estefanell of the AI agency SpecialGuestX pairs diverse image sequences of people and places with a contemplative voice-over to ponder ideas of reality, privacy and the lives of artificially generated people. At the same time, he wonders about the strong desire to create these synthetic worlds. “When I first watched this video,” recalls the narrator, “the meaning of the image ceased to make sense.”

In the music video titled “Closer,” based on a song by Iceboy Violet and nueen, filmmaker Mau Morgó captures the world-weary exhaustion of Gen Z through dozens of youthful characters slumbering, often under the green glow of video screens. The snapshot of a generation that has come of age in the era of social media and now artificial intelligence, pictured here with phones clutched close to their bodies as they murmur in their sleep, feels quietly wrenching.

A pre-teen girl dozes while holding a video game controller, surrounded by bright screens.
The music video for ‘Closer’ spotlights a generation awash in screens.
Mau Morgó

4. Nostalgia

Sometimes filmmakers turn to AI to capture the past.

Rome-based filmmaker Andrea Ciulu uses AI to reimagine 1980s East Coast hip-hop culture in “On These Streets,” which depicts the city’s expanse and energy through breakdancing as kids run through alleys and then spin magically up into the air.

Ciulu says that he wanted to capture New York’s urban milieu, all of which he experienced at a distance, from Italy, as a kid. The video thus evokes a sense of nostalgia for a mythic time and place to create a memory that is also hallucinatory.

Andrea Ciulu’s short film ‘On These Streets.’

Similarly, David Slade’s “Shadow Rabbit” borrows black-and-white imagery reminiscent of the 1950s to show small children discovering miniature animals crawling about on their hands. In just a few seconds, Slade depicts the enchanting imagination of children and links it to generated imagery, underscoring AI’s capacities for creating fanciful worlds.

5. New times, new spaces

In his video for the song “The Hardest Part” by Washed Out, filmmaker Paul Trillo creates an infinite zoom that follows a group of characters down the seemingly endless aisle of a school bus, through the high school cafeteria and out onto the highway at night. The video perfectly captures the zoominess of time and the collapse of space for someone young and in love haplessly careening through the world.

The freewheeling camera also characterizes the work of Montreal-based duo Vallée Duhamel, whose music video “The Pulse Within” spins and twirls, careening up and around characters who are cut loose from the laws of gravity.

In both music videos, viewers experience time and space as a dazzling, topsy-turvy vortex where the rules of traditional time and space no longer apply.

A car in flames mid-air on a foggy night.
In Vallée Duhamel’s ‘The Pulse Within,’ the rules of physics no longer apply.
Source

Right now, in a world where algorithms increasingly shape everyday life, many works of art are beginning to reflect how intertwined we’ve become with computational systems.

What if machines are suggesting new ways to see ourselves, as much as we’re teaching them to see like humans?





Source link

Continue Reading

Filmmaking

We’re in a golden age for body horror films – as Demi Moore’s The Substance proves

Published

on

By

We’re in a golden age for body horror films – as Demi Moore’s The Substance proves


In the 1980s, film scholar Barbara Creed coined the term the “monstrous-feminine”. It refers to the way that female monsters are typically portrayed as threatening and disgusting for reasons connected to their bodies and their sexuality. New film The Substance takes a leaf out of Creed’s book by proposing a feminist critique of female experience through the visceral language of the body horror, a sub-genre preoccupied with the transformation, destruction or grotesque exaggeration of the human body.

The Substance is a film about a fading Hollywood star who will go to any lengths to stay beautiful. After having her TV aerobics show cancelled, Elisabeth Sparkle (Demi Moore) resorts to a mysterious serum that can create a “better” version of her – a younger double she can inhabit a few days at a time.

As the pull of success and the return of public recognition lure Sparkle away from her older, now abandoned self, horrendous mutations ensue. It seems poignant that the protagonist of this dark parable should be played by Moore, an actor whose looks have long been scrutinised.

In the October issue of Sight and Sound, the film’s director, Coralie Fargeat, explains that it’s not intended as a caricature, but “a mirror of society’s misogynistic mentality”. It really is “that gross … that violent in the real world,” she argues.

Many agree with her. In a review for Film International, film critic Alexandra Heller-Nicholas goes as far as to call The Substance a “documentary”, due to its “emotional fidelity”. That is, its ability to make literal the disconnection between body and consciousness caused by ageing, which impacts women particularly negatively.

The trailer for The Substance.

A growing body of films

The Substance is not the only major film in 2024 to be marketed, either fully or in part, as “body horror”. This is surprising because body horror originally emerged as a niche, often independently produced, sub-genre.

Body horror’s gruesome aesthetic and themes of corporeal decay, transformation and mutilation can be off-putting for many viewers. Yet films like Love Lies Bleeding, Tiger Stripes and I Saw the TV Glow (which all had wide releases in 2024) have turned to the sub-genre. Their directors have been drawn to its ability to tell timely stories about the way corporeality, identity and social interactions cannot be separated.

These films are largely about marginalised or maladjusted people. They show how our personal actions and sense of identity are always affected by the availability of role models and the limitations imposed on people by governmental, educational, religious and familial forces. For example, the teenage protagonist in Tiger Stripes rebels against the expectations that, because she is a girl, she should cover her hair, show modesty and be courteous.

From Poor Things and Infinity Pool (both 2023) to Hatching (2022) and Titane (2021), the 2020s are shaping up into something of a new golden age for body horror.

Novelist A.K. Blakemore has written of the rise of “femcore” – a literary trend of “ultraviolent body-horror”. Eliza Clark’s Boy Parts (2020), Alison Rumfitt’s Brainwyrms (2023), Monika Kim’s The Eyes Are the Best Part (2024) and the anthology Of the Flesh (2024) are included under this label.

And there’s a similar trend emerging in streaming shows, from the episode The Outside from Guillermo del Toro’s Cabinet of Curiosities (2022) to Alice Birch’s remake of David Cronenberg’s Dead Ringers (2023).

The body horror in The Substance.
Courtesy of Mubi

A sub-genre with substance

One of the key things that characterises this contemporary wave of body horror is the influx of directors who identify as women and as queer.

There were far fewer women and queer directors in the late 1970s and 1980s, when body horror gained popularity thanks to films like The Evil Dead (1981), The Fly (1986) and Hellraiser (1987), than there are now. This decade has made big moves towards inclusion, and the film industry has been greatly impacted by social movements like Me Too, Trans Lives Matter and Black Lives Matter, even if much work is yet to be done.

Body horror is particularly appealing to creators who would have previously found it difficult to make a living in the world of commercial filmmaking. Filmmakers (including Rose Glass, Amanda Nell Eu, Jane Schoenbrun, Hanna Bergholm, Julia Ducournau, Michelle Garza Cervera, Natalie Erika James, Alice Maio Mackay, Nia DaCosta and Coralie Fargeat) have found a valuable lexicon for feminist, trans-activist and anti-racist messages in the sub-genre. Many of them talk about their work as highly personal – if not based on their direct experience.

The body horror sub-genre is attuned to the violence of social exclusion and discrimination. Its metamorphic, painful, insidious and carnal nightmares help articulate the concerns of a new generation of artists for whom corporeality, and sometimes simply being visible, has become a political statement.

David Cronenberg closed his classic body horror film Videodrome (1983) with the emblematic line: “Long live the new flesh!” He needn’t have worried. It’s here to stay.


Looking for something good? Cut through the noise with a carefully curated selection of the latest releases, live events and exhibitions, straight to your inbox every fortnight, on Fridays. Sign up here.




Source link

Continue Reading

Trending