Industrial Light & Magic
3 HN recommenders · recommended in 7 months, 2020–2023
4:43 · 2.5M views · Feb 20, 2020
ILM shows how The Mandalorian season one used a large curved LED wall to display interactive 3D environments in camera. The video covers the virtual production setup replacing location shoots.
Cited as the canonical look at LED-wall virtual production, referenced in threads on game engines in film and CGI.
9 comments from Hacker News
This video has a lot of examples: this video Part of the idea is to do as much as possible in-camera, by rendering the virtual surroundings at a high enough quality to directly film them as the actors' backdrop. It's sort of like a wildly more advanced version of using matte painting backdrops. It also seems far better for actor immersion than green screen, as the people on camera get a live wraparound view of the virtual 'set'.
The advances they've made in virtual production studio backdrops are amazing. Camera-linked floor-to-ceiling 180° LED screens and synced lighting is just amazing. The stuff they're able to do in The Mandalorian is incredible. Though once you know what to look for (the camo hiding the floor/wall seam) you can tell they're using it a bit too much. But still it's incredible. this video
Take a look at how they filled the Mandalorian. Quite a lot of it was filmed inside a large video wall / cube. One of the big advantages for them was that it resulted in far more realistic lighting. this video
It's an exciting time. Unreal Engine is being used to great effect in things like The Mandalorian: this video The latest developments in large language models are another area interesting to me personally as a developer. Since the beginning of the video game medium, limitations in programming game AI have left video games stuck in a corner, where they use violence as the primary means of driving immersion, simply because it's just too complicated to model human-like behavior outside the domain of simple carnival games. Some games try and brute force their way around this by explicitly picking from a set of predetermined branching paths at predetermined critical moments. But the latest AI tools, first seen in stuff like the GPT-3 powered AI Dungeon , reveal that there will soon be new methods of maintaining a coherent story in a simulated game. We won't have to resort to violence and fancy carnival games for much longer.
> That was done for lighting. I don't think that's correct, the ILM team presented this technology in a video: this video (paraphrased) "it was designed to both light the actors and be a background that we can photograph, so that we end up with real-time live pixels in-camera" Also from the article you linked: > If the content was created in advance of the shoot, then photographing actors, props and set pieces in front of this wall could create final in-camera visual effects — or “near” finals, with only technical fixes required, and with complete creative confidence in the composition and look of the shots. I'm not an expert in film terminology but it does not sound by any stretch that this was primarily about lighting.