This week involved learning about nDisplay, combining in camera with a virtual screen (a scene set up in UE5) and gaining a realistic representation of parallax effect. Jason and Cam did a little demo for the open day, with a scene of Australian NT landscape (mixed with some local gum tree branches to add to the illusion!).
Here is link to the clip:
The camera in the physical space is marked, like you would mark-up a person to tack their movements with the Vicon motion capture system. This real footage is linked with the scene in UE5, where a blend of in camera and virtual come together. The actors can perform with the scene in the background and the camera can then move around the physical space, creating a parallax effect. Lighting of the physical scene is important to match the lighting of the virtual scene, to make it as believable as possible. It also helps to add real props in the physical scene, that layers a foreground/mid ground/background effect, just like the tree branch example in the Flinders Uni open day, adding depth to the illusion.
Below are the behind the scene images that I captured throughout this process:
This photo above is from the second part of the session that we had with Brittany, a drama graduate who won a Helpman Academy program, enabling her to further specialise in motion capture acting, working a with a motion capture mentor that teaches her a range of detailed moves for different character types. We were given the task of marking her up so that she could play a robot character; one that we had to reconfigure to match her body, so that the robot could match her walking movements better.
Comments