This is an experiment using Volume's depth prediction and 3D reconstruction system. Everything in the video was shot in real-time using an iPad.
This experiment with Pulp Fiction allows users to step inside one the film’s scenes in Augmented Reality, using Apple’s ARKit framework on an iPad. This experiment, is one of a few that the Volume team are conducting at the moment to illustrate the power of being able to reconstruct 3D scenes from 2D images.
The team is using a deep learning system to train the AI to break down, analyze and reproduce the 2D images as realistically as possible in AR.