A three-year project to research and develop new VFX tools will present its first findings at next week’s FMX animation and effects conference.

Members of the European Commission-funded Project Dreamspace include representatives from The Foundry, Ncam, Stargate Germany, CreW, Saarland University, iMinds and Filmakademie Baden-Wuerttemberg.

It hopes to tackle issues around collaborative workflows and combining live performances, video and computer-generated imagery in real-time.

The initial findings will be focused on the technical components necessary to enable virtual production.

“As virtual and augmented reality continue to command attention from content creators, our main challenge remains finding ways in which complex, highly technical content can be created faster, with more flexibility and creativity,” said Jon Starck, head of research at The Foundry and technical coordinator for Project Dreamspace.

Key findings the group will present include:

  • Markerless camera tracking with depth keying
  • Omnidirectional video for virtual sets
  • Lighting capture to match real and virtual lights
  • Interchangeable real-time and high-quality rendering
  • Real-time compositing connected to post-production
  • On-set tools for intuitive and collaborative set-up and visualisation
  • New immersive experiences

Some of the members of Project Dreamspace will give presentations at FMX.

FMX takes place in Stuttgart, Germany from 5 to 8 May.