The Goal:
Back in 1996 - JCS Productions embarked on a challenging quest to create world's first Sci-Fi sitcom using Virtual Production.
The Challenge:
Due to severe budget constraints, our team was tasked to avoid creating expensive real-world television set, and our direction was to produce Merged/Extended Reality pilot for Sci-Fi TV show - by designing an effective process for Virtual Production - real-time combination of actors and 3D CG virtual set.
The Work:
I was assigned a task to Lead Virtual Set assets production and technological pipeline to produce the pilot for Low-Tech Sci-Fi sitcom dubbed ''Halalit'' (Space Ship).
According to co-creator and TV Director of the project - Eyal Sher - we were on a task to create Israel's parody on prime-time Science Fiction shows, creating ''Halalit'' as low-tech Sci-Fi sitcom, spiced up with some political satire.
My roles:
Wearing few hats, I was responsible for part of Concept Art, Visual Effects Direction, Animation, and Project Management. Being principal co-inventor of the first Virtual Production concept/technology (created at Pixel Control - later to become Viz-RT) - I had no fears of incoming problems!
Under the supervision of JCS's producer - Udi Rabina, and with great help of RT-Set's Rafi Brin and lead JCS modeler Ofer Sadot - we created pioneering production pipeline that tied real-time ''XR'' Virtual-Set-based production - into post-production: editing, additional animation, and VFX.
Solution:
Using Rt-Set's technology, Studio Cameras were synchronized with real-time CG renderings coming out of SGI Monster Reality engine - allowing actors performing against chroma-key studio - to be superimposed over virtual set of the spaceship - in real time!
Keeping original component videos - of both real-time CG and actors against chroma-key recorded on digital betacam tapes - we were able later in postproduction - to address any glitches or mistakes, and re-compose critical shots using conventional compositing/VFX.
Difficulties:
Back in those times, technical challenges of creating ambitious real-time 3D - were mind-boggling. Entire set had to be created on very-low poly count (below 45000 polygons), while all textures had to be stitched in only two 2K x 2K image files!
Spaceship's TV set had to represent low-tech Sci-Fi, and remind more on the submarine - rather than the space-ship : )
Achieved:
To our best knowledge - Halalit was the first (crazy : ) attempt to create Virtual-Studio-based TV series. Virtual studio solution for Merged Reality TV production enabled great savings and flexibility of set creation and modifications. It was possible to shoot 22 minute episode in only 2 production days - which included studio/set rehearsals.
Encouraged by the results, JCS - Jerusalem Capital Studios - formed a new department - dedicated to creation/production of original television content.
