In 2016 I worked with Data Arts Team at Google to record six artists doing their thing in VR. We wanted to give visitors of the site an idea of what VR was capable of by recording the artists' process as they painted, sculpted, and created designs in Tilt Brush.
Two Microsoft Kinect cameras was pointed at the artists from opposing angles. The resulting depth image was encoded as video and I wrote a renderer to decode this data and display them as wireframe and particles.
I also worked with the Tilt Brush team to re-create the brushes that existed in Unity in order to re-render the strokes exactly as how the artists intended them to be inside WebGL.