I wrote a custom calibration utility built on top of OpenCV in unity to calibrate leap motion to projector. Then I projected leap motion's tracking directly back to my hand.
This is a small two day experiment to see how far I can get with some projection mapping.