The possible solution to Iron man's holograph UI

To implement the UI that we see in that Iron man holograph UI, using the current technology without the cost of an arm or a leg, here is the possible solution. Please see my previous post.

1. Using the augment reality glasses to project the model into our eyes
2. Give 3D vision to our computer

Questions I have are:

1. Do we have the product? Probably. I hope it works with Linux, has a simple/easy API to work with.
   It is not the critical part for this moment. If a Linux friendly 3D display is not ready yet, a stub can be used for development.
   (Action item, find what's out there)
2. Do we have 3D vision implemented for computers? Probably not, maybe not as well as mouse and keyboard. Maybe implement a simple version, for example, build the 3D tracking ability to a pen. (Action item, find a product, the hardware. If it doesn't exist, maybe put together of two webcams.)
3. What libraries, softwares and existing knowledge we can leverage. (Action item, learn)