VR/AR system. - https://docs.google.com/document/d/e/2PACX-1vRgoDtwTT6TZrJRVk_oJ6I7y8vUk-xnhu67rI9kywZV2jRMA5Siz0cG9HdhFPk7grP_IKvuywg1VYn1/pub
3D VR / AR system.
John Sokol Jan 2011
I am just planning to keep this one really really simple. Either they fund it or they don't. But just take what's off the shelf and bridge it to what already exists in the software world.
As they say "Flip it" meaning just do one thing, make money and sell it off, go on to the next. Not get too emotionally involved.
Yes some passion, it's very cool stuff. I think a low cost 3D display device that's cheaper than buying a home 3D setup and more flexible in its capabilities. But this is just a small stepping stone to where I want to get.
The unit consists of 2 Micro LCD display with 3D graphics, and can be embedded into a pair of video glasses. Specifically the display would be the: http://www.kopin.com/bdm-922k/ driven by an NVIDIA Tegra 3 chip.
The device should be able to play 3D movies and render 3D graphics for games and other applications located on people PC’s or Phone as well as be able to run applications stand alone.
The device should be able to play 3D movies and render 3D graphics for games and other applications located on people PC’s or Phone as well as be able to run applications stand alone.
Back in the late 80’s Virtual Reality was the next big thing. Companies like VPL were able to partner with Sun and SGI in making commercial Virtual Reality systems. Some companies even tried to bring this technology to consumers with 3D VR gaming systems that people would pay $20 just to try for 10 minutes.
It’s has also been the centerpiece of many TV shows from the Star Trek Holodeck to the more recent Battlestar Galactica spin off Caprica and for movies like Lawnmower man, Tron and Avatar.
Since then Augmented reality has also come into popularity. This is where the virtual world and the real world are mixed also known as Mixed reality. This allow you to see the real world with computer graphics superimposed over it, like showing in Terminator, Robocop and the binoculars used in Star wars. Today this is primarily in the form of smartphone apps that display animated characters over QR codes.
We are starting to see some of the first signed of this technology begin to reach the market with the Wii Mote and the XBox Kinect and other gesture recognition systems that have yet to reach the market.
Here we are today in 2011, and with Moore’s law, the prices of technology have dropped while the capabilities have soared to new heights since 1990’s.
- Low cost head worn video displays are readily available from China to watch video from your iPod with.
- Cell phone have low cost Dual core 1 Ghz CPU’s and graphics accelerators.
- 3D Content is starting to gain market traction and 3D TV’s are available in stores.
- 3D BlueRay, 3D Netflix, 3D Youtube and a bunch of new 3D cameras and Cell phones are making 3D a permanent part of the market.
Today there is not one consumer level 3D headsets, although 3D Glasses are common that work in conjunction with special displays and TV’s.
Not one company makes a mass consumer VR or AR products.
What I propose is to make a $300 to $500 retail price, portable, mobile VR / AR / 3D Video headset.
- 3D movies can be viewed in private.
- Virtual reality multiplayer 3D games can be played.
- The device can wirelessly communicate with laptops and mobile phones to take advantage of the phones communication , storage and processing power.
- Augmented reality application and games will change the world, there are many developers and some amazing applications for phones but no hardware is available to do the full 3D immersion versions of it.
- The device can be interfaced to exercise equipment so a run on the treadmill can turn in to a run on the beach in Maui. And stationary bike can be the tour de france. The applications for game in this area can be huge.,
- Remote control of AUV’s and other telepresence application that allow the viewer to see in 3D and respond to the wearers head movement.
Using off the shelf optics assembly and doing a custom PCB with CPU’s it is possible to take one of these video goggles to a whole new level.
With such a device 3D immersion into existing PC based games can be done.
Support for 3D graphics in HTML5 on the display, allowing for a 3D web experience.
Support for existing VR/AR applications.
To define a standard for the next generation of these applications to run on.
SPECS
Hardware
Nvidia Tegra 2 or Tegra 3 GPU. Multi Core Arm Processor with Graphic Acceleration.
Stereo Audio & Video
Support of WiFi and BlueTooth.
2 Camera Modules (option to provide Stereo Video Input for AR applications, improved tracking etc.)
3 Axis motion and gyro
ADXL330 3-axis accelerometer
MPU-6000/6050: World’s First Integrated 3-Axis Gyro, 3-Axis Accel and 9-Axis MotionFusion http://invensense.com/mems/gyro/mpu6000.html
Lithium Ion Batteries.
* Possible inclusion of separate external 3D spatial Controller, like Wii Mote or similar. with BlueTooth Interface.
Initial prototype could be build with off the shelf Tegra 2 dev board:
Software
Webkit
HTML5
OpenGL, WebGL
Arm Linux
LLVM
Video Streaming in and out of Stereo Video in MPEG2 and MPEG4 AVC, H.264
The main software is designed to run stand along to the web using WiFi or act as a slave device to a cell phone or PC that is doing graphics rendering.
Surfing a 3D web experience with 3D icons is already possible with current 3D setups on PC, this will all work on this device also and could make for a much richer 3D web experience.
No comments:
Post a Comment