From HIT Lab Australia
Details of AUDF Innovation Grant Application
Name: Utilising iPhone/iPod touch for controlling 3D applications
Applicant: Christian McGee
Date: October 3, 2008
The basic aim of the project will be to develop an iPhone/iPod touch client app that allows the user to interact with a 3D application being displayed on a computer screen (and previewed on the iPhone as well) wirelessly using the UI features built into the iPhone. Perhaps even utilise the accelerometer to enable tilt control.
The project may also need to develop a server/controller application that manages the input received from the iPhone/iPod touch and in real time manipulates a 3D application displayed on the VisionSpace.
For proof of concept, the server and client apps will communicate via wi-fi using an airport extreme to set up an internal wireless network. However the iPhone should be able to communicate via a 3G internet connection from anywhere in the world.
The ability for multiple iPhones (ie people) to interact with the same 3D application simultaneous would also be investigated.
Another basic aim of the project would be to provide a more intuitive wireless controller for the HIT Lab Visionspace and utilise the unique touch screen features available on the iPhone. Currently the VisionSpace at HIT Lab NZ uses a FlyStick from Advanced Realtime Tracking (ART) as an input device. The FlyStick is basically an expensive wireless controller very similar to a wireless games controller. It interacts well with the ART Infrared Tracking system which has just been purchased. HIT Lab Australia has decided not to purchase a FlyStick at the moment and investigate other options. The FlyStick is not real intuitive for zooming, panning and rotation operations on 3D images. It is hoped that the iPhone will provide a more intuitive human/computer interface.
Educational Uses
Being able to control applications (not just 3D applications) via the iPhone’s touch screen could have many applications in the education and other sectors. The HIT Lab is currently establishing links and collaborations with many UTas schools and bodies including Architecture, Performing Arts, Engineering, Human Movement, Human Life Sciences, Nursing, Computing and Information Systems and the Maritime College. Part of the project would be to work with these groups to find new and innovative uses of the iPhone as a wireless controller for 3D and possibly other applications. Initially, the project would concentrate on utilising the iPhone on applications developed for the VisionSpace.
Required Equipment/Software
- 2 x iPhone and /or iPod Touch
- 1 x Airport Extreme (wireless connectivity)
- 1 x MacBook Pro – application development
- Xcode and iPhone SDK
Deliverables
- Client iPhone/iPod touch application
- Server application
- Example 3D applications that can be controlled utilising 1 and 2
