As promised, something cool! This video demonstrates Markerless Augmented Reality on an iPhone 3Gs. It is done using natural feature tracking by inspecting FAST corners as demonstrated in the previous video here: http://www.youtube.com/watch?v=I4RnDjmGry8
Just a short post regarding the detection of FAST corners on an iPhone 3Gs using only the official SDK (ie, Appstore ready). This video differs from the previous ones in that it’s extremely fast (total processing time per frame is 10ms) and it can detect and draw thousands of points of interest using FAST, OpenCV [...]
This video demonstrates my first attempt at tracking FAST corners using SURF descriptors on the iPhone 3G. The framerate is still quite low but I haven’t started optimizing the code for the phone yet. The table below shows the relative amount of processing time each step takes, hopefully each can be reduced. This post is [...]
As part of my research I am developing tools and libraries for use at the MIH Medialab at Stellenbosch that will allow us to create Augmented Reality applications on mobile devices. In the screenshot you can see the output of the Cambridge FAST corners algorithm running on an iPhone 3G. Video frames are captured from the iPhone’s camera using the camera callback Hook trick published by the brilliant iPhone hacker Norio Nomura (to whom I am eternally grateful). The video frames are processed by OpenCV which was compiled for the iPhone (static libs) and then passed onto the FAST corner detection algorithm with Nonmaximal suppression enabled. The resulting points are simply drawn on a transparent UIView overlayed on the cameraPreview view.
Sign up for our newsletter: