Mirror Image

Mostly AR and Stuff

Tracking planes in the city

In relation to tracking cityscape I did some planar segmentation test. Segmented FAST generated corners with simple 5-points projective invariant.
In some cases 5-point give some rough approximation:
planar segments
In some cases outliers are quite bad – some point have very close projective invariant but still are in diffferent planes.
bad seggment
So simple method not quite work…

19, March, 2009 Posted by | Coding AR, computer vision | , , , , , , , , , | 4 Comments

Region Tracking

Experimenting with MSER region tracking
The problem is that regions seems not stable enough and way too big.
MSER of downsampled images, original images, MSER of mean shift filtered images, MSER of smoothed images:
mser
Mean shift filtering seems capture more feauters, but it’s too computationally expensive.

3, March, 2009 Posted by | Coding AR | , , , , , , | Comments Off on Region Tracking

Nintendo DSi and Augmented Reality revisited

Returning to my old post about DSi and AR, it’s known now that main DSi CPU is 132 Mhz. That is marginally acceptable for markers based AR games. What kind of performance can be achieved for DSi ?
Here is my old Nokia 6600 demo which run at 107Mhz CPU phone. With DSi 133Mhz CPU+second 33Mhz CPU I’d estimate the same game can run on DSi at 8-10 fps. That’s is not a stellar, but nevertheless playable frame rate. Could be faster with some aggressive optimization or simplifications.

20, February, 2009 Posted by | Augmented Reality, Mobile, mobile games, Nintendo DSi | , , , , | 1 Comment

Future of Augmented Reality social networks :)

From Abstruse Goose
goose

18, February, 2009 Posted by | Augmented Reality | , , , , | 2 Comments

My take on the next gen mobile augmented reality device specs

Everyone talking about what near-future AR device should look like, so I’d like too.

First possibility – videoglasses with camera + lightweight PC.
Dedicated wearable PC is out IMO, it’s a too hardcore staff.
Next close thing is a netbook. Netbook could be used both in its main capacity and as an AR platform. However the problem here is the weight. Somehow I don’t think average user would want to carry around 1kg netbook in the backpack, while using AR. Anything more light wouldn’t have enough processing power to track mid-resolution stereo cameras in real time. Nevertheless weight could be reduced.
Make display and keyboard detachable, use carbon fiber case and easily replaceable dual (or may be triple) batteries. If all this would reduce weight below 400g while keeping CPU above 1.5Mhz with 2.5 hours of full load battery life (5 hours with dual batteries) such netbook could be viable platform for AR with videoglasses.

Second possibility – handheld/smartphone. Here we have severe limitations on the battery/CPU/GPU. That’s why I don’t think high resolution display would be beneficial for such AR device. To process high-resolution images require a lot of CPU power. And with small size of display hi-res wouldn’t look much better then low/mid res. 320×240 is good enough , 400×320 is optimal probably. For the same reason 1 Mb camera is enough too, but it should be fast, preferably 60 fps, camera with high quality sensors, without any distortions and good for low-light conditions. I’m not sure about auto-focus. Slow auto-focus could be a problem. Accelerometers and compass would be good. GPS is a must. CPU – 600 Mhz at least, with hardware floating point. Lightweight GPU. Most important thing is API. Complete access to Image Processor (if present), Digital Signal Processor and raw camera data. That kind of API is not easily accessible on the most of the modern smartphones.
Actually if existing smartphones had such an API opened right now there would be breakthrough in the mobile AR already. Access to DSP could make image processing a lot faster.

Now would any such device allow real time AR like in the Coca-Cola avatar ad? Definitely no.
The bottleneck here is the battery IMO. We have to wait for some new future tech like carbon nanotubes
supercapacitors to see complete coverage AR.

1, February, 2009 Posted by | Augmented Reality | , , , , , , , | 5 Comments

Markerless tracking with FAST

Testing outdoor markerless tracking with FAST/SURF feature detector.
The plane of the camera is not parallel to the earth, that make difficult for eye to estimate precision.
registration

29, January, 2009 Posted by | Uncategorized | , , , , , , , , | Comments Off on Markerless tracking with FAST

Sony camera with face and scene recognition

Sony DSG-G3 camera run busybox linux and have scene(?) and face recognition. With more and more computer vision algorithms integrated into cameras, and more powerful CPUs, cameras becoming essentially AR platform.

14, January, 2009 Posted by | Augmented Reality | , | Comments Off on Sony camera with face and scene recognition

Detachable magnetic lens for mobile phone

Interesting accessory – detachable lens which can be attached to any mobile phone. If phone camera is not magnetic enough there in adhesive magnetic ring to glue to the phone. (through smartmobile twitter)
magnetic lens

4, January, 2009 Posted by | Mobile | , , | Comments Off on Detachable magnetic lens for mobile phone