Markerless tracking

I’ve started experimenting with markerless tracking. I’ve captured several cityscape image sequences and processed them with SURF detector. I’ve used Nokia N95 viewfinder frames. Here descriptors were oriented:

There are some corresponding features detected in both images, but their descriptors arn’t fit.
Interesting, upright, not oriented descriptors give little different picture – some new correspondences found, some lost.