The task of automatic document analysis and recognition is very common in everyday life. Basically, every time when a user needs to automatically parse and recognize some content from a picture captured with a mobile phone/tablet or a scanned document – for example, text, tables, links, etc., automatic document recognition and text analysis come to the stage.
Marker-based augmented reality (AR) is extremely popular nowadays. However, full user immersion is possible only in the case of robust real-time computer vision solutions working on the mobile device. We have developed a custom hybrid tracking system based on local feature tracking and template-based matching. The tracking engine tracks the homography changes using optical flow algorithm and then refines the residual warp using the optimized template matcher.