OBJECT2D3D - Object (category) Detection, Localisation, Registration and Recognition

Object 01 Object 02 Object 03

Goals

The goal of this project is to solve some of the most fundamental problems in computer vision - detection, localisation and recognition of real 3-D objects in 2-D (or lately 2.X-D) images. The main focus is set to general methods which are automatic and perform accurately and reliably in many application areas. Methods should tolerate normal distortions in images (e.g. projective transformation, illumination, occlusion and noise),

This project is mainly carried out using academic funding from several sources and the methods are developed gradually in PhD theses during the course of work.

The current main objectives: Approaches currently under investigation:

Sub-projects

The project is currently divided to the following PhD tasks:
  1. EVEX - Object Evidence Extraction
  2. SPATMODEL - Spatial Constellation Models of Local Descriptors
The following projects benefit from the results of this project:
  1. FACEDETECT - Face Detection

News

The latest results of a very accurate object localisation will be presented in the ICCV2007 workshop!

Contact information

Joni Kämäräinen E-mail WWW Project leader, professor
Alexander Drobchenko E-mail WWW Post-graduate researcher
Jarmo Ilonen E-mail WWW Post-graduate researcher
Pekka Paalanen E-mail WWW Post-graduate researcher

Download

Source code

  1. -

Data sets

  1. -

Links to other resources

Research groups working on general object detection and recognition
CalTech Vision Group (prof Perona)
Univ. Oxford - Robotics Group (Visual Geometry Group) (Prof Zisserman)
Princeton Vision Lab (prof Li)
Univ. British Columbia - Lab for Computational Intelligence (prof Lowe)
Cornell Univ. - Computer Vision Group (prof Huttenlocher)
Data sets
Prof Li's group's 3D object category data set from ICCV2007

Documentation

Do not hesitate to to contact authors (e-mail, etc.) in order to retrieve copies or reprints of the following publications.

  1. Articles in international scientific journals with referee practice
    1. Ville Kyrki, Joni-Kristian Kämäräinen, Heikki Kälviäinen, Pattern Recognition Letters, Simple Gabor Feature Space for Invariant Object Recognition, (2004) pp. 311--318, No. 3 Vol. 25
    2. Miroslav Hamouz, Josef Kittler, Joni-Kristian Kämäräinen, Pekka Paalanen, Heikki Kälviäinen, Jiri Matas, IEEE Transactions on Pattern Analysis and Machine Intelligence, Feature-Based Affine-Invariant Localization of Faces, (2005) pp. 1490-1495, No. 9 Vol. 27
    3. Joni-Kristian Kämäräinen, Ville Kyrki, Heikki Kälviäinen, IEEE Transactions on Image Processing, Invariance Properties of Gabor Filter Based Features - Overview and Applications, (2006) pp. 1088-1099, No. 5 Vol. 15
    4. Jarmo Ilonen, Joni-Kristian Kämäräinen, Pekka Paalanen, Miroslav Hamouz, Josef Kittler, Heikki Kälviäinen, IEEE Transactions on Image Processing, Image feature localization by multiple hypothesis testing of Gabor features, (2008) pp. 311-325, No. 3 Vol. 17
  2. Articles in international compilation works and in international scientific conference proceedings with referee practice
    1. Joni-Kristian Kämäräinen, Ville Kyrki, Miroslav Hamouz, Josef Kittler, Heikki Kälviäinen, Proc. of the IAPR Workshop on Machine Vision Applications, Invariant Gabor Features for Face Evidence Extraction, (2002) pp. 228-231,
    2. Ville Kyrki, Joni-Kristian Kämäräinen, Heikki Kälviäinen, Proceedings of the 5th International Conference on Advanced Conce pts for Intelligent Vision Systems Theory and Applications, Simple Gabor Feature Space for Invariant Object Recognition, (2003) pp. 46--51,
    3. Miroslav Hamouz, Josef Kittler, Joni-Kristian Kämäräinen, Heikki Kälviäinen, Proc. of the 4th Int. Conf. on the Audio- and Video-Based Biometric Person Authentication (AVBPA2003), Hypotheses-Driven Affine Invariant Localization of Faces in Verification Systems, (2003) pp. 276-284,
    4. Joni-Kristian Kämäräinen, Jarmo Ilonen, Pekka Paalanen, Miroslav Hamouz, Heikki Kälviäinen, Josef Kittler, Proc. of the 14th Scandinavian Conf. of Image Analysis, Object Evidence Extraction Using Simple Gabor Features and Statistical Ranking, (2005) pp. 119-129,
    5. Jarmo Ilonen, Joni-Kristian Kämäräinen, Proc. of the Int. Joint Conf. on Neural Networks (IJCNN), Object categorization using self-organization over visual appearance, (2006) pp. 4549-4553,
    6. Alexander Drobchenko, Jarmo Ilonen, Joni-Kristian Kämäräinen, Albert Sadovnikov, Heikki Kälviäinen, Miroslav Hamouz, Proc. of the 15th Scandinavian Conf. of Image Analysis, Object class detection using local image features and point pattern matching constellation search, (2007)
    7. Jarmo Ilonen, Joni-Kristian Kämäräinen, Heikki Kälviäinen, Proc. of the 14th International Conference on Image Analysis and Processing (ICIAP2007), Fast extraction of multi-resolution Gabor features, (2007) pp. 481-486,
    8. Joni-Kristian Kämäräinen, Miroslav Hamouz, Josef Kittler, Pekka Paalanen, Jarmo Ilonen, Alexander Drobchenko, Proc. of the ICCV 2007 Workshop on Non-Rigid Registration and Tracking Through Learning (NRTL2007), Object Localisation Using Generative Probability Model for Spatial Constellation and Local Image Features, (2007)
    9. Joni-Kristian Kämäräinen, Jarmo Ilonen, 20th Int. Conf. on Pattern Recognition (ICPR2010), Learning and Detection of Object Landmarks in Canonical Object Space, (2010)
  3. Scientific monographs
    1. Joni-Kristian Kämäräinen, Ph.D thesis, Feature Extraction Using Gabor Filters, (2003) pdf (2.47 MB)
    2. Jarmo Ilonen, Ph.D thesis, Supervised local image feature detection, (2007) pdf (10.26 MB)
  4. Other Scientific Publications
    1. Jarmo Ilonen, Joni-Kristian Kämäräinen, Heikki Kälviäinen, Efficient Computation of Gabor Features, (2005) No. 100 pdf (1.06 MB)
    2. Ville Kyrki, Joni-Kristian Kämäräinen, Simple Gabor Feature Space for Invariant Object Recognition, (2003) No. 83