3D AUGMENTED REALITY

a) Acquisition systems for images and 3D models

1) Image formation and camera model
Perspective projection, Pin-hole camera, Thin lenses, Fish-eye lenses, simplified and general camera model, camera calibration.

2) Computation of salient points and features
Harris e Stephens method, Scale Invariant Feature Transform (SIFT), salient points correspondences.

3) Homographies
Computationof homographies (DLT), homographies and object detection, applications of 2D augmented reality.

4) Stereopsys
3D Triangulation, epipolar geometry, epipolar rectification, essential matrix and factorizzation, motion and structure from calibrated homography, local correspondence methods, window correspondence methods, accuracy-reliability trade-off, occlusions, global correspondence methods.

5) 3D reconstruction from other sensors
IR Structured-light depth sensors (MS Kinect v.1), Time-of-Flight depth sensors (MS Kinect v.2), active stereo sensors, laser scanners.

6) Non-calibrated reconstruction
Fundamental matrix and its computation, projective reconstruction from 2 and N views, incremental reconstruction, Structure-from-Motion, bundle adjustment.

7) Optical flow
Motion field: computation of motion and structure.

8) Orientation methods
Quaternions, orientation 2D-2D, orientatio 3D-3D: DLT and ICP methods, orientation 3D-2D.

b) Machine learning methods for augmented reality

9) Object detection and scene understanding
Image and 3D models features, image/object classification strategies, machine learning algorithms for object classification, Support Vector Machine for image/object classification, Deep Neural Networks for image/object classification, application of Deep Learning strategies to Human-computer interfaces (HCI).

c) visualization and graphical rendering

10) 3D displays, VR visors, and augmented reality devices

11) Rendering
Projective geometry and convention, ray tracing and ray casting, the radiance (or rendering) equation and its solution, illumination, the radiance solution by local methods: Phong and Cook-Torrance models, rasterization, the OpenGL pipeline.

12) Interactive augmented reality.
Introduction to Unity. Development of simple AR applications.