Accueil > Formations > Master MVA > Présentation des cours
1-Explore the structure of images at "patch" level.
(Patches are small image extracts that are processed in computational neural networks and in recent image processing. The current dimension that start being well understood is about 8x8=64 to 60x60=3600)
2-Apply it to a fundamental problem requiring an understanding of this structure: image denoising
3-Compare image processing designed by humans to image processing learned by deep neural networks
This course addresses one of the fundamental problems of signal and image processing, the separation of noise and signal. This was already the key problem of Shannon's foundational Mathematical Theory of Communication. Ever since, this problem is recurring and has uncountable applications for image formation, image and video post-production, and feature detection. Since the 70s, several denoising approaches have been identified and can be grouped in a handful of useful 'denoising principles' with notable progress.
Yet, in 2016, neural denoisers have started outperforming (slightly) human made denoising algorithms. Their principles are quite different. Human algorithms adopt mathematical principles to denoise and stick by them. Neural algorithms are fully pragmatic and learn jointly noise and image structure from large collections of images. The inner workings of these learned denoising networks are not yet fully understood.
This course organized by three image processing specialists and deep learning practitioners stands at this crucial crossroad. We will explain the classical theories, the neural devices and demonstrate what perspectives and cross-fertilization this comparison yields. Both theories process image patches. The course will be designed to understand in depth patch structure and the structure of the global ensemble of patches.
elementary probability, Fourier, differential calculus
Deep learning will be introduced from scratch
Each session will imply a combination of course, online experiments with IPOL
Every Friday, 14h-17h
End: first week of December (10 courses)
1)Simple mathematical exercises on the subject of the course + experimental report on image processing experiments made on line (no programming will be required). Both delivered each week.
2) For those interested: neural networks practice report
2) A final oral examination (or written if the number of students is too important)
-online workshops at IPOL (image processing on line, www.ipol.im)
Image sampling and discrete Fourier transform
A fast tutorial on Gaussian vectors
Noise
Multiscale DCT Denoising
Image self-similarity and denoising
Bayesian patch-based methods
A crash course on deep learning (I and II)
A comparative study of deep and shallow CNNs denoisers
Comparison of all denoising methods