A massively parallel multi-level approach to a domain decomposition method for the optical flow estimation with varying illumination
The SMAI journal of computational mathematics, Volume 2 (2016) , pp. 121-140.

We consider a variational method to solve the optical flow problem with varying illumination. We apply an adaptive control of the regularization parameter which allows us to preserve the edges and fine features of the computed flow. To reduce the complexity of the estimation for high resolution images and the time of computations, we implement a multi-level parallel approach based on the domain decomposition with the Schwarz overlapping method. The second level of parallelism uses the massively parallel solver MUMPS. We perform some numerical simulations to show the efficiency of our approach and to validate it on classical and real-world image sequences.

Published online:
DOI: https://doi.org/10.5802/smai-jcm.11
Keywords: optical flow, varying illumination, domain decomposition, adaptive control, finite element method, variational method, multi-level parallelism.
     author = {Diane Gilliocq-Hirtz and Zakaria Belhachmi},
     title = {A massively parallel multi-level approach to a domain decomposition method for the optical flow estimation with varying illumination},
     journal = {The SMAI journal of computational mathematics},
     pages = {121--140},
     publisher = {Soci\'et\'e de Math\'ematiques Appliqu\'ees et Industrielles},
     volume = {2},
     year = {2016},
     doi = {10.5802/smai-jcm.11},
     mrnumber = {3633547},
     zbl = {1416.65331},
     language = {en},
     url = {https://smai-jcm.centre-mersenne.org/articles/10.5802/smai-jcm.11/}
Diane Gilliocq-Hirtz; Zakaria Belhachmi. A massively parallel multi-level approach to a domain decomposition method for the optical flow estimation with varying illumination. The SMAI journal of computational mathematics, Volume 2 (2016) , pp. 121-140. doi : 10.5802/smai-jcm.11. https://smai-jcm.centre-mersenne.org/articles/10.5802/smai-jcm.11/

[1] P.R. Amestoy; I.S. Duff; J.-Y. L’Excellent; J. Koster MUMPS: A General Purpose Distributed Memory Sparse Solver, Applied Parallel Computing. New Paradigms for HPC in Industry and Academia: 5th International Workshop, PARA 2000 Bergen, Norway, June 18–20, 2000 Proceedings (2001) | Article

[2] G. Aubert; R. Deriche; P. Kornprobst Computing Optical Flow via Variational Techniques, SIAM Journal on Applied Mathematics, Volume 60 (1999), pp. 156-182 | Article | MR 1740840 | Zbl 0942.35057

[3] J.L. Barron; D.J. Fleet; S.S. Beauchemin Performance of optical flow techniques, International Journal of Computer Vision, Volume 12 (1994), pp. 43-77 | Article

[4] Z. Belhachmi; D. Gilliocq-Hirtz Coupling parareal and adaptive control in optical flow estimation with application in movie’s restoration, Computer Vision and Image Analysis Applications (ICCVIA), 2015 International Conference on (2015), pp. 1-6

[5] Z. Belhachmi; F. Hecht Control of the Effects of Regularization on Variational Optic Flow Computations, Journal of Mathematical Imaging and Vision, Volume 40 (2011), pp. 1-19 | Article | MR 2782117 | Zbl 1255.68206

[6] Z. Belhachmi; F. Hecht An adaptive approach for segmentation and TV denoising in the optic flow estimation (2014) (Working paper or preprint)

[7] T. Brox; A. Bruhn; N. Papenberg; J. Weickert High Accuracy Optical Flow Estimation Based on a Theory for Warping, Computer Vision - ECCV 2004 (T. Pajdla; J. Matas, eds.), Springer Berlin Heidelberg, 2004, pp. 25-36 | Article | Zbl 1098.68736

[8] A. Bruhn Variational optic flow computation: Accurate modelling and efficient numerics (2006) (Ph. D. Thesis)

[9] A. Bruhn; J. Weickert; C. Schnorr Lucas/Kanade meets Horn/Schunck: Combining Local and Global Optic Flow Methods, International Journal of Computer Vision, Volume 61 (2005), pp. 211-231 | Article

[10] M.A. Gennert; S. Negahdaripour Relaxing the Brightness Constancy Assumption in Computing Optical Flow, Technical Report, Massachusetts Institute of Technology Cambridge, MA, USA (1987)

[11] F. Hecht New development in FreeFem++, J. Numer. Math., Volume 20 (2012), pp. 251-265 | Article | MR 3043640 | Zbl 1266.68090

[12] B. Horn; B. Schunck Determining optical flow, Artificial Intelligence, Volume 17 (1981), pp. 185 -203 | Article

[13] P.-L. Lions On the Schwarz alterning method. III: A variant for nonoverlapping subdomains, Third internationnal symposium on domain decomposition methods for partial differential equations, Volume 6 (1990), pp. 202-223 | Zbl 0704.65090

[14] B.D. Lucas; T. Kanade An Iterative Image Registration Technique with an Application to Stereo Vision, Proceedings of the 7th International Joint Conference on Artificial Intelligence - Volume 2 (IJCAI’81) (1981), pp. 674-679 http://dl.acm.org/citation.cfm?id=1623264.1623280

[15] E. Mémin; P. Pérez A multigrid approach to hierarchical motion estimation, Proc. Int. Conf. on Computer Vision, ICCV’98 (1998), pp. 933-938 | Article

[16] Y. Mileva; A. Bruhn; J. Weickert Illumination-Robust Variational Optical Flow with Photometric Invariants, Pattern Recognition (F. Hamprecht; C. Schnorr; B. Jähne, eds.), Springer Berlin Heidelberg, 2007, pp. 152-162

[17] P. Ruhnau; T. Kohlberger; C. Schnorr; H. Nobach Variational optical flow estimation for particle image velocimetry, Experiments in Fluids, Volume 38 (2005), pp. 21-32 | Article

[18] J. Weickert; A. Bruhn; N. Papenberg; T. Brox Variational Optic Flow Computation: From Continuous Models to Algorithms, International Workshop on Computer Vision and Image Analysis (ed. L. Alvarez), IWCVIA-03, Las Palmas de Gran Canaria (2003)

[19] J. Weickert; C. Schnorr Variational Optic Flow Computation with a Spatio-Temporal Smoothness Constraint, Journal of Mathematical Imaging and Vision, Volume 14 (2001), pp. 245-255 | Article | Zbl 0988.68821

[20] H. Zimmer; A. Bruhn; J. Weickert; L. Valgaerts; A. Salgado; B. Rosenhahn; H.-P. Seidel Complementary Optic Flow, Energy Minimization Methods in Computer Vision and Pattern Recognition (D. Cremers; Y. Boykov; A. Blake; Schmidt F., eds.), Springer, 2009, pp. 207-220 | Article