Learning a Generative Motion Model from Image Sequences based on a Latent Motion Matrix - 3IA Côte d’Azur – Interdisciplinary Institute for Artificial Intelligence Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Medical Imaging Année : 2021

Learning a Generative Motion Model from Image Sequences based on a Latent Motion Matrix

Résumé

We propose to learn a probabilistic motion model from a sequence of images for spatio-temporal registration. Our model encodes motion in a low-dimensional probabilistic spacethe motion matrix-which enables various motion analysis tasks such as simulation and interpolation of realistic motion patterns allowing for faster data acquisition and data augmentation. More precisely, the motion matrix allows to transport the recovered motion from one subject to another simulating for example a pathological motion in a healthy subject without the need for inter-subject registration. The method is based on a conditional latent variable model that is trained using amortized variational inference. This unsupervised generative model follows a novel multivariate Gaussian process prior and is applied within a temporal convolutional network which leads to a diffeomorphic motion model. Temporal consistency and generalizability is further improved by applying a temporal dropout training scheme. Applied to cardiac cine-MRI sequences, we show improved registration accuracy and spatio-temporally smoother deformations compared to three state-of-the-art registration algorithms. Besides, we demonstrate the model's applicability for motion analysis, simulation and super-resolution by an improved motion reconstruction from sequences with missing frames compared to linear and cubic interpolation.
Fichier principal
Vignette du fichier
krebs_final.pdf (3.24 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03126419 , version 1 (31-01-2021)

Identifiants

Citer

Julian Krebs, Hervé Delingette, Nicholas Ayache, Tommaso Mansi. Learning a Generative Motion Model from Image Sequences based on a Latent Motion Matrix. IEEE Transactions on Medical Imaging, 2021, ⟨10.1109/TMI.2021.3056531⟩. ⟨hal-03126419⟩
193 Consultations
117 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More