Results 1  10
of
127
Dynamically consistent optical flow estimation
 In International Conference on Computer Vision, ICCV’07
, 2007
"... In this paper, we present a framework for dynamic consistent estimation of dense motion fields over a sequence of images. The originality of the approach is to exploit recipes related to optimal control theory. This setup allows performing the estimation of an unknown state function according to a g ..."
Abstract

Cited by 32 (7 self)
 Add to MetaCart
(Show Context)
In this paper, we present a framework for dynamic consistent estimation of dense motion fields over a sequence of images. The originality of the approach is to exploit recipes related to optimal control theory. This setup allows performing the estimation of an unknown state function according to a given dynamical model and to noisy and incomplete measurements. The overall process is formalized through the minimization of a global spatiotemporal cost functional w.r.t the complete sequence of motion fields. The minimization is handled considering an adjoint formulation. The resulting scheme consists in iterating a forward integration of the evolution model and a backward integration of the adjoint evolution model guided by a discrepancy measurement between the state variable and the available noisy observations. Such an approach allows us to cope with several delicate situations (such as the absence of data) which are not well managed with usual estimators. 1.
Layered estimation of atmospheric mesoscale dynamics from satellite imagery
 IEEE trans. on Geo. and Rem. Sensing
"... Abstract—In this paper, we address the problem of estimating mesoscale dynamics of atmospheric layers from satellite image sequences. Due to the great deal of spatial and temporal distortions of cloud patterns and because of the sparse 3D nature of cloud observations, standard densemotion fieldes ..."
Abstract

Cited by 21 (16 self)
 Add to MetaCart
(Show Context)
Abstract—In this paper, we address the problem of estimating mesoscale dynamics of atmospheric layers from satellite image sequences. Due to the great deal of spatial and temporal distortions of cloud patterns and because of the sparse 3D nature of cloud observations, standard densemotion fieldestimation techniques used in computer vision are not well adapted to satellite images. Relying on a physically sound vertical decomposition of the atmosphere into layers, we propose a densemotion estimator dedicated to the extraction of multilayer horizontal wind fields. This estimator is expressed as the minimization of a global function including data and spatiotemporal smoothness terms. A robust data term relying on the integratedcontinuity equation massconservation model is proposed to fit sparsetransmittance observations related to each layer. A novel spatiotemporal smoother derived from large eddy prediction of a shallowwater momentumconservation model is used to build constraints for largescale temporal coherence. These constraints are combined in a global smoothing framework with a robust secondorder smoother, preserving divergent and vorticity structures of the flow. For optimization, a twostage motion estimation scheme is proposed to overcome multiresolution limitations when capturing the dynamics of mesoscale structures. This alternative approach relies on the combination of correlation and opticalflow observations in a variational context. An exhaustive evaluation of the novel method is first performed on a scalar image sequence generated by direct numerical simulation of a turbulent 2D flow. By qualitative comparisons, the method is then assessed on a METEOSAT image sequence. Index Terms—Atmosphericmotion estimation, correlationbased vector interpolation, filtered shallowwater equations, integrated continuity equation (ICE), layer transmittance, optical flow, spatiotemporal smoothing, variational methods. I.
Variational dense motion estimation using the Helmholtz decomposition
 SCALE SPACE METHODS IN COMPUTER VISION, VOLUME 2695 OF LNCS
, 2003
"... We present a novel variational approach to dense motion estimation of highly nonrigid structures in image sequences. Our representation of the motion vector field is based on the extended Helmholtz Decomposition into its principal constituents: The laminar flow and two potential functions related ..."
Abstract

Cited by 21 (14 self)
 Add to MetaCart
(Show Context)
We present a novel variational approach to dense motion estimation of highly nonrigid structures in image sequences. Our representation of the motion vector field is based on the extended Helmholtz Decomposition into its principal constituents: The laminar flow and two potential functions related to the solenoidal and irrotational flow, respectively. The potential functions, which are of primary interest for flow pattern analysis in numerous application fields like remote sensing or fluid mechanics, are directly estimated from image sequences with a variational approach. We use regularizers with derivatives up to third order to obtain unbiased high–quality solutions. Computationally, the approach is made tractable by means of auxiliary variables. The performance of the approach is demonstrated with groundtruth experiments and realworld data.
A low dimensional fluid motion estimator
 Int. J. Comp. Vision
"... In this paper we propose a new motion estimator for image sequences depicting fluid flows. The proposed estimator is based on the Helmholtz decomposition of vector fields. This decomposition consists in representing the velocity field as a sum of a divergence free component and a vorticity free comp ..."
Abstract

Cited by 20 (8 self)
 Add to MetaCart
(Show Context)
In this paper we propose a new motion estimator for image sequences depicting fluid flows. The proposed estimator is based on the Helmholtz decomposition of vector fields. This decomposition consists in representing the velocity field as a sum of a divergence free component and a vorticity free component. The objective is to provide a lowdimensional parametric representation of optical flows by depicting them as deformations generated by a reduced number of vortex and source particles. Both components are approximated using a discretization of the vorticity and divergence maps through regularized Dirac measures. The resulting so called irrotational and solenoidal fields consist of linear combinations of basis functions obtained through a convolution product of the Green kernel gradient and the vorticity map or the divergence map respectively. The coefficient values and the basis function parameters are obtained by minimization of a functional relying on an integrated version of mass conservation principle of fluid mechanics. Results are provided on synthetic examples and real world sequences. 1
A Variational Technique for Time Consistent Tracking of Curves and Motion
 J MATH IMAGING VIS
"... In this paper, a new framework for the tracking of closed curves and their associated motion fields is described. The proposed method enables a continuous tracking along an image sequence of both a deformable curve and its velocity field. Such an approach is formalized through the minimization of a ..."
Abstract

Cited by 19 (7 self)
 Add to MetaCart
In this paper, a new framework for the tracking of closed curves and their associated motion fields is described. The proposed method enables a continuous tracking along an image sequence of both a deformable curve and its velocity field. Such an approach is formalized through the minimization of a global spatiotemporal continuous cost functional, w.r.t a set of variables representing the curve and its related motion field. The resulting minimization process relies on optimal control approach and consists in a forward integration of an evolution law followed by a backward integration of an adjoint evolution model. This latter pde includes a term related to the discrepancy between the current estimation of the state variable and discrete noisy measurements of the system. The closed curves are represented through implicit surface modeling, whereas the motion is described either by a vector field or through vorticity and divergence maps depending on the kind of targeted applications. The efficiency of the approach is demonstrated on two types of image sequences showing deformable objects and fluid motions.
Vortex and source particles for fluid motion estimation
 In Proc. 5th Int. Conf. on ScaleSpace and PDE methods in Computer Vision (ScaleSpace’05
, 2005
"... acuzol,memin¡ Abstract. In this paper we propose a new motion estimator for image sequences depicting fluid flows. The proposed estimator is based on the Helmholtz decomposition of vector fields. This decomposition consists in representing the velocity field as a sum of a divergence free component a ..."
Abstract

Cited by 19 (9 self)
 Add to MetaCart
(Show Context)
acuzol,memin¡ Abstract. In this paper we propose a new motion estimator for image sequences depicting fluid flows. The proposed estimator is based on the Helmholtz decomposition of vector fields. This decomposition consists in representing the velocity field as a sum of a divergence free component and a curl free component. In order to provide a low dimensional solution, both components are approximated using a discretization of the vorticity and divergence maps through regularized Dirac measure. The resulting so called irrotational and solenoidal fields consist then in linear combinations of basis functions obtained through a convolution product of the Green kernel gradient and the vorticity map or the divergence map respectively. The coefficient values and the basis function parameters are obtained as the minimizer of a functional relying on an integrated version of mass conservation principle of fluid mechanics. Results are provided on real world sequences. 1
Robust Point Matching via Vector Field Consensus
, 2013
"... Abstract — In this paper, we propose an efficient algorithm, called vector field consensus, for establishing robust point correspondences between two sets of points. Our algorithm starts by creating a set of putative correspondences which can contain a very large number of false correspondences, or ..."
Abstract

Cited by 17 (5 self)
 Add to MetaCart
(Show Context)
Abstract — In this paper, we propose an efficient algorithm, called vector field consensus, for establishing robust point correspondences between two sets of points. Our algorithm starts by creating a set of putative correspondences which can contain a very large number of false correspondences, or outliers, in addition to a limited number of true correspondences (inliers). Next, we solve for correspondence by interpolating a vector field between the two point sets, which involves estimating a consensus of inlier points whose matching follows a nonparametric geometrical constraint. We formulate this a maximum a posteriori (MAP) estimation of a Bayesian model with hidden/latent variables indicating whether matches in the putative set are outliers or inliers. We impose nonparametric geometrical constraints on the correspondence, as a prior distribution, using Tikhonov regularizers in a reproducing kernel Hilbert space. MAP estimation is performed by the EM algorithm which by also estimating the variance of the prior model (initialized to a large value) is able to obtain good estimates very quickly (e.g., avoiding many of the local minima inherent in this formulation). We illustrate this method on data sets in 2D and 3D and demonstrate that it is robust to a very large number of outliers (even up to 90%). We also show that in the special case where there is an underlying parametric geometrical model (e.g., the epipolar line constraint) that we obtain better results than standard alternatives like RANSAC if a large number of outliers are present. This suggests a twostage strategy, where we use our nonparametric model to reduce the size of the putative set and then apply a parametric variant of our approach to estimate the geometric parameters. Our algorithm is computationally efficient and we provide code for others to use it. In addition, our approach is general and can be applied to other problems, such as learning with a badly corrupted training data set. Index Terms — Point correspondence, outlier removal, matching, regularization.
A stochastic filter for fluid motion tracking
 In Proc. Int. Conf. on Computer Vision (ICCV’05
, 2005
"... In this paper we present a method for the tracking of fluid flows velocity fields. The technique we propose is formalized within sequential Bayesian filter framework. The filter we propose here combines an Itô diffusion process coming from a stochastic formulation of the vorticityvelocity form of N ..."
Abstract

Cited by 15 (12 self)
 Add to MetaCart
(Show Context)
In this paper we present a method for the tracking of fluid flows velocity fields. The technique we propose is formalized within sequential Bayesian filter framework. The filter we propose here combines an Itô diffusion process coming from a stochastic formulation of the vorticityvelocity form of NavierStokes equation and discrete measurements extracted from an image sequence. The resulting tracker provides robust and consistent estimations of instantaneous motion fields along the whole image sequence. In order to handle a state space of reasonable dimension for the stochastic filtering problem, we represent the motion field as a combination of adapted basis functions. The used basis functions ensue from a mollification of BiotSavart integral and a discretization of the vorticity and divergence maps of the fluid vector field. The efficiency of the method is demonstrated on a long real world sequence showing a vortex launch at tip of airplane wing. 1.
Recovery, Visualization, and Analysis of Actin and Tubulin Polymer Flow in Live Cells: A Fluorescent Speckle Microscopy Study
, 2003
"... ABSTRACT Fluorescent speckle microscopy (FSM) is becoming the technique of choice for analyzing in vivo the dynamics of polymer assemblies, such as the cytoskeleton. The massive amount of data produced by this method calls for computational approaches to recover the quantities of interest; namely, t ..."
Abstract

Cited by 15 (3 self)
 Add to MetaCart
ABSTRACT Fluorescent speckle microscopy (FSM) is becoming the technique of choice for analyzing in vivo the dynamics of polymer assemblies, such as the cytoskeleton. The massive amount of data produced by this method calls for computational approaches to recover the quantities of interest; namely, the polymerization and depolymerization activities and the motions undergone by the cytoskeleton over time. Attempts toward this goal have been hampered by the limited signaltonoise ratio of typical FSM data, by the constant appearance and disappearance of speckles due to polymer turnover, and by the presence of flow singularities characteristic of many cytoskeletal polymer assemblies. To deal with these problems, we present a particlebased method for tracking fluorescent speckles in timelapse FSM image series, based on ideas from operational research and graph theory. Our software delivers the displacements of thousands of speckles between consecutive frames, taking into account that speckles may appear and disappear. In this article we exploit this information to recover the speckle flow field. First, the software is tested on synthetic data to validate our methods. We then apply it to mapping filamentous actin retrograde flow at the front edge of migrating newt lung epithelial cells. Our results confirm findings from previously published kymograph analyses and manual tracking of such FSM data and illustrate the power of automated tracking for generating complete and quantitative flow measurements. Third, we analyze microtubule poleward flux in mitotic metaphase spindles assembled in Xenopus egg extracts, bringing new insight into the dynamics of microtubule assemblies in this system.