To effectively encode data-intensive, multi-view imaging content, H.264/AVC as a state-of-the-art coding standard is often adopted for its superior coding efficiency. However, an H.264 encoder is very complex because of the many advanced but computationally complicated schemes it employs in achieving a high-coding performance. The most time-consuming component is variable block-size motion estimation (ME). A ME technique is proposed in this paper to accelerate the encoding by employing what is known as epipolar geometry, which provides constraints for multiview image sequences. Theoretical analyses and experimental results prove that the proposed ME’s use of epipolar geometry can greatly reduce a search region and effectively track large and irregular motion, typical for convergent multi-view camera setups. As a result, compared with fast full search at large search size adopted in H.264, our proposed ME algorithm can obtain a similar coding efficiency while achieving a speedup ratio of 2. 1.