Article Sidebar
Main Article Content
In the context of multiple view geometry, images of static scenes are modeled as linear projections from a projective space ℙ3 to a projective plane ℙ2 and, similarly, videos or images of suitable dynamic or segmented scenes can be modeled as linear projections from ℙk to ℙh, with k > h ≥ 2. In those settings, the projective reconstruction of a scene consists in recovering the position of the projected objects and the projections themselves from their images, after identifying many enough correspondences between the images. A critical locus for the reconstruction problem is a configuration of points and of centers of projections, in the ambient space, where the reconstruction of a scene fails. Critical loci turn out to be suitable algebraic varieties. In this paper we investigate those critical loci which are hypersurfaces in high dimension complex projective spaces, and we determine their equations. Moreover, to give evidence of some practical implications of the existence of these critical loci, we perform a simulated experiment to test the instability phenomena for the reconstruction of a scene, near a critical hypersurface.
Article Details
M. Bertolini, G. Besana, R. Notari, and C. Turrini. Critical loci in computer vision and matrices dropping rank in codimension one. J. of Pure and Applied Algebra, 224(12): 106439, 2020. https://doi.org/10.1016/j.jpaa.2020.106439. (Crossref)
M. Bertolini, G. Besana, and C. Turrini. Applications of multiview tensors in higher dimensions. In S. Aja-Fernández, R. de Luis García, D. Tao, and X. Li, editors, Tensors in image processing and computer vision, Advances in Pattern Recognition, pages 237–260. Springer, London, 2009. https://doi.org/10.1007/978-1-84882-299-311. (Crossref)
M. Bertolini, G. Besana, and C. Turrini. Critical loci for projective reconstruction from multiple views in higher dimension: A comprehensive theoretical approach. Linear Algebra and its Applications, 469: 335–363, 2015. https://doi.org/10.1016/j.laa.2014.11.021. (Crossref)
M. Bertolini, G. Besana, and C. Turrini. Generalized fundamental matrices as grassmann tensors. Annali di Matematica Pura ed Applicata (1923 -), Jul 2016. https://doi.org/10.1007/s10231-016-0585-4. (Crossref)
M. Bertolini, R. Notari, and C. Turrini. The bordiga surface as critical locus for 3-view reconstructions. J. of Symbolic Computation, 91: 74–97, 2019. MEGA 2017, Effective Methods in Algebraic Geometry, Nice (France), June 12-16, 2017. https://doi.org/10.1016/j.jsc.2018.06.014. (Crossref)
M. Bertolini and C. Turrini. Critical configurations for 1-view in projections from Pk →P2. J. of Mathematical Imaging and Vision, 27: 277–287, 2007. https://doi.org/10.1007/s10851-007-0649-6. (Crossref)
M. Bertolini, C. Turrini, and G. Besana. Instability of projective reconstruction of dynamic scenes near critical configurations. In IEEE Int. Conf. on Computer Vision, pages 1–7, Los Alamitos ,CA, USA, 2007. IEEE Computer Society. https://doi.org/10.1109/ICCV.2007.4409100. (Crossref)
T. Buchanan. The twisted cubic and camera calibration. Computer Vision, Graphics, and Image Processing, 42(1): 130–132, 1988. https://doi.org/10.1016/0734-189X(88)90146-6. (Crossref)
D. A. Cox, J. Little, and D. O’Shea. Ideals, Varieties, and Algorithms: An Introduction to Computational Algebraic Geometry and Commutative Algebra. Springer, 2015. https://doi.org/10.1007/978-3-319-16721-3. (Crossref)
X. Fan and R. Vidal. The space of multibody fundamental matrices: Rank, geometry and projection. In R. Vidal, A. Heyden, and Y. Ma, editors, Dynamical Vision. Proc. Int. Workshop on Dynamical Vision WDV 2005, volume 4358 of Lecture Notes in Computer Science, pages 1–17. Springer, 2007. https://doi.org/10.1007/978-3-540-70932-91. (Crossref)
D. R. Grayson and M. Stillman. Macaulay2, a software system for research in algebraic geometry. http://macaulay2.com.
J. Harris. Agebraic Geometry: A First Course, volume 133 of Graduate Texts in Mathematics. Springer-Verlag, New York, 1992. https://doi.org/10.1007/978-1-4757-2189-8. (Crossref)
R. Hartley and F. Kahl. Critical configurations for projective reconstruction from multiple views. Int. J. of Computer Vision, 71(1): 5–47, 2007. https://doi.org/10.1007/s11263-005-4796-1. (Crossref)
R. Hartley and R. Vidal. The multibody trifocal tensor: motion segmentation from 3 perspective views. In Proc. 2004 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition CVPR 2004, volume 1, pages I–I, Washington, DC, USA, 27 Jun-2 Jul 2004. https://doi.org/10.1109/CVPR.2004.1315109. (Crossref)
R. Hartley and A. Zisserman. Multiple View Geometry in Computer Vision. Cambridge University Press, New York, 2nd edition, 2003. https://doi.org/10.1017/CBO9780511811685. (Crossref)
R. I. Hartley. Ambiguous configurations for 3-view projective reconstruction. In Computer Vision. Proc. European Conf. on Computer Vision ECCV 2000, Part I, volume 1842 of Lecture Notes in Computer Science, pages 922–935, Dublin, Ireland, 26 Jun-1 Jul 2000. Springer. Doi:10.1007/3-540-45054-860. (Crossref)
R. I. Hartley and F. Schaffalitzky. Reconstruction from projections using Grassmann tensors. Int. J. of Computer Vision, 83(3): 274–293, 2009. https://doi.org/10.1007/s11263-009-0225-1. (Crossref)
R. Hartshorne. Algebraic Geometry, volume 52 of Graduate Texts in Mathematics. Springer, New York, 1977. https://doi.org/10.1007/978-1-4757-3849-0. (Crossref)
K. Huang, R. Fossum, and Y. Ma. Generalized rank conditions in multiple view geometry with applications to dynamical scenes. In Computer Vision. Proc. European Conf. on Computer Vision ECCV 2002, Part II, volume 2351 of Lecture Notes in Computer Science, pages 201–216, Copenhagen, Denmark, 28-31 May 2002. Springer. Doi:10.1007/3-540-47967-814. (Crossref)
F. Kahl, R. Hartley, and K. Astrom. Critical configurations for n-view projective reconstruction. In Proc. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition CVPR 2001, pages II–II, Kauai, HI, USA, 8-14 Dec 2001. https://doi.org/10.1109/CVPR.2001.990945. (Crossref)
J. Krames. Zur Ermittlung eines Objektes aus zwei Perspektiven (Ein Beitrag zur Theorie der ,,gefährlichen Örter”). Monatshefte für Mathematik und Physik, 49: 327–354, 1940. https://doi.org/10.1007/BF01707311. (Crossref)
S. Maybank. Theory of Reconstruction from Image Motion, volume 28 of Springer Series in Information Sciences. Springer, Berlin, Heidelberg, 1993. https://doi.org/10.1007/978-3-642-77557-4. (Crossref)
A. Shashua and S. J. Maybank. Degeneraten point configurations of three views: Do critical surfaces exist? Technical Report TR 96-19, Hebrew University, 1996. http://www.cs.huji.ac.il/~shashua/papers/cvpr-critical.ps.gz.
The MathWorks, Inc. Matlab. Natick, MA, USA. https://www.mathworks.com.
R. Vidal and Y. Ma. A unified algebraic approach to 2-D and 3-D motion segmentation and estimation. J. of Mathematical Imaging and Vision, 25(3): 403–421, 2006. https://doi.org/10.1007/s10851-006-8286-z. (Crossref)
R. Vidal, Y. Ma, S. Soatto, and S. Sastry. Two-view multibody structure from motion. Int. J. of Computer Vision, 68(1): 7–25, 2006. https://doi.org/10.1007/s11263-005-4839-7. (Crossref)
L. Wolf and A. Shashua. On projection matrices Pk → P2, k = 3, ...,6, and their applications in computer vision. Int. J. of Computer Vision, 48(1): 53–67, 2002. https://doi.org/10.1023/A:1014855311993. (Crossref)