Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
97 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Order-One Rolling Shutter Cameras (2403.11295v1)

Published 17 Mar 2024 in cs.CV, cs.NA, math.AG, and math.NA

Abstract: Rolling shutter (RS) cameras dominate consumer and smartphone markets. Several methods for computing the absolute pose of RS cameras have appeared in the last 20 years, but the relative pose problem has not been fully solved yet. We provide a unified theory for the important class of order-one rolling shutter (RS$_1$) cameras. These cameras generalize the perspective projection to RS cameras, projecting a generic space point to exactly one image point via a rational map. We introduce a new back-projection RS camera model, characterize RS$_1$ cameras, construct explicit parameterizations of such cameras, and determine the image of a space line. We classify all minimal problems for solving the relative camera pose problem with linear RS$_1$ cameras and discover new practical cases. Finally, we show how the theory can be used to explain RS models previously used for absolute pose computation.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (53)
  1. Geometric models of rolling-shutter cameras. In Omnidirectional Vision, Camera Networks and Non-classical Cameras, 04 2005.
  2. Simultaneous object pose and velocity computation using a single view from a rolling shutter camera. In ECCV, pages 56–68, 2006.
  3. O. Ait-Aider and F. Berry. Structure and kinematics triangulation with a rolling shutter stereo rig. In ICCV, 2009.
  4. Admissible linear map models of linear cameras. In The Twenty-Third IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2010, San Francisco, CA, USA, 13-18 June 2010, pages 1578–1585. IEEE Computer Society, 2010.
  5. Rolling shutter bundle adjustment. In CVPR, 2012.
  6. Global optimization of object pose and motion from a single rolling shutter image with automatic 2d-3d matching. In ECCV, 2012.
  7. Rolling Shutter Camera Calibration. In CVPR, 2013.
  8. Rolling Shutter Stereo. In ICCV, 2013.
  9. A minimal solution to the rolling shutter pose estimation problem. In IROS, 2015.
  10. R6P - rolling shutter absolute pose problem. In CVPR, 2015.
  11. Rolling shutter absolute pose problem with known vertical direction. In CVPR, 2016.
  12. Degeneracies in rolling shutter sfm. In ECCV, 2016.
  13. Rolling shutter camera relative pose: Generalized epipolar geometry. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 4132–4140, 2016.
  14. Self-Calibration-Based Approach to Critical Motion Sequences of Rolling-Shutter Structure From Motion. In CVPR, 2017.
  15. Rolling-Shutter-Aware Differential SfM and Image Rectification. In ICCV, 2017.
  16. Linear solution to the minimal absolute pose rolling shutter problem. In ACCV, 2018.
  17. A robust method for strong rolling shutter effects correction using lines with automatic feature selection. In CVPR, 2018.
  18. Minimal solvers for monocular rolling shutter compensation under ackermann motion. In WACV, 2018.
  19. Occlusion-Aware Rolling Shutter Rectification of 3d Scenes. In CVPR, 2018.
  20. Rolling shutter camera absolute pose. IEEE Trans. Pattern Anal. Mach. Intell., 42(6):1439–1452, 2019.
  21. Learning structure-and-motion-aware rolling shutter correction. In CVPR, 2019.
  22. From two rolling shutters to one global shutter. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 2505–2513, 2020.
  23. Rolling shutter camera: Modeling, optimization and learning. Mach. Intell. Res., 20(6):783–798, 2023.
  24. Deep network for rolling shutter rectification. CoRR, abs/2112.06170, 2021.
  25. Solving rolling shutter 3d vision problems using analogies with non-rigidity. Int. J. Comput. Vis., 129(1):100–122, 2021.
  26. Inverting a rolling shutter camera: Bring rolling shutter images to high framerate global shutter video. In 2021 IEEE/CVF International Conference on Computer Vision, ICCV 2021, Montreal, QC, Canada, October 10-17, 2021, pages 4208–4217. IEEE, 2021.
  27. Towards rolling shutter correction and deblurring in dynamic scenes. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021, virtual, June 19-25, 2021, pages 9219–9228. Computer Vision Foundation / IEEE, 2021.
  28. Differential sfm and image correction for a rolling shutter stereo rig. Image Vis. Comput., 124:104492, 2022.
  29. Scanline homographies for rolling-shutter plane absolute pose. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2022, New Orleans, LA, USA, June 18-24, 2022, pages 8983–8992. IEEE, 2022.
  30. Revisiting rolling shutter bundle adjustment: Toward accurate and fast solution. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023, Vancouver, BC, Canada, June 17-24, 2023, pages 4863–4871. IEEE, 2023.
  31. Rolling shutter inversion: Bring rolling shutter images to high framerate global shutter video. IEEE Trans. Pattern Anal. Mach. Intell., 45(5):6214–6230, 2023.
  32. Learning to solve hard minimal problems. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2022, New Orleans, LA, USA, June 18-24, 2022, pages 5522–5532. IEEE, 2022.
  33. Automatic Generator of Minimal Problem Solvers. In ECCV, 2008.
  34. Beyond grobner bases: Basis selection for minimal solvers. In 2018 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2018, Salt Lake City, UT, USA, June 18-22, 2018, pages 3945–3954. Computer Vision Foundation / IEEE Computer Society, 2018.
  35. Optimizing elimination templates by greedy parameter search. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 15754–15764, June 2022.
  36. Trifocal relative pose from lines at points. IEEE Trans. Pattern Anal. Mach. Intell., 45(6):7870–7884, 2023.
  37. HomotopyContinuation.jl: A package for homotopy continuation in julia, 2018.
  38. Four-view geometry with unknown radial distortion. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023, Vancouver, BC, Canada, June 17-24, 2023, pages 8990–9000. IEEE, 2023.
  39. Multiple view geometry in computer vision. Cambridge university press, 2003.
  40. R6P – rolling shutter absolute pose problem. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 2292–2300, 2015.
  41. Congruences and concurrent lines in multi-view geometry. Advances in Applied Mathematics, 88:62–91, 2017.
  42. The space of all stereo images. Int. J. Comput. Vis., 48(1):21–38, 2002.
  43. Tomas Pajdla. Stereo with oblique cameras. Int. J. Comput. Vis., 47(1-3):161–170, 2002.
  44. Jean Ponce. What is a camera? In 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2009), 20-25 June 2009, Miami, Florida, USA, pages 1526–1533. IEEE Computer Society, 2009.
  45. General models for rational cameras and the case of two-slit projections. CoRR, abs/1612.01160, 2016.
  46. Multiple View Geometry in Computer Vision. Cambridge, 2nd edition, 2003.
  47. Charles Minshall Jessop. A Treatise on the Line Complex. Cambridge University Press, 1903.
  48. Galois/monodromy groups for decomposing minimal problems in 3d reconstruction. SIAM Journal on Applied Algebra and Geometry, 6(4):740–772, 2022.
  49. Ernst Eduard Kummer. Über die algebraischen Strahlensysteme, in’s Besondere über die der ersten und zweiten Ordnung. Königl. Akademie der Wissenschaften zu Berlin, 1866.
  50. Pietro De Poi. Congruences of lines with one-dimensional focal locus. Portugaliae Mathematica, 61:329–338, 2004.
  51. Patrick Le Barz. Formules pour les espaces multisécants aux courbes algébriques. Comptes Rendus Mathematique, 340(10):743–746, 2005.
  52. Ph Ellia and Davide Franco. Gonality, clifford index and multisecants. Journal of Pure and Applied Algebra, 158(1):25–39, 2001.
  53. Macaulay2, a software system for research in algebraic geometry. http://www2.macaulay2.com.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (4)
  1. Marvin Anas Hahn (22 papers)
  2. Kathlén Kohn (32 papers)
  3. Orlando Marigliano (11 papers)
  4. Tomas Pajdla (38 papers)
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now