Many works have been presented for indoor scene understanding, yet few of them combine structural reasoning with full motion estimation in a real-time oriented approach. In this work we address the problem of estimating the 3D structural layout of complex and cluttered indoor scenes from monocular video sequences, where the observer can freely move in the surrounding space. We propose an effective probabilistic formulation that allows us to generate, evaluate and optimize layout hypotheses by integrating new image evidence as the observer moves. Compared to state-of-the-art work, our approach makes significantly less limiting hypotheses about the scene and the observer (e.g., Manhattan world assumption, known camera motion). We introduce a new challenging dataset and present an extensive experimental evaluation, which demonstrates that our formulation reaches near-real-time computation time and outperforms state-of-the-art methods while operating in significantly less constrained conditions.

Furlan, A., Miller, S., Sorrenti, D., Fei Fei, L., Savarese, S. (2013). Free your Camera: 3D Indoor Scene Understanding from Arbitrary Camera Motion. In Proceedings of British Machine Vision Conference 2013. BMVA (British Machine Vision Association) [10.5244/C.27.24].

Free your Camera: 3D Indoor Scene Understanding from Arbitrary Camera Motion

FURLAN, AXEL;SORRENTI, DOMENICO GIORGIO;
2013

Abstract

Many works have been presented for indoor scene understanding, yet few of them combine structural reasoning with full motion estimation in a real-time oriented approach. In this work we address the problem of estimating the 3D structural layout of complex and cluttered indoor scenes from monocular video sequences, where the observer can freely move in the surrounding space. We propose an effective probabilistic formulation that allows us to generate, evaluate and optimize layout hypotheses by integrating new image evidence as the observer moves. Compared to state-of-the-art work, our approach makes significantly less limiting hypotheses about the scene and the observer (e.g., Manhattan world assumption, known camera motion). We introduce a new challenging dataset and present an extensive experimental evaluation, which demonstrates that our formulation reaches near-real-time computation time and outperforms state-of-the-art methods while operating in significantly less constrained conditions.
poster + paper
computer vision; robot vision; scene understanding; 3D scene layout
English
British Machine Vision Conference 2013
2013
Proceedings of British Machine Vision Conference 2013
2013
none
Furlan, A., Miller, S., Sorrenti, D., Fei Fei, L., Savarese, S. (2013). Free your Camera: 3D Indoor Scene Understanding from Arbitrary Camera Motion. In Proceedings of British Machine Vision Conference 2013. BMVA (British Machine Vision Association) [10.5244/C.27.24].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/49449
Citazioni
  • Scopus 29
  • ???jsp.display-item.citation.isi??? 8
Social impact