3D Scene Reconstruction from a Single Viewport (ECCV 2020, long)