Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Scale in co3d annotation file #85

Open
AzmiHaider92 opened this issue Feb 14, 2024 · 1 comment
Open

Scale in co3d annotation file #85

AzmiHaider92 opened this issue Feb 14, 2024 · 1 comment

Comments

@AzmiHaider92
Copy link

Hi,

I'm trying to run NeRF on the scenes from your dataset.
I started by looking at one frame in a scene in the category "hydrant":
Using the FrameData, I extracted the R,T matrices and converted them to opencv format using https://github.com/facebookresearch/pytorch3d/blob/main/pytorch3d/utils/camera_conversions.py#L65

So, this should give me the camera position of this specific frame.
Looking at the extracted location of the camera (the T vector), I'm seeing large numbers that don't match the image (for example 7m even though the hydrant is very close to the camera as appears in the image).
Also, the deph map of the frame and the point cloud of the scene shows large number that can't be real.

I assume there's some kind of scaling needed.
How can I extract this scaling factor?

Thanks

@shapovalov
Copy link
Contributor

Unfortunately we only crowd-sourced RGB videos without any depth signal or even knowledge of sensor calibration, so we cannot provide metric depth.
The coordinate system was normalised for each scene separately (I think to have STD=1 of the SfM reconstructed point cloud).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants