-
Notifications
You must be signed in to change notification settings - Fork 24
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Uncolored clouds and PointNet baseline #132
base: main
Are you sure you want to change the base?
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hi @Vynikal, thanks a lot for your contribution!
It looks mostly ok to me, and I think it would be great to have this added to myria3d!
Before that, it needs some changes related to your readme and missing tests
@@ -1,37 +1,60 @@ | |||
<div align="center"> | |||
|
|||
# Myria3D: Aerial Lidar HD Semantic Segmentation with Deep Learning | |||
# Fork adapted to train/infer on non-colorized data |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can you remove the parts that are relate to your fork from this MR please, as it won't be relevant once merged
[![Documentation Build](https://github.com/IGNF/myria3d/actions/workflows/gh-pages.yml/badge.svg)](https://github.com/IGNF/myria3d/actions/workflows/gh-pages.yml) | ||
</div> | ||
<br><br> | ||
To train PointNet: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
___ | ||
|
||
# Comparisons |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think that your comparisons can have a place in the documentation too, provided that you update the links so that the images are stored in our repo as well (in case yours is modified)
@@ -0,0 +1,126 @@ | |||
import torch |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This needs testing, tests can be added in https://github.com/IGNF/myria3d/blob/main/tests/myria3d/models/modules/ (see https://github.com/IGNF/myria3d/blob/main/tests/myria3d/models/modules/test_randla_nets.py for an example)
@@ -0,0 +1,46 @@ | |||
# function to turn points loaded via pdal into a pyg Data object, with additional channels |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
this needs tests as well, that can be added in https://github.com/IGNF/myria3d/tree/main/tests/myria3d/pctl/transforms
Hi, as this was done during an internship and I've since shifted my work elsewhere, I won't be able to provide further changes. Feel free to adapt the suggestions in any way you see fit. |
Uncolored clouds
The motivation is to use the model as an augmentation of FLAIR dataset without using inaccurate cloud colorizing. As the attributes are different, it's necessary to write a new dataset description and pre-transform. Also rgb normalizing is now conditional to to rgb attribute. NoRGB separate experiments were created.
PointNet baseline
Taking advantage of the modular design of Myria3D, just another model to compare with, nothing more, nothing less. Also coming with the NoRGB variant.
The two NoRGB models were trained and tested, more info in the forked repository readme, also including trained checkpoints.
It might not be perfect, feel free to point out the issues.