Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Uncolored clouds and PointNet baseline #132

Open
wants to merge 3 commits into
base: main
Choose a base branch
from
Open

Conversation

Vynikal
Copy link

@Vynikal Vynikal commented Jun 27, 2024

Uncolored clouds

The motivation is to use the model as an augmentation of FLAIR dataset without using inaccurate cloud colorizing. As the attributes are different, it's necessary to write a new dataset description and pre-transform. Also rgb normalizing is now conditional to to rgb attribute. NoRGB separate experiments were created.

PointNet baseline

Taking advantage of the modular design of Myria3D, just another model to compare with, nothing more, nothing less. Also coming with the NoRGB variant.

The two NoRGB models were trained and tested, more info in the forked repository readme, also including trained checkpoints.

It might not be perfect, feel free to point out the issues.

Copy link
Collaborator

@leavauchier leavauchier left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @Vynikal, thanks a lot for your contribution!
It looks mostly ok to me, and I think it would be great to have this added to myria3d!

Before that, it needs some changes related to your readme and missing tests

@@ -1,37 +1,60 @@
<div align="center">

# Myria3D: Aerial Lidar HD Semantic Segmentation with Deep Learning
# Fork adapted to train/infer on non-colorized data
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you remove the parts that are relate to your fork from this MR please, as it won't be relevant once merged

[![Documentation Build](https://github.com/IGNF/myria3d/actions/workflows/gh-pages.yml/badge.svg)](https://github.com/IGNF/myria3d/actions/workflows/gh-pages.yml)
</div>
<br><br>
To train PointNet:
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Infos on how to train are in the documentation, can you move your update to this part? eg. here

Same for the inference, see here

___

# Comparisons
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think that your comparisons can have a place in the documentation too, provided that you update the links so that the images are stored in our repo as well (in case yours is modified)

@@ -0,0 +1,126 @@
import torch
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@@ -0,0 +1,46 @@
# function to turn points loaded via pdal into a pyg Data object, with additional channels
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this needs tests as well, that can be added in https://github.com/IGNF/myria3d/tree/main/tests/myria3d/pctl/transforms

@Vynikal
Copy link
Author

Vynikal commented Dec 13, 2024

Hi, as this was done during an internship and I've since shifted my work elsewhere, I won't be able to provide further changes. Feel free to adapt the suggestions in any way you see fit.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants