Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Apptainer] Command-line takes minutes to start running, even for the help command. #3287

Open
petertheprocess opened this issue Jul 4, 2024 · 0 comments

Comments

@petertheprocess
Copy link

Describe the bug
Hi there,

I am not sure is there the right place to post this issue. I am using apptainer container in a HPC cluster, this is the only way for me to set up nerfstudio on that cluster due to limit permission.

After the container building finished, the python inside the container cannot import nerfstudio and even cannot import numpy, then I figured out some env variables are missing. And after I added them, all function works and I can train and render successfully. But for each cmd I run, it got stuck and took minutes to get the 1st line of output, even for the simple help command.

To Reproduce

  1. build the container
    bash apptainer build --sandbox nerstudio_sandbox docker://dromni/nerfstudio:1.1.3
  2. launch the container, --env is needed because I found this variables are missing for some reason and without them python cannot loacte pkgs.
    apptainer exec -e --nv --writable\ -B $SCRATCH/nerfstudio/:/workspace/nerfstudio\ --env PYTHONPATH=/home/user/.local/lib/python3.10/site-packages:/home/user/nerfstudio \ $SCRATCH/nerfstudio_sandbox env HOME=/home/user bas
  3. run any command, and wait minutes to get output.
    bash ns-train --help
    Expected behavior
    At least the help command wont take so long to execute.

Additional context
My apptainer version is 1.3.2, after the 1st line of output shows on the screen, everything seems work in normal speed. So I guess there are some issues behind the command-line setup.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant