Support for RTX 4090 #27

shingarey · 2024-04-04T17:34:50Z

The current Dockerfile uses an image with outdated CUDA library cudagl:11.3.0-devel which does not support RTX 4090. To fix this, the docker image and torch version in the Dockerfile can be updated. Following changes worked for me.

Update docker image and torch version in docker/dockerfile:

FROM nvidia/cuda:12.1.0-devel-ubuntu20.04

...

RUN conda init bash &&\
    echo "conda activate my" >> ~/.bashrc &&\
    conda activate my &&\
    pip install torchvision==0.16.0+cu121 torchaudio==2.1.0 torch==2.1.0+cu121 --index-url https://download.pytorch.org/whl/cu121 &&\
...

Additionally, update the compiler flags in bundlesdf/mycuda/setup.py from c++14 to c++17:

nvcc_flags = ['-Xcompiler', '-O3', '-std=c++17', '-U__CUDA_NO_HALF_OPERATORS__', '-U__CUDA_NO_HALF_CONVERSIONS__', '-U__CUDA_NO_HALF2_OPERATORS__']
c_flags = ['-O3', '-std=c++17']

With these fixes, I was able to successfully build and run the provided examples: run_demo.py and bundlesdf/run_nerf.py.

The text was updated successfully, but these errors were encountered:

wenbowen123 · 2024-04-04T18:17:54Z

Perfect, thanks for sharing this!

longwoo · 2024-04-08T07:48:05Z

@shingarey could you share the docker environment for 4090? For some reason, I failed to build docker from dockerfile. It would be great to download the environment by docker pull

shingarey · 2024-04-09T06:28:47Z

@longwoo try this one:
foundationpose custom docker image with cuda121

monajalal · 2024-04-09T14:23:48Z

@shingarey I pulled your docker but could you please share how you incorporate it into run_container.sh?

(base) mona@ada:/data/FoundationPose$ docker pull shingarey/foundationpose_custom_cuda121:latest
latest: Pulling from shingarey/foundationpose_custom_cuda121
96d54c3075c9: Pull complete 
755e535b54a3: Pull complete 
24ff69e0a1e4: Pull complete 
76a627ca5e65: Pull complete 
35817692a87e: Pull complete 
84b6a42e847a: Pull complete 
4639b7cd68e5: Pull complete 
a7bc10701a5b: Pull complete 
7d32a9230f8f: Pull complete 
8c35a1861813: Pull complete 
e3f63d7242f5: Pull complete 
7d4b097a7e9d: Pull complete 
4612d657f431: Pull complete 
730e1cd9723b: Pull complete 
b4a75e4ece39: Pull complete 
fe0293ccd76c: Pull complete 
ed1a8048ef98: Pull complete 
1308be50bc97: Pull complete 
4412cb55cd12: Pull complete 
013df3150cc3: Pull complete 
8441b9a1ff80: Pull complete 
ad30346aeadc: Pull complete 
9c24ef1ac2af: Pull complete 
Digest: sha256:288252092889a52a2e3f1c0087e4a380a601beedf54615c18312ab59cf1f3fb5
Status: Downloaded newer image for shingarey/foundationpose_custom_cuda121:latest
docker.io/shingarey/foundationpose_custom_cuda121:latest

(base) mona@ada:/data/FoundationPose/docker$ cat run_container.sh
docker rm -f foundationpose
CATGRASP_DIR=$(pwd)/../
xhost +  && docker run --gpus all --env NVIDIA_DISABLE_REQUIRE=1 -it --network=host --name foundationpose shingarey/foundationpose_custom_cuda121:latest  --cap-add=SYS_PTRACE --security-opt seccomp=unconfined -v /data:/data -v /mnt:/mnt -v /tmp/.X11-unix:/tmp/.X11-unix -v /tmp:/tmp  --ipc=host -e DISPLAY=${DISPLAY} -e GIT_INDEX_FILE foundationpose:latest bash

(base) mona@ada:/data/FoundationPose/docker$ bash run_container.sh 
fp
access control disabled, clients can connect from any host

==========
== CUDA ==
==========

CUDA Version 12.1.0

Container image Copyright (c) 2016-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.

This container image and its contents are governed by the NVIDIA Deep Learning Container License.
By pulling and using the container, you accept the terms and conditions of this license:
https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license

A copy of this license is made available in this container at /NGC-DL-CONTAINER-LICENSE for your convenience.

*************************
** DEPRECATION NOTICE! **
*************************
THIS IMAGE IS DEPRECATED and is scheduled for DELETION.
    https://gitlab.com/nvidia/container-images/cuda/blob/master/doc/support-policy.md

/opt/nvidia/nvidia_entrypoint.sh: line 67: exec: --: invalid option
exec: usage: exec [-cl] [-a name] [command [arguments ...]] [redirection ...]

(base) mona@ada:/data/FoundationPose/docker$ bash run_container.sh
foundationpose
access control disabled, clients can connect from any host

==========
== CUDA ==
==========

CUDA Version 12.1.0

Container image Copyright (c) 2016-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.

This container image and its contents are governed by the NVIDIA Deep Learning Container License.
By pulling and using the container, you accept the terms and conditions of this license:
https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license

A copy of this license is made available in this container at /NGC-DL-CONTAINER-LICENSE for your convenience.

*************************
** DEPRECATION NOTICE! **
*************************
THIS IMAGE IS DEPRECATED and is scheduled for DELETION.
    https://gitlab.com/nvidia/container-images/cuda/blob/master/doc/support-policy.md

/opt/nvidia/nvidia_entrypoint.sh: line 67: exec: --: invalid option
exec: usage: exec [-cl] [-a name] [command [arguments ...]] [redirection ...]
(base) mona@ada:/data/FoundationPose/docker$ cat run_container.sh
docker rm -f foundationpose
CATGRASP_DIR=$(pwd)/../
xhost +  && docker run --gpus all --env NVIDIA_DISABLE_REQUIRE=1 -it --network=host --name foundationpose docker.io/shingarey/foundationpose_custom_cuda121:latest  --cap-add=SYS_PTRACE --security-opt seccomp=unconfined -v /data:/data -v /mnt:/mnt -v /tmp/.X11-unix:/tmp/.X11-unix -v /tmp:/tmp  --ipc=host -e DISPLAY=${DISPLAY} -e GIT_INDEX_FILE foundationpose:latest bash

shingarey · 2024-04-09T14:38:22Z

docker rm -f foundationpose
CATGRASP_DIR=$(pwd)/../
xhost +  && docker run --gpus all --env NVIDIA_DISABLE_REQUIRE=1 -it --network=host --name foundationpose  --cap-add=SYS_PTRACE --security-opt seccomp=unconfined -v __PATH_TO_FOUNDATIONPOSE_ON_HOST_PC__:__PATH_ON_CONTAINER__ -v /mnt:/mnt -v /tmp/.X11-unix:/tmp/.X11-unix -v /tmp:/tmp  --ipc=host -e DISPLAY=${DISPLAY} -e GIT_INDEX_FILE foundationpose:latest bash

__PATH_TO_FOUNDATIONPOSE_ON_HOST_PC__ - is the path to the directory on your host system
__PATH_ON_CONTAINER__ - where to mount inside the container, e.g. /home/your_name

foundationpose:latest might need to be adapted if you use different image.

Jarvan-hhh · 2024-04-11T05:06:19Z

PATH_TO_FOUNDATIONPOSE_ON_HOST_PC Is this path referring to the path of FoundationPose-main? I don't quite understand, thank you.

monajalal · 2024-04-11T17:37:08Z

@shingarey

can you show all the steps including the docker pull?
do you use same command as below?
docker pull shingarey/foundationpose_custom_cuda121:latest

shingarey · 2024-04-12T17:16:34Z

Yes, it refers to the path to the FoundationPose directory on your host PC.
I use it as described in the initial post.

Jarvan-hhh · 2024-04-15T06:21:06Z

Thank you for your reply, it is very helpful to me.

StevePotter · 2024-05-02T21:00:34Z

What are the reasons for not making a PR and making this update available in the main branch? Why keep it at 11.3? Also, cudagl and cuda images are at different docker repos. CudaGL adds support for OpenGL, but doesn't have images past cuda 11.4. Do we need OpenGL support?

Cheney-36 · 2024-07-21T11:15:30Z

Thank you very much for your discussion. In the end, I resolved the issue using the following commanddocker rm -f foundationpose DIR=$(pwd)/..// xhost + && docker run --gpus all --env NVIDIA_DISABLE_REQUIRE=1 -it --network=host --name foundationpose --cap-add=SYS_PTRACE --security-opt seccomp=unconfined -v $DIR:$DIR -v /mnt:/mnt -v /tmp/.X11-unix:/tmp/.X11-unix -v /tmp:/tmp --ipc=host -e DISPLAY=${DISPLAY} -e GIT_INDEX_FILE shingarey/foundationpose_custom_cuda121:latest bash -c "cd $DIR && bash"

zhaowangji · 2024-10-06T12:10:31Z

Thank you!
I also met the problem that simply modifying the docker file and rebuilding didn't work, but after pull your image(and solved the "mycpp" issue, which is solved by using other methods provided in the issues), it finally works.

DavidePeron19 · 2024-10-22T15:05:50Z

@shingarey would it be possible for you to share the Dockerfile you used to create the image since I would like to work on that updating it to Ubuntu 22 and adding ROS dependencies? It is my first time working with Docker and I am a bit lost on how to create the image and Dockerfile from scratch

wenbowen123 closed this as completed Apr 4, 2024

wenbowen123 mentioned this issue Apr 6, 2024

error in docker for ADA 6000 RTX -- nvcc fatal : Unsupported gpu architecture 'compute_89' #30

Closed

savidini mentioned this issue Apr 11, 2024

Preprocessing of depth image for model-based inference #44

Closed

aThinkingNeal mentioned this issue Apr 30, 2024

CUDA and pytorch version mismatch #6

Closed

mrtnbm mentioned this issue Jun 11, 2024

Improvements to docker #81

Open

zhaowangji mentioned this issue Oct 6, 2024

Last step issue!! #230

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Support for RTX 4090 #27

Support for RTX 4090 #27

shingarey commented Apr 4, 2024 •

edited

Loading

wenbowen123 commented Apr 4, 2024

longwoo commented Apr 8, 2024

shingarey commented Apr 9, 2024 •

edited

Loading

monajalal commented Apr 9, 2024 •

edited

Loading

shingarey commented Apr 9, 2024 •

edited

Loading

Jarvan-hhh commented Apr 11, 2024

monajalal commented Apr 11, 2024

shingarey commented Apr 12, 2024

Jarvan-hhh commented Apr 15, 2024

StevePotter commented May 2, 2024 •

edited

Loading

Cheney-36 commented Jul 21, 2024

zhaowangji commented Oct 6, 2024

DavidePeron19 commented Oct 22, 2024

Support for RTX 4090 #27

Support for RTX 4090 #27

Comments

shingarey commented Apr 4, 2024 • edited Loading

wenbowen123 commented Apr 4, 2024

longwoo commented Apr 8, 2024

shingarey commented Apr 9, 2024 • edited Loading

monajalal commented Apr 9, 2024 • edited Loading

shingarey commented Apr 9, 2024 • edited Loading

Jarvan-hhh commented Apr 11, 2024

monajalal commented Apr 11, 2024

shingarey commented Apr 12, 2024

Jarvan-hhh commented Apr 15, 2024

StevePotter commented May 2, 2024 • edited Loading

Cheney-36 commented Jul 21, 2024

zhaowangji commented Oct 6, 2024

DavidePeron19 commented Oct 22, 2024

shingarey commented Apr 4, 2024 •

edited

Loading

shingarey commented Apr 9, 2024 •

edited

Loading

monajalal commented Apr 9, 2024 •

edited

Loading

shingarey commented Apr 9, 2024 •

edited

Loading

StevePotter commented May 2, 2024 •

edited

Loading