-
Notifications
You must be signed in to change notification settings - Fork 126
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ModuleNotFoundError: No module named 'selective_scan_cuda' #55
Comments
There's no module |
I was trying to run
which imports In |
It is optional, without Check Selective Scan (optional)
|
Got it! Thank you. What are these
|
They are supposed to be the very simple version of |
Thanks! Closing this. |
Hi! You said 'We only have selective_scan_cuda_core, selective_scan_cuda_oflex and selective_scan_cuda_nrow.' But I couldn't import selective_scan_cuda_oflex or selective_scan_cuda_core. It shows that 'NameError: name 'selective_scan_cuda_oflex' is not defined'. What's the fix? Thank you! |
Hello, please, what if I want to run your sample program on Windows? My computer is an rtx 2060 laptop. The teacher has no fucking money and can't provide a server. |
have you tried the solution in issue #95 ? |
I looked and wondered if I was using the original mamba. i tried both in the original mamba and in your Vmanba. With the original mamba I added define to the two header files as I did, and then ran pip install . mamba reports an error Error compiling objects for extension. Your Vmamba runs in that error Note: This error is from a sub-process and may not be a pip problem.
ERROR: Failed building wheel for selective-scan
Run setup.py clean for selective-scan
Failed to build selective-scan
ERROR: Failed to build wheel for selective-scan, wheel is required to install pyproject.toml based project
I looked at the source code again and I suspect it's because my RTX 2060 maxes out to cuda11.6.Left
Leaving tears of poverty in my eyes
At 2024-04-17 16:16:09, "Liu Yue" ***@***.***> wrote:
Hello, please, what if I want to run your sample program on Windows? My computer is an rtx 2060 laptop. The teacher has no fucking money and can't provide a server.
have you tried the solution in issue #95 ?
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you commented.Message ID: ***@***.***>
|
the selective scan in vmamba do support cuda version under cuda11.6. You can try lower version of cuda then, if cuda11.6 is too high for your device. |
I'm using a RTX2060 laptop, Windows, and happen to have cuda11.6 installed.I was getting all sorts of errors when I reproduced mamba before. You don't have to go through all that trouble to reproduce this result, do you? I'm not a cs major, I'm not in a position to judge whether an experience post is credible or not.
At 2024-04-18 17:16:30, "Liu Yue" ***@***.***> wrote:
the selective scan in vmamba do support cuda version under cuda11.6. You can try lower version of cuda then, if cuda11.6 is too high for your device.
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you commented.Message ID: ***@***.***>
|
He |
Have you solved it ? Maybe you can not find the module selective_scan_cuda_oflex, mainly because that you did not install kernel/selective_scan. |
As you said, I suspect this is the reason, but after I've installed it, it's still missing.
…---Original---
From: "Liu ***@***.***>
Date: Tue, Jun 4, 2024 19:56 PM
To: ***@***.***>;
Cc: ***@***.******@***.***>;
Subject: Re: [MzeroMiko/VMamba] ModuleNotFoundError: No module named'selective_scan_cuda' (Issue #55)
Have you solved it ?
Maybe you can not find the module selective_scan_cuda_oflex, mainly because that you did not install kernel/selective_scan.
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you commented.Message ID: ***@***.***>
|
I have been successfully run. Environment follows: Python 3.10.14
causal_conv can also be downloaded by searching pypi causal_conv, (maba2) jt2@ubuntu:/data3/jt2$ pip list Brotli 1.0.9 (maba2) jt2@ubuntu:/data3/jt2$ conda list packages in environment at /home/jt2/anaconda3/envs/maba2:Name Version Build Channel_libgcc_mutex 0.1 main defaults |
I have successfully installed selective_scan 0.0.2, but I can only import selective_scan_cuda_oflex, and selective_scan_cuda_core shows no module, is it that this module is no longer supported? |
I'm having the same problem too! I am using only VSSBlock, and not using vssm, there is no way to set a default selective scan module, I would like to use torch only, but it defaults to selective_scan_cuda_core. Btw i have selective scan 0.0.2 installed too, when using only VSSBlock, it errors out because it doesn find it when calling something in csms6s.py Does someone know how can I change the backend to mamba or torch? |
I tried both: If you want to check the modules compared with mamba_ssm, install mamba_ssm first! If you want to check if the implementation of selective scan of ours is the same with mamba_ssm, selective_scan/test_selective_scan.py is here for you. Change to MODE = "mamba_ssm_sscore" in selective_scan/test_selective_scan.py, and run pytest selective_scan/test_selective_scan.py. If you want to check if the implementation of selective scan of ours is the same with reference code (selective_scan_ref), change to MODE = "sscore" in selective_scan/test_selective_scan.py, and run pytest selective_scan/test_selective_scan.py. but still got this error:
@MzeroMiko Any help would be great. |
selective_scan_cuda_core is deprecated, so use selective_scan_cuda_oflex instead. |
@MzeroMiko Thanks for the reply.
It's imported in the code. Any updated specific instructions? Or should we fix it ourselves and make a pull request? |
No modification needed as core is aligned with oflex, they acts the same when the hyperparameter oflex equals false. Also,all the models except for v2 (which is also deprecated,use v05 instead) uses oflex,or mamba for ablation. |
Sorry, it is still unclear to me in terms of the specific modifications. If we follow exactly the same instructions we will encounter the same issue again. Any specific instructions to install packages or hyperparameters when running a code would be helpful. |
what's the hyperparameters you are using? |
I followed this one: If you want to check if the implementation of selective scan of ours is the same with mamba_ssm, selective_scan/test_selective_scan.py is here for you. Change to MODE = "mamba_ssm_sscore" in selective_scan/test_selective_scan.py, and run pytest selective_scan/test_selective_scan.py. |
So you want to check if everything is right? Then modify |
Hi author, my project requires CUDA 11.1, I have successfully pip install . from kernels/selective_scan, however, I have this nasty error from importing selective_scan_cuda_oflex:
|
Hi! I followed the instructions for installation, and after
cd selective_scan && pip install .
I can successfully importselective_scan
but not other functions:What's the fix? Thank you.
The text was updated successfully, but these errors were encountered: