Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Regarding the issue with the CrossMamba block #17

Open
ZHUXIUJINChris opened this issue Jun 29, 2024 · 3 comments
Open

Regarding the issue with the CrossMamba block #17

ZHUXIUJINChris opened this issue Jun 29, 2024 · 3 comments

Comments

@ZHUXIUJINChris
Copy link

Thank you for the excellent work!
1719685514095

In this block, how does a single gated Z control both paths? I couldn't find it in the code. How exactly is it connected? Could you tell me the specific location in the code?

@wVelpro
Copy link

wVelpro commented Jul 2, 2024

I have the same question.

@alexhe101
Copy link
Owner

In function: mamba_inner_fn_no_out_proj
https://github.com/alexhe101/Pan-Mamba/blob/main/Mamba-block/mamba_simple.py#L19

@ZHUXIUJINChris
Copy link
Author

ZHUXIUJINChris commented Jul 3, 2024

Thank you for your response. Is this gating operation originally present in VisionMamba and Mamba? Will using this function twice separately in "V3" form this connection?

I only saw this place using Z in the underlying code.

1719980704819

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants