Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Questions about the anomaly embedding #71

Open
Jaeihk opened this issue Aug 27, 2024 · 2 comments
Open

Questions about the anomaly embedding #71

Jaeihk opened this issue Aug 27, 2024 · 2 comments

Comments

@Jaeihk
Copy link

Jaeihk commented Aug 27, 2024

In this paper, it says k=8 tokens for random embedding, but when I actually checked embeddings.pt , it's [4,1280], is k=4 correct?

image

embedding_dict = torch.load("./embeddings_gs-299999.pt")
Shape: torch.Size([4, 1280])

@sjtuplayer
Copy link
Owner

In this paper, it says k=8 tokens for random embedding, but when I actually checked embeddings.pt , it's [4,1280], is k=4 correct?

image

embedding_dict = torch.load("./embeddings_gs-299999.pt") Shape: torch.Size([4, 1280])

The provided embedding.pt is correct, since the length only has a very tiny influence on results. You can just use it.

@Jaeihk
Copy link
Author

Jaeihk commented Oct 4, 2024

Thank you for your answer.
Can you upload the code for calculating IS score?
Thank you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants