What is the meaning of token length in Normalization?

[EricLina]

Hi there!
Excellent job on your work!
Could you please explain the concept of 'longer token' in this context?

[tian-qing001]

Hi @EricLina, thanks for your interest in our work.
In this context, a token $x_i$ is actually a vector in $\mathbb{R}^{1\times d}$ space. We consider a token $x_i$ with larger norm $\Vert x_i \Vert$ to be a longer token. For example, $2x_i$ is longer than $x_i$ when $x_i\neq 0$.

[EricLina]

Thanks for your reply.