What does W_c[c1; ...; cM] notation in the paper mean for character embeddings?

[brando90]

The paper does not explain what the concatenation of vectors with the semicolon operation means. Can this be clarified?

if we have n_i = W_c[c1; ...; cM], does this mean that W_c is a [1,M] vector and [c1; ...; cM] is a [M, D] matrix?

[zysszy]

The paper does not explain what the concatenation of vectors with the semicolon operation means. Can this be clarified?

if we have n_i = W_c[c1; ...; cM], does this mean that W_c is a [1,M] vector and [c1; ...; cM] is a [M, D] matrix?

If we have n_i = W_c[c1; ...; cM], this mean that W_c is a [D, M * D] matrix and [c1; ...; cM] is a [M * D, 1] vector (implemented by torch.cat or tf.concat), where D is the hidden size.

[brando90]

The paper does not explain what the concatenation of vectors with the semicolon operation means. Can this be clarified?

if we have n_i = W_c[c1; ...; cM], does this mean that W_c is a [1,M] vector and [c1; ...; cM] is a [M, D] matrix?

If we have n_i = W_c[c1; ...; cM], this mean that W_c is a [D, M * D] matrix and [c1; ...; cM] is a [M * D, 1] vector (implemented by torch.cat or tf.concat), where D is the hidden size.

Thanks for the clarification. I think that is non-standard notation, perhaps you could write what that means in the paper next time? e.g. in the appendix if it's getting to long.

Thanks!

[zysszy]

The paper does not explain what the concatenation of vectors with the semicolon operation means. Can this be clarified?

if we have n_i = W_c[c1; ...; cM], does this mean that W_c is a [1,M] vector and [c1; ...; cM] is a [M, D] matrix?

If we have n_i = W_c[c1; ...; cM], this mean that W_c is a [D, M * D] matrix and [c1; ...; cM] is a [M * D, 1] vector (implemented by torch.cat or tf.concat), where D is the hidden size.

Thanks for the clarification. I think that is non-standard notation, perhaps you could write what that means in the paper next time? e.g. in the appendix if it's getting to long.

Thanks!

Thanks for you advice~