This repository has been archived by the owner on Jul 7, 2023. It is now read-only.

Use of Layer Normalization #1910

Open

Andre1998Shuvam opened this issue Mar 19, 2022 · 0 comments

Andre1998Shuvam commented Mar 19, 2022

Hello! I would like to know why Layer Normalization and Residual connections have been used in the Transformer architecture.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.