Understanding Transformers Part 17: Generating the Output Word

In the previous article, we set up the residual connections to get the final output values from the decoder. In this article, we begin by passing these two output values through a fully connected layer. This layer has: One input for each value representing the current token (in this case, 2 inputs)