Language Translation using Transformer in Python.

Photo by Arseny Togulev on Unsplash

Introduction

The tasks such as text summarization, predicting next word in the sentence, language translation built traditional seq2seq models has major disadvantage of losing information from beginning of the sentence for each word we add. These sequence models primarily works on encoding and decoding of the sentence. So, for long sequence and very long sentences, the…