Let’s play with Transformers!

Back in 2017, taming the transformer was no trivial task. Researchers had to wrangle with a very large perimeter space. Now with many trials blazed, you play with transformers on your own. It's easy and fun!

To begin, let’s open a google colab and create a new notebook (or if you have a really high end computer, a jupyter notebook will work). You’ll probably want to take advantage of Google’s free GPU or TPU hardware accelerators (runtime -> change runtime type).

First, let’s import our favorite package:

import tensorflow as tf