This makes it more difficult to learn # dependencies between distant positions. In the Transformer this is # reduced to a constant number of operations, albeit at the cost of # reduced effective ...