Abstract
An important property of human perception is that one does not tend to process a whole scene in its entirety at once, for example, if we want to tell which model is a car, we do not need to look at people or animals in the environment. Likewise, when doing classification in pictures, we need to “pay attention” in certain parts of the image. Attention is an important component of neural ne…