We gratefully acknowledge support from
the Simons Foundation and member institutions.

Chenguang Wang is qualified to endorse.

Transformer on a Diet

Chenguang Wang: Is registered as an author of this paper.
Can endorse for cs.AI, cs.CL, cs.CV, cs.IR, cs.LG, cs.SI. (why?)

Zihao Ye, Aston Zhang, Zheng Zhang and Alexander J. Smola are not registered as owners of this paper. (why?)