From Attention to Transformer — A Leap in NLP History Guo Zhonghao, Li Mengning, Xu Chenyang, Yuan Yueying, Zheng Yuguo, Zhu Lin Abstract Our group adopted a text summarization model called BertSum in project. It is a deep learning model based on Google Bert which published in late 2018. Bert is hu...