Cpt

CPT中文预训练模型:理解和生成

CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation 复旦大学,邱锡鹏老师团队 使用不平衡的Transformer编码器解码器架构,用MLM和DAE联合预训练,均可用于NLU和NLG。 CPT: a novel Chi...