BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

中文nlp解决方案(大模型、数据、模型、训练、推理)

GPT2 for Chinese chitchat/用于中文闲聊的GPT2模型(实现了DialoGPT的MMI思想)

RoBERTa中文预训练模型: RoBERTa for Chinese

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

pytorch实现 Bert 做seq2seq任务，使用unilm方案,现在也可以做自动摘要，文本分类，情感分析，NER，词性标注等任务,支持t5模型，支持GPT2进行文章续写。

Human ChatGPT Comparison Corpus (HC3), Detectors, and more! 🔥

Chinese NewsTitle Generation Project by GPT2.带有超级详细注释的中文GPT2新闻标题生成项目。

Simple Text-Generator with OpenAI gpt-2 Pytorch Implementation

TextGen: Implementation of Text Generation models, include LLaMA, BLOOM, GPT2, BART, T5, SongNet and so on. 文本生成模型，实现了包括LLaMA，ChatGLM，BLOOM，GPT2，Seq2Seq，BART，T5，UDA等模型的训练和预测，开箱即用。

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

Pre-trained Transformers for Arabic Language Understanding and Generation (Arabic BERT, Arabic GPT2, Arabic ELECTRA)

Code for producing Japanese pretrained models provided by rinna Co., Ltd.

A PyTorch implementation of "Graph Wavelet Neural Network" (ICLR 2019)

Easy-to-use CPM for Chinese text generation（基于CPM的中文文本生成）

NLP 领域常见任务的实现，包括新词发现、以及基于pytorch的词向量、中文文本分类、实体识别、摘要文本生成、句子相似度判断、三元组抽取、预训练模型等。

Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpeed

MindSpore online courses: Step into LLM

1. Use BERT, ALBERT and GPT2 as tensorflow2.0's layer. 2. Implement GCN, GAN, GIN and GraphSAGE based on message passing.

PyTorch Implementation of OpenAI GPT-2