Skip to content
This repository was archived by the owner on Jan 15, 2024. It is now read-only.

Commit 98325f5

Browse files
sxjsciencesxjscience
authored
[AMP] Add AMP support to Machine Translation (#1448)
* Update wmt2014_ende.sh Delete wmt2014_ende_base.sh Update README.md Update train_transformer.py fix Update train_transformer.py Update train_transformer.py update Update README.md Update wmt2014_ende_base.sh fix Update train_transformer.py Update train_transformer.py Update train_transformer.py Update run_squad.py update update Update README.md Update train_transformer.py Update train_transformer.py Update train_transformer.py Update train_transformer.py Update train_transformer.py Update train_transformer.py Update README.md Update train_transformer.py Update train_transformer.py Update train_transformer.py Update train_transformer.py Update train_transformer.py Update train_transformer.py Update train_transformer.py update Update train_transformer.py Update train_transformer.py Update train_transformer.py Update train_transformer.py Update train_transformer.py fix Update train_transformer.py use save again Update average_checkpoint.py update Update README.md Update README.md update fix Update README.md update update update Update README.md Update README.md Update README.md update Update README.md Update average_checkpoint.py * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * Update base.py * Revert "Update base.py" This reverts commit 8bad1b5. * Update README.md * update * fix * Update train_transformer.py * Update README.md * update * update * update * Update train_transformer.py * Update train_transformer.py * Update train_transformer.py * Update README.md * use 1.0 scale * fix * use even rank * Update train_transformer.py * Update train_transformer.py * Update train_transformer.py * Update train_transformer.py * Update train_transformer.py * update * Update train_transformer.py * Update train_transformer.py * Update train_transformer.py * fix * Update train_transformer.py * add optimizer + optimizer params * Update train_transformer.py * Update README.md * update * revise logging * fix * update * update * Update README.md * update * Update sequence_sampler.py * Update README.md * Update README.md * Update train_transformer.py * fix logging * Update train_transformer.py * Update train_transformer.py * update * Update evaluate_transformer.py * Update evaluate_transformer.py * fix * Update README.md * Update train_transformer.py * update * fix * Update train_transformer.py * Update train_transformer.py * try to add multi-gpu beam search * Update train_transformer.py * Update sampler.py * Update train_transformer.py * Update train_transformer.py * Update train_transformer.py * update * Update train_transformer.py * update * Update train_transformer.py * Update train_transformer.py * Update README.md * Update train_transformer.py * Update README.md * Update train_transformer.py * Update train_transformer.py * fix * Update README.md * update * update * update * Update README.md * update * update * update * update * fix * Update average_checkpoint.py * Update README.md * Update README.md * Update sampler.py * Update README.md * update * move count_parameters * Update parameter.py * Update test_models_transformer.py * add ETA * fix * Update train_transformer.py * add round to * Update train_transformer.py * Update train_transformer.py * Update train_transformer.py * Update train_transformer.py * Update sampler.py * Update sampler.py * Update sampler.py * Update sampler.py * Update sampler.py * Update train_transformer.py * Update sampler.py * fix * move AverageSGD Tracker to utils/parameter * Update evaluate_transformer.py * Update evaluate_transformer.py * Update evaluate_transformer.py * Update evaluate_transformer.py * Create evaluate_epochs_wmt2014_ende.sh * Update README.md * Update evaluate_epochs_wmt2014_ende.sh * Update evaluate_epochs_wmt2014_ende.sh * update * Update README.md * update * Update README.md * Update README.md * update SQuAD to latest * update SQuAD to latest * fix error * update * fix * Update text_prediction_part1.md * Update README.md * Update README.md * Update README.md * Update README.md * Update evaluate_epochs_wmt2014_ende.sh * use sorted * update link of files
1 parent 1cdb67b commit 98325f5

30 files changed

Lines changed: 1334 additions & 644 deletions

‎README.md‎

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -27,9 +27,6 @@ process the text data, and train models.
2727
First of all, install the latest MXNet. You may use the following commands:
2828

2929
```bash
30-
# Install the version with CUDA 10.0
31-
python3 -m pip install -U --pre "mxnet-cu100>=2.0.0b20201206" -f https://dist.mxnet.io/python
32-
3330
# Install the version with CUDA 10.1
3431
python3 -m pip install -U --pre "mxnet-cu101>=2.0.0b20201206" -f https://dist.mxnet.io/python
3532

‎docs/examples/text_prediction/text_prediction_part1.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -136,7 +136,7 @@ It is straightforward to load the other models by specifying the name of the mod
136136

137137

138138
```{.python .input}
139-
from gluonnlp.utils.misc import count_parameters
139+
from gluonnlp.utils.parameter import count_parameters
140140
param_num_l = []
141141
for name in ['google_en_uncased_bert_base',
142142
'google_uncased_mobilebert']:

‎scripts/datasets/general_nlp_benchmark/prepare_glue.py‎

Lines changed: 17 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -467,20 +467,20 @@ def read_broadcoverage_diagnostic(dir_path):
467467

468468

469469
GLUE_TASK2PATH = {
470-
"cola": "https://firebasestorage.googleapis.com/v0/b/mtl-sentence-representations.appspot.com/o/data%2FCoLA.zip?alt=media&token=46d5e637-3411-4188-bc44-5809b5bfb5f4", # noqa
471-
"sst": "https://firebasestorage.googleapis.com/v0/b/mtl-sentence-representations.appspot.com/o/data%2FSST-2.zip?alt=media&token=aabc5f6b-e466-44a2-b9b4-cf6337f84ac8", # noqa
470+
"cola": "https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/glue/cola.zip", # noqa
471+
"sst": "https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/glue/sst.zip", # noqa
472472
"mrpc": {
473473
'train': "https://dl.fbaipublicfiles.com/senteval/senteval_data/msr_paraphrase_train.txt",
474474
'dev': "https://firebasestorage.googleapis.com/v0/b/mtl-sentence-representations.appspot.com/o/data%2Fmrpc_dev_ids.tsv?alt=media&token=ec5c0836-31d5-48f4-b431-7480817f1adc",
475475
'test': "https://dl.fbaipublicfiles.com/senteval/senteval_data/msr_paraphrase_test.txt"
476476
},
477-
"qqp": "https://firebasestorage.googleapis.com/v0/b/mtl-sentence-representations.appspot.com/o/data%2FQQP-clean.zip?alt=media&token=11a647cb-ecd3-49c9-9d31-79f8ca8fe277", # noqa
478-
"sts": "https://firebasestorage.googleapis.com/v0/b/mtl-sentence-representations.appspot.com/o/data%2FSTS-B.zip?alt=media&token=bddb94a7-8706-4e0d-a694-1109e12273b5", # noqa
479-
"mnli": "https://firebasestorage.googleapis.com/v0/b/mtl-sentence-representations.appspot.com/o/data%2FMNLI.zip?alt=media&token=50329ea1-e339-40e2-809c-10c40afff3ce", # noqa
480-
"snli": "https://firebasestorage.googleapis.com/v0/b/mtl-sentence-representations.appspot.com/o/data%2FSNLI.zip?alt=media&token=4afcfbb2-ff0c-4b2d-a09a-dbf07926f4df", # noqa
481-
"qnli": "https://firebasestorage.googleapis.com/v0/b/mtl-sentence-representations.appspot.com/o/data%2FQNLIv2.zip?alt=media&token=6fdcf570-0fc5-4631-8456-9505272d1601", # noqa
482-
"rte": "https://firebasestorage.googleapis.com/v0/b/mtl-sentence-representations.appspot.com/o/data%2FRTE.zip?alt=media&token=5efa7e85-a0bb-4f19-8ea2-9e1840f077fb", # noqa
483-
"wnli": "https://firebasestorage.googleapis.com/v0/b/mtl-sentence-representations.appspot.com/o/data%2FWNLI.zip?alt=media&token=068ad0a0-ded7-4bd7-99a5-5e00222e0faf", # noqa
477+
"qqp": "https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/glue/qqp.zip", # noqa
478+
"sts": "https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/glue/sts.zip", # noqa
479+
"mnli": "https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/glue/mnli.zip", # noqa
480+
"snli": "https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/glue/snli.zip", # noqa
481+
"qnli": "https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/glue/qnli.zip", # noqa
482+
"rte": "https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/glue/rte.zip", # noqa
483+
"wnli": "https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/glue/wnli.zip", # noqa
484484
"diagnostic": [
485485
"https://storage.googleapis.com/mtl-sentence-representations.appspot.com/tsvsWithoutLabels%2FAX.tsv?GoogleAccessId=firebase-adminsdk-0khhl@mtl-sentence-representations.iam.gserviceaccount.com&Expires=2498860800&Signature=DuQ2CSPt2Yfre0C%2BiISrVYrIFaZH1Lc7hBVZDD4ZyR7fZYOMNOUGpi8QxBmTNOrNPjR3z1cggo7WXFfrgECP6FBJSsURv8Ybrue8Ypt%2FTPxbuJ0Xc2FhDi%2BarnecCBFO77RSbfuz%2Bs95hRrYhTnByqu3U%2FYZPaj3tZt5QdfpH2IUROY8LiBXoXS46LE%2FgOQc%2FKN%2BA9SoscRDYsnxHfG0IjXGwHN%2Bf88q6hOmAxeNPx6moDulUF6XMUAaXCSFU%2BnRO2RDL9CapWxj%2BDl7syNyHhB7987hZ80B%2FwFkQ3MEs8auvt5XW1%2Bd4aCU7ytgM69r8JDCwibfhZxpaa4gd50QXQ%3D%3D", # noqa
486486
"https://www.dropbox.com/s/ju7d95ifb072q9f/diagnostic-full.tsv?dl=1",
@@ -503,16 +503,16 @@ def read_broadcoverage_diagnostic(dir_path):
503503

504504

505505
SUPERGLUE_TASK2PATH = {
506-
"cb": "https://dl.fbaipublicfiles.com/glue/superglue/data/v2/CB.zip",
507-
"copa": "https://dl.fbaipublicfiles.com/glue/superglue/data/v2/COPA.zip",
508-
"multirc": "https://dl.fbaipublicfiles.com/glue/superglue/data/v2/MultiRC.zip",
509-
"rte": "https://dl.fbaipublicfiles.com/glue/superglue/data/v2/RTE.zip",
510-
"wic": "https://dl.fbaipublicfiles.com/glue/superglue/data/v2/WiC.zip",
511-
"wsc": "https://dl.fbaipublicfiles.com/glue/superglue/data/v2/WSC.zip",
506+
"cb": "https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/superglue/cb.zip",
507+
"copa": "https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/superglue/copa.zip",
508+
"multirc": "https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/superglue/multirc.zip",
509+
"rte": "https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/superglue/rte.zip",
510+
"wic": "https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/superglue/wic.zip",
511+
"wsc": "https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/superglue/wsc.zip",
512512
"broadcoverage-diagnostic": "https://dl.fbaipublicfiles.com/glue/superglue/data/v2/AX-b.zip",
513513
"winogender-diagnostic": "https://dl.fbaipublicfiles.com/glue/superglue/data/v2/AX-g.zip",
514-
"boolq": "https://dl.fbaipublicfiles.com/glue/superglue/data/v2/BoolQ.zip",
515-
"record": "https://dl.fbaipublicfiles.com/glue/superglue/data/v2/ReCoRD.zip",
514+
"boolq": "https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/superglue/boolq.zip",
515+
"record": "https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/superglue/record.zip",
516516
}
517517

518518
SUPERGLUE_READER = {

‎scripts/datasets/machine_translation/wmt2014_ende.sh‎

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -32,9 +32,6 @@ nlp_process clean_tok_para_corpus --src-lang ${SRC} \
3232
--tgt-lang ${TGT} \
3333
--src-corpus dev.raw.${SRC} \
3434
--tgt-corpus dev.raw.${TGT} \
35-
--min-num-words 1 \
36-
--max-num-words 100 \
37-
--max-ratio 1.5 \
3835
--src-save-path dev.tok.${SRC} \
3936
--tgt-save-path dev.tok.${TGT}
4037

‎scripts/datasets/machine_translation/wmt2014_ende_base.sh‎

Lines changed: 0 additions & 76 deletions
This file was deleted.

‎scripts/datasets/url_checksums/glue.txt‎

Lines changed: 9 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -1,14 +1,14 @@
1-
https://firebasestorage.googleapis.com/v0/b/mtl-sentence-representations.appspot.com/o/data%2FCoLA.zip?alt=media&token=46d5e637-3411-4188-bc44-5809b5bfb5f4 19096246cd2a06d8fe2d13880d6cec61149f77c7 376971
2-
https://firebasestorage.googleapis.com/v0/b/mtl-sentence-representations.appspot.com/o/data%2FSST-2.zip?alt=media&token=aabc5f6b-e466-44a2-b9b4-cf6337f84ac8 44f5954391612a8b3d9d65f6d4a824e9ae8d19ce 7439277
1+
https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/glue/cola.zip 19096246cd2a06d8fe2d13880d6cec61149f77c7 376971
2+
https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/glue/sst.zip 44f5954391612a8b3d9d65f6d4a824e9ae8d19ce 7439277
33
https://dl.fbaipublicfiles.com/senteval/senteval_data/msr_paraphrase_train.txt 716e0f67af962f08220b7e97d229b293077ef41f 1047044
44
https://firebasestorage.googleapis.com/v0/b/mtl-sentence-representations.appspot.com/o/data%2Fmrpc_dev_ids.tsv?alt=media&token=ec5c0836-31d5-48f4-b431-7480817f1adc 506c7a1a5e0dd551ceec2f84070fa1a8c2bc4b41 6222
55
https://dl.fbaipublicfiles.com/senteval/senteval_data/msr_paraphrase_test.txt 4265196c15cf75620b0b592b8b921f543bda7e6c 441275
6-
https://firebasestorage.googleapis.com/v0/b/mtl-sentence-representations.appspot.com/o/data%2FQQP-clean.zip?alt=media&token=11a647cb-ecd3-49c9-9d31-79f8ca8fe277 d775bd543ee78e3f64892a43ada949daf93e003d 41696084
7-
https://firebasestorage.googleapis.com/v0/b/mtl-sentence-representations.appspot.com/o/data%2FSTS-B.zip?alt=media&token=bddb94a7-8706-4e0d-a694-1109e12273b5 cc66d8533052de6d7475ac56dfce300751e070a4 802872
8-
https://firebasestorage.googleapis.com/v0/b/mtl-sentence-representations.appspot.com/o/data%2FMNLI.zip?alt=media&token=50329ea1-e339-40e2-809c-10c40afff3ce c22c684daa5cc9fad949d09d10ecedf94a2ce053 312783507
9-
https://firebasestorage.googleapis.com/v0/b/mtl-sentence-representations.appspot.com/o/data%2FSNLI.zip?alt=media&token=4afcfbb2-ff0c-4b2d-a09a-dbf07926f4df c60db4cc8820749e6af9f713f4d55109dd46e8c1 129820157
10-
https://firebasestorage.googleapis.com/v0/b/mtl-sentence-representations.appspot.com/o/data%2FQNLIv2.zip?alt=media&token=6fdcf570-0fc5-4631-8456-9505272d1601 6700cb1d2536bf512314b01350f9ac382439218e 10627589
11-
https://firebasestorage.googleapis.com/v0/b/mtl-sentence-representations.appspot.com/o/data%2FRTE.zip?alt=media&token=5efa7e85-a0bb-4f19-8ea2-9e1840f077fb 2eb8630df898b7d8df14ca9130c1ac1cf79eb376 697150
12-
https://firebasestorage.googleapis.com/v0/b/mtl-sentence-representations.appspot.com/o/data%2FWNLI.zip?alt=media&token=068ad0a0-ded7-4bd7-99a5-5e00222e0faf fc9834b5a8af4e1d8412e48bc38b477510a8c2d0 28999
6+
https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/glue/qqp.zip d775bd543ee78e3f64892a43ada949daf93e003d 41696084
7+
https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/glue/sts.zip cc66d8533052de6d7475ac56dfce300751e070a4 802872
8+
https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/glue/mnli.zip c22c684daa5cc9fad949d09d10ecedf94a2ce053 312783507
9+
https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/glue/snli.zip c60db4cc8820749e6af9f713f4d55109dd46e8c1 129820157
10+
https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/glue/qnli.zip 6700cb1d2536bf512314b01350f9ac382439218e 10627589
11+
https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/glue/rte.zip 2eb8630df898b7d8df14ca9130c1ac1cf79eb376 697150
12+
https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/glue/wnli.zip fc9834b5a8af4e1d8412e48bc38b477510a8c2d0 28999
1313
https://storage.googleapis.com/mtl-sentence-representations.appspot.com/tsvsWithoutLabels%2FAX.tsv?GoogleAccessId=firebase-adminsdk-0khhl@mtl-sentence-representations.iam.gserviceaccount.com&Expires=2498860800&Signature=DuQ2CSPt2Yfre0C%2BiISrVYrIFaZH1Lc7hBVZDD4ZyR7fZYOMNOUGpi8QxBmTNOrNPjR3z1cggo7WXFfrgECP6FBJSsURv8Ybrue8Ypt%2FTPxbuJ0Xc2FhDi%2BarnecCBFO77RSbfuz%2Bs95hRrYhTnByqu3U%2FYZPaj3tZt5QdfpH2IUROY8LiBXoXS46LE%2FgOQc%2FKN%2BA9SoscRDYsnxHfG0IjXGwHN%2Bf88q6hOmAxeNPx6moDulUF6XMUAaXCSFU%2BnRO2RDL9CapWxj%2BDl7syNyHhB7987hZ80B%2FwFkQ3MEs8auvt5XW1%2Bd4aCU7ytgM69r8JDCwibfhZxpaa4gd50QXQ%3D%3D c137a2020ab489011dc38fde9ee429f4e2c71257 222257
1414
https://www.dropbox.com/s/ju7d95ifb072q9f/diagnostic-full.tsv?dl=1 2f46c4b80fea8d3ea52a28e05467af3332fa65d9 265530

‎scripts/datasets/url_checksums/superglue.txt‎

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -1,10 +1,10 @@
1-
https://dl.fbaipublicfiles.com/glue/superglue/data/v2/CB.zip c16fa0a46f0f888d59767851c44d8db397896fe5 75482
2-
https://dl.fbaipublicfiles.com/glue/superglue/data/v2/COPA.zip ef110b215d7ff95a2fd2d0133f0959d324e9eec3 43986
3-
https://dl.fbaipublicfiles.com/glue/superglue/data/v2/MultiRC.zip 05bfcb1da7ea06742266f24503342fc20b2ab88a 1116225
4-
https://dl.fbaipublicfiles.com/glue/superglue/data/v2/RTE.zip 66105efeccc3fc54f9c5539de4c2d393d5bb4d36 750920
5-
https://dl.fbaipublicfiles.com/glue/superglue/data/v2/WiC.zip 5b95487a3690abc718bc173ccd35bf084c43b10a 396213
6-
https://dl.fbaipublicfiles.com/glue/superglue/data/v2/WSC.zip 829ec3dd532284281cc19bacf9cded6c11d3452d 32751
1+
https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/superglue/cb.zip c16fa0a46f0f888d59767851c44d8db397896fe5 75482
2+
https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/superglue/copa.zip ef110b215d7ff95a2fd2d0133f0959d324e9eec3 43986
3+
https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/superglue/multirc.zip 05bfcb1da7ea06742266f24503342fc20b2ab88a 1116225
4+
https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/superglue/rte.zip 66105efeccc3fc54f9c5539de4c2d393d5bb4d36 750920
5+
https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/superglue/wic.zip 5b95487a3690abc718bc173ccd35bf084c43b10a 396213
6+
https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/superglue/wsc.zip 829ec3dd532284281cc19bacf9cded6c11d3452d 32751
77
https://dl.fbaipublicfiles.com/glue/superglue/data/v2/AX-b.zip 8c8874dcace4942dd00cf9f76c2537ea0e2026eb 33950
88
https://dl.fbaipublicfiles.com/glue/superglue/data/v2/AX-g.zip 949909079262bc4f6fb66bd889707aa71218975f 10413
9-
https://dl.fbaipublicfiles.com/glue/superglue/data/v2/BoolQ.zip 90bf152c8012869d326260709404ce5111a76b46 4118001
10-
https://dl.fbaipublicfiles.com/glue/superglue/data/v2/ReCoRD.zip af2825be511efa8fbc7813756e768efffb8fcc11 51757880
9+
https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/superglue/boolq.zip 90bf152c8012869d326260709404ce5111a76b46 4118001
10+
https://gluonnlp-numpy-data.s3-accelerate.amazonaws.com/datasets/text_classification/glue_superglue/superglue/record.zip af2825be511efa8fbc7813756e768efffb8fcc11 51757880

‎scripts/generation/README.md‎

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,7 @@
1-
#Generation
1+
# Sequence Generation
22

3+
4+
## Generate Sequences from GPT-2
35
Some of the examples below may include Unicode text characters. Set the environment variable:
46
```bash
57
export PYTHONIOENCODING=UTF-8

0 commit comments

Comments
 (0)