Skip to content

about spm.SentencePieceTrainer.Train(train) #185

@Joll123

Description

@Joll123

when I running the prepro.py, it is terminating at spm.SentencePieceTrainer.Train(train).And I get no any information. Has anyone encountered this problem? how to deal with it?

INFO:root:# Train a joint BPE model with sentencepiece

Process finished with exit code 139 (interrupted by signal 11: SIGSEGV)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions