when I am running RLHF script, I encountered a error

[liuzhiyong01]

My environments setting:
deepspeed==0.9.0,
torch==2.0.0+cu117
CUDA Version: 11.0
pretrained model is facebook/opt-350m

Who can help me solve this problem? Thanks

[liuzhiyong01]

when I set enable_hybrid_engine=False, it's solved, what is the reason?

[nbl97]

+1, same issue

[geldarr]

+1