References: chatglm2ptuning
Pay attention to problem 1: AttributeError: 'Seq2SeqTrainer' object has no attribute 'is_deepspeed_enabl
torch.distributed.elastic.multiprocessing.errors.ChildFailedError:
The version may be too high, you can refer to the environment of chatglm2