运行清华大学开源的ChatGLM-6B及其微调算法P-tuning v2,根据其官方提供的步骤,在配置好环境后Run:
>>bash train.sh
>>报错如下:
Traceback (most recent call last):
File "/home/tricorder/workspace/NascentCore/ChatGLM-6B/ptuning/main.py", line 433, in <module>
main()
File "/home/tricorder/workspace/NascentCore/ChatGLM-6B/ptuning/main.py", line 371, in main
model.enable_input_require_grads()
File "/home/tricorder/yang/anaconda3/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1614, in __getattr__
raise AttributeError("'{}' object has no attribute '{}'".format(
AttributeError: 'ChatGLMForConditionalGeneration' object has no attribute 'enable_input_require_grads'
原因是transformers包没有更新(需要降级或升级)。
运行以下代码:
pip install transformers==4.27.1
问题解决。