动态推理时出现报错

[zhaohongpu]

文档链接&描述 Document Links & Description

python predictor.py --model_name_or_path THUDM/chatglm2-6b --data_file ./mydata/dev.json --dtype float16
WARNING: OMP_NUM_THREADS set to 10, not 1. The computation speed will not be optimized if you use data parallel. It will fail if this PaddlePaddle binary is compiled with OpenBlas since OpenBlas does not support multi-threads.
PLEASE USE OMP_NUM_THREADS WISELY.
Traceback (most recent call last):
File "/root/autodl-tmp/PaddleNLP/llm/predictor.py", line 29, in
from paddle.base.framework import in_cinn_mode, in_pir_executor_mode
ImportError: cannot import name 'in_cinn_mode' from 'paddle.base.framework' (/root/miniconda3/envs/dbgpt/lib/python3.10/site-packages/paddle/base/framework.py)
运行动态图推理出现这种报错怎么回事呢？

请提出你的建议/提个PR修复这个问题 Please give your suggestion/update a PR to fix it

No response