Skip to content

Issues: intel/intel-extension-for-transformers

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

30 Open 135 Closed
30 Open 135 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

INSTALL ERRORS PLS HELP!!!
#1699 opened Sep 18, 2024 by c2rx
After fine-tuning qwen2-1.5B-instruction and quantifying its AWQ, an error occurred while using Intel Extension for Transformers and CPU for inference. But when I used the same method to fine tune and quantify qwen1.5-4B chat before, I could use Intel Extension for Transformers to accelerate CPU inference. 对qwen2-1.5B-instruct微调并且awq量化后，使用intel-extension-for-transformers和CPU进行推理时出错。但我之前使用同样的方式微调和量化的qwen1.5-4B-chat时是可以使用intel-extension-for-transformers加速CPU推理的。
#1697 opened Sep 11, 2024 by Autism-al
1
intel-extension-for-transformers.ipynb
#1696 opened Aug 30, 2024 by ayttop
3
Error in import: ModuleNotFoundError: No module named 'neural_compressor.conf'
#1695 opened Aug 27, 2024 by Nicogs43
6
Improve Qlora docs & finetune qwen2-0.5b instruct example
#1692 opened Aug 25, 2024 by bil-ash
core dumped
#1690 opened Aug 23, 2024 by zwx109473
1
Rag example not working
#1688 opened Aug 14, 2024 by anayjain
1
AutoModelForCausalLM model.generate Wrong response by docker run the same chatglm3-int4 model bin file
#1680 opened Jul 28, 2024 by ahlwjnj
evaluation Parameter Parsing problem
#1676 opened Jul 24, 2024 by 1826133674
How to config then let the Neural Chat work for chatglm3-6b?
#1659 opened Jul 9, 2024 by ahlwjnj
@a32543254 @lvliang-intel
question about configuration documentation Improvements or additions to documentation
#1643 opened Jun 28, 2024 by menglin0320
@a32543254
3
ImportError: cannot import name 'WeightOnlyQuantizedLinear' from 'intel_extension_for_pytorch.nn.utils._quantize_convert'
#1630 opened Jun 21, 2024 by junruizh2021
@PenghuiCheng
2
[Neural_chat] Chat completion is very slow with neuralchat_server
#1616 opened Jun 17, 2024 by noobHappylife
@lvliang-intel
rag plugin initialize failed
#1538 opened May 10, 2024 by redhairerINTEL
@XuhuiRen
1
neuralchat /v1/askdoc/create 404 not found. Failed to call this api on ubuntu system. aitce NeuralChat
#1533 opened May 8, 2024 by RongLei-intel
@xiguiw
3
[neural-chat]: deployment backend server failed to start aitce
#1525 opened May 2, 2024 by raj-ritu17
@NeoZhangJianyu
2
Cannot run llama3 8b instruct: AssertionError: Fail to convert pytorch model
#1522 opened Apr 30, 2024 by N3RDIUM
@Zhenzhong1
17
unable to start talkingbot frondend
#1517 opened Apr 26, 2024 by raj-ritu17
@lvliang-intel
5
ITREX need to do modification for llama3 new prompt format
#1507 opened Apr 23, 2024 by redhairerINTEL
@a32543254 @kevinintel
3
Python3.11: Could not build wheels for cchardet, which is required to install pyproject.toml-based projects
#1469 opened Apr 10, 2024 by bbelky
@lvliang-intel
3
RAG example not working.. aitce
#1464 opened Apr 8, 2024 by guytamir
@lvliang-intel @xiguiw
1
Fails to load saved model : Trying to set a tensor of shape torch.Size([1376, 4096]) in "qweight" (which has shape torch.Size([4096, 1376])), this look incorrect.
#1407 opened Mar 21, 2024 by kranipa
@intellinjun
8
SageMaker does not support Transformers 4.34.1 which is required by ITREX
#1381 opened Mar 14, 2024 by eduand-alvarez
@VincyZhang
3
pip install failure on python3.10-alpine image
#1379 opened Mar 13, 2024 by lrrountr
@VincyZhang
2
plugin init failed aitce
#1377 opened Mar 13, 2024 by anayjain
@NeoZhangJianyu
5
ProTip! Updated in the last three days: updated:>2024-09-16.