Hugging Face's logo

nvidia
/
NV-Embed-v2

Feature Extraction
Transformers
Safetensors
sentence-transformers
English
nvembed
mteb
custom_code
Eval Results (legacy)
Model card Files
xet
 Community
46

Cannot import name 'MISTRAL_INPUTS_DOCSTRING' from 'transformers.models.mistral.modeling_mistral'

#43
by deleted - opened
Discussion
deleted

I ran the code to use this model using Sentence Transformers :
model = SentenceTransformer("nvidia/NV-Embed-v2", trust_remote_code=True)

I encountered the error in the process - ImportError: cannot import name 'MISTRAL_INPUTS_DOCSTRING' from 'transformers.models.mistral.modeling_mistral'
I tried upgrading transformers and reinstalling sentence-transformers but to no avail. Please help me resolve this issue.
bitsydarel

Same issue
sohv

Can anyone please help me with resolving this issue ?
timchen0618

Same issue
yixin

same problem

yixin

pip reinstall transformer resolved this case.

sohv

@yixin Are you sure ? I feel that the dependencies listed in the model page are not up-to-date (versions are old). Maybe this is causing the above issue.
NasAzzam

pip install transformers==4.49

It will fix it hopefully, for others as well.
themaverick1

use package versions as suggested in the model card

pip install torch==2.2.0
pip install transformers==4.42.4
pip install flash-attn==2.2.0
pip install sentence-transformers==2.7.0

Sign up or log in to comment