This model could not be loaded by the inference API
#20
by matbee - opened
⚠️ This model could not be loaded by the inference API. ⚠️
Model bigcode/starcoder does not exist
same issue for me
Same here.
did you login first?
I was having the same issue yesterday using Windows.
copy your token from https://huggingface.co/settings/tokens
login using 'huggingface-cli login' then right-click. Note: nothing will show on screen. Hit enter key. then run your santacoder_inference.py
python -m santacoder_inference bigcode/starcoder --wbits 4 --groupsize 128 --load starcoder-GPTQ-4bit-128g/model.pt
Looks like the issue has been fixed
matbee changed discussion status to closed