bloom-1b7 versus bloom-3b
#15
by JoseGris - opened
Hi,
Do you recommend me to use bloom-1b7 or bloom-3b? Which one is better?
Thanks in advance!
Depends on your usecase. Usually the larger the better in terms of performance, but the higher the cost in terms of memory and in terms of latency.