Error when run the demo code.
#1
by UnnamedWatcher - opened
I run the demo code but failed. The error is :
When the tranformers version degrades from 4.44.2 to 4.40.1, the bug disappeared.
can i use the model by vllm，how to run it ，help please