runtime error
Exit code: 1. Reason: safetensors: 16%|ββ | 744M/4.55G [00:23<01:14, 50.9MB/s][A model-00003-of-00003.safetensors: 30%|βββ | 1.35G/4.55G [00:25<00:30, 106MB/s][A model-00003-of-00003.safetensors: 38%|ββββ | 1.73G/4.55G [00:37<00:48, 57.9MB/s][A model-00003-of-00003.safetensors: 48%|βββββ | 2.20G/4.55G [00:38<00:27, 85.0MB/s][A model-00003-of-00003.safetensors: 60%|ββββββ | 2.74G/4.55G [00:39<00:14, 125MB/s] [A model-00003-of-00003.safetensors: 78%|ββββββββ | 3.54G/4.55G [00:40<00:05, 196MB/s][A model-00003-of-00003.safetensors: 90%|βββββββββ | 4.08G/4.55G [00:42<00:01, 238MB/s][A model-00003-of-00003.safetensors: 100%|ββββββββββ| 4.55G/4.55G [00:42<00:00, 106MB/s] Loading checkpoint shards: 0%| | 0/3 [00:00<?, ?it/s][A Loading checkpoint shards: 100%|ββββββββββ| 3/3 [00:00<00:00, 11.97it/s] generation_config.json: 0%| | 0.00/116 [00:00<?, ?B/s][A generation_config.json: 100%|ββββββββββ| 116/116 [00:00<00:00, 549kB/s] Some parameters are on the meta device because they were offloaded to the disk and cpu. You shouldn't move a model that is dispatched using accelerate hooks. Traceback (most recent call last): File "/app/app.py", line 274, in <module> preloaded_output = get_preload_output() File "/app/app.py", line 269, in get_preload_output html_output = extract_and_visualize(abstract) File "/app/app.py", line 141, in extract_and_visualize raw_output = run_mistral_extract(sentence) File "/app/app.py", line 81, in run_mistral_extract tokenizer, model, device = get_model() File "/app/app.py", line 75, in get_model model.to(device) File "/usr/local/lib/python3.10/site-packages/accelerate/big_modeling.py", line 462, in wrapper raise RuntimeError("You can't move a model that has some modules offloaded to cpu or disk.") RuntimeError: You can't move a model that has some modules offloaded to cpu or disk.
Container logs:
Fetching error logs...