Text Generation
Transformers
PEFT
English
gravityllm
spatial-audio
immersive-audio
spatial9
iamf
instruction-tuning
json
lora
qlora
Instructions to use Spatial9/GravityLLM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Spatial9/GravityLLM with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Spatial9/GravityLLM")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Spatial9/GravityLLM", dtype="auto") - PEFT
How to use Spatial9/GravityLLM with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Spatial9/GravityLLM with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Spatial9/GravityLLM" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Spatial9/GravityLLM", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/Spatial9/GravityLLM
- SGLang
How to use Spatial9/GravityLLM with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Spatial9/GravityLLM" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Spatial9/GravityLLM", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Spatial9/GravityLLM" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Spatial9/GravityLLM", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use Spatial9/GravityLLM with Docker Model Runner:
docker model run hf.co/Spatial9/GravityLLM
| {"prompt": "GravityLLM: Output ONLY valid JSON matching the Spatial9Scene schema.\n\nINPUT:\n{\n \"target_format\": \"iamf\",\n \"max_objects\": 8,\n \"style\": \"cinematic\",\n \"section\": \"break\",\n \"global\": {\n \"bpm\": 90,\n \"energy\": 0.45\n },\n \"stems\": [\n {\n \"id\": \"d1\",\n \"class\": \"dialogue\",\n \"lufs\": -18.0,\n \"transient\": 0.35,\n \"band_energy\": {\n \"low\": 0.05,\n \"mid\": 0.75,\n \"high\": 0.2\n },\n \"leadness\": 0.98\n },\n {\n \"id\": \"st1\",\n \"class\": \"strings\",\n \"lufs\": -24.0,\n \"transient\": 0.08,\n \"band_energy\": {\n \"low\": 0.15,\n \"mid\": 0.6,\n \"high\": 0.25\n },\n \"leadness\": 0.25\n },\n {\n \"id\": \"p1\",\n \"class\": \"pad\",\n \"lufs\": -25.5,\n \"transient\": 0.05,\n \"band_energy\": {\n \"low\": 0.25,\n \"mid\": 0.55,\n \"high\": 0.2\n },\n \"leadness\": 0.1\n },\n {\n \"id\": \"fx1\",\n \"class\": \"fx\",\n \"lufs\": -26.0,\n \"transient\": 0.15,\n \"band_energy\": {\n \"low\": 0.1,\n \"mid\": 0.25,\n \"high\": 0.65\n },\n \"leadness\": 0.05\n }\n ],\n \"rules\": [\n {\n \"type\": \"anchor\",\n \"track_class\": \"dialogue\",\n \"az_deg\": 0,\n \"el_deg\": 5,\n \"dist_m\": 1.8\n },\n {\n \"type\": \"keep_dialogue_clear\",\n \"band_hz\": [\n 1000,\n 4000\n ]\n },\n {\n \"type\": \"width_pref\",\n \"track_class\": \"pad\",\n \"min_width\": 0.8\n }\n ]\n}", "completion": "{\n \"version\": \"1.0\",\n \"bed\": {\n \"layout\": \"iamf\",\n \"loudness_target_lufs\": -16.0,\n \"room_preset\": \"cinema_large\"\n },\n \"objects\": [\n {\n \"id\": \"d1\",\n \"class\": \"dialogue\",\n \"az_deg\": 0,\n \"el_deg\": 5,\n \"dist_m\": 1.8,\n \"width\": 0.1,\n \"gain_db\": 0.0,\n \"reverb_send\": 0.08,\n \"early_reflections\": 0.18,\n \"motion\": [\n {\n \"t\": 0.0,\n \"az_deg\": 0,\n \"el_deg\": 5,\n \"dist_m\": 1.8\n },\n {\n \"t\": 1.0,\n \"az_deg\": 0,\n \"el_deg\": 5,\n \"dist_m\": 1.8\n }\n ]\n },\n {\n \"id\": \"st1\",\n \"class\": \"strings\",\n \"az_deg\": -35,\n \"el_deg\": 18,\n \"dist_m\": 4.2,\n \"width\": 0.4,\n \"gain_db\": -4.0,\n \"reverb_send\": 0.24,\n \"early_reflections\": 0.1,\n \"motion\": [\n {\n \"t\": 0.0,\n \"az_deg\": -35,\n \"el_deg\": 18,\n \"dist_m\": 4.2\n },\n {\n \"t\": 1.0,\n \"az_deg\": -20,\n \"el_deg\": 18,\n \"dist_m\": 4.2\n }\n ]\n },\n {\n \"id\": \"p1\",\n \"class\": \"pad\",\n \"az_deg\": -80,\n \"el_deg\": 18,\n \"dist_m\": 5.5,\n \"width\": 0.85,\n \"gain_db\": -6.0,\n \"reverb_send\": 0.35,\n \"early_reflections\": 0.12,\n \"motion\": [\n {\n \"t\": 0.0,\n \"az_deg\": -80,\n \"el_deg\": 18,\n \"dist_m\": 5.5\n },\n {\n \"t\": 1.0,\n \"az_deg\": -80,\n \"el_deg\": 18,\n \"dist_m\": 5.5\n }\n ]\n },\n {\n \"id\": \"fx1\",\n \"class\": \"fx\",\n \"az_deg\": 95,\n \"el_deg\": 28,\n \"dist_m\": 7.0,\n \"width\": 0.7,\n \"gain_db\": -10.0,\n \"reverb_send\": 0.55,\n \"early_reflections\": 0.08,\n \"motion\": [\n {\n \"t\": 0.0,\n \"az_deg\": 80,\n \"el_deg\": 28,\n \"dist_m\": 7.0\n },\n {\n \"t\": 1.0,\n \"az_deg\": 120,\n \"el_deg\": 28,\n \"dist_m\": 7.0\n }\n ]\n }\n ],\n \"constraints_applied\": [\n \"anchor:dialogue@0/5/1.8\",\n \"keep_dialogue_clear_1000-4000Hz\",\n \"pad_width>=0.80\"\n ]\n}"} | |
| {"prompt": "GravityLLM: Output ONLY valid JSON matching the Spatial9Scene schema.\n\nINPUT:\n{\n \"target_format\": \"iamf\",\n \"max_objects\": 12,\n \"style\": \"live_stage\",\n \"section\": \"chorus\",\n \"global\": {\n \"bpm\": 112,\n \"energy\": 0.78\n },\n \"stems\": [\n {\n \"id\": \"lv1\",\n \"class\": \"lead_vocal\",\n \"lufs\": -15.5,\n \"transient\": 0.3,\n \"band_energy\": {\n \"low\": 0.08,\n \"mid\": 0.72,\n \"high\": 0.2\n },\n \"leadness\": 0.96\n },\n {\n \"id\": \"g1\",\n \"class\": \"guitar\",\n \"lufs\": -17.4,\n \"transient\": 0.46,\n \"band_energy\": {\n \"low\": 0.15,\n \"mid\": 0.6,\n \"high\": 0.25\n },\n \"leadness\": 0.5\n },\n {\n \"id\": \"g2\",\n \"class\": \"guitar\",\n \"lufs\": -18.1,\n \"transient\": 0.44,\n \"band_energy\": {\n \"low\": 0.12,\n \"mid\": 0.62,\n \"high\": 0.26\n },\n \"leadness\": 0.42\n },\n {\n \"id\": \"dr1\",\n \"class\": \"drums_bus\",\n \"lufs\": -11.8,\n \"transient\": 0.88,\n \"band_energy\": {\n \"low\": 0.4,\n \"mid\": 0.4,\n \"high\": 0.2\n },\n \"leadness\": 0.35\n },\n {\n \"id\": \"b1\",\n \"class\": \"bass\",\n \"lufs\": -12.4,\n \"transient\": 0.61,\n \"band_energy\": {\n \"low\": 0.82,\n \"mid\": 0.14,\n \"high\": 0.04\n },\n \"leadness\": 0.3\n },\n {\n \"id\": \"crowd\",\n \"class\": \"ambience\",\n \"lufs\": -27.0,\n \"transient\": 0.05,\n \"band_energy\": {\n \"low\": 0.2,\n \"mid\": 0.5,\n \"high\": 0.3\n },\n \"leadness\": 0.02\n }\n ],\n \"rules\": [\n {\n \"type\": \"anchor\",\n \"track_class\": \"lead_vocal\",\n \"az_deg\": 0,\n \"el_deg\": 8,\n \"dist_m\": 1.7\n },\n {\n \"type\": \"mono_low_end\",\n \"hz_below\": 120\n },\n {\n \"type\": \"stage_pair\",\n \"left_class\": \"guitar\",\n \"right_class\": \"guitar\"\n }\n ]\n}", "completion": "{\n \"version\": \"1.0\",\n \"bed\": {\n \"layout\": \"iamf\",\n \"loudness_target_lufs\": -15.0,\n \"room_preset\": \"stage_live\"\n },\n \"objects\": [\n {\n \"id\": \"lv1\",\n \"class\": \"lead_vocal\",\n \"az_deg\": 0,\n \"el_deg\": 8,\n \"dist_m\": 1.7,\n \"width\": 0.18,\n \"gain_db\": 0.0,\n \"reverb_send\": 0.16,\n \"early_reflections\": 0.24,\n \"motion\": [\n {\n \"t\": 0.0,\n \"az_deg\": 0,\n \"el_deg\": 8,\n \"dist_m\": 1.7\n },\n {\n \"t\": 1.0,\n \"az_deg\": 0,\n \"el_deg\": 8,\n \"dist_m\": 1.7\n }\n ]\n },\n {\n \"id\": \"g1\",\n \"class\": \"guitar\",\n \"az_deg\": -35,\n \"el_deg\": 6,\n \"dist_m\": 2.8,\n \"width\": 0.26,\n \"gain_db\": -1.5,\n \"reverb_send\": 0.11,\n \"early_reflections\": 0.15,\n \"motion\": [\n {\n \"t\": 0.0,\n \"az_deg\": -35,\n \"el_deg\": 6,\n \"dist_m\": 2.8\n },\n {\n \"t\": 1.0,\n \"az_deg\": -30,\n \"el_deg\": 6,\n \"dist_m\": 2.8\n }\n ]\n },\n {\n \"id\": \"g2\",\n \"class\": \"guitar\",\n \"az_deg\": 35,\n \"el_deg\": 6,\n \"dist_m\": 2.8,\n \"width\": 0.26,\n \"gain_db\": -1.5,\n \"reverb_send\": 0.11,\n \"early_reflections\": 0.15,\n \"motion\": [\n {\n \"t\": 0.0,\n \"az_deg\": 35,\n \"el_deg\": 6,\n \"dist_m\": 2.8\n },\n {\n \"t\": 1.0,\n \"az_deg\": 30,\n \"el_deg\": 6,\n \"dist_m\": 2.8\n }\n ]\n },\n {\n \"id\": \"dr1\",\n \"class\": \"drums_bus\",\n \"az_deg\": 0,\n \"el_deg\": 0,\n \"dist_m\": 2.4,\n \"width\": 0.2,\n \"gain_db\": -0.5,\n \"reverb_send\": 0.08,\n \"early_reflections\": 0.12,\n \"motion\": [\n {\n \"t\": 0.0,\n \"az_deg\": 0,\n \"el_deg\": 0,\n \"dist_m\": 2.4\n },\n {\n \"t\": 1.0,\n \"az_deg\": 0,\n \"el_deg\": 0,\n \"dist_m\": 2.4\n }\n ]\n },\n {\n \"id\": \"b1\",\n \"class\": \"bass\",\n \"az_deg\": 0,\n \"el_deg\": -5,\n \"dist_m\": 2.8,\n \"width\": 0.05,\n \"gain_db\": -0.8,\n \"reverb_send\": 0.04,\n \"early_reflections\": 0.05,\n \"motion\": [\n {\n \"t\": 0.0,\n \"az_deg\": 0,\n \"el_deg\": -5,\n \"dist_m\": 2.8\n },\n {\n \"t\": 1.0,\n \"az_deg\": 0,\n \"el_deg\": -5,\n \"dist_m\": 2.8\n }\n ]\n },\n {\n \"id\": \"crowd\",\n \"class\": \"ambience\",\n \"az_deg\": 180,\n \"el_deg\": 12,\n \"dist_m\": 10.0,\n \"width\": 1.0,\n \"gain_db\": -12.0,\n \"reverb_send\": 0.6,\n \"early_reflections\": 0.1,\n \"motion\": [\n {\n \"t\": 0.0,\n \"az_deg\": 160,\n \"el_deg\": 12,\n \"dist_m\": 10.0\n },\n {\n \"t\": 1.0,\n \"az_deg\": 200,\n \"el_deg\": 12,\n \"dist_m\": 10.0\n }\n ]\n }\n ],\n \"constraints_applied\": [\n \"anchor:lead_vocal@0/8/1.7\",\n \"mono_low_end<120Hz\",\n \"stage_pair:guitars\"\n ]\n}"} | |