AI on demand: Usage: Difference between revisions

From MediaWiki
Jump to navigation Jump to search
 
(6 intermediate revisions by 2 users not shown)
Line 23: Line 23:
   "data": [
   "data": [
     {
     {
       "id": "allenai/olmOCR-2-7B",
       "object": "model",
       "max_model_len": 8192,
       "max_model_len": 8192,
       "object": "model"
      "id": "allenai/olmOCR-2-7B"
    },
    {
      "object": "model",
      "max_model_len": 131072,
      "id": "apertus-ai/Apertus-v1.5-8B"
    },
    {
       "object": "model",
      "max_model_len": 131072,
      "id": "deepseek-ai/DeepSeek-V4-Flash-0731"
     },
     },
     {
     {
       "id": "lightonai/LightOnOCR-2-1B",
       "object": "model",
       "max_model_len": 16384,
       "max_model_len": 16384,
       "object": "model"
       "id": "lightonai/LightOnOCR-2-1B"
     },
     },
     {
     {
       "id": "MinerU2.5-2509-1.2B",
       "object": "model",
       "max_model_len": 16384,
       "max_model_len": 16384,
       "object": "model"
       "id": "MinerU2.5-2509-1.2B"
     },
     },
     {
     {
       "id": "MiniMaxAI/MiniMax-M2.5",
       "object": "model",
       "max_model_len": 196608,
       "max_model_len": 196608,
       "object": "model"
       "id": "MiniMaxAI/MiniMax-M2.5"
     },
     },
     {
     {
       "id": "NVIDIA/NVIDIA-Nemotron-3-Super-120B-A12B",
       "object": "model",
       "max_model_len": 131072,
       "max_model_len": 131072,
       "object": "model"
       "id": "NVIDIA/NVIDIA-Nemotron-3-Super-120B-A12B"
     },
     },
     {
     {
       "id": "Qwen/Qwen3.5-35B-A3B-FP8",
       "object": "model",
       "max_model_len": 131072,
       "max_model_len": 131072,
       "object": "model"
       "id": "openai/gpt-oss-120b"
     },
     },
     {
     {
       "id": "Qwen/Qwen3-Coder-Next",
      "object": "model",
      "max_model_len": 131072,
       "id": "Qwen/Qwen3.5-35B-A3B-FP8"
    },
    {
      "object": "model",
       "max_model_len": 262144,
       "max_model_len": 262144,
       "object": "model"
      "id": "Qwen/Qwen3.8-27B"
    },
    {
       "object": "model",
      "max_model_len": 262144,
      "id": "Qwen/Qwen3-Coder-Next"
     }
     }
   ],
   ],
Line 79: Line 99:
   "data": [
   "data": [
     {
     {
       "id": "mistralai/Voxtral-Mini-3B-2507",
      "object": "model",
      "object": "model"
       "id": "mistralai/Voxtral-Mini-3B-2507"
     },
     },
     {
     {
       "id": "openai/whisper-large-v3",
      "object": "model",
      "object": "model"
       "id": "openai/whisper-large-v3"
     }
     }
   ],
   ],
Line 108: Line 128:
   "data": [
   "data": [
     {
     {
       "id": "BAAI/bge-m3",
       "object": "model",
       "max_model_len": 8192,
       "max_model_len": 8192,
       "object": "model"
       "id": "BAAI/bge-m3"
     }
     }
   ],
   ],
Line 134: Line 154:
   "data": [
   "data": [
     {
     {
       "id": "BAAI/bge-reranker-v2-m3",
       "object": "model",
       "max_model_len": 8192,
       "max_model_len": 8192,
       "object": "model"
       "id": "BAAI/bge-reranker-v2-m3"
     }
     }
   ],
   ],
Line 187: Line 207:
<syntaxhighlight lang="json">
<syntaxhighlight lang="json">
{
{
  "month": "2026-08",
   "models": [
   "models": [
     {
     {
       "cost_chf": 0.000002,
       "cost_chf": 0.000019,
       "model": "MinerU2.5-2509-1.2B",
       "output": 11,
       "output": 16,
       "input": 256,
       "input": 70
       "model": "allenai/olmOCR-2-7B"
     },
     },
     {
     {
       "cost_chf": 0.054537,
       "cost_chf": 0.003268,
       "model": "MiniMaxAI/MiniMax-M2.5",
       "output": 942,
       "output": 3603,
       "input": 22679,
       "input": 10097
       "model": "apertus-ai/Apertus-v1.5-8B"
     },
     },
     {
     {
       "cost_chf": 0.0016,
       "cost_chf": 0.562569,
       "model": "mistralai/Voxtral-Mini-3B-2507",
       "output": 9555,
       "seconds": 8
      "input": 257397,
       "model": "NVIDIA/NVIDIA-Nemotron-3-Super-120B-A12B"
     },
     },
     {
     {
       "cost_chf": 0.003774,
       "cost_chf": 16.6957,
       "model": "swiss-ai/Apertus-70B-Instruct-2509",
       "output": 120992,
       "output": 551,
       "input": 2734180,
       "input": 443
       "model": "openai/gpt-oss-120b"
     }
     }
   ],
   ],
  "month": "2026-03",
   "total_cost_chf": 17.261556
   "total_cost_chf": 0.059913
}
}
</syntaxhighlight>
</syntaxhighlight>


[[Category: AI on demand]]
[[Category: AI on demand]]

Latest revision as of 09:15, 31 August 2026

Overview

This pages describes some useful usage commands.

Usage

We assume you've received your API key from us in our usual manner.

Usage - List all models

Usage - List all models - Generic

# Set your personal key:
STONEY_KEY=sk-...

# List all generic models:
curl https://llm.stoney-cloud.com/v1/models \
        --silent --fail --show-error \
        --header "Authorization: Bearer $STONEY_KEY" \
        | jq

Example output:

{
  "data": [
    {
      "object": "model",
      "max_model_len": 8192,
      "id": "allenai/olmOCR-2-7B"
    },
    {
      "object": "model",
      "max_model_len": 131072,
      "id": "apertus-ai/Apertus-v1.5-8B"
    },
    {
      "object": "model",
      "max_model_len": 131072,
      "id": "deepseek-ai/DeepSeek-V4-Flash-0731"
    },
    {
      "object": "model",
      "max_model_len": 16384,
      "id": "lightonai/LightOnOCR-2-1B"
    },
    {
      "object": "model",
      "max_model_len": 16384,
      "id": "MinerU2.5-2509-1.2B"
    },
    {
      "object": "model",
      "max_model_len": 196608,
      "id": "MiniMaxAI/MiniMax-M2.5"
    },
    {
      "object": "model",
      "max_model_len": 131072,
      "id": "NVIDIA/NVIDIA-Nemotron-3-Super-120B-A12B"
    },
    {
      "object": "model",
      "max_model_len": 131072,
      "id": "openai/gpt-oss-120b"
    },
    {
      "object": "model",
      "max_model_len": 131072,
      "id": "Qwen/Qwen3.5-35B-A3B-FP8"
    },
    {
      "object": "model",
      "max_model_len": 262144,
      "id": "Qwen/Qwen3.8-27B"
    },
    {
      "object": "model",
      "max_model_len": 262144,
      "id": "Qwen/Qwen3-Coder-Next"
    }
  ],
  "object": "list"
}

Usage - List all models - Audio

# Set your personal key:
STONEY_KEY=sk-...

# List all audio models:
curl https://llm.stoney-cloud.com/v1/audio/models \
        --silent --fail --show-error \
        --header "Authorization: Bearer $STONEY_KEY" \
        | jq

Example output:

{
  "data": [
    {
      "object": "model",
      "id": "mistralai/Voxtral-Mini-3B-2507"
    },
    {
      "object": "model",
      "id": "openai/whisper-large-v3"
    }
  ],
  "object": "list"
}

Usage - List all models - Embeddings

# Set your personal key:
STONEY_KEY=sk-...

# List all embeddings models:
curl https://llm.stoney-cloud.com/v1/embeddings/models \
        --silent --fail --show-error \
        --header "Authorization: Bearer $STONEY_KEY" \
        | jq

Example output:

{
  "data": [
    {
      "object": "model",
      "max_model_len": 8192,
      "id": "BAAI/bge-m3"
    }
  ],
  "object": "list"
}

Usage - List all models - Rerank

# Set your personal key:
STONEY_KEY=sk-...

# List all rerank models:
curl https://llm.stoney-cloud.com/v1/rerank/models \
        --silent --fail --show-error \
        --header "Authorization: Bearer $STONEY_KEY" \
        | jq

Example output:

{
  "data": [
    {
      "object": "model",
      "max_model_len": 8192,
      "id": "BAAI/bge-reranker-v2-m3"
    }
  ],
  "object": "list"
}

Usage - List all models - Images

# Set your personal key:
STONEY_KEY=sk-...

# List all images models:
curl https://llm.stoney-cloud.com/v1/images/models \
        --silent --fail --show-error \
        --header "Authorization: Bearer $STONEY_KEY" \
        | jq

Example output:

{
  "data": [
    {
      "object": "model",
      "id": "black-forest-labs/FLUX.1-schnell"
    }
  ],
  "object": "list"
}

Usage - Inspecting your usage

We issue one key per model for now. The usage is thus per-model-per-key.

# Set your personal key:
STONEY_KEY=sk-...

# Set desired month in the form YYYY-MM, for example: '2026-03'.
MONTH=$(date +%Y-%m)

curl https://llm.stoney-cloud.com/v1/usage?month="$MONTH" \
        --silent --fail --show-error \
        --header "Authorization: Bearer $STONEY_KEY" \
        | jq

Example output:

{
  "month": "2026-08",
  "models": [
    {
      "cost_chf": 0.000019,
      "output": 11,
      "input": 256,
      "model": "allenai/olmOCR-2-7B"
    },
    {
      "cost_chf": 0.003268,
      "output": 942,
      "input": 22679,
      "model": "apertus-ai/Apertus-v1.5-8B"
    },
    {
      "cost_chf": 0.562569,
      "output": 9555,
      "input": 257397,
      "model": "NVIDIA/NVIDIA-Nemotron-3-Super-120B-A12B"
    },
    {
      "cost_chf": 16.6957,
      "output": 120992,
      "input": 2734180,
      "model": "openai/gpt-oss-120b"
    }
  ],
  "total_cost_chf": 17.261556
}