AI on Demand: Test streaming

From MediaWiki
Revision as of 13:21, 29 October 2026 by Sst-djo (talk | contribs) (Created page with "= Overview = This pages describes some useful usage commands on how to test token streaming. = Usage = We assume you've received your API key from us in our usual manner. For testing purposes the model selection for general purpose models is: * apertus-ai/Apertus-v1.5-8B * MiniMaxAI/MiniMax-M2.5 * NVIDIA/NVIDIA-Nemotron-3-Super-120B-A12B * Qwen/Qwen3-Coder-Next * Qwen/Qwen3.5-35B-A3B-FP8 == Usage - Inference with token-stream ==")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

Overview

This pages describes some useful usage commands on how to test token streaming.

Usage

We assume you've received your API key from us in our usual manner.

For testing purposes the model selection for general purpose models is:

  • apertus-ai/Apertus-v1.5-8B
  • MiniMaxAI/MiniMax-M2.5
  • NVIDIA/NVIDIA-Nemotron-3-Super-120B-A12B
  • Qwen/Qwen3-Coder-Next
  • Qwen/Qwen3.5-35B-A3B-FP8

Usage - Inference with token-stream

Retrieved from "https://wiki.stoney-cloud.com/w/index.php?title=AI_on_Demand:_Test_streaming&oldid=1225"