AI on demand: jaredpalmer/kev-27b

Overview

System One decision models such as jaredpalmer/kev-27b assess text and return structured answers and probabilities in a single forward pass.

They support three question types:

• Choice
  • Selects the single best option (or returns a probability distribution) from a fixed set of 2 to 255 declared options.

• Noul (Yes/No)
  • Returns a boolean probability distribution for a binary question.

• Score
  • Assigns a numeric value along a defined ordered scale (typically 2 to 10 levels) to represent a grading rubric or rating.

These models suit classification, routing, and decision support. They do not generate conversational answers or explanations, and their predictions can be wrong. Reported probabilities require evaluation on representative data before using them for consequential automation.

Our jaredpalmer/kev-27b implementation has a multilingual checkpoint with a fixed 65'536-token input limit.

Usage

Usage - Choice

The following choice example routes a request to a department.

Example call:

# Set your personal key:
STONEY_KEY=sk-....

# Execute the actual call:
curl --fail-with-body -sS \
  https://llm.stoney-cloud.com/v1/systemone \
  -H "apikey: $STONEY_KEY" \
  -H 'Content-Type: application/json' \
  --data-binary '{
    "model": "jaredpalmer/kev-27b",
    "state": {
      "document": "Meine Rechnung wurde zweimal belastet. Bitte prüfen Sie die doppelte Zahlung."
    },
    "questions": {
      "department": {
        "type": "choice",
        "instructions": "Which department should handle this request?",
        "criteria": {
          "technical": "Application errors and login problems",
          "billing": "Invoices, payments and duplicate charges",
          "support": "General customer support and newsletter preferences"
        }
      }
    }
  }' | jq .

Example answer:

{
  "model": "jaredpalmer/kev-27b",
  "answers": {
    "department": {
      "type": "choice",
      "choice": "billing",
      "confidence": 0.9985,
      "probabilities": {
        "technical": 0.0003,
        "billing": 0.999,
        "support": 0.0007
      }
    }
  },
  "usage": {
    "input_tokens": 59,
    "output_tokens": 62,
    "prompt_tokens": 59,
    "completion_tokens": 62
  },
  "latency_ms": 45.9
}

Usage - Noul

The following noul example detects if customer explicitly requests a refund.

Example call:

# Set your personal key:
STONEY_KEY=sk-....

# Execute the actual call:
curl --fail-with-body -sS \
  https://llm.stoney-cloud.com/v1/systemone \
  -H "apikey: $STONEY_KEY" \
  -H 'Content-Type: application/json' \
  --data-binary '{
    "model": "jaredpalmer/kev-27b",
    "state": {
      "document": "Meine Rechnung wurde zweimal belastet. Bitte erstatten Sie mir die zweite Zahlung zurück."
    },
    "questions": {
      "refund_requested": {
        "type": "noul",
        "instructions": "Does the customer explicitly request a refund?",
        "criteria": {
          "true": "The customer explicitly asks for money to be returned.",
          "false": "The customer does not ask for money to be returned."
        }
      }
    }
  }' | jq .

Example answer:

  "model": "jaredpalmer/kev-27b",
  "answers": {
    "refund_requested": {
      "type": "noul",
      "noul": 0.9851
    }
  },
  "usage": {
    "input_tokens": 60,
    "output_tokens": 23,
    "prompt_tokens": 60,
    "completion_tokens": 23
  },
  "latency_ms": 86.9
}

Usage - Score

The following score example estimates the urgency of a support request. The criteria is arranged from lowest to highest.

Example call:

# Set your personal key:
STONEY_KEY=sk-....

# Execute the actual call:
curl --fail-with-body -sS \
  https://llm.stoney-cloud.com/v1/systemone \
  -H "apikey: $STONEY_KEY" \
  -H 'Content-Type: application/json' \
  --data-binary '{
    "model": "jaredpalmer/kev-27b",
    "state": {
      "document": "Unser gesamtes Produktionssystem ist ausgefallen. Alle Kunden sind betroffen und können keine Bestellungen aufgeben. Wir benötigen sofort Hilfe."
    },
    "questions": {
      "urgency": {
        "type": "score",
        "instructions": "How urgent is this support request?",
        "criteria": [
          "Not urgent: informational request with no operational impact",
          "Low urgency: minor inconvenience with a workaround",
          "Moderate urgency: partial disruption affecting some users",
          "High urgency: major disruption requiring prompt attention",
          "Critical urgency: complete production outage affecting all customers"
        ]
      }
    }
  }' | jq .

Example answer:

{
  "model": "jaredpalmer/kev-27b",
  "answers": {
    "urgency": {
      "type": "score",
      "score": 3.9722,
      "legend": {
        "0": "Not urgent: informational request with no operational impact",
        "1": "Low urgency: minor inconvenience with a workaround",
        "2": "Moderate urgency: partial disruption affecting some users",
        "3": "High urgency: major disruption requiring prompt attention",
        "4": "Critical urgency: complete production outage affecting all customers"
      },
      "probabilities": {
        "0": 0.0001,
        "1": 0.0001,
        "2": 0.0003,
        "3": 0.0264,
        "4": 0.9731
      },
      "confidence": 0.9769
    }
  },
  "usage": {
    "input_tokens": 91,
    "output_tokens": 162,
    "prompt_tokens": 91,
    "completion_tokens": 162
  },
  "latency_ms": 99.0
}