Doku/LLM
GPT 6 Astra
1.1M contextPrompt-Caching
POST
https://api.foxwire.ai/v1/chat/completions#Pricing Summary
Input Tokens
$5 per 1M tokens. Corresponds to all context prompt tokens sent.
Output Tokens
$25 per 1M tokens. Corresponds to content generated by the model.
Cache Read
$0.5 per 1M tokens. Up to 90% savings when hitting the prompt cache.
Cache Write
$0 per 1M tokens. Cost to index input context for caching.
#Beispielanfrage
Execute completions using standard OpenAI SDK formats by pointing base endpoints here.
bash
curl https://api.foxwire.ai/v1/chat/completions \
-H "Authorization: Bearer $CORRY_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "gpt-6-astra",
"messages": [{"role": "user", "content": "Hello"}]
}'#Antwortbeispiel
Ein standardmäßiges OpenAI-kompatibles Chat-Completion-Objekt. Das model-Feld wird auf den von Ihnen angeforderten Namen normalisiert.
json
{
"id": "chatcmpl-abc123",
"object": "chat.completion",
"model": "gpt-6-astra",
"choices": [
{
"index": 0,
"message": { "role": "assistant", "content": "Hello! How can I help you today?" },
"finish_reason": "stop"
}
],
"usage": { "prompt_tokens": 12, "completion_tokens": 9, "total_tokens": 21, "cost": 0.000234, "currency": "USD" }
}Cost field
usage.cost is the amount charged for this call (in USD); in streaming it arrives on the final chunk that carries usage. OpenAI SDKs ignore this extra field.
#Prompt-Caching
Bei cache-fähigen Modellen setzen Sie den langen statischen Inhalt (System, Wissensbasis) an den Anfang und fügen einen Cache-Haltepunkt hinzu. Zwischengespeicherte Teile können nur 1/10 kosten. Cache-Treffer werden im usage-Feld der Antwort ausgewiesen.
json
{
"model": "gpt-6-astra",
"messages": [
{
"role": "system",
"content": [
{ "type": "text", "text": "( long static context ... )", "cache_control": { "type": "ephemeral" } }
]
},
{ "role": "user", "content": "your question" }
]
}Prompt Caching Tip
Prompt caching matches request prefixes exactly. Make sure long contexts (e.g. system instructions, developer tools) appear at the start of your message list.
