Chat Create

Start a conversation with an LLM using existing OpenAI schemas.

post

Queue a new asynchronous chat completion task for background processing and later retrieval.

Authorizations
Body
modelstring · enumRequiredPossible values:
reasoning_effortstring · enumOptionalDefault: mediumPossible values:
frequency_penaltynumber · min: -2 · max: 2OptionalDefault: 0
max_completion_tokensnumber · min: -1 · max: 600OptionalDefault: 128
nnumber · enumOptionalDefault: 1Possible values:
presence_penaltynumber · min: -2 · max: 2OptionalDefault: 0
seednumberOptionalDefault: 591256
service_tierstring · enumOptionalDefault: defaultPossible values:
stopstring[]Optional
streambooleanOptionalDefault: false
temperaturenumber · max: 2OptionalDefault: 1
top_pnumber · max: 1OptionalDefault: 1
tool_choiceany ofOptional
string · enumOptionalPossible values:
or
parallel_tool_callsbooleanOptionalDefault: true
Responses
200
Returns a unique ID for the asynchronous chat task, used to retrieve the generated result once processing is complete.
application/json
post
POST /async/chat/create HTTP/1.1
Host: api.distribute.ai
authorization: YOUR_API_KEY
Content-Type: application/json
Accept: */*
Content-Length: 584

{
  "messages": [
    {
      "role": "system",
      "content": "text",
      "name": "text"
    }
  ],
  "model": "Llama-3.1 8B",
  "reasoning_effort": "medium",
  "metadata": {
    "ANY_ADDITIONAL_PROPERTY": "text"
  },
  "frequency_penalty": 0,
  "max_completion_tokens": 128,
  "n": 1,
  "modalities": [
    "text"
  ],
  "presence_penalty": 0,
  "seed": 591256,
  "service_tier": "default",
  "stop": [
    "text"
  ],
  "stream": false,
  "stream_options": {
    "include_usage": true
  },
  "temperature": 1,
  "top_p": 1,
  "tools": [
    {
      "type": "function",
      "function": {
        "description": "text",
        "name": "text",
        "parameters": {
          "ANY_ADDITIONAL_PROPERTY": "text"
        },
        "strict": false
      }
    }
  ],
  "tool_choice": "none",
  "parallel_tool_calls": true
}
{
  "id": "text"
}

Last updated