Chat（Streamed return.）

POST

/chat/completions

Chat models take a series of messages as input and return a model-generated message as output. While the chat format is designed to make multi-turn conversations easy, it's just as useful for single-turn tasks without any conversation.

Price List：https://302.ai/pricing_api/

Request

Header Params

Content-Type

string

required

Example:

application/json

string

required

Example:

application/json

Authorization

string

required

Place the API key generated in the management dashboard under API KEYS after 'Bearer', like 'Bearer sk-xxxx'

Example:

Bearer {{YOUR_API_KEY}}

Body Params application/json

model

string

required

The ID of the model to use. For more details on which models are compatible with the Chat API, refer to the Model Endpoint Compatibility Table

messages

array [object {2}]

required

Generate chat completion messages in chat format

role

string

optional

content

string

optional

temperature

integer

optional

Use a sampling temperature between 0 and 2. Higher values (e.g., 0.8) will make the output more random, while lower values (e.g., 0.2) will make the output more focused and deterministic. We generally recommend altering this or top_p, but not both.

top_p

integer

optional

An alternative to temperature sampling is nucleus sampling, where the model considers the results of the tokens with top_p probability mass. For example, 0.1 means only the tokens comprising the top 10% probability mass are considered. We generally recommend altering this or temperature, but not both

integer

optional

How many chat completion options to generate for each input message

stream

boolean

optional

If set, partial message increments will be sent, similar to ChatGPT. As tokens become available, they will be sent as pure data [server-sent events]
(https://developer.mozilla.org/en-US/docs/Web/API/Server-sent_events/Using_server-sent_events#Event_stream_format)`data: [DONE]`Send，the stream is terminated by the message.About example code，Please refer to OpenAI Cookbook 。

stop

string

optional

The API will stop generating up to 4 more sequences of tokens.

max_tokens

integer

optional

The maximum number of tokens to be generated for the chat completion. The total length of input tokens and generated tokens is limited by the model's context length.

presence_penalty

number

optional

A number between -2.0 and 2.0. Positive values penalize new tokens based on whether they appear in the text so far, increasing the likelihood of the model discussing new topics. See more about frequency and presence penalties.

frequency_penalty

number

optional

A number between -2.0 and 2.0. Positive values penalize new tokens based on their existing frequency in the text, reducing the likelihood of the model repeating the same line verbatim. See more about frequency and presence penalties.

logit_bias

null

optional

Modifies the likelihood of specified tokens appearing in the completion. Accepts a JSON object that maps tokens (specified by their token IDs in the tokenizer) to an associated bias value ranging from -100 to 100. Mathematically, the bias is added to the logits generated by the model before sampling. The exact effect varies by model, but values between -1 and 1 should decrease or increase the likelihood of selection, while values like -100 or 100 should result in the relevant tokens being either prohibited or exclusively selected.

user

string

optional

A unique identifier for your end user, which can help OpenAI monitor and detect abuse. Learn more。

Example

{
  "model": "gpt-4o",
  "messages": [{"role": "user", "content": "Hello!"}],
  "stream":true
}

Request samples

Shell

JavaScript

Java

Swift

PHP

Python

HTTP

Objective-C

Ruby

OCaml

Dart

curl --location --request POST 'https://api.302.ai/v1/chat/completions' \
--header 'Accept: application/json' \
--header 'Authorization: Bearer sk-jls4AaVBGoe1GwZD64qZA1qyKTN1MPHa4NmvH1cT68z7K1Zz' \
--header 'Content-Type: application/json' \
--data-raw '{
  "model": "gpt-4o",
  "messages": [{"role": "user", "content": "Hello!"}],
  "stream":true
}'

Responses

🟢200OK

application/json

Body

string

required

object

string

required

created

integer

required

choices

array [object {3}]

required

index

integer

optional

message

object

optional

finish_reason

string

optional

usage

object

required

prompt_tokens

integer

required

completion_tokens

integer

required

total_tokens

integer

required

Example

{
    "id": "chatcmpl-123",
    "object": "chat.completion",
    "created": 1677652288,
    "choices": [
        {
            "index": 0,
            "message": {
                "role": "assistant",
                "content": "\n\nHello there, how may I assist you today?"
            },
            "finish_reason": "stop"
        }
    ],
    "usage": {
        "prompt_tokens": 9,
        "completion_tokens": 12,
        "total_tokens": 21
    }
}

Modified at 2024-12-10 06:15:01

Responses（Talk）

Chat (gpt-4o Image Analysis)