Where can I find a list of more possible parameters for API Batch, like ","max_tokens": 1500, "num_samples": 2}"

API
1

Where can I find a list of API batch possible parameters?
Like: “max_tokens”: 1500, “num_samples”: 2

1 Like
2

You can find a list of possible parameters for API batches in the OpenAI API documentation. The key parameters include:

  • model: Specifies the model to use (e.g., gpt-3.5-turbo).
  • prompt: The input text or sequence of prompts.
  • max_tokens: The maximum number of tokens to generate (e.g., 1500).
  • temperature: Controls randomness in the output (e.g., 0.7).
  • top_p: Controls diversity via nucleus sampling (e.g., 0.9).
  • n: Number of completions to generate for each prompt (e.g., 2).
  • stop: A list of tokens where the generation should stop.
  • presence_penalty: Encourages the model to include new topics.
  • frequency_penalty: Reduces repetition by penalizing repeated words.

For the most detailed and up-to-date list of parameters, refer to the official OpenAI API .documentation