Incomplete or truncate result

General API discussion
1

Hello, I am using the following API call but the result is incomplete or truncated. I get results like this:

#NorthKorea-linked #LazarusGroup transfers $63.4M in #Ethereum from #2022HarmonyBridge hack to #crypto exchanges. Funds frozen, 124 $BTC recovered. Attack is part of a larger #crypto theft operation totaling …

API call:

    const response = await this.openai.createCompletion({
      model: 'text-davinci-003',
      prompt:
        'Create an objective summary news from this article with less than 260 characters including spaces:\n' +
        text +
        '\n',
      temperature: 0.7,
      max_tokens: 65,
      top_p: 1.0,
      frequency_penalty: 0.0,
      presence_penalty: 0.0
    });```

How can I improve it?
2

I think I will be right in saying that your max_tokens is way to low for what you are doing.

You need tokens that accommodate input and output. Tokens equate crudely to 1 per every 4 letters.

A high max_tokens will not cause them to be consumed unless they are used. And they are a generally a fraction of a cent per 1000.

2 Likes
3

Thanks for the answer. do you know how I can get the result in more than 260 characters? The result is bigger.

4

Just as @paul.armstrong said: set a higher max_tokens.

    const response = await this.openai.createCompletion({
      model: 'text-davinci-003',
      prompt:
        'Create an objective summary news from this article with less than 260 characters including spaces:\n' +
        text +
        '\n',
      temperature: 0.7,
      max_tokens: 1000,
      top_p: 1.0,
      frequency_penalty: 0.0,
      presence_penalty: 0.0
    });```
5

Sorry, the result I what to be less than 260. I wrote “more than” by mistake.

6

Something like this?

[TASK: Create a short, objective summary from this article.\nLENGTH: less than 260 characters including spaces.]