How can I prevent a fine-tuned model from generating a lot of END tokens?

API
1

Hi friends,

I’ve been trying to experiment with fine-tuning an ada model to ouput IaC files, however the model generates random tokens to the max lenght I’ve set in the portal, is there any way to stop this from happening?

image
image1486×746 60.8 KB

1 Like
2

Please post an example of the prompt and the expected completion.

Also, please post example lines of your JSONL fine-tuning training file and note the parameters you used when you fine tuned your ada base model.

Please post actual text and not screen shots, because to help you we can easily test and we do not want to type from a screen shot (take too much time and so that will not happen), but copy-and-paste from the actually text (so we can test quickly and accurately).

Thanks @ionascumihaig

:slight_smile:

3

@ruby_coder Thanks, for taking the time to answer.

Prompt:

This module create a storageAccount resource with apiVersion 2021-01-01.

Expected output:

{‘type’: ‘microsoft.storage/storageaccounts’, ‘apiversion’: ‘2019-04-01’, ‘name’: "[variables(‘diagnostic_storagegroup_name’)]", ‘location’: "[parameters(‘location’)]", ‘sku’: {‘name’: ‘standard_lrs’, ‘tier’: ‘standard’}, ‘kind’: ‘storagev2’, ‘properties’: {‘networkacls’: {‘bypass’: ‘azureservices’, ‘defaultaction’: ‘allow’}, ‘supportshttpstrafficonly’: false, ‘encryption’: {‘services’: {‘file’: {‘enabled’: true}, ‘blob’: {‘enabled’: true}}, ‘keysource’: ‘microsoft.storage’}}} END"}

JSONL file used for fine tuning: train_prepared.jsonl - Google Drive