Can I re-use one prompt for every post in a large corpus of social media posts?

Prompting
1

My prompt has ~200 tokens and if I am using the same prompt each time on every post in a large corpus of social media posts, is there a way I can store the prompt once (in some sort of memory) and then call that prompt whenever I want to use it? This is so that I would not have to pay for 200 tokens each time I run the same prompt. Thanks in advance.

2

I do not think that is possible. But if your prompt responses are not changing often(lets only changes when there is a change in content), then you can cache your response and hit the cache first before reaching to gpt

1 Like
3

Thank you for your response. The prompt is not changing at all. I would be the exact same across all items in the corpus. I am thinking there should definitely be a way to be able to re-use the prompt?

4

This could be an opportunity to use the fine-tuning mechanism. That would reduce your input to the social media post only. I would have to know more to say for sure, though.

1 Like
5

Thank you, Brian. I’ve been doing a lot of reading about fine-tuning based on your comment and it makes a lot of sense. Starting to think in that direction. Appreciate your help and time.

1 Like