Remembering the past in gpt-4o-mini-audio-preview

I made a chatbot using gpt-4o-mini-audio-preview. In order for this bot to remember past conversations, I create a new request by adding old conversations to each request. This increases the number of tokens incredibly. Is there an alternative solution? Because after 10-15 conversations, the number of tokens increases uncontrollably.