I’m interested to create an app which acts as a career coach as I transition to a new role. I want to have an ongoing conversation about my work and for the app to learn about it as I go along so that it can provide advice.
It works quite nicely as a conversation with memory, but of course the context window fills up eventually. I’ve tried to fine-tune the model using the conversation data provided so far, but it seems to forget all the details when I do this.
Any suggestion for where I’m going wrong?