Fine-tuning on conversations

You are correct, there is only the previous input taken into context to produce the next output. But your example seemed to have a gentle back-and-forth feel to it, without a deeper prior context.

To have a deeper context ‘virtual you’, I think you need at least two fine tuned models. And the more I think about it, I think you also need several classifiers running in the background, as well as several non-AI based RegEx pattern cross-correlation engines.

Here is at least my early thoughts on creating a deeper ‘virtual you’ without the extra stuff I just mentioned above: