Why do plugins redo api calls when aswers are in the first call?

I find a behavior which is actually quite a waste. If you retrieve your json via the plugin call and ask a second question which is clearly in the content it already pulled from the previous question - its simply does a fresh api call. This is a huge waste and is especially different to how chatgpt generally works as it has some token memory and can tie previous conversations together. However it seems the json data is forgotten right after the first answer. I wonder if similar behavior is seen in functions. Do other see this as a waste or resources and poor user experience?

1 Like

How do you imagine it could work any differently?

Think about when the API is called.