Cachedtoken not working recently while using chatCompletion api

[pcosta]

I am experiencing the same issues.

A pipeline that used to cache most of its prompt tokens between calls is not caching them any longer. We first identified this issue on December 29th.