GPTs knowledge upload. Images for reference when creating new images

I have several images in png uploaded to GPTs knowledge that are exactly the type of image I want it to produce. In the instructions I have told it at least 20 different ways to reference the images I gave it for style, placement, background, and size. Regardless of how I write it, it still refuses to reference the images in knowledge even a little bit, even if that is its only instruction. Any ideas? Thanks.

I read something about dall-e 3 rweriting all prompts to include more detail and this thread has a few good responses about this topic. Perhaps thats whats influencing the GPT to act up?