When you prompt and receive a lengthy and complicated response, it is really hard to digest it all without clicking away to google, or prompt on a separate window. It breaks the user experience, sends users to a competitor, and is time consuming.
My suggestion is when you receive text response, you are able to highlight a section of the response, and open a separate window where you can ask a question with the highlight as the context. The original prompt and response should be available to see, the small popup is just a drill-down.