Correct.
Yes, the limit is context window, which must include your history, input query and output. So you need to manage that. The best way is to use vanishing history, basically to truncate earlier history, or selected history, or some act of summarization. There are multiple ways and each has tradeoffs so you can create a table of what to use in particular circumstances.