I am confused by the difference between multi-shot and Chain of Thought prompting.
Does Chain of Thought prompting involve supplying the prompt with many examples that go through it logically step by step? How would this be different than multi-shot prompting?
For example, in this chain of thought paper example, the blue text is where the chain of thought comes in. In reality, does each of my prompts need to contain an example of the blue text? Or is the blue text the output of the LLM model? Thanks