Heya! Welcome to the forum!
Do you have an example of the system/user/assistant prompt(s) you’re using?
Examples of output?
What settings are you using? Temperature, etc.
You can output HTML, but it’s generally not recommended. Much easier to wrap the output of the LLM with HTML tags.