Personally, I use models to produce raw text for 2 reasons:
- Safer from the code base point of view
- If model needs to produce JSON, means at least 2 distinct key value pair - probably I’m wrong in my approach as it looks like there might be at least 2 distinct tasks to get the output I need, so fine tuning separate models for those tasks usually is the best approach (quality + modularity of the system)