RAG input via System message: JSON vs plain text

API
9

The user’s message, or a chunk of the conversation for example

BTW, modern embedding models are even instructable

e.g.: NV-Embed-v2 (not openai)

task_name_to_instruct = {"example": "Given a question, retrieve passages that answer the question",}

query_prefix = "Instruct: "+task_name_to_instruct["example"]+"\nQuery: "
queries = [
    'are judo throws allowed in wrestling?', 
    'how to become a radiology technician in michigan?'
    ]

nvidia/NV-Embed-v2 · Hugging Face

pretty cool stuff