Can gpt 3.5 turbo provide citations in RAG

[20euai044]

I have a list of documents in my RAG pipeline.
In the response, I also need to provide citations like [1] [2] in between content. sample given below !

This will help reduce hallucinations and avoid out of context, since each line or para or code or table response crafted has a proper citation.

I need help with prompt to achieve this.
The citation should be provided in the response and its actual document name in end, as given in image

[supershaneski]

Using classic RAG

1. With File extracts relevant to the question
   

   

2. With File extracts not relevant to the question
   

   

3. No File extracts
   

   

[20euai044]

@supershaneski , Thanks for your reply.
But
I’m working on text data in my documents.
So, if user ask: How to create a google account
The response should contain verified citations for each step from documents.

else should reply- i dont know.
I tried to fine-tune prompt to include citations:

OpenAI src: Prompt engineering - OpenAI API

But OpenAI prompt gives me a list of citations in the end of response. While
I need them verified sentence by sentence.

Thanks

[sam-boundary]

Are you looking for something like this?: Wikipedia RAG example (source code - baml, ts)

If you want it to give you them sentence-by-sentence, then you need to instruct it to give them to you like that, e.g. answer in (sentence, citation) pairs.

[20euai044]

Thanks @sam-boundary ,
it is exactly what I’m looking for

Does it work for Code blocs, table , steps based questions ?

[sam-boundary]

Yep - BAML allows you to define arbitrary input and output types, so it’s really just a matter of whatever you can think of! You can take a look at the getting started guide here