Instruction fine tuning using LoRA with RAG

I it possible to perform instruction fine-tuning with a prompt using LoRA for low rank adoptation. Create a RAG for it too.