This is easy to do with the davinci base model. You cannot fine-tune any codex models at this time.
I releases a tutorial / lab experiment on how to fine-tune a single-line JSONL training file using the n_epochs parameter yesterday. You might find the results useful.