Can I get logits if I go for finetuning with OAI?

I am currently planning to finetune a GPT-4 model using my own dataset and am curious to know if there is a possibility to access the logits as well during this process. Could you provide information on whether this feature is available and how I might go about obtaining these logits?