Is there a possibility that OpenAI will offer their models for on-premise usage, allowing users to fine-tune them on their own premises?

Is there a possibility that OpenAI will offer their models for on-premise usage, allowing users to fine-tune them on their own premises? It has been observed that GPT4 models have demonstrated superior performance compared to other open-source language models when it comes to code generation. Whether OpenAI will make GPT4 models available for download, enabling users to quickly conduct proof-of-concept for finetuning and not worrying about data privacy and legal implications.

2 Likes

Out of interest how much high performance GPU hardware do you have on premise?

I’ve seen estimates of needing over 3TB of GPU VRAM to run GPT4 unquantised but I’m not sure outsiders know for certain?

I believe the answer is no, btw, and you might want to investigate one of the larger open source models for this purpose. Maybe wait for Llama 3?

1 Like