Hardware Requirements for training large dataset

We are using GPT model for our nlp chatbot project & in order to fine tune & train the data of close to 1000 pdf documents what would be the hardware requirements of what would be the required GPU size

Hi! Welcome to the forums!

Since this is a cloud service, you can probably get away with a wifi-enabled arduino to be honest :thinking:

If you’re talking about stuff like rag retrieval, 1000 documents aren’t that many (depending on their size) - you may not really need a powerful computer at all.