Hi there @cjaballah and welcome to the Forum!
.xlsx files are supported under the Assistant, however the approach for uploading them is slightly different compared to other files. You cannot attach .xlsx files to the vector store. Instead, you need to attach them to the code interpreter. For that to work, the code interpreter needs to be enabled.
For some additional details, you can also have a look at this thread where we’ve recently addressed the issue: