GPT is a large language model and is capable of few shot language translation.
ERNIE and BERT, some of the muppets models have been trained in multiple languages.
Transformers translate using language vector correlation, google translate is a totally different approach.
Quite dont understand your question.
What you can do in Jarvis.ai, copy.ai and some similar websites is you can type in English and get results in Russian (example lang) or you can type in Russian and get results in English or any other language. I am impressed with that I wonder how is that possible.
When I try to do the same in openai, I dont get what I want, even though I do openai is not that good with other languages. That’s why I thought those websites were translating the input into English (if it is not) and then getting results in English and translate it to desired language.