Will we be able to use plugins in playgrounds?

Or is there any other way to use the plugins with our chatgpt4 api outside of https://chat.openai.com/chat

Not currently. We will share if it does become available in the future.