Canvas Not Showing Preview Option?

OpenAI announced that we can now render HTML and React through Canvas.

However I am not seeing how? In their example video there’s a “Preview” button on the top right. This isn’t showing up for me.