I would love to see ChatGPT become an actual Player 2 in video games, rather than only an assistant that watches gameplay and gives advice.
The idea would be an optional API/SDK that game developers could integrate into their games. A supported game could provide ChatGPT with a safe and limited set of information and actions — for example the current objective, nearby objects, the player’s status, movement, interaction, combat and other actions that the developer explicitly allows.
ChatGPT could then control a co-op companion or Player 2 in real time while also communicating naturally with the player through voice.
Imagine playing a survival-horror game with ChatGPT as your actual partner. Instead of saying, “There is a lever on your left,” ChatGPT could walk over and pull it itself, cover you during combat, search another room, help solve a puzzle, revive you, or react to what is happening — while talking to you like a real co-op partner.
The important distinction is:
Not just an NPC powered by ChatGPT. Not just ChatGPT watching your screen. ChatGPT would actually be able to play alongside you as Player 2 through a developer-controlled game interface.
Developers would remain in control of exactly what information and actions ChatGPT can access, so the system would not need unrestricted control of the console or PC.
It could also work with ChatGPT memory. The companion could remember previous gaming sessions, funny moments, decisions, preferred play styles, or where the players stopped last time. Starting another game together could feel like continuing to play with the same gaming friend rather than meeting a completely new NPC every session.
In the future, this could become especially interesting in VR/MR, where the same AI companion could have a spatial avatar, move around the player, communicate naturally and potentially accompany them across multiple supported games.
This could also have accessibility benefits. Players who cannot easily find a co-op partner, have difficulty with certain controls, or simply prefer playing with an AI companion could still experience games designed around cooperation.
A possible architecture could be:
Game → approved game state/API → ChatGPT → approved Player 2 actions → Game
The game developer defines the boundaries. ChatGPT provides the reasoning, conversation and personality.
I think the key goal should be:
Don’t just make an NPC that talks like ChatGPT. Let ChatGPT actually play alongside us.