A group of researchers from China and Singapore taught OpenAI GPT-4V-based AI to play Red Dead Redemption 2 (RDR2). In their article, they talked about the concept of General Computer Control (GCC) for AI, and about the multimodal CRADLE agent - an interface between GPT-4V and RDR2. In their opinion, the main problems with the game AI agent arose when using computer vision. Image Source: Rockstar
Source: 3dnews.ru
