Digital Optimus is computer-use: real-time video of a screen with controls out, the same photons-in/controls-out loop as a self-driving car, so a physical Optimus can operate any computer. SpaceX's large model assigns it tasks.
"we have digital Optimus which is basically driving a computer screen"
He said Digital Optimus can play about halfway through Diablo by looking at the screen like a human, is good at Counter-Strike and other fast games, is training on League, and the goal is to generalize across all games.
"We’re making interesting progress here.
Digital Optimus can play about halfway through the Diablo campaign so far just by looking at the screen like a human.
Skill at Counter-Strike and other fast games is good too.
League is also in training.
Goal is to generalize across all games."