Back to explore

Jev-like Model Plays Minecraft

The author trained a 0.8B multimodal decision model that generates keyboard and mouse actions from screen input, running locally on a MacBook at 5 FPS to play Minecraft.

I trained a jev like multimodal decision model to play Minecraft. It only sees the screen. You enter a prompt, it outputs keyboard and mouse keys. The 0.8B model is running locally on my macbook at 5 FPS. Vision is all you need 👇

· 7 likesOpen on X