Put Gemini and GPT into Minecraft as coaches—who can understand a robot's micro-management?
# Place Gemini and GPT as coaches in Minecraft. Who can understand robot micro-control? ## Key Conclusions A joint team from National Tsing Hua University and NVIDIA conducted a comprehensive evaluation of mainstream large models such as Gemini 2.0 and GPT-4.1 against embodied intelligence tasks in Minecraft, including milking cows, shearing sheep, and killing spiders. The results showed that **Gemini 2.0-Flash maintained an accuracy rate of over 70% across 10 tasks, being the only model without any shortcomings; models like GPT-4.1 performed mediocrely, while traditional CLIP-based models failed completely.** ## Experimental Design The research team constructed 10 embodied intelligence task scenarios, including: - **Basic control**: Balancing a inverted pendulum (Cart Pole) - **Soft body manipulation**: Straightening ropes, translating water cups - **Spatial perception**: Kicking a ball into the net, clearing blocks into holes, opening drawers...