IT之家 AI

223 questions, 2651 standards: Alibaba Qwen opens sources BlenderWorld, putting a big test of 3D modeling on AI

IT Home news on October 17: The Alibaba Qwen team opened source BlenderWorld on October 14. This is a benchmark used to evaluate visual AI agents in completing real 3D creation tasks within Blender. The project uses the…

Image source · IT之家 AI
Thank you to the IT Home netizen Domado for sharing the clue!

IT Home on October 17 reported that the Alibaba Qwen team opened-source BlenderWorld on October 14. This is a benchmark used to evaluate visual AI agents in completing real 3D creation tasks within Blender. The project uses the MIT license, and its code and dataset have been published on GitHub, Hugging Face, and ModelScope.

Unlike the common “generate a picture” task, BlenderWorld requires AI to deliver an editable .blend engineering file, and to output a rendered image, video, or model export file as needed. In this test, the model must not just provide a beautiful image; it also needs to include materials, geometric structures, lighting, and cameras, creating a 3D scene that designers can continue to modify.

The benchmark includes 223 tasks and 2,651 standards, covering 9 major categories and 22 subcategories such as products, architecture, natural environment, characters, animation, and scientific visualization. Among them, 78 tasks provide only text descriptions, 130 tasks include images along with text, 15 tasks include videos along with text; additionally, 59 tasks come with specification files such as dimensions, materials, or camera parameters.

The evaluation method is also quite strict: the system renders the submitted Blender projects from 8 adaptive perspectives, and combines scene inspection, 2,651 task-specific binary scoring criteria, as well as 8 overall visual quality scores. The final score is calculated by weighting 50% for rule compliance and 50% for visual quality.

The project currently provides a complete installation, generation, packaging, and testing process, allowing developers to integrate any generated framework into testing. The repository indicates that it uses Blender 4.2.10, and requires a Linux and Python 3.10 or later environment; the testing phase also requires model services with visual capabilities.

IT Home provides references

Ad notice: The text contains external link pointers (including but not limited to hyperlinks, QR codes, passwords, etc.) designed to provide more information, save selection time, and the results are for reference only. Articles on IT Home that include external links all include this notice.

Original source

IT之家 AI

Content notes

Original publication and rights belong to the source.

Machine translation · Refer to the original