ModelUp.co and Fater.ai have launched a prototype tool that converts textual prompts into 3D models, enabling users to generate three-dimensional representations based on written descriptions as they chat with the application.
Renowned AI Expert Dr. Fei-Fei Li (a professor at Stanford and co-director of HAI - the Stanford Institute of Human-Centered AI) unveiled World Labs, a new tech startup aiming to revolutionize AI by creating large world models (LWMs) that can perceive and generate 3D environments with unprecedented realism.
Electronic Arts has launched a groundbreaking "Imagination to Creation" AI platform that empowers users to craft and customize games in real-time using voice commands, eliminating the need for coding skills.
Roblox is developing an open-source AI tool that will enable game developers to create 3D environments and objects using just text prompts.
This survey paper by Ma et al (2024) explores various methods for combining LLMs with 3D data representations, such as point clouds and Neural Radiance Fields, to perform tasks like scene understanding, captioning, and navigation.
