Are you a LEGO fan? Then this tool, recently developed by American researchers, will interest you. They have just developed LEGOGPT, an artificial intelligence that transforms your LEGO construction ideas using your instructions so that they are physically stable in real life.
LEGOGPT, the ChatGPT for LEGO fans
As you may have noticed, artificial intelligence is increasingly becoming a part of our daily lives. And today, it's a new tool developed by computer scientists at Carnegie Mellon University that might interest you if you're a LEGO construction enthusiast.
Like Open AI's ChatGPT artificial intelligence, LEGOGPT allows you to create a visual of your construction idea in small Danish bricks, which are celebrating their 93rd anniversary this year. The principle is simple: you simply give the AI a description of the LEGO construction you want to create, and LEGOGPT will then generate a constructible model. Because yes, while AIs are capable of generating 3D visuals that are visually convincing, in reality, they are not necessarily usable. Indeed, AIs do not take into account certain physical factors such as contact, gravity, or balance. The goal of LEGOGPT is to offer a tool capable of providing a model that is both feasible and physically stable.
LEGOGPT offers 98% stable models
To achieve this, the researchers trained the AI by building a database of more than 47,000 physically validated constructions, each accompanied by a legend. The AI learned to determine which brick to add to the requested structure to offer the user step-by-step model building while ensuring physical stability. Before adding a new piece, LEGOGPT checks that it will not cause the structure to fall. If this is the case, then she imagines another solution. With this method, the researchers managed to obtain a stability rate of 98.8%! In addition, the AI is able to take into account instructions on the choice of colors of the small bricks.
We've released the code for LegoGPT. This autoregressive model generates physically stable and buildable designs from text prompts, by integrating physics laws and assembly constraints into LLM training and inference.
— Jun-Yan Zhu (@junyanz89) May 9, 2025
This work is led by PhD students @AvaLovelace0, @kangle_deng,… pic.twitter.com/wdhkF5NBgC
For now, even though LEGOGPT is well advanced, the artificial intelligence is not completely finished. Researchers want to enrich the database to train it even more.
If you're interested in the project and want to take a look at LEGOGPT, the team has decided to share the AI as open-source, which means that you can access it freely and for free by visiting the project's Github page.
0 Comments