All experiments
AI × 3D In progress
Can AI control Unreal Engine?
Can a language model operate a 3D editor rather than describe one?
What I tried
Exposed editor operations to an agent as explicit, inspectable commands instead of free-form text, and gave it a way to read the scene back after acting.
What happened
Fluency was never the problem. The model could explain any workflow and still fail to leave a trace inside the editor.
Once actions returned observable state, the failures became specific and therefore fixable: wrong target, wrong transform, wrong assumption about what was selected.
Next question
How much scene state does an agent need to see before its spatial decisions stop being guesses?