Language models (LMs) have gained traction as aids in software engineering, where users act as intermediaries between LMs and computers, refining LM-generated code based on computer feedback. Recent advancements depict LMs functioning autonomously in computer environments, potentially expediting software development. However, the practical application of this autonomous approach still needs to be explored.