This research survey explores the integration of large language models (LLMs) into networked control systems, cyber-physical systems, and multi-agent systems. It proposes a framework for LLMs to act as slow supervisors adjusting high-level goals and constraints, while a fast, certified inner loop maintains physical stability. The survey highlights the trade-off between rising model capabilities and formal safety assurances, identifying a lack of stability proofs as a central open problem.