Abstract: Large-scale production systems are largely operated by management software like Kubernetes operators and increasingly by AI agents. Production systems have diverse functionalities, interfaces, and fault-tolerance properties; hence, their management semantics are complex and less standard. Today, management-plane software is largely implemented based on experience and documents of the managed systems, where correct management is a best effort. We advocate for the practice of writing formal operations specification (FOS) as a formal contract to precisely describe expected behaviors of the production system and to enable systematic checking and verification of management-plane software and agents. We argue that the FOS should be part of standard system interface to enable reliable system management. We suggest that every production system include a FOS and share our experience of writing FOSes for real-world systems; we show that writing and maintaining a FOS is affordable and can potentially be automated

Comments