A Model for Automated Network Provisioning and Management: An Exciting New Paradigm

Network operations center automation
Ben Ludeman

By Ben Ludeman

Ben has been designing, deploying, and supporting high-availability enterprise networks for 19 years. He has implemented automation solutions for managing and operating physical and virtual devices within networks. Ben manages INOC’s high-availability infrastructure both in the cloud and data centers.
In case your time is short

The Integrated Network Provisioning and Operations Platform (INPOP) is a new approach to network management that combines automation, Infrastructure as Code (IaC), and a Configuration Management Database (CMDB). Developed by INOC, INPOP aims to streamline network setup, configuration, and monitoring, reducing manual interventions and human errors. Key features include:

  • Automated provisioning based on CMDB specifications
  • Real-time monitoring and validation
  • User-friendly web interface with role-based access control
  • Scalable and efficient network management

INPOP was successfully implemented at the Radiological Society of North America's (RSNA) annual event, demonstrating improved efficiency, accuracy, and adaptability in managing a large-scale, dynamic network environment. This approach could serve as a blueprint for future network management solutions in various IT infrastructures.

Network provisioning and management have changed little over the past decade or two. Despite advancements in automation and software-defined networking (SDN), many networks still rely heavily on manual processes, direct configurations, command-line inputs, and physical supervision by network engineers.

This "traditional" approach has its drawbacks. It lacks scalability, is prone to human error, and demands costly resources, especially in dynamic environments like large-scale events, expansive enterprises, and service-oriented IT infrastructures. But a new approach aims to change that.

INOC developed and tested the Integrated Network Provisioning and Operations Platform, or INPOP, which promises to streamline network management through automation and integration.

INPOP redefines network management by integrating IaC principles and a CMDB, automating and streamlining provisioning and operations. Launched at a major conference in 2023, INPOP significantly reduced manual interventions, enhanced network stability through standardized configurations, and allowed the network to adapt more easily to changing demands.

Here's why we’re excited about INPOP as an alternative approach to building and managing networks and why other ITOps professionals might find it compelling:

  • It’s scalable and efficient. By automating critical parts of provisioning and network adjustments, we found that INPOP reduces deployment and modification times, effectively tackling scalability challenges.
  • It reduces human errors. Using a CMDB for network configuration minimizes human error and ensures network setups are aligned with predefined policies.
  • It allows for more proactive monitoring. INPOP's integrated monitoring and validation capabilities provide continuous, deep oversight of network performance, enabling early issue detection and shifting support from reactive to proactive.

As a somewhat pioneering approach, INPOP confirms the benefits of more automated, flexible, and reliable network management practices. It offers a refreshing alternative to the status quo and provides a blueprint for future innovations in the field.

This case study explores INPOP's development and first real-world implementation, highlighting its potential for broader adoption and further evolution in various networking environments.

Background: Evolving Event Network Needs and the Genesis of INPOP

INPOP’s first deployment was a rigorous test, providing pop-up network support for the Radiological Society of North America’s Scientific Assembly and Annual Meeting. This event is the largest medical imaging gathering in the world, attracting over 55,000 professionals and more than 700 exhibitors. With hundreds of tech-heavy booths, displays, educational sessions, scientific exhibits, and event operations, the IT infrastructure is vast—and 100% uptime is critical.

The event’s network, RSNAnet, spans two million square feet and includes multiple distinct networks for various needs. Its growing size each year underscores the limitations of manual, spreadsheet, and CLI script-based management methods. (More details about this network can be found in our other piece here.) The event's complexity prompted us to apply innovative and automated techniques we've developed for NOC support, leading to a better model for setting up and operating RSNAnet.

Inside INPOP

Again, INPOP’s software-based system combines IaC principles with a CMDB to automate key aspects of IT infrastructure management. At its core, INPOP utilizes a central database to store and manage all network-related configurations. This centralized approach allows for automatic application of settings across the network, significantly reducing the need for manual input and lowering the risk of human error.

While initially designed to meet the complex and dynamic networking demands of large-scale events, INPOP's versatility suggests potential applications in various other IT environments. The system's ability to streamline setup, configuration, and ongoing monitoring positions it as a promising solution for a wide range of network management challenges.

The figures and step sequences below illustrate how INPOP introduces databases and tooling into a typical network setup and, more importantly, how this tooling enhances management.

Traditional Network Management Approach

Screenshot 2024-08-04 at 1.29.52 PM

Traditional Steps:

  1. Manually configure Router A & B for internet connectivity and inter-router routing.
  2. Manually configure each Switch for VLANs and inter-switch links.
  3. Manually configure Access Points (AP1 & AP2) for wireless networks.
  4. Assign static IP addresses or DHCP settings to PCs and configure network access.
  5. Set up manual routes and possibly QoS settings across routers and switches.
  6. Manually verify connectivity and performance across all devices and links.
  7. Any network changes require manual reconfiguration and verification.

INPOP (Automated Network Management)

2

Steps:

  1. Network structure and policies (VLANs, IP schemes, routing, QoS) are defined in CMDB.
  2. INPOP automatically provisions Routers A & B, including internet and routing configs.
  3. Switches are automatically configured with VLANs, inter-switch links, and QoS policies.
  4. Access Points receive configuration for wireless networks automatically.
  5. PCs are set up with network access via DHCP, ensuring proper IP configuration.
  6. Automated tools apply routing and QoS policies across the network based on CMDB.
  7. Continuous real-time monitoring validates network operation against CMDB, adjusting as needed.
  8. Network changes in the CMDB propagate automatically, minimizing manual intervention.

Below, we dissect the specific technical components to more clearly show how its architecture and features contribute to its effectiveness in modernizing network management practices.

1. CMDB Integration

Integrating a CMDB shifts network management towards a model that emphasizes abstraction and automation to handle complexity. A central, declarative model defines the network's intended state and pairs with automation tools to simplify administrative tasks, making the networking team more agile and responsive.

CMDB as the Network's Architectural Blueprint

INPOP’s CMDB consolidates all network configuration data into a unified repository, acting as the network's architectural blueprint. This provides a comprehensive view of the network's design and operational state, allowing for more precise management and oversight.

The CMDB is meticulously detailed, covering device IPs, hostnames, port configurations, and VLAN assignments. From this singular reference point, every network component can be easily accessed, analyzed, and managed.

Screenshot 2024-08-13 at 3.58.52 PM


A Declarative Model for Network Configuration

Beyond providing data storage, the CMDB underpins a declarative approach to network configuration. Administrators specify the network's desired state within the CMDB, from overarching network topology to specific port settings. INPOP then aligns the actual network configuration with this blueprint, shifting from the traditional imperative management model—relying on direct commands and configurations—to a declarative model that abstracts and simplifies complex tasks.

Screenshot 2024-08-13 at 4.00.10 PM

INPOP interprets the CMDB's directives to automatically enact the required configurations across the network infrastructure, ensuring consistent adherence to the planned network design.

Automated Alignment with Real-World Network State

Crucially, INPOP actively maintains the alignment of the actual network setup with the CMDB's declarative model through an advanced automation layer. This layer interfaces with network devices, applying the configurations dictated by the CMDB. It translates high-level, human-readable directives into specific device commands and settings, merging theoretical design with practical execution.

The system continuously monitors the network to confirm operational compliance with the CMDB's parameters. Any discrepancies are automatically corrected or flagged for intervention, preserving the network's operational integrity and ensuring its performance matches the intended design.

Screenshot 2024-08-13 at 4.02.46 PM

2. Automated Provisioning

INPOP represents a possible step forward in network setup through its advanced automated provisioning system, deeply rooted in the CMDB's extensive data. This system translates the CMDB's high-level design objectives into precise configurations across network devices, aligning the physical network with its detailed digital blueprint.

Parsing CMDB Entries

The process begins with parsing the CMDB entries, where INPOP uses algorithms to interpret the configuration data. This step identifies the specific requirements of each network component, serving as the foundation for generating exact device configurations.

Screenshot 2024-08-13 at 4.05.40 PM

Generating Device-Specific Configurations

After parsing, INPOP dynamically generates configurations tailored to each device. This involves translating the CMDB's high-level directives into practical configurations that devices can execute. The process accounts for each device's model and capabilities, ensuring compatibility and performance optimization.

For example, in configuring VLANs, INPOP assigns VLAN IDs and integrates considerations for link configurations, tagging protocols, and access control policies, facilitating robust network segmentation and security.

Screenshot 2024-08-13 at 4.06.46 PM 

Deploying Configurations to Network Components

With configurations ready, INPOP deploys them across the network through automation scripts and APIs, directly communicating with network devices. This remote application bypasses the need for manual CLI interactions, reducing delays and the risk of human error.

Deployment is managed to avoid disrupting network services, with changes typically staged for maintenance windows or designed for easy rollback to ensure network integrity.

Screenshot 2024-08-13 at 4.08.22 PM

Handling Complex Network Tasks with Automation

The true power of INPOP’s automated provisioning system shines in its handling of intricate network tasks:

  • VLAN Assignments Across Multiple Switches: INPOP manages VLAN configurations with precision, orchestrating VLAN traffic optimally across the network, configuring trunk links for VLAN carriage, and setting up specific VLANs on access ports for effective segmentation and security.
  • Automated Gateway Configurations: INPOP streamlines gateway device configurations, selecting appropriate routing protocols and settings based on the network's design and traffic needs as outlined in the CMDB. This includes managing dynamic routing, VPN tunnels, and NAT rules, enhancing network connectivity and performance.

3. Real-time Monitoring and Validation

INPOP's comprehensive monitoring system continuously checks the network to ensure its operational state aligns with the CMDB's specified designs. This system blends active and passive monitoring methods, such as SNMP polling, Syslog analysis, and tailored health checks to collect extensive telemetry from network devices.

Any discrepancy between the CMDB's definitions and the actual network setup triggers alerts, leading to either automatic or manual rectification. This constant, hyper-vigilant validation process confirms adherence to the planned network design and supports swift fault detection and resolution.

Advanced Real-time Monitoring Techniques

INPOP's monitoring framework is designed to maintain constant harmony between the network's operational state and the CMDB's specifications. Using a mix of active and passive monitoring strategies ensures thorough oversight of the network's health and functionality.

  • SNMP Polling: This actively solicits network devices for data on bandwidth usage, error rates, and other vital performance metrics, allowing for the immediate identification and addressing of any issues.
  • Syslog Analysis: By passively examining system logs from network devices for errors, warnings, or significant events, INPOP can preemptively tackle issues signaled by the devices, potentially before they affect network operations.
  • Custom Health Checks: These involve specially designed scripts or agents deployed on network devices or within the network management framework, crafted to reflect the unique needs of the network's structure or the RSNA event, ensuring the flawless functioning of critical operations.

Screenshot 2024-08-13 at 4.11.38 PM

Proactive Discrepancy Management

The heart of the real-time monitoring and validation process in INPOP lies in its capability to detect and address discrepancies between the CMDB's declarations and the network's actual operational state.

When deviations are detected, INPOP initiates a well-defined sequence of responses:

  • Alert Generation: Automated mechanisms produce alerts to inform network administrators of discrepancies, with the alerts ranked by the potential operational impact.

  • Automated Remediation Processes: INPOP can autonomously initiate corrective measures for certain discrepancies, such as reconfiguring devices, restarting services, or executing corrective scripts.

  • Manual Remediation Guidance: Complex issues or those requiring human intervention result in alerts packed with detailed insights, helping administrators address the problem based on in-depth monitoring data analysis.

Screenshot 2024-08-13 at 4.15.26 PM

Enhancing Network Performance and Reliability

INPOP's real-time monitoring and validation functions ensure strict conformance to the network's designated blueprint and enable quick issue mitigation. This proactive stance optimizes network performance and minimizes downtime and operational interruptions. By ensuring the operational network precisely mirrors its CMDB-drafted ideal, INPOP secures the RSNA event's network infrastructure's strength, dependability, and adaptability to meet evolving demands.

4. A User-friendly, Web-Based Interface and Portal Architecture 

We built INPOP with a user-friendly web portal, using modern web technologies to ensure accessibility across various devices and browsers. The portal's modular architecture allows seamless integration with the CMDB and the automated provisioning and monitoring systems.

  • Graphical Network Representation: The portal offers a dynamic graphical display of the network's topology, sourced directly from the CMDB data, to accurately depict the network's layout, including devices, connections, and configurations. This visual navigation aids in demystifying complex network structures and the relationships between components.

  • Intuitive Configuration Management: The portal simplifies network configuration through intuitive interfaces, allowing administrators to apply changes via graphical interactions. These adjustments are automatically converted into the corresponding backend commands by INPOP  — minimizing the learning curve and error potential compared to CLI methods. This makes network management more approachable for administrators at different skill levels.

  • Real-time Monitoring and Diagnostics: A key feature of the portal is its integration with the real-time monitoring system, giving administrators immediate access to network health, traffic, and performance data. This functionality enables swift issue identification and resolution. Data is presented in a clear format, using charts, graphs, and alerts to underline essential details and trends.

  • Enhanced Security with Role-based Access Control: The INPOP portal critically addresses security through detailed role-based access control (RBAC). This system ensures users receive permissions aligned with their organizational roles, safeguarding against unauthorized network alterations. By defining roles with specific access rights, the portal upholds the principle of least privilege, minimizing the risk of misconfigurations and security violations.

Implementation at RSNA’s Annual Event

RSNA-2021-Show-Floor-1500

The implementation of INPOP at the RSNA event showcased its ability to oversee the network's full lifecycle, from setup to decommissioning.

Below, we briefly explain a few of the key steps of implementation.

1. Developing INPOP for RSNA

Developing INPOP for RSNA involved thoroughly analyzing the event's networking needs and acknowledging the temporary setup and the demand for reliable, high-speed connections. We ran an agile development project for quick feature iteration and testing tailored to RSNA's unique needs.

The deployment meticulously aligned the venue's physical layout with the network design, ensuring the infrastructure could support the demands of radiological imaging equipment, vendor booths, and attendee connectivity. This preparation set the stage for automated provisioning via the CMDB.

2. Automated Provisioning and Dynamic Adjustments

INPOP's automated provisioning was critical in enhancing the RSNA network setup. It automated traditionally manual tasks like VLAN configurations and router setups precisely, using automation scripts to communicate directly with network hardware and apply configurations—minimizing human error and setup times.

The system dynamically adjusted the network in response to evolving needs during the event, such as adding new booths or relocating sessions, ensuring consistent connectivity.

3. Streamlined Onboarding and Real-time Monitoring

INPOP significantly improved the onboarding process for vendors and participants by allowing connectivity requests through an intuitive web interface. These requests were automatically translated into network configurations, reducing the IT staff's workload and enabling quicker operational readiness for vendors.

INPOP's integration with real-time monitoring and validation ensured that new devices met RSNA's security and performance criteria upon connection, quickly identifying and correcting any issues. This proactive stance helped maintain a secure and efficient network environment throughout the event.

Results

After its first deployment, INPOP demonstrated several compelling results that motivate us to continue refining the system.

  • Efficiency Gains Through Automation: INPOP streamlined network management processes for the RSNA event, from setup to daily adjustments. It translated high-level configuration directives from the CMDB into specific device commands, eliminating manual configuration and enabling rapid changes in response to evolving event requirements, showcasing better network management agility.
  • Enhanced Accuracy and Reliability: By automating the configuration process, INPOP minimized human error, a common source of network issues. This automation ensured every device was configured based on predefined specifications in the CMDB, significantly decreasing configuration errors. As a result, the network became more stable and dependable, with fewer disruptions and increased satisfaction among RSNA participants and vendors.
  • Operational Insights for Proactive Management: INPOP provided monitoring and validation capabilities that helped the network management team detect and address potential issues before they impacted users. This capability ensured smooth operation throughout the event and helped optimize the network to handle high-demand moments.
  • Scalability to Meet Evolving Requirements: INPOP's modular, code-driven nature offered significant scalability benefits. The system was designed with flexibility in mind, allowing for easy adaptation and scaling of the network infrastructure to meet the RSNA event's dynamic requirements. Whether accommodating additional participants, integrating new technologies, or expanding the network to cover more areas, INPOP could efficiently scale to meet these needs.

A Potential New Blueprint for Network Setup and Management

The INPOP model represents a refined approach to network management. It demonstrates a holistic method that integrates modular architecture, automation, declarative configuration, real-time monitoring, and user-centric interfaces. Synthesizing this model offers a comprehensive blueprint for building and managing future networks more effectively.

Here's how these components could inform a better approach to building networks:

Teams could start with a modular network design that allows easy scalability and adaptation to changing requirements. This approach would better support the gradual expansion of network capabilities or downsizing in response to demand fluctuations without overhauling the entire infrastructure.

During the network build, teams could implement toolsets that automate the configuration of network devices, security policies, and performance settings based on predefined templates or policies stored in a CMDB. Automation would then enforce compliance and configuration standards across all network components.

Incorporating a CMDB or similar repository as the single source of truth for the network's desired state at the outset of a network build enables automation tools to interpret the CMDB's specifications and configure network devices and services accordingly, aligning the actual network state with the intended design.

As part of a network build, teams could deploy monitoring solutions that track a wide range of metrics across devices and services. These tools could feed real-time data into the network management system, enabling automatic adjustments or alerts for conditions that deviate from expected performance thresholds.

Network management interfaces could be designed to be intuitive and accessible, empowering users with different levels of expertise to manage and interact with the network efficiently. A user-friendly dashboard could provide a visual overview of the network's status, configuration options, and performance metrics. Role-based access controls could tailor the interface and available actions to the user's role, ensuring ease of use and security.

Final Thoughts

INPOP signals a step forward in a network management paradigm long ripe for innovation. As IT environments become more dynamic and demanding, the limitations of traditional network management will grow more untenable. INPOP has opened an avenue for better network efficiency, reliability, and flexibility. The principles and practices built into this system offer a solid foundation for considering the next generation of network management solutions.

Schedule a free NOC consult to learn more about our services and explore some potential NOC solutions. Our consults are tailored to your needs, whether you’re considering outsourced NOC support or operations consulting for a new or existing NOC.

AIOps White Paper Cover

Free white paper The Role of AIOps in Enhancing NOC Support

Download our free white paper and learn how your NOC support stands to gain from AIOps by overcoming operational challenges and delivering outstanding service. Use the free included worksheet to contextualize the value of AIOps for your organization.

Ben Ludeman

Author Bio

Ben Ludeman

Ben has been designing, deploying, and supporting high-availability enterprise networks for 19 years. He has implemented automation solutions for managing and operating physical and virtual devices within networks. Ben manages INOC’s high-availability infrastructure both in the cloud and data centers.

Let’s Talk NOC

Use the form below to drop us a line. We'll follow up within one business day.

men shaking hands after making a deal