How to try out nested-pods locally (VLAN + trunk)

How to try out nested-pods locally (VLAN + trunk)

Following are the instructions for an all-in-one setup where K8s will also be running inside the same Nova VM in which Kuryr-controller and Kuryr-cni will be running. 4GB memory and 2 vCPUs, is the minimum resource requirement for the VM:

  1. To install OpenStack services run devstack with devstack/local.conf.pod-in-vm.undercloud.sample. Ensure that “trunk” service plugin is enabled in /etc/neutron/neutron.conf:

    [DEFAULT]
    service_plugins = neutron.services.l3_router.l3_router_plugin.L3RouterPlugin,neutron.services.trunk.plugin.TrunkPlugin
    
  2. Launch a VM with Neutron trunk port.. The next steps can be followed: Boot VM with a Trunk Port.

  1. Inside VM, install and setup Kubernetes along with Kuryr using devstack:
    • Since undercloud Neutron will be used by pods, Neutron services should be disabled in localrc.

    • Run devstack with devstack/local.conf.pod-in-vm.overcloud.sample. but first fill in the needed information:

      • Point to the undercloud deployment by setting:

        SERVICE_HOST=UNDERCLOUD_CONTROLLER_IP
        
      • Fill in the subnetpool id of the undercloud deployment, as well as the router where the new pod and service networks need to be connected:

        KURYR_NEUTRON_DEFAULT_SUBNETPOOL_ID=UNDERCLOUD_SUBNETPOOL_V4_ID
        KURYR_NEUTRON_DEFAULT_ROUTER=router1
        
  2. Once devstack is done and all services are up inside VM. Next steps are to configure the missing information at /etc/kuryr/kuryr.conf:

    • Configure worker VMs subnet:

      [pod_vif_nested]
      worker_nodes_subnet = <UNDERCLOUD_SUBNET_WORKER_NODES_UUID>
      
    • Configure “pod_vif_driver” as “nested-vlan”:

      [kubernetes]
      pod_vif_driver = nested-vlan
      
    • Configure binding section:

      [binding]
      driver = kuryr.lib.binding.drivers.vlan
      link_iface = <VM interface name eg. eth0>
      
    • Restart kuryr-k8s-controller:

      sudo systemctl restart devstack@kuryr-kubernetes.service
      

Now launch pods using kubectl, Undercloud Neutron will serve the networking.

Creative Commons Attribution 3.0 License

Except where otherwise noted, this document is licensed under Creative Commons Attribution 3.0 License. See all OpenStack Legal Documents.