Preparing the Cluster

Configure Mayastor Nodes

In the context of the Mayastor application, a "Mayastor Node" (MSN) is a Kubernetes worker node on which is scheduled an instance of a Mayastor data plane pod and is thus capable of hosting storage "pools" and exporting Persistent Volumes (PV) to application pods within the cluster. A MSN makes use of block storage device(s) attached to it to contribute storage capacity to its pool(s), which supply backing storage for the Persistent Volumes provisioned on the parent cluster by Mayastor.
Kubernetes worker nodes are not required to be MSNs in order to be able to mount Mayastor-provisioned Persistent Volumes for the application pods scheduled on them. New MSN nodes can be provisioned within the cluster at any time after the initial deployment, as aggregate demands for capacity, performance and availability levels increase.

Verify / Enable Huge Page Support

2MiB-sized Huge Pages must be supported and enabled on a MSN. A minimum number of 1024 such pages (i.e. 2GiB total) must be available on each node, which should be verified thus:
1
grep HugePages /proc/meminfo
2
3
AnonHugePages: 0 kB
4
ShmemHugePages: 0 kB
5
HugePages_Total: 1024
6
HugePages_Free: 671
7
HugePages_Rsvd: 0
8
HugePages_Surp: 0
Copied!
If fewer than 1024 pages are available then the page count should be reconfigured as required, accounting for any other workloads which may be co-resident on the worker node and which also require them. For example:
1
echo 1024 | sudo tee /sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages
Copied!
This change should also be made persistent across reboots by adding the required value to the file/etc/sysctl.conf like so:
1
echo vm.nr_hugepages = 1024 | sudo tee -a /etc/sysctl.conf
Copied!
If you modify the Huge Page configuration of a node, you must either restart kubelet or reboot the node. Mayastor will not deploy correctly if the available Huge Page count as reported by the node's kubelet instance does not satisfy the minimum requirements.

Label Mayastor Node Candidates

All worker nodes which will have Mayastor pods running on them must be labelled with the OpenEBS engine type "mayastor". This label will be used as a selector by the Mayastor Daemonset, which is deployed as a part of Mayastor data plane component installation. To add this label to a node, execute:
1
kubectl label node <node_name> openebs.io/engine=mayastor
Copied!