Monitoring and Control and Scaling
Control and scaling concepts
Concept | Description |
---|---|
Metric | A built-in metric that is provided by a hypervisor or provider (e.g. CPU usage) or a custom metric that the user creates and populates using API calls |
Alarm | An alarm activates when a metric passes a certain threshold. If you imagine a dashboard for your metrics, alarms are like red lights that light up when conditions change, for example, when there is a problem. See Manage cloud alarms and Infrastructure Alarms |
Alert | An alert enables you to configure notifications or actions from alarms. Alerts are like a worker monitoring a group of alarms; when all the lights for the group are lit up, the alert is activated. Alerts can trigger action plans. |
Action plan | A sequence of actions to perform on entities on the platform, such as VMs or scaling groups. An action plan is run by a trigger. |
Trigger | A trigger is an alert or a schedule that will run the action plan, for example, during times of increased demand. |
Scaling group | For horizontal autoscaling, create a scaling group for a VM with rules to define how the platform should scale it out. You can then include scaling operations in an action plan. |
Vertical scaling | Vertical scaling means scaling up, adding more resources to an existing VM, for example, boosting your CPU and or RAM capacity. |
Horizontal scaling | Horizontal scaling means scaling out, deploying more VMs when you need more resources. |
Manage scaling groups
- Introduction to autoscaling
- Automatically scale VMs
- Define a scaling group
- Configure automatic scaling actions
- Trigger autoscaling
- How the platform scales VMs
- Perform maintenance on a scaling group
- Display scaling actions for a scaling group
- Display metrics for a scaling group
- Add tags to a scaling group
- Move a scaling group to another virtual appliance in the same virtual datacenter
- Restrict a scaling group
- Delete a scaling group
- Manage scaling groups with the API
Introduction to autoscaling
To configure an automatic response to changing demands for resources, you can scale out VMs or scale them in, which is also called horizontal autoscaling. To scale out, the platform clones the base VM and deploys the clones. To scale in, the platform will delete clone VMs and undeploy the base VM. Scaling operations are subject to all standard platform constraints, such as privileges and allocation limits.
Screenshot: A scaling group with VMs deployed automatically.
- Limitations:
- Autoscaling does not clone captured VMs, so to use scaling groups with a captured VM, create an instance and recreate the VM. Create instances to save VM disks to templates
- VApp specs do not support scaling groups. See What do specs save and create
Scaling groups have aggregate alarms that are associated with the base VM. This means that you can push custom metrics for clone VMs but you cannot create alarms for cloned VMs that are part of a scaling group.
- State of base VM: A scaling group with a deployed base VM would be destroyed if the base VM were deleted directly on the hypervisor. In contrast, a scaling group with an undeployed base VM is not vulnerable to interference at the hypervisor level
Automatically scale VMs
The platform enables you to automatically scale out (add more VMs) or scale up (add more resources to existing VMs).
Privilege: Manage scaling groups, Manage workflow for scaling groups
To use autoscaling do these steps:
- Create a base VM, which can be deployed or undeployed
- Configure the VM and enable metrics
- Define a scaling group with rules for scaling the VM.
The checkbox to automatically create a scaling action, will create the following automatically:- Standard alarms and alerts for the selected metrics
- Action plans with scaling actions for the VM and triggers for the action plans, which are monitoring alerts
Related pages:
Define a scaling group
Before you begin:
- Configure the base VM that will be scaled
- Ensure that you have enough resources in your virtual datacenter to deploy up to the maximum number of cloned VMs, especially IP addresses
To create a scaling group:
- Go to Virtual datacenters → Virtual appliances
- On the VM icon, from the options menu, select Define scaling group
- Enter the scaling parameters and rules
- Click Save
For more details see GUI Define scaling group
When you save the scaling group, Abiquo will mark the VM icon with the scaling group symbol and display the scaling group name.
- When the scaling group leaves maintenance mode, Abiquo will create clones of the base VM and deploy them to reach the minimum size.
- The number in the bottom right-hand corner of the icon is the number of running VMs in the scaling group, including the base VM.
To open the scaling group and check its parameters, click the scaling group symbol at the top of the VM icon.
Configure automatic scaling actions
To configure automatic scaling actions:
- When you define a scaling group, select Create autoscaling action and Save the scaling group
- In the dialog, select a Metric to control an autoscaling action
- To configure more options, including the thresholds for scaling in and scaling out, click Show more
- To add this action, click Add
- Add more actions as required
The platform will automatically create the alarms, alerts, and action plan to automatically scale in or out according to your thresholds.
Trigger autoscaling
Before you begin:
- Create a VM and a scaling group for the VM. See Define a scaling group
- If you create an automatic scaling action, then the VM metrics will trigger autoscaling when they cross the thresholds set for the actions
To enable autoscaling operations to run:
- Create an action plan with a scaling action for the VM with the scaling group. See Create an action plan to automate VM actions
- Create triggers to run the action plan. See Create a trigger for an action plan
When scaling, the platform will search for a scaling rule that is valid for the specific time range, or for a default rule. It will create or delete/undeploy the number of VMs in the rule, then wait for the cooldown period before accepting another scaling request.
How the platform scales VMs
To scale out, the platform does not deploy VMs that are undeployed in the scaling group. To clone the base VM, the platform will do the following:
- Create disks using the following:
- Copies of content of disks from the VM template
- Empty disks or volumes for each additional disk used in the VM
- Disk controllers used in the VM
- Apply ALL configuration used in the VM, for example:
- CPU and RAM
- Network connections of the same type (e.g. private network)
- Assignment of firewall policies and attachment to load balancers
- Chef recipes, backups, cloud-init, variables, and so on
- Metrics. The group of metrics from clone VMs and the base VM (if it is deployed) can activate alarms in the base VM, even if it is not deployed
- Exception – Alarms: the scaling group has only one set of alarms in the base VM
To scale in, Abiquo currently selects the VMs to delete or undeploy using first in, first out (FIFO). The platform deletes and undeploys VMs without requesting user confirmation when there are disks that are not stored in the Apps library (ISO configuration drive or additional hard disk).
Perform maintenance on a scaling group
To make changes to your VMs in a scaling group (manually deploy, undeploy, delete, etc.) and edit the scaling group, put it into maintenance mode, which will disable autoscaling.
When you leave maintenance mode, the platform will apply your modifications to the scaling group, e.g. adding new rules. Then the platform will adjust the number of VMs in the group to within the minimum and maximum size range.
To put the scaling group in maintenance mode:
- Go to Virtual datacenters → Virtual appliances → select VM
- At the bottom of the VM icon, click the cog maintenance symbol at the bottom of the VM icon
OR if the scaling group is open, click the spanner maintenance symbol in the top right corner
To leave maintenance mode
- Click a maintenance button
To automatically manage maintenance mode
- Trigger action plans with the action "Scaling group: start maintenance mode" or "Scaling group: end maintenance mode".
To delete the base VM, you must delete the scaling group first.
Display scaling actions for a scaling group
To display scaling actions of a scaling group:
- Go to Virtual datacenters → Virtual appliances → open virtual appliance
- If the scaling group is not in maintenance mode, click the cog maintenance symbol
- Edit the scaling group and go to Autoscaling actions
- To show or hide more details of a scaling action, click Show more or Show less
You can also display all the elements created for the automatic scaling action in the relevant sections of the UI, such as the Alarms tab, and the Control view.
Display metrics for a scaling group
Abiquo can display custom metrics for your scaling groups and built-in metrics for the VMs in the scaling group.
Scaling groups also have built-in metrics that are a composite of the VM metrics, and which have the same names as the VM metrics. The Abiquo UI does not display the built-in scaling group metrics but you can access them through the Abiquo API.
To display metrics for a scaling group:
- On the Scaling group icon, click the Monitoring symbol in the top right-hand corner
OR Open a Scaling group and click the Monitoring symbol - Select the Scaling group or Virtual machines page
You can configure the display of metrics at this level.
- To filter metric statistics, click on the Filter button and select the granularity, statistic, time frame, and dimension, as required.
Add tags to a scaling group
To manage tags for a scaling group:
- Go to Virtual appliances → Virtual machines
- Select a scaling group and put it into maintenance mode
- Open and edit the scaling group → Tags
- Add tags
For more details see GUI Edit template Tags
Move a scaling group to another virtual appliance in the same virtual datacenter
To move a scaling group to another virtual appliance in the same virtual datacenter:
- Put the scaling group in maintenance mode
- Click the Move button
- Select the new virtual appliance
Restrict a scaling group
To move a scaling group to a restricted virtual appliance, do these steps:
- Click the cog or wrench maintenance symbol to put the scaling group into maintenance mode
- Click the cross arrows move button
- Select the checkbox to Move to a restricted virtual appliance, or
Select a restricted virtual appliance, or
Create a new VApp and select the Restrict virtual appliance checkbox
Delete a scaling group
When you delete a scaling group, the platform will place all the VMs in the virtual appliance as regular VMs and the scaling group constraints will no longer exist.
To delete a scaling group:
- Go to Virtual datacenters → Virtual appliances
- Open the scaling group
- Click the wrench maintenance button to put the scaling group into maintenance mode
- Click the trash can delete button
Manage scaling groups with the API
API Documentation
For the Abiquo API documentation of this feature, see Abiquo API Resources and the page for this resource ScalingGroupsResource.
Manage alerts
Introduction to Alerts
Alerts are a group of one or more alarms. An alert can notify the user when it activates and it can also trigger action plans. An alert activates when all its alarms are activated. An alarm activates when a metric passes a certain threshold.
If you imagine a dashboard for your metrics, alarms are like red lights that light up when conditions change, for example, when there is a problem. Alerts are like a worker monitoring a group of alarms; when all the lights for the group are lit up, then the worker takes action and activates the alert.
Display Alerts
To display and manage alerts:
- Go to Control → Alerts
Create Alerts and Alarms
An alert will trigger when all its alarms are activated. You can use the alert to trigger actions. See Manage Action Plans.
Privilege: Access alerts section, Manage alerts
Before you begin:
- Retrieve VM built-in metrics, by editing VMs and enabling monitoring (see VM monitoring and metrics) or create custom metrics
- Create one or more metric alarms (see Manage cloud alarms and Infrastructure Alarms). You cannot save an alert without an alarm
To create an alert:
- Go to Control → Alerts
- Click the + add button
Enter the alert details and assign alarms as described below
Click Save
For more details see GUI Create alert General information
Click the + add button to assign alarms to the alert.
You must assign at least one alarm to be able to save the alert. Select an existing alarm, or create a new alarm, and assign it to the alert. Repeat for the required alarms
You can filter the Alarms list by Metric and also if the alarm is Active or not.
Remove alarms from alerts
You can delete any alarm at any time, even if it is part of one or more alerts. The platform will not warn you that the alarm is used in an alert. However, you can check this in Control view. After you delete an alarm, you cannot recover it.
You can also remove an alarm from an alert.
Privilege: Access alarms section, Manage alarms, Manage alerts
To delete an alarm:
- Go to Virtual datacenters or Infrastructure → Alarms
- Select the alarm and delete it by clicking on the trash bin delete button
To remove an alarm from an alert:
Go to Control → Alerts → edit alert
Select the alarm, click the trash bin delete button, and confirm
The platform will remove it from this alert, but it will remain in all other alerts that it is associated with
If you delete a VM, the platform will delete any alarms associated with its metrics.
Manage action plans
Introduction to Action plans
To enable more control over cloud operations, users can create action plans that will automatically run tasks on VMs and scaling groups, and to run general tasks.
Action plans are an important automation functionality of the platform. They can combine general tasks with tasks that run on VMs and scaling groups in different providers and have multiple triggers including alerts from custom metrics or built-in metrics and schedules. Each VM or scaling group can have multiple action plans.
Display action plans
To display action plans:
- Go to Control → Action plans
Create an action plan
Before you create an action plan, consider the elements that you wish to automate with the action plan. Create VMs or scaling groups, fetch metrics, and create alarms and alerts.
To create an action plan:
- Go to Control → Action plans, and click the + add button
- Enter the action plan details
- Go to Actions to add actions:
- Click the + add button
- Enter action details
- Type: Select a general action or select a VM or scaling group
- Decrease CPU/RAM: you cannot use this with hot-reconfigure and you must check that the OS is compatible
Instance: Name for Instance (clone) template. The platform will append the date to the name supplied
- Webhook action - Expected HTTP status code: If this status code is returned, continue running the action plan. Default: 204 No Content
Email action - To, CC: Enter email addresses as a comma separated list
- Put the actions in run order using the arrow buttons
To run the action plan automatically, go to the Triggers tab and create an alert or schedule trigger.
When you create actions on VMs also consider the following constraints.
- User constraints: e.g. allocation limits
- Platform constraints: e.g. to create an instance, the VM must be deployed and powered off
- Hypervisor constraints: e.g. when using hot reconfigure on ESXi, you cannot decrement CPU or RAM
For the API, note that you can request the JSON schema for each action plan entry type from the API.
See: https://wiki.abiquo.com/api/latest/ActionPlansResource.html#list-action-plan-entry-templates
Run an action plan now
To run an action plan immediately to test it, do these steps:
- Go to Control → Action plans
- Select the action plan
- On the Actions panel, click the Run action plan button
Abiquo recommends that you run an action plan manually to test it before you create a trigger to run it automatically
Create a trigger for an action plan
The platform supports two types of triggers to run action plans: Alerts and Schedules.
To run your action plan based on metrics, select an existing alert with these steps:
- Go to Control → Action plans
- Select an action plan
- Below the Alerts panel, click the + add button
- Select an alert. For details about creating an alert, see Manage Alerts
To run your action plan automatically at selected dates and times, create a schedule trigger with these steps:
- Go to Control → Action plans
- Select an action plan
- Below the Schedules panel, click the + add button
- Enter the details of the schedule using the calendar or time and repeat interval.
For more details see GUI Edit action plan Schedules
Delete an action plan
If you delete an action plan, Abiquo will also delete the schedule associated with that action plan.
Copyright © 2006-2022, Abiquo Holdings SL. All rights reserved