...
Prepare yum repositories on all servers
Prepare yum repositories on all servers for v5.2
...
Upgrade distributed API and DB servers
This section describes the upgrade for a standard API and DB server.
These steps are for a Distributed API Server with the database on the API server.
Abiquo will upgrade to new versions of RabbitMQ and MySQL that require a manual upgrade path of dependencies.
Note |
---|
These steps are for a server that contains RabbitMQ AND MySQL |
Remove the Erlang and Galera packages.
Code Block |
---|
yum remove erlang* galera
yum clean all && yum makecache |
...
Install new RabbitMQ and MariaDB server
Code Block |
---|
yum install rabbitmq-server MariaDB-server |
Before you confirm, check that the packages will be installed from the abiquo-base repository
rabbitmq-server: 3.8.2.1
MariaDB-server: 10.4.10.1
...
Upgrade Abiquo to 5.2.x
Code Block |
---|
yum update |
Before you confirm, check the following packages will be installed from the abiquo-base repository:
jdk: 11.0.6u10
redis: 5.0.7.1
After the update, check versions.
Check that the symbolic link to the latest version of Java points to Java 11 on Monolithic Server or Datanode
Code Block |
---|
# cd /usr/java
# ll
latest -> /usr/java/jdk-11.0.6+10 |
Check that the correct Tomcat version will be used on the Monolithic Server
Code Block |
---|
# cd /opt/abiquo/tomcat/bin
# sh version.sh
Using CATALINA_BASE: /opt/abiquo/tomcat
Using CATALINA_HOME: /opt/abiquo/tomcat
Using CATALINA_TMPDIR: /opt/abiquo/tomcat/temp
Using JRE_HOME: /usr
Using CLASSPATH: /opt/abiquo/tomcat/bin/bootstrap.jar:/opt/abiquo/tomcat/bin/tomcat-juli.jar
NOTE: Picked up JDK_JAVA_OPTIONS: --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED
Server version: Apache Tomcat/9.0.33
Server built: Mar 11 2020 09:31:38 UTC
Server number: 9.0.33.0
OS Name: Linux
OS Version: 3.10.0-1160.15.2.el7.x86_64
Architecture: amd64
JVM Version: 11.0.6+10
JVM Vendor: AdoptOpenJDK |
On the Monolithic Server in the JDK folder, check certificate migration for AM download. The API Server certificate should be listed for Java 11 with its FQDN. You may need to enter the storepass option to supply the password and you can use the alias option to search for the hostname or FQDN of your server
...
Check that you have the repository URL and credentials
To upgrade to a version with a patch number of zero, for example, version 5.2.0
Expand | ||||
---|---|---|---|---|
| ||||
|
OR To upgrade to a version with patch number that is not zero, for example, version 5.2.1, enable both repositories:
Code Block yum-config-manager --enable abiquo-base yum-config-manager --enable abiquo-updates
Optionally add your username and password to the Abiquo repos
Code Block yum-config-manager --save --setopt=abiquo-*.username=MYUSERNAME yum-config-manager --save --setopt=abiquo-*.password=MYPASSWORD
Don't forget to use a backslash to escape any shell special characters. For more details, see https://www.oreilly.com/library/view/learning-the-bash/1565923472/ch01s09.html
Clean yum and make cache
Code Block |
---|
yum clean all && yum makecache |
If you did not make snapshots of all servers already, then do this now
Warning |
---|
Major upgradeThe upgrade to Abiquo 5.2.x is a major upgrade with upgrades of third-party software packages that are critical platform dependencies You must make snapshots of ALL servers before you start the upgrade |
...
Upgrade distributed API and DB servers
This section describes the upgrade for a standard API and DB server.
These steps are for a Distributed API Server with the database on the API server.
Abiquo will upgrade to new versions of RabbitMQ and MySQL that require a manual upgrade path of dependencies.
Note |
---|
These steps are for a server that contains RabbitMQ AND MySQL |
Remove the Erlang and Galera packages.
Code Block yum remove erlang* galera yum clean all && yum makecache
Install new RabbitMQ and MariaDB server
Code Block yum install rabbitmq-server MariaDB-server
Before you confirm, check that the packages will be installed from the abiquo-base repository
rabbitmq-server: 3.8.2.1
MariaDB-server: 10.4.10.1
Upgrade Abiquo to 5.2.x
Code Block yum update
Before you confirm, check the following packages will be installed from the abiquo-base repository:
jdk: 11.0.6u10
redis: 5.0.7.1
After the update, check versions.
Check that the symbolic link to the latest version of Java points to Java 11 on Monolithic Server or Datanode
Code Block # cd /usr/java # ll latest -> /usr/java/jdk-11.0.6+10/lib/security
Check that the correct Tomcat version will be used on the Monolithic Server
Code Block # cd /opt/abiquo/tomcat/bin # keytool -list -keystore cacerts -alias (hostname or fqdn)
For example
Code Block sudo keytool -list -keystore cacerts -alias abiquo.example.com
Enable and start the new services
Code Block systemctl enable mariadb systemctl enable rabbitmq-server systemctl start mariadb systemctl start rabbitmq-server
Upgrade MySQL
Code Block mysql_upgrade
The mysql_upgrade step may detect errors that trigger messages such as the following:
Code Block kinton_accounting.ACCOUNT_PERIOD_USAGE_VW Error : Column count of mysql.proc is wrong. Expected 21, found 20. Created with MariaDB 100129, now running 100410. Please use mysql_upgrade to fix this error
These messages are expected and this same mysql_upgrade process will automatically fix these errors in its next stages.
Check that the mysql_upgrade process completes correctly.
Check that your hostname is in your DNS or in your /etc/hosts file
Retry the above abiquo-db update command.
Upgrade the Abiquo API databases
Code Block |
---|
abiquo-db [-h DB hostname] [-P DB port] [-u user] [-p password] update |
If the liquibase update fails with a message similar to the following:
Code Block |
---|
Liquibase update Failed: Validation Failed:
1 change sets check sum
src/X.X.X-XX/kinton-X.X.X.xml::ABICLOUDPREMIUM-XXXX-XxxxxxxxXXxXxxxxxxXxxxxx::XXXXXXXXX is now: 7:ee2fa6e058ec76c7abf801567898917d
For more information, use the --logLevel flag |
Do the following steps
Clear the database checksums
Code Block |
---|
abiquo-db clearCheckSums |
Change file owners to tomcat user
Code Block |
---|
chown -R tomcat /opt/abiquo |
This section contains an alternative upgrade procedure for standalone Database servers and a Distributed API server without DB
...
title | Click for Upgrade Standalone DB and API servers |
---|
Upgrade standalone database servers
This step is for standalone MariaDB database servers.
Abiquo will upgrade to a new version of MySQL that requires a manual upgrade path of dependencies.
Note |
---|
These steps are for a server that contains MySQL only. If you have a datanode server with RabbitMQ, please follow the steps in the appropriate section above. |
...
Remove the Galera package
Code Block |
---|
yum remove galera
yum clean all && yum makecache |
...
Install new MariaDB server
Code Block |
---|
yum install MariaDB-server |
Before you confirm, check that the packages will be installed from the abiquo-base repository
MariaDB-server: 10.4.10.1
...
Upgrade Abiquo to 5.2.x
Code Block |
---|
yum update |
Before you confirm, check the following packages will be installed from the abiquo-base repository:
jdk: 11.0.6u10
redis: 5.0.7.1
After the update, check versions.
Check that the symbolic link to the latest version of Java points to Java 11
Code Block |
---|
# cd /usr/java
# ll
latest -> /usr/java/jdk-11.0.6+10 |
Enable the services that were reinstalled
Code Block |
---|
systemctl enable mariadb
systemctl start mariadb |
Upgrade MySQL
Code Block |
---|
mysql_upgrade |
The mysql_upgrade step may detect errors that trigger messages such as the following:
...
sh version.sh Using CATALINA_BASE: /opt/abiquo/tomcat Using CATALINA_HOME: /opt/abiquo/tomcat Using CATALINA_TMPDIR: /opt/abiquo/tomcat/temp Using JRE_HOME: /usr Using CLASSPATH: /opt/abiquo/tomcat/bin/bootstrap.jar:/opt/abiquo/tomcat/bin/tomcat-juli.jar NOTE: Picked up JDK_JAVA_OPTIONS: --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED Server version: Apache Tomcat/9.0.33 Server built: Mar 11 2020 09:31:38 UTC Server number: 9.0.33.0 OS Name: Linux OS Version: 3.10.0-1160.15.2.el7.x86_64 Architecture: amd64 JVM Version: 11.0.6+10 JVM Vendor: AdoptOpenJDK
On the Monolithic Server in the JDK folder, check certificate migration for AM download. The API Server certificate should be listed for Java 11 with its FQDN. You may need to enter the storepass option to supply the password and you can use the alias option to search for the hostname or FQDN of your server
Code Block # cd /usr/java/jdk-11.0.6+10/lib/security # keytool -list -keystore cacerts -alias (hostname or fqdn)
For example
Code Block sudo keytool -list -keystore cacerts -alias abiquo.example.com
Enable and start the new services
Code Block systemctl enable mariadb systemctl enable rabbitmq-server systemctl start mariadb systemctl start rabbitmq-server
Upgrade MySQL
Code Block mysql_upgrade
The mysql_upgrade step may detect errors that trigger messages such as the following:
Code Block kinton_accounting.ACCOUNT_PERIOD_USAGE_VW Error : Column count of mysql.proc is wrong. Expected 21, found 20. Created with MariaDB 100129, now running 100410. Please use mysql_upgrade to fix this error
These messages are expected and this same mysql_upgrade process will automatically fix these errors in its next stages.
Check that the mysql_upgrade process completes correctly.
Check that your hostname is in your DNS or in your /etc/hosts file
Upgrade the Abiquo API databases
...
Code Block abiquo-db [-h DB hostname] [-P DB port] [-u user] [-p password] update
If the liquibase update fails with a message similar to the following:
Code Block Liquibase update Failed: Validation Failed: 1 change sets check sum src/X.X.X-XX/kinton-X.X.X.xml::ABICLOUDPREMIUM-XXXX-XxxxxxxxXXxXxxxxxxXxxxxx::XXXXXXXXX is now: 7:ee2fa6e058ec76c7abf801567898917d For more information, use the --logLevel flag
Do the following steps
Clear the database checksums
Code Block abiquo-db clearCheckSums
Retry the above abiquo-db update command.
Change file owners to tomcat user
Code Block chown -R tomcat /opt/abiquo
This section contains an alternative upgrade procedure for standalone Database servers and a Distributed API server without DB
Expand | ||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| distributed API serversThese steps are for an API server in a distributed environment that has a separate database server
| |||||||||||||||||||||||||||||||||||||||
Upgrade standalone database servers This step is for standalone MariaDB database servers. Abiquo will upgrade to a new versions version of RabbitMQ MySQL that require requires a manual upgrade path of dependencies.
Upgrade distributed API servers These steps are for an API server in a distributed environment that has a separate database server. Abiquo will upgrade to new versions of RabbitMQ that require a manual upgrade path of dependencies.
On the API Server, change file permissions so the Abiquo services can run as the tomcat user (not root) and allow access to the configuration files
|
Upgrade remote services servers
These steps are for remote services servers in a distributed or HA environment.
Upgrade EVERY remote services server with these steps.
...
On the remote services servers, upgrade Abiquo to 5.2.x
Code Block |
---|
yum update |
Before you confirm, check the following packages will be installed from the abiquo-base repository:
jdk: 11.0.6u10
redis: 5.0.7.1
After the update, check versions of Java and Tomcat
Check that the symbolic link to the latest version of Java points to Java 11
Code Block |
---|
# cd /usr/java
# ll
latest -> /usr/java/jdk-11.0.6+10 |
Check that the correct Tomcat version will be used
Code Block |
---|
# cd /opt/abiquo/tomcat/bin
# sh version.sh
Using CATALINA_BASE: /opt/abiquo/tomcat
Using CATALINA_HOME: /opt/abiquo/tomcat
Using CATALINA_TMPDIR: /opt/abiquo/tomcat/temp
Using JRE_HOME: /usr
Using CLASSPATH: /opt/abiquo/tomcat/bin/bootstrap.jar:/opt/abiquo/tomcat/bin/tomcat-juli.jar
NOTE: Picked up JDK_JAVA_OPTIONS: --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED
Server version: Apache Tomcat/9.0.33
Server built: Mar 11 2020 09:31:38 UTC
Server number: 9.0.33.0
OS Name: Linux
OS Version: 3.10.0-1160.15.2.el7.x86_64
Architecture: amd64
JVM Version: 11.0.6+10
JVM Vendor: AdoptOpenJDK |
On the remote services server in the JDK folder, check certificate migration to allow AM download
The API server certificate should be listed for Java 11 with its FQDN. You may need to enter the storepass option to supply the password and you can use the alias option to search for the hostname or FQDN of your server
Code Block |
---|
# cd /usr/java/jdk-11.0.6+10/lib/security
# keytool -list -keystore cacerts -alias (hostname or fqdn) |
For example
Code Block |
---|
sudo keytool -list -keystore cacerts -alias abiquo.example.com |
On all remote services servers using SSL
Edit the Tomcat server configuration file:
Code Block |
---|
/opt/abiquo/tomcat/conf/server.xml |
Find the location of the certificate files for Java 8
Code Block |
---|
keystoreFile="/usr/java/default/jre/lib/security/cacerts" |
Change it to the location for Java 11 (e.g. remove "/jre")
Code Block |
---|
keystoreFile="/usr/java/default/lib/security/cacerts" |
On all remote services servers, change file owners to tomcat user
Code Block |
---|
chown -R tomcat /opt/abiquo |
On the remote services with appliance manager and the V2V server (i.e. servers that mount the NFS repository), change file owners to Tomcat user
Code Block |
---|
chown -R tomcat /opt/vm_repository
chmod -R a+r /opt/vm_repository |
Upgrade monitoring server
This step is for Watchtower monitoring servers in all installations.
To continue using Java 8 (for Cassandra), remove the JDK through the package manager. If you use yum, it will be delete all the dependencies and you will have to reinstall them
Code Block |
---|
rpm -e --nodeps jdk |
Check the jdk to install is version 8
Code Block |
---|
rpm -qa | grep jdk |
Check that Java is correctly installed:
If you execute this command and get that error, please execute the command from the next bullet:
Code Block |
---|
$ java
-bash: java: command not found |
Fix it by executing this command, then selecting the option "java-1.8.0-openjdk.x86_64 (/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.292.b10-1.el7_9.x86_64/jre/bin/java)":
Code Block |
---|
$ sudo alternatives --config java
There are 3 programs which provide 'java'.
Selection Command
-----------------------------------------------
1 /usr/java/jdk1.8.0_144/bin/java
+ 2 /usr/java/jdk-11.0.6+10/bin/java
* 3 java-1.8.0-openjdk.x86_64 (/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.292.b10-1.el7_9.x86_64/jre/bin/java)
Enter to keep the current selection[+], or type selection number: 3
|
As for the Abiquo DB steps, remove Galera, which will also remove MariaDB
Code Block |
---|
yum remove galera |
Clean yum and make cache
Code Block |
---|
yum clean all && yum makecache |
Install MariaDB
Code Block |
---|
yum install MariaDB-server |
Update Abiquo
Code Block |
---|
yum update |
Check that the Java package is now "javajdk" to use Java 1.8.0u144 with Cassandra:
Code Block |
---|
# rpm -qa 'javajdk*'
javajdk-1.8.0u144-6691.el7.x86_64 |
...
If you have a HA datanode that runs the watchtower database, skip directly to Step 10 to update watchtower database
Enable and start the services that were reinstalled
Code Block |
---|
systemctl enable mariadb
systemctl start mariadb |
Upgrade MySQL
Code Block |
---|
mysql_upgrade |
The mysql_upgrade step may detect errors that trigger messages such as the following message (note: this example is from the Abiquo database server).
Code Block |
---|
kinton_accounting.ACCOUNT_PERIOD_USAGE_VW Error : Column count of mysql.proc is wrong. Expected 21, found 20. Created with MariaDB 100129, now running 100410. Please use mysql_upgrade to fix this error |
These messages are expected and this same mysql_upgrade process will automatically fix these errors in its next stages.
Check that the mysql_upgrade process completes correctly.
Update the Abiquo Watchtower database
Code Block |
---|
watchtower-db [-h DB hostname] [-P DB port] [-u user] [-p password] update |
Upgrade steps from 4.7.x to 5.0.x
Start with your original version and perform the steps to the final version.
...
title | Click for Upgrade steps from 4.7.x to 5.0.x |
---|
Run Redis database scriptUpgrade steps from 4.7.x to 5.0.x
On each Remote Services server:
Code Block |
---|
# cd /usr/share/doc/abiquo-redis/redis/
# bash ./4.2.3/00-old-vsm-definitions.sh |
Post-upgrade steps:
Change the tutorials' softlinks in the frontend servers. If there is a softlink
/var/www/html/ui/config/tutorials
pointing to/opt/abiquo/config/tutorials
, change it to point to/opt/abiquo/tutorials
instead.If your Apache redirect addresses end in trailing slash characters ("/"), remove the trailing slashes
Upgrade steps from 5.0.x to 5.1.x
Start with your original version and perform the steps to the final version.
...
title | Click for Upgrade steps from 5.0.x to 5.1.x for Veeam |
---|
Run script to update job names on Veeam server
When upgrading from 5.0.x or 5.1.x to 5.1.2 or above, if you are using Veeam, run the following application that will update the job names on the Veeam server to allow duplicate VM names.
The instructions for running the tool are in the following file.
Code Block |
---|
/usr/share/doc/abiquo-model/scripts/veeam-job-modifier/README.md |
To run the tool, do these steps:
Edit the veeam.properties file and set the MySQL jdbc properties. Replace the examples with the values for the Abiquo database
Code Block |
---|
abiquo.database.jdbcurl = jdbc:mysql://abiquoserver.example.com:3306/kinton
abiquo.database.user = mysqlUser
abiquo.database.password = mysqlPassword |
...
Obtain the Veeam version and credentials to pass as arguments to the script
veeam95u4
Run for usage with Veeam server 9.5u4 orveeam10
Run for usage with Veeam server 10-ip
IP address of Veeam server-u, --user
veeamServerUser-p, --password
veeamServerPassword
...
The other argument defines a dry-run mode to test the script
-no-dry, --no-dry-run
If true, update Veeam job names. If false, only show what will the names will look like after the change
Run the tool in dry-run mode (with the argument "--no-dry-run false" and check the Veeam jobs that it will update.
Code Block |
---|
java -jar /usr/share/doc/abiquo-model/scripts/veeam-job-modifier/veeam-job-modifier-jar-with-dependencies.jar veeam10 -ip \ http://veeamserver.example.com:9399/api -u veeamServerUser -p veeamServerPassword -no-dry false |
Run the tool in production mode to update the Veeam server
Code Block |
---|
java -jar /usr/share/doc/abiquo-model/scripts/veeam-job-modifier/veeam-job-modifier-jar-with-dependencies.jar veeam10 -ip \ http://veeamserver.example.com:9399/api -u veeamServerUser -p veeamServerPassword -no-dry true |
...
After you run the tool, edit the veeam.properties file, and remove the temporary properties with the database credentials.
...
title | Click for Upgrade steps from 5.0.x to 5.1.2 or 5.2.x for VM names |
---|
Run mandatory database scripts on Redis database and Watchtower SQL database
When upgrading from any version lower than 5.1.2, do the following steps once (e.g. during upgrade to 5.1.2 OR upgrade to 5.2.x)
On the Abiquo Server, run the following tool that will generate two scripts to run on the Redis database and Watchtower SQL database.
These scripts change the use of the Abiquo VM Identifier (name attribute) as the UID to the ID of the VM as the new UID.
The instructions for running the tool are in the following file:
Code Block |
---|
/usr/share/doc/abiquo-model/scripts/wt-db-redis-db-migration-tool/README.md |
To run the tool and scripts, do these steps:
...
On the Abiquo Server, run the tool to generate the scripts, supplying the database credentials
Code Block |
---|
$ java -jar /usr/share/doc/abiquo-model/scripts/wt-db-redis-db-migration-tool/wtrtool.jar \
--kinton "jdbc:mysql://localhost:3306/kinton?autoReconnect=true&user=mysqlUser&password=mysqlPassword" \
--output . |
You should find the following scripts in the output directory (by default the current directory)
redisdelta, which is Bash script
watchtowerdelta.sql
...
For each Remote Services server, copy the redisdelta Bash script to the server.
On each Remote Services server, run the Bash script. Note that this script requires Bash version 4, which is the default version on Abiquo servers
Code Block |
---|
bash ./redisdelta |
...
Copy the SQL script to the Watchtower Monitoring Server.
Run the SQL script
Code Block |
---|
mysql watchtower < ./watchtowerdelta.sql |
Run Redis database script
On each Remote Services server:
Code Block |
---|
# cd /usr/share/doc/abiquo-redis/redis/
# bash ./4.2.3/00-old-vsm-definitions.sh |
Upgrade steps from 5.1.x to 5.2.x
Start with your original version and perform the steps to the final version.
When upgrading from 5.1.0 or 5.1.1 to 5.1.2 or above, follow the steps from the Upgrade steps from 5.0.x to 5.1.x block.
Expand | |||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| |||||||||||||
Run Redis Script to update Azure VSM subscriptions If you have VMs deployed in Azure, on the Remote Services server, run this script that will use the Redis address and port configured in abiquo.properties. The script will add the VM's Resource Group to the VSM Redis subscription of the VM. We assume that VMs are in the same Resource Group as their virtual datacenter. This is certainly true if the VMs were deployed from Abiquo. In any case, if you previously onboarded a VM in a different RG, the virtual machine definition synchronization process will update it. This script gets the resource group from the VDC provider ID with the format resourceGroup/vdcproviderId, e.g. abiquo-westeurope/abqvnet-vdcname.
|
...
Upgrade remote services servers
These steps are for remote services servers in a distributed or HA environment.
Upgrade EVERY remote services server with these steps.
On the remote services servers, upgrade Abiquo to 5.2.x
Code Block yum update
Before you confirm, check the following packages will be installed from the abiquo-base repository:
jdk: 11.0.6u10
redis: 5.0.7.1
After the update, check versions of Java and Tomcat
Check that the symbolic link to the latest version of Java points to Java 11
Code Block # cd /usr/java # ll latest -> /usr/java/jdk-11.0.6+10
Check that the correct Tomcat version will be used
Code Block # cd /opt/abiquo/tomcat/bin # sh version.sh Using CATALINA_BASE: /opt/abiquo/tomcat Using CATALINA_HOME: /opt/abiquo/tomcat Using CATALINA_TMPDIR: /opt/abiquo/tomcat/temp Using JRE_HOME: /usr Using CLASSPATH: /opt/abiquo/tomcat/bin/bootstrap.jar:/opt/abiquo/tomcat/bin/tomcat-juli.jar NOTE: Picked up JDK_JAVA_OPTIONS: --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED Server version: Apache Tomcat/9.0.33 Server built: Mar 11 2020 09:31:38 UTC Server number: 9.0.33.0 OS Name: Linux OS Version: 3.10.0-1160.15.2.el7.x86_64 Architecture: amd64 JVM Version: 11.0.6+10 JVM Vendor: AdoptOpenJDK
On the remote services server in the JDK folder, check certificate migration to allow AM download
The API server certificate should be listed for Java 11 with its FQDN. You may need to enter the storepass option to supply the password and you can use the alias option to search for the hostname or FQDN of your server
Code Block # cd /usr/java/jdk-11.0.6+10/lib/security # keytool -list -keystore cacerts -alias (hostname or fqdn)
For example
Code Block sudo keytool -list -keystore cacerts -alias abiquo.example.com
On all remote services servers using SSL
Edit the Tomcat server configuration file:
Code Block /opt/abiquo/tomcat/conf/server.xml
Find the location of the certificate files for Java 8
Code Block keystoreFile="/usr/java/default/jre/lib/security/cacerts"
Change it to the location for Java 11 (e.g. remove "/jre")
Code Block keystoreFile="/usr/java/default/lib/security/cacerts"
On all remote services servers, change file owners to tomcat user
Code Block chown -R tomcat /opt/abiquo
On the remote services with appliance manager and the V2V server (i.e. servers that mount the NFS repository), change file owners to Tomcat user
Code Block chown -R tomcat /opt/vm_repository chmod -R a+r /opt/vm_repository
...
Upgrade monitoring server
This step is for Watchtower monitoring servers in all installations.
To continue using Java 8 (for Cassandra), remove the JDK through the package manager. If you use yum, it will be delete all the dependencies and you will have to reinstall them
Code Block rpm -e --nodeps jdk
Check the jdk to install is version 8
Code Block rpm -qa | grep jdk
Check that Java is correctly installed:
If you execute this command and get that error, please execute the command from the next bullet:
Code Block $ java -bash: java: command not found
Fix it by executing this command, then selecting the option "java-1.8.0-openjdk.x86_64 (/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.292.b10-1.el7_9.x86_64/jre/bin/java)":
Code Block $ sudo alternatives --config java There are 3 programs which provide 'java'. Selection Command ----------------------------------------------- 1 /usr/java/jdk1.8.0_144/bin/java + 2 /usr/java/jdk-11.0.6+10/bin/java * 3 java-1.8.0-openjdk.x86_64 (/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.292.b10-1.el7_9.x86_64/jre/bin/java) Enter to keep the current selection[+], or type selection number: 3
As for the Abiquo DB steps, remove Galera, which will also remove MariaDB
Code Block yum remove galera
Clean yum and make cache
Code Block yum clean all && yum makecache
Install MariaDB
Code Block yum install MariaDB-server
Update Abiquo
Code Block yum update
Check that the Java package is now "javajdk" to use Java 1.8.0u144 with Cassandra:
Code Block # rpm -qa 'javajdk*' javajdk-1.8.0u144-6691.el7.x86_64
If you have a HA datanode that runs the watchtower database, skip directly to Step 10 to update watchtower database
Enable and start the services that were reinstalled
Code Block systemctl enable mariadb systemctl start mariadb
Upgrade MySQL
Code Block mysql_upgrade
The mysql_upgrade step may detect errors that trigger messages such as the following message (note: this example is from the Abiquo database server).
Code Block kinton_accounting.ACCOUNT_PERIOD_USAGE_VW Error : Column count of mysql.proc is wrong. Expected 21, found 20. Created with MariaDB 100129, now running 100410. Please use mysql_upgrade to fix this error
These messages are expected and this same mysql_upgrade process will automatically fix these errors in its next stages.
Check that the mysql_upgrade process completes correctly.
Update the Abiquo Watchtower database
Code Block watchtower-db [-h DB hostname] [-P DB port] [-u user] [-p password] update
Edit the file
/opt/kairosdb/conf/kairosdb.properties
to update the name of the following variable and to remove the port from it:Remove the line
kairosdb.datastore.cassandra.host_list=192.168.888.999:9160
.
And add this linekairosdb.datastore.cassandra.cql_host_list=192.168.888.999
.
Please note the newcql_
prefix forhost_list
Add
kairosdb.datastore.cassandra.datapoint_ttl = 15768000
(ref: Internal JIRA SUP-333):
Edit the file
/etc/cassandra/conf/cassandra.yml
OR/etc/cassandra/default.conf/cassandra.yaml
(whichever exists) to remove a variable:Remove the line starting with
kairosdb.datastore.cassandra.datapoint_ttl
and save and close the file.
...
Upgrade steps from 4.7.x to 5.0.x
Start with your original version and perform the steps to the final version.
Expand | ||
---|---|---|
| ||
Run Redis database scriptUpgrade steps from 4.7.x to 5.0.x On each Remote Services server:
Post-upgrade steps:
|
...
Upgrade steps from 5.0.x to 5.1.x
Start with your original version and perform the steps to the final version.
Expand | ||||||
---|---|---|---|---|---|---|
| ||||||
Run script to update job names on Veeam server When upgrading from 5.0.x or 5.1.x to 5.1.2 or above, if you are using Veeam, run the following application that will update the job names on the Veeam server to allow duplicate VM names. The instructions for running the tool are in the following file.
To run the tool, do these steps:
| ||||||
Expand | ||||||
|
Code Block |
---|
<Service name="Catalina">
<Connector
protocol="org.apache.coyote.http11.Http11NioProtocol"
port="8009" maxThreads="200"
scheme="https" secure="true" SSLEnabled="true"
keystoreFile="/opt/abiquo/tomcat/conf/remoters.jks" keystorePass="changeit" keyAlias="myremoters.bcn.abiquo.com"
clientAuth="false" secretRequired="false"
sslProtocol="TLS"/> |
If you have a separate API and UI server, on the API server, edit the server.xml file and allow the AJP connector to listen everywhere, not just on localhost, by setting address="0.0.0.0". Also add secretRequired="false".
Code Block |
---|
<Connector port="8010" protocol="AJP/1.3"
enableLookups="false"
tomcatAuthentication="false"
connectionTimeout="20000"
secretRequired="false"
address="0.0.0.0"
/> |
title | Click for Upgrade steps from 5.1.x to 5.2.x for Redis |
---|
title | Click for Upgrade steps from 5.1.x to 5.2.x for billing dashboards |
---|
Upgrade steps for 5.2 versions
These steps apply to upgrades starting from version 5.2.0 and above.
...
title | Click here to show/hide the steps to upgrade 5.2 versions |
---|
Upgrade steps for 5.2 versions
...
Configure Abiquo after the upgrade
...
Before you start the Abiquo Tomcat server, add Abiquo configuration properties to the abiquo.properties file.
By default the abiquo.properties file is found in the /opt/abiquo/config/ folder.
See Changes to Abiquo configuration properties
Configure the user interface. The default UI location is /var/www/html/ui.
Optional: Add custom labels and translations in the lang_xx_XX_custom.json files in the lang folder
Add custom configuration to client-config-custom.json. See Configure Abiquo UI
If your API is not in the same domain as the UI, set the API endpoint pointing to your Abiquo API server:
Code Block |
---|
{
"config.endpoint": "http://myAPIserver/api"
} |
...
Reporting changes: To upgrade the Abiquo Reports database for the upgrade to Abiquo 4.7.x+, contact Abiquo Support for the file and procedure.
Start Abiquo servers and services
Start Abiquo servers and services
...
|
Expand | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|
| ||||||||||
Run mandatory database scripts on Redis database and Watchtower SQL database When upgrading from any version lower than 5.1.2, do the following steps once (e.g. during upgrade to 5.1.2 OR upgrade to 5.2.x) On the Abiquo Server, run the following tool that will generate two scripts to run on the Redis database and Watchtower SQL database. These scripts change the use of the Abiquo VM Identifier (name attribute) as the UID to the ID of the VM as the new UID. The instructions for running the tool are in the following file:
To run the tool and scripts, do these steps:
Run Redis database script On each Remote Services server:
|
...
Upgrade steps from 5.1.x to 5.2.x
Start with your original version and perform the steps to the final version.
When upgrading from 5.1.0 or 5.1.1 to 5.1.2 or above, follow the steps from the Upgrade steps from 5.0.x to 5.1.x block.
Expand | ||||
---|---|---|---|---|
| ||||
Run Redis Script to update Azure VSM subscriptions If you have VMs deployed in Azure, on the Remote Services server, run this script that will use the Redis address and port configured in abiquo.properties. The script will add the VM's Resource Group to the VSM Redis subscription of the VM. We assume that VMs are in the same Resource Group as their virtual datacenter. This is certainly true if the VMs were deployed from Abiquo. In any case, if you previously onboarded a VM in a different RG, the virtual machine definition synchronization process will update it. This script gets the resource group from the VDC provider ID with the format resourceGroup/vdcproviderId, e.g. abiquo-westeurope/abqvnet-vdcname.
|
Expand | ||||
---|---|---|---|---|
| ||||
Configure HTTPS TLS between Tomcat servers If you are using HTTPS TLS between the Tomcat servers, do these steps. For details of this configuration, see Configure Abiquo Tomcat with HTTPS for Remote RS.
|
Expand | ||
---|---|---|
| ||
Run Redis database script These scripts can always be found on the Abiquo Server. On each Remote Services server (including Monolithic sever) or Datanode server run the Redis scripts.
|
Expand | ||
---|---|---|
| ||
Remove deprecated billing dashboard scripts In Abiquo 5.2, the billing dashboard feature has been integrated into the Abiquo platform. If you were using the billing dashboard in a previous version, do these steps.
|
Upgrade steps for 5.2 versions
These steps apply to upgrades starting from version 5.2.0 and above
Expand | ||
---|---|---|
| ||
|
...
Configure Abiquo after the upgrade
Before you start the Abiquo Tomcat server, add Abiquo configuration properties to the abiquo.properties file.
By default the abiquo.properties file is found in the /opt/abiquo/config/ folder.
See Changes to Abiquo configuration propertiesConfigure the user interface. The default UI location is /var/www/html/ui.
Optional: Add custom labels and translations in the lang_xx_XX_custom.json files in the lang folder
Add custom configuration to client-config-custom.json. See Configure Abiquo UI
If your API is not in the same domain as the UI, set the API endpoint pointing to your Abiquo API server:Code Block { "config.endpoint": "http://myAPIserver/api" }
Reporting changes: To upgrade the Abiquo Reports database for the upgrade to Abiquo 4.7.x+, contact Abiquo Support for the file and procedure.
...
Start Abiquo servers and services
To start the Abiquo platform servers and services, do these steps:
On the Abiquo server, restart the HTTP daemon to refresh the user interface files, and bring up the Tomcat server.
Code Block service httpd start service abiquo-tomcat start
On the Remote services server, start the Tomcat server
Code Block service abiquo-tomcat start
On the Monitoring server do these steps.
Edit the file
/opt/kairosdb/conf/kairosdb.properties
to update the name of the following variable and to remove the port from it:Replace the line
kairosdb.datastore.cassandra.host_list=192.168.888.999:9160
.With this line
kairosdb.datastore.cassandra.cql_host_list=192.168.888.999
. Please note the newcql_
prefix forhost_list
.
Edit the file
/etc/cassandra/conf/cassandra.yml
OR/etc/cassandra/default.conf/cassandra.yaml
(whichever exists) to remove a variable:Remove the line starting with
kairosdb.datastore.cassandra.datapoint_ttl
and save and close the file.
Edit the file
/opt/kairosdb/conf/kairosdb.properties
to add a new variable (ref: Internal JIRA SUP-333):Add
kairosdb.datastore.cassandra.datapoint_ttl = 15768000
On the Monitoring server, start the Cassandra service
Code Block sudo service cassandra start
WAIT about 5 minutes until the service is up and running
Start the KairosDB service
Code Block sudo service kairosdb start
Start the other services in this order
Code Block sudo service abiquo-emmett start sudo service abiquo-delorean start
On the V2V server: restart the Tomcat server:
Code Block service abiquo-tomcat restart
In Abiquo, re-enable the physical machines!
Clear your browser cache to prevent glitches in the UI