Release notes for Abiquo 6.0

16168

XaaS

XaaS required for first version

15999

Tags

TAG Management Phase 2

15867

Technical

UI Optimizations

15479

VMware

Snapshot feature

15390

Tags

Tag policies management

14821

XaaS

XAS required to enter in master

16289

Catalogue

Implement Bootstrap script at template level

Ticket: 7472

16280

Technical

Jenkinsfile should not reference other branches

16235

Azure

Private IPs attached to vNIC should not be shown as not used

Ticket: 7441

16187

Google

User interface - Add Purpose field to global subnets

16164

Technical

Remove deprecated code (Template 3.2)

16162

Azure

NSG firewall supports rules with IP addresses/CIDR ranges

16158

Technical

Remove Abiquo HA from UI

16157

Technical

Docker remove code

16145

Public cloud

Public provider instance: create image with instance name (OCI, Amazon)

16142

Amazon

Billing Cannot connect to an S3 bucket in a region other than us-east-1 in a predictable way
New required enterprise property for resellers and standard accounts: amazon_bucket_region.
The value is the code for the AWS region where the billing bucket is located (for example, us-east-1)

Ticket: 7369

16127

Rubrik

Rubrik vCenter properties. See Configure Rubrik backup plugin

5.4.4

16096

VCD

Add support for vCloud Director Upgrade to version 10.3

5.4.4
Ticket: 7355

16089

Technical

Remove mandatory AbstractDatacenter on AsyncTask creation

16088

Public cloud

RG logical delete empty hierarchy (OCI, Azure)

16079

Customer
integration

Use Feign default client instead of ApacheHttpClient

16077

VMware

Add UI snapshot Widget

16046

Google

Default firewall for VDC attribute in Global firewalls

16029

Technical

Update user interface for internal changes to hardware profiles family/type views

16027

User interface

Add a Refresh button to the UI

16018

Tags

Simplify entity search by tag

16007

VCD 

Add tag support to vcloud

16005

Automation

Allow action plan entries to be dynamically configured by tags

15988

Azure

VMs created from disk from snapshot template are not synchronized

5.4.3

15979

Technical

Update spotbugs/PMD/errorprone

15937

Hardware profiles

Move provider from hardware_profile_type to hardware_profile_family

15931

OCI

OCI instance (template)

15928

User interface

Adapt UI for OCI load balancer with required target groups belonging to LBs

15910

OCI

Onboard Defined tags as read-only resource tags

15905

Google

Filter templates with name contains text string

15836

Technical

Review Apache Tomcat JDBC Connection Pool configuration

15641

OCI

OCI VM cloud init/variables

15498

Customer
integration

Create account

15444

OCI

OCI load balancer

15072

Documentation

Add wiki links for 6.0

15071

Documentation

Remove provider names from abiquo-properties file

14896

User interface 

Exciting new Monitoring UX improvements

14698

Google 

API Logical delete with subnets/global network

14641

Google

Google tags

14547

Billing

Delete cost usage before billing records insertion

5.4.3
Tickets: 7350, 7372

14407

Google 

Clone VM with subnets

14395

Automation

Add trace and / or event when scaling rules have reached end time

14121

Users

Allow user with the appropriate privilege to modify their own allowed CIDRs

13793

SAML

Require configuration of MaxAuthenticationAge on Spring SAML using a property

New required property abiquo.saml.authentication.maxage. If you do not add this property, SAML will not start

Ticket: 6726

13748

XaaS 

Microsoft CSP: Office 365

13729

XaaS 

AWS:Route 53

13709

Google 

Load balancer internal/external

13593

Technical

configure OWASP maven plugin to check vulnerable dependencies

13379

Rubrik

Detect Backup policy changes in Rubrik.
Optional abiquo.backup.policy.sync.delay property to set on the Abiquo Server in abiquo.properties.
Specify, in milliseconds, how often to run the backup policy synchronization. The default value represents 24 hours. 

16344

Pricing

Cannot create a new pricing model from an enterprise with an existing pricing model

16290

Veeam

Veeam check if Backup session is from Abiquo

5.4.6
Ticket: 7400

16279

vCenter

Error capturing VM with uppercase disk extension

Ticket: 7440

16269

Billing

Billing job fails and stays in Initial status if enterprise properties are missing

16231

vCenter

vCenter cluster deployment can fail due to standalone ESXi

Ticket: 7446

16218

OCI

OCI sync RG fails with user restricted compartment

16213

VCD

vCloud does not import external IP assigned to a VM

5.2.5, 5.4.5
Ticket: 7398

16210

VCD

Cannot import orgVdc when using external networks with less than 'abiquo.vcd.reserved-ips' (20) IPs

5.2.5, 5.4.5

16207

VCD

Take instance in a virtualdatacenter with multiple VMs creates a temporary vApp that is not deleted

5.2.5, 5.4.5

16151

SAML

Cannot login with basic auth use - after SAML login completed

5.4.4

16092

VM

VM event is appearing in wrong VM when renaming-vm fails

Ticket: 7370

16091

Pricing

Pricing template - Wrong validation related to VM prices

16085

Pricing

Enterprise associations button does not associate / disassociate pricing models

16054

Azure

Firewalls with option all traffic is not correctly created

16032

Azure

VM without template using dummy template cannot be reconfigured

5.4.3

15949

User interface

Reopening create public IP does not refresh form type (full/reduced)

15943

Google

Global firewall unmaterialized tags not working

15939

Billing

Estimated Widget prints NaN when there is nothing created

15894

Google

Create more than one autogenerated subnet IP throws VLAN-57 error

15891

Public cloud

Adding two credentials at same time fails with 500 ERROR

15888

User interface

Extend monitoring client UI property to vapp monitoring button

Ticket: 7280 

15755

Google

GCP Error assigning FW in configure if is GN autocreated FW

15481

Public cloud

Improve error message when validating public cloud credentials

15476

Azure

Regular user should not see Address ranges option by default (Unauthorized error)

14621

Technical

Setting provider ID when deploysOwner is true at ResponseListener can end in an inconsistent job state

14448

User interface

Column sorting in License view does not work

5.4.2
Ticket: 7331

14105

Documentation

In API examples, the format of header is not valid for copy and paste to bash shell

Ticket: 7237 

13359

Public cloud

Unexpected error deleting PCR with backup policy

12624

Private cloud

Improve error message when maximum VLAN TAG is exceeded when deploying a VM in a new VDC

Tickets: 6212, 7155

12541

Technical

Use Stream instead of Iterable in the lists

10591

Technical

Persistent VM not refreshing

6268

Technical

Badly written error trying failing to unsubscribe a Virtual Machine

12593

Cost codes

Allow multiple cost codes and VM costcodes

14152

GCP

In Google Cloud Platform add support for custom hardware profiles

16517

Billing

Add multiple cost codes to current Abiquo Billing

16491

Private cloud

Cloud init network injection is not working for ubuntu-18 templates

7550

16370

Private cloud

Return datastore even if a host does not have it mounted correctly

7496

16332

NSX-T

Check NSX-T 3.1.3 version compatibility

16239

UI

Add Load Balancing at global level

15659

Billing

Check AWS subscriptions and costs of the Abiquo environment

7199

16612

Billing

Add more detail to usage type

16514

Hardware profiles

Review hardware profile values for dynamic that are set from template

16473

Hardware profiles

Increase/decrease hardware profile for dynamic

16469

Billing

Align Abiquo billing version with platform

16448

Private cloud

Incorrect assignment and creation of IPs in external network. See Changes to external IP management in Abiquo 6.0.1

16445

Billing

Adapt customer billing integration to API/dashboard for all private cloud providers

16404

Billing

Exclude Office products from Azure billing

16382

OCI

OCI: restricted user with cost usage policy cannot add pricing credentials

16381

Cost codes

Add new cost code endpoints to list cost code from an entity

16372

UI

Improve cost code VM layout

16371

UI

Add description column to cost codes tab at Edit VM

16365

Billing

Remove Azure plans check tool

16358

Events

Add task URI on events. Note change to the event entity and streaming API

16357

Azure

Modify behavior of marketplace products

16313

Amazon

Reserved tags can be synchronized only. User should not be allowed to edit these tags

16307

Events

VM change state error event doesn't show plugin error

16292

Veeam

Veeam Backup results drop BackupJobSession call

16259

Billing

AWS check tool now included in public-cloud-billing-check-tool

16234

UI

Allow disk with size 0 for some providers: in Azure obtain provider disk size on deploy

16228

GCP

Review whether subnet IP and FW rules edition are supported after upgrading BOM

16227

GCP

GCP addresses are not returning purpose. GCP API issue was resolved by GCP

16221

GCP

Update GCP hardware profile types:

• Added series(hardware profile types):
  Tau T2D(family: general purpose)
  C2D (family: compute optimized)
  A2 (family: accelerated computing)

• Also added f1-micro, g1-small to N1 series.

16090

Events

Abstract datastore tier limits - soft limits exceeded details are not displayed on Events tab

15984

Private cloud

Check that new MAC is not repeated and that it is correct. Validate manual user network data entry

15892

Hardware profiles

For dynamic hardware profiles, resolve display and increase/decrease functionality

15439

UI

Add "Generate billing" button to "Edit credentials"

15070

Azure

Review VPC class exception

14969

Technical

Remove Guava functional utilities from monitor service

14561

Technical

Change Async task enterprise to nullable (also review abstract datacenter)

14322

Azure

Azure should not use shorter provider ID

14157

Veeam

Log returns a NullPointerException when requesting a restore

11399

Pricing

Improve pricing template editing

16602

OCI

List not accessible in compartments

16596

Guest setup

VM is not able to get IP from the DHCP (if not using NAT)

16594

Private cloud

Update description of plugin metadata override property for disk controllers

16587

Rubrik

Allow Rubrik billing to work with captured organizations in VCD

16578

Technical

Memory leak with large pools in NARS and XAS. Resolved by updating Akka

16576

Guest setup

Guest initial password API is not working as expected. Resolved by waiting with a timeout and throwing an error if it doesn't complete with success.

16574

Guest setup

Guest initial password is only able to change root password. Resolved allowing sudoer users except root to set a password.

7585

16573

Technical

Two ValidatorFactorys are created every time we call validate(foo) from a service

16570

Guest setup

VM delete rollback is failing when a wrong password is set in guest-initial-password

16564

Guest setup

Cloud-init network injection is not working when DHCP or NSX-T. Enable DHCP broadcast request in Distributed Firewall (DFW in NSX-T: security/east-west firewall). Set the following Abiquo property to enable Tier1 DFW configuration to allow DHCP traffic from these services. Set to an empty list to disable DHCP. #abiquo.nsxt.dhcp.services=DHCP-Client,DHCP-Server,DHCPv6_Client,DHCPv6_Server

7562

16549

Technical

XAS and NARS may reach a limit creating channels. This can cause the async response to be lost (task is never completed)

16529

Billing

Last bills providers list is not correctly set from the client custom JSON file

7466

16526

Guest setup

Cloud-init network injection fails due to 'ipv4dhcp' keyword instead of ‘ipv4_dhcp’ in '50-cloud-init' file

7562

16525

Technical

Action plans should not execute reconfigure actions for NOT_DEPLOYED VMs. For example, ti is not necessary to lock a VM that is not allocated in order to make changes.

16513

Technical

Fix SpotBugs AMServiceStub.class NP_OPTIONAL_RETURN_NULL

16496

UI

IPv6 addresses do not fit in the field when editing a VM

16482

Upgrade

Abiquo database update to 6.0.0 fails if some roles are not present

7510

16474

Technical

Firewall could be duplicated in database if async and sync tasks are combined

16472

Private cloud

Changes of RAM are detected even when there are no changes in sync

16463

XaaS

Failed to publish mechanism doesn't work for xas.war

16458

OCI

Cannot update OCI load balancer conditional action target in UI

16457

UI

OCI load balancer should only show target groups of the same load balancer in UI

16456

UI

Wrong algorithms for OCI network load balancer

16451

GCP

Global firewalls are not updating all fields in sync

16449

UI

Minor lang_en_US_labels.json fixes to labels in Spanish version of UI

16414

Technical

Occasionally deploy fails due to AlreadyExist creating the destination folder. Retry before failing

16413

GCP

Sync fails if there are any VMs without a supported configuration that would not usually be imported (e.g. legacy VM with no subnet IP)

16410

Private cloud

Unexpected error when editing an external network from vCenter

16408

UI

When creating an OCI target group from the VDC screen, there is no Response body field

16407

OCI

Routing rule types persist in UI after changing load balancer type

16373

Ui

Bad page indicator when listing VMs from server in Infrastructure view

16350

Public cloud

Deleting the health check from an Azure load balancer and creating a new one causes an error

16306

Billing

AWS returns more than one billing period for same dates and account ID

7416

16304

Veeam

Veeam cache properties file should be updated

16291

Veeam

Check if Backup result contains VirtualMachineIdentifier

16266

Azure

Some templates are listed but not found when you try to import them

16223

Private cloud

CPU/RAM used in host/cluster state increases when retrieving VMs from managed datastores

7444

16120

Snapshot

Reverting to snapshot with different IP does not update IP at ABQ (e.g. snapshot does not have IP on NSX-T device). User should open a console on the VM and renew the IP

15932

Technical

Possible NPE parsing hypervisor.model.provider firewall rule to server.core.cloud

15140

Azure

Sometimes LBs are not properly deleted

14596

User interface

Internal server error setting enterprise property (changing uppercase and lowercase) before closing form

14166

Backup

Backup policy: once created, the description cannot be left empty

13773

Backup

Backup action is pending forever after configuration is removed

13600

Azure

Cannot deploy VM using third party template from the marketplace

13506

Technical

Increase kinton.rasd.instanceID and ip_pool_management.ip field size

13499

VCD

Unexpected error when synchronizing load balancer without default pool on virtual server

13341

Public cloud

VM variables don't work with Windows VMs. Create documentation that describes how to create VM templates for guest setup.

13304

Amazon

Cannot create VApp from spec with load balancer in AWS

12467

Technical

Delete all dcLimits cannot delete the provider limits

11392

Technical

Bad method signature in Vpc#deleteVPC

16693

Azure billing

Billing does not generate previous month data if no consolidated bill is present

16689

Azure Billing

Exclude Azure billing entries by Product ID.
On the Remote Services server, set the abiquo.azure.billing.parser.lineitem.productid.ignore.path property to define a path to a file that contains a list of all the products to ignore. The file is a CSV file with one column (so it is a list of items on separate lines and it contains no commas).

16667

Billing check tool

Allow billing check tool to check keynode enterprises too in AWS.
New AWS option: -r, --rootEnterpriseId to specify reseller or keynode for pricing credentials. This replaces the previous reseller option
See Public cloud billing check tool

16554

Billing check tool

Billing check tool should use platform seed file

16641

VCD

Error onboarding users when there are two vCloud Directors at the same time.
Now when the enterprise already exists, use it again instead of failing.

Ticket: 7598

16628

Billing check tool

Billing check tool does not take into account an AWS SPP discount.
New AWS option: -spp, --sppDiscount to include the solution provider program discount.
See Public cloud billing check tool

16625

Azure Billing

Azure reserved instance prefixes are not applied to customers with RIs without billing scope

16787

Authentication

Allow LDAP and Abiquo authentication. The following properties should be set on the Abiquo Server:

abiquo.auth.module=ldap
abiquo.ldap.mode=multi

See LDAP and Active Directory integration where there is a new section about how to use LDAP and basic authentication at the same time.

16786

Azure billing

Remove Azure’s commas from the Service attribute for Reserved instances!

16775

Private cloud

Avoid HEAD requests to datastore ISO files during 'getVirtualMachines' to retrieve VMs from hypervisor.
To set size of ISO disks to 0, use the com.abiquo.esxi.discovery.isoSizeSkip property on the Remote services server.

16759

Private cloud

Allow DNS configuration of Linux hosts using ESXi for guest setup without DHCP/NSX-T.
This configuration is a global DNS setting for the VM that includes the DNS servers from the networks of the VM NICs.

7659

16749

Backup

Billing backup results tool. You can use this tool to add backup results to your cloud bills. See /wiki/spaces/doctest/pages/341573671

16626

FinOps

Update privileges for multiple cost codes to remove previous privilege and add 3 new ones
In the user interface, the cost codes feature has been renamed to extra charges!
See Changes to privileges and Multiple cost codes

7672

16772

Private cloud

Uploading template with specific name in ISO/DISK fails

7635

16771

Private cloud

While retrieving VMs from a hypervisor, LOCK them so that periodic VM definition sync does not update them

16769

Veeam

Abiquo does not receive backup results when there are a large number of backup jobs

16757

FinOps

Make costcodes request only if user has the appropriate cost codes privilege

7672

16712

Snapshot

Make snapshot request only if user has the appropriate manage snapshot privilege

7657

16846

Public cloud billing

Split billing files by reseller

16847

User interface

Confirmation dialog for resetting a VM

16831

NSX-T

Allow multiple values when allowing NSX-T DNAT by using Abiquo property.
You can now set the property value to multiple IPs/CIDRs or a single NSX-T group that already exists.

16874

Technical

Mechanism to finish AsyncJob on AsyncTaskCallback database errors

16391

NSX-T

Rename the abiquo.nsxt.infra.tier0-external-ip property to abiquo.nsxt.infra.tier0-allowed-gateways.

Allow traffic from the Tier-0 physical network through this entry point.
List of IPs or CIDRs in CSV format, or the name of a single NSX-T group that already exists.
In Abiquo 6.0.4, the group name cannot contain special characters such as a colon (“:”).
We changed this property because In the Tier-0 infrastructure outside the VDC, there could be something like a "cluster of gateways".
If a gateway goes down, then BGP will use another gateway.

16819

User interface

On the entity monitoring widget, the user cannot edit the metric

16815

User interface

VM metrics view shows more metrics than selected

16814

User interface

Loading UI to dashboard sometimes takes identerprise as undefined

7706

16807

API documentation

API changelog not updated in wiki

16805

Technical

UI Version is wrong in the generated packages

16803

User interface

Multiple Entity monitoring widgets are not supported

7694

16802

User interface

Entity monitoring widget stays in loading state

7694

16867

Billing

CDR generator is using wrong procedure to compare with reseller

16892

User interface

Enterprise properties are limited to 50 characters

16885

NSX-T

SNAT firewall rule 72.16.0.0/12 is not a private range (172.16.0.0/12)

16870

NSX-T

Tier-1 should not announce all the connected segments

16863

NSX-T

The group “Allow private LBs on segments of Tier-1 : vdcname” is not deleted with the virtual datacenter

16771

Private cloud

While retrieving/importing VMs from hypervisor, lock all VMs associated with the hypervisor

16825

NSX-T

VPN support in the Abiquo NSX-T integration

• For a description and configuration steps to add VPNs to your existing configuration, see Abiquo and NSX-T VPNs

• For details of how Abiquo supports VPNs in NSX-T, see Manage VPNs

• For full configuration details, see Configure the Abiquo NSX-T integration

16903

User interface

Add a new UI client property to exclude bill providers from display on billing dashboard.
This is a temporary property until the new private billing functionality is introduced.
See Configure provider list in dashboard billing widgets

16901

Private cloud

Refactor process to retrieve/import VMs:

• Add new VMs to the database

• For existing VMs, request VM definition sync to update VM configuration in Abiquo (using the same process as the periodic check)

16888

Azure

CSP billing should use pre-tax values.
Added a property to identify and exclude the Azure plans consumption items from billing line items.
Azure plans consumption will then be obtained from usage items only.

16872

Private cloud

When editing a VM, add an autoselected external IP from the available external IPs

7729

16774

Private cloud

On VM import, delegate synchronization of existing VMs to Virtual machine definition sync process

16934

Public cloud billing

Manual billing ignores enterprises with billing only credential

16930

User interface

Allow Edit and Sync VPNs if operation is supported.
NSX-T does not support VPN edit or sync, so do not display these buttons

16919

LDAP

2FA does not work when LDAP is enabled in multi mode

16918

User interface

400-BAD-REQUEST: Metadata cannot be null error when creating VM from template with bootstrap script and monitoring enabled by default

7774

16912

NSX-T

Distributed firewall rules for DNAT/SNAT could be more restrictive with the destinations.
See Configure the Abiquo NSX-T integration
To summarise the changes to firewalls related to this issue and the other NSX-T NAT firewall issues.

• The abiquo.nsxt.infra.tier0-allowed-gateways property was removed.

• It was replaced by the following properties for entry points:

  • abiquo.nsxt.infra.allow-dnat-sources

  • abiquo.nsxt.infra.allow-snat-destinations

• And the following properties to allow internet access

  • abiquo.nsxt.infra.allow-dnat-sources-public

  • abiquo.nsxt.infra.allow-snat-destinations-public

• The above properties are context properties, so you can configure them on the Abiquo server, or as enterprise properties, or for a VDC

• You can specify and IP address, network address or an existing NSX-T group

16911

NSX-T

SNAT distributed firewall rule prevents connecting to another NAT IP

16910

NSX-T

Bad firewall ports

16904

LDAP

Invalid login shows 2fa confirmation instead of Bad credentials

7764

16902

NSX-T

Cannot capture VM when using NSXT (and Group 'Exclude' was modified)

7761

16009

NSX-T

Editing load balancer does not work depending on which button is used.
API was not persisting Health Check provider ID after creating the health check in the provider

17022

Azure CSP billing

Entries of type “azure plan” with a charge type of "cancelImmediate" should not be excluded from the monthly reconciliation file. This is because they are not in the daily usage reconciliation file, and they are cancelled with a “customer credit” charge type that has the same value but in negative in the monthly reconciliation file.

17015

Security

Security improvement

17004

Security

Security improvement

17001

AWS

Close ElasticLoadBalancingV2Client in AWSConnection

7753

16961

User interface

Use UTC date in Last bills widget