64
CloudStack Release Notes Documentation Release 4.6.0 Apache CloudStack November 25, 2015

CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

  • Upload
    others

  • View
    8

  • Download
    0

Embed Size (px)

Citation preview

Page 1: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release NotesDocumentation

Release 4.6.0

Apache CloudStack

November 25, 2015

Page 2: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27
Page 3: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

Contents

1 What’s New in 4.6 31.1 Redundant Routers for VPC . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31.2 UI: SSH keys and User-Data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31.3 Send statistics collected by StatsCollector to Graphite . . . . . . . . . . . . . . . . . . . . . . . . . 31.4 Browser-based Template/Volume upload . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31.5 Run CloudStack inside Docker . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41.6 Deprecation of awsapi . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41.7 Improvements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4

2 Issues Fixed in 4.6 72.1 Issues Fixed in 4.6.0 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7

3 Compatibility Matrix 133.1 Supported OS Versions for Management Server . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 133.2 Supported Hypervisor Versions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 133.3 Supported External Devices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 143.4 Supported Browsers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14

4 API Changes Introduced in 4.6 154.1 Added API commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 154.2 Updated API commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

5 General Upgrade Notes 175.1 Java version upgraded to Java 1.7 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 175.2 OVS plug-in . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 175.3 Active-Directory Authentication (LDAP) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 175.4 SystemVM 32bit deprecated . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 175.5 Other Notes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17

6 Upgrade Instruction from 4.5.x 196.1 Packages repository . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 196.2 Update System-VM templates . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 196.3 Database Preparation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 226.4 Management Server on Ubuntu . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 226.5 Management Server on CentOS/RHEL . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 236.6 Hypervisor: XenServer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 246.7 Hypervisor: VMware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 246.8 Hypervisor: KVM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 256.9 Restart management services . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26

i

Page 4: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

6.10 System-VMs and Virtual-Routers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26

7 Upgrade Instruction from 4.4.x 277.1 Packages repository . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 277.2 Update System-VM templates . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 277.3 Database Preparation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 297.4 Management Server on Ubuntu . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 307.5 Management Server on CentOS/RHEL . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 317.6 Hypervisor: XenServer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 327.7 Hypervisor: VMware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 327.8 Hypervisor: KVM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 337.9 Restart management services . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 347.10 System-VMs and Virtual-Routers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

8 Upgrade Instruction from 4.3.x 378.1 Packages repository . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 378.2 Update System-VM templates . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 378.3 Database Preparation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 398.4 Management Server on Ubuntu . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 408.5 Management Server on CentOS/RHEL . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 418.6 Hypervisor: XenServer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 428.7 Hypervisor: VMware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 428.8 Hypervisor: KVM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 438.9 Restart management services . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 448.10 System-VMs and Virtual-Routers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44

9 Upgrade Instruction from 4.2.x 459.1 Packages repository . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 459.2 Update System-VM templates . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 469.3 Database Preparation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 489.4 Management Server Ubuntu . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 499.5 Management Server CentOS/RHEL . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 509.6 Hypervisor: Xen/XenServer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 519.7 Hypervisor: VMware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 519.8 Hypervisor: KVM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 529.9 Restart management services . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 539.10 Settings Changes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 539.11 System-VMs and Virtual-Routers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53

10 Known Issues in 4.6.0 5510.1 All known issues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56

ii

Page 5: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

This document contains information specific to this release of CloudStack, including upgrade instructions from priorreleases, new features added to CloudStack, API changes, and issues fixed in the release. For installation instructions,please see the CloudStack Installation Guide. For usage and administration instructions, please see the CloudStackAdministrator’s Guide.

Contents:

Contents 1

Page 6: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

2 Contents

Page 7: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CHAPTER 1

What’s New in 4.6

Version 4.6.0 includes more than 240 bug fixes from previous release, the following new features and improvements.

1.1 Redundant Routers for VPC

Create VPC using an High Available pair of Virtual Routers in active-pasive mode. The main goal behind its imple-mentation is to increase critical application’s uptime, offering a better Disaster Recovery strategy by quickly switchingnetwork traffic to a backup virtual router, hence increasing business continuity.

Supported hypervisors: AnyLink Redundant VR spec

1.2 UI: SSH keys and User-Data

It is now possible to import, delete and get instances inventory for SSH keys from the webui at the account level.Instance can now be created with ssh key and user-data defined from the webui wizard.

Supported hypervisors: N/ALink CLOUDSTACK-7882

1.3 Send statistics collected by StatsCollector to Graphite

Send StatsCollector from the management server to a Graphite server in addition to the usage database. This allowsease of graphing for CPU, Network and Disk I/O for instances and hosts.

Supported hypervisors: AnyLink CLOUDSTACK-7583

1.4 Browser-based Template/Volume upload

This feature enables the users to directly upload template or volume to Cloudstack and eliminates the dependency onan external http server. This is a complementary functionality and users can continue to register template/volume withURL.

Supported hypervisors: N/ALink Browser Upload spec

3

Page 8: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

1.5 Run CloudStack inside Docker

Provide Docker images collection of Apache CloudStack modules thru automated build on docker hub. These con-tainers are usable for Continous Integration tests, demo, rapid deployment of CloudStack for test purposes.

Supported hypervisors: N/ALink https://hub.docker.com/u/cloudstack/

1.6 Deprecation of awsapi

The module awsapi has been removed from the source code and replaced by ec2stack(https://github.com/apache/cloudstack-ec2stack). Removal of awsapi change the upgrade process to 4.6 fromprevious release as the RPM cloudstack-awsapi must be removed. This deprecation removed close to 1 million linesof code from the source base.

Supported hypervisors: N/ALink CLOUDSTACK-8433

1.7 Improvements

Here is the list of new features and improvements:

Jira ID DescriptionCLOUDSTACK-8301 Enable configuring local storage use for system VMs at zone level...CLOUDSTACK-7924 Browser-based Template / Volume upload...CLOUDSTACK-7583 Send statistics collected by StatsCollector to optional Graphite host...CLOUDSTACK-5863 Restore volume snapshot...CLOUDSTACK-8489 Provide smbios vendor information via KVM/Libvirt to Guest...CLOUDSTACK-8324 DHCP/DNS offload and config drive support for adv shared network...CLOUDSTACK-8313 Local Storage overprovisioning should be possible...CLOUDSTACK-8744 Add missing localization (l10n) for several parts in the UI...CLOUDSTACK-8740 make UI style customisation easier...CLOUDSTACK-8840 Update systemd profile for usage server...CLOUDSTACK-8252 KVM vlan passthrough 4095...CLOUDSTACK-8016 return code of the call to cloudstack-setup-agent is not checked...CLOUDSTACK-8036 SAML plugin provides no way to save IDP metadata in DB or file...CLOUDSTACK-7983 Create Disk/Service Offering for Domain Admin...CLOUDSTACK-7882 SSH Keypair Creation/Selection in UI...CLOUDSTACK-7908 Addition of userid field to vm_instance table to identify user that created the ...CLOUDSTACK-7847 API: listDomains should display the domain resources, similar to listAccounts...CLOUDSTACK-7698 Don’t (acquire IP/create NAT) by default while deploying VM if not necessary...CLOUDSTACK-6139 System.vm.use.local.storage global setting to zone setting...CLOUDSTACK-8486 Refactoring LibVirt (KVM) Hypervisor Plugin...CLOUDSTACK-8477 Refactoring XenServer Hypervisor Plugin...CLOUDSTACK-8506 Make ACS compliant with the RFC 3021...CLOUDSTACK-8502 Implement Annotions for XenServer and Libvirt resources...CLOUDSTACK-8647 LDAP Trust AD and Autoimport...CLOUDSTACK-8635 Ubuntu packages should depend on OpenJDK headless JRE...CLOUDSTACK-8625 Systemd profile for KVM Agent...

Continued on next page

4 Chapter 1. What’s New in 4.6

Page 9: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

Table 1.1 – continued from previous pageJira ID DescriptionCLOUDSTACK-8624 cloud-install-sys-tmplt: add support for mysql port and optimise the disk capaci...CLOUDSTACK-8607 As an Operator I want to be able to change the host password on the host itself ...CLOUDSTACK-8596 [LDAP] Nested groups, ability of recursively querying nested groups...CLOUDSTACK-8590 Refactoring NiciraNVP resource...CLOUDSTACK-8589 As an operator I want to be able to change the KVM hypervisor credentials...CLOUDSTACK-8580 Users should be able to expunge VMs...CLOUDSTACK-8581 Make S3 TCP KeepAlive and ConnectionTtl configureable...CLOUDSTACK-8426 Use a separate thread pool for VR reboot in case of out-of-band movement...CLOUDSTACK-8424 KVM: allow a way to add CPU flags/features specific to a host...CLOUDSTACK-8457 Make SAML plugin production grade...CLOUDSTACK-9034 Cloudstack-docs-admin has rst files bullet list incorrectly terminated...CLOUDSTACK-8272 Improve password serving script by making it non-blocking non-locking concurrent...CLOUDSTACK-8197 make minimal sysvm version configuratble...CLOUDSTACK-8151 An API to cleanup cloud_usage table...CLOUDSTACK-8133 Add instance count to listSecurityGroups API call....CLOUDSTACK-8169 Dynamic storage adaptor detection for KVM agent...CLOUDSTACK-8063 list secondary Ips information in VM response...CLOUDSTACK-4719 Document details parameter of registerTemplate...CLOUDSTACK-1667 improve explanation of extractable ISO...CLOUDSTACK-8989 component/test_ps_limits.py can also be run on a “basic” setup...CLOUDSTACK-8992 Allow more then 6 disks to be connected to a KVM VM....CLOUDSTACK-9044 RBD Primary Storage isn’t shown in the Zone Wizard...

1.7. Improvements 5

Page 10: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

6 Chapter 1. What’s New in 4.6

Page 11: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CHAPTER 2

Issues Fixed in 4.6

Apache CloudStack uses Jira to track its issues. All new features and bugs for 4.6.0 have been tracked in Jira, andhave a standard naming convention of “CLOUDSTACK-NNNN” where “NNNN” is the issue number.

2.1 Issues Fixed in 4.6.0

For the list of issues fixed, see Issues Fixed in 4.6.0.

Bug ID DescriptionCLOUDSTACK-9046 Fix upgrade path from 4.4 and 4.5 to 4.6...CLOUDSTACK-9045 Wrong mounting directory specified for managment server....CLOUDSTACK-9043 Localization de_DE and zh_CN don’t works: Uncaught SyntaxError: Unexpected token...CLOUDSTACK-9040 Tomcat 7 & 8 don’t work with the install scripts on Ubuntu...CLOUDSTACK-9038 Infrastructure tab is slow because of synchronous API calls...CLOUDSTACK-9019 Storage VM gets two mgmt nics when no storage net defined...CLOUDSTACK-9016 Fail to create VM instance within VPC ...CLOUDSTACK-9014 Rename xapi plugins for s3 and swift to make them work after renaming the calls...CLOUDSTACK-9010 Fix packaging for CentOS 7...CLOUDSTACK-9008 VM Snapshots no longer work with managed storage...CLOUDSTACK-9000 Logrotate cloudstack-agent error and out files...CLOUDSTACK-8999 serviceConfig.py does not take in custom kvm resource...CLOUDSTACK-8993 DHCP fails with “no address available” when an IP is reused...CLOUDSTACK-8990 start a stopped machine on a specific determinable host on UI...CLOUDSTACK-8985 Deleted volume’s removed column not updated...CLOUDSTACK-8984 VPC Network offerings tab missing from UI...CLOUDSTACK-8964 Can’t create template or volume from snapshot - “Are you sure you got the right ...CLOUDSTACK-8952 The redundant routers are facing a race condition due to several KeepaliveD/Conn...CLOUDSTACK-8947 Load Balancer not working with Isolated Networks...CLOUDSTACK-8934 Default routes not configured for rVPC and RVR...CLOUDSTACK-8933 SSVm and CPVM do not survive a reboot from API...CLOUDSTACK-8930 Showing blank screen when click ‘Next’ link in final step of Add Zone wizard....CLOUDSTACK-8927 [VPC]Executing command in VR: /opt/cloud/bin/router_proxy.sh is failing whenever...CLOUDSTACK-8925 Default allow for Egress rules is not being configured properly in VR iptables r...CLOUDSTACK-8924 [Blocker] test duplicated in test_scale_vm.py...CLOUDSTACK-8923 Create storage network IP range failed, Unknown parameters : zoneid...CLOUDSTACK-8917 Instance tab takes long time to load with 12K active VM (total vms: 190K)...CLOUDSTACK-8905 [Blocker] Egress rules are not configured in VR...

Continued on next page

7

Page 12: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

Table 2.1 – continued from previous pageBug ID DescriptionCLOUDSTACK-8898 Devcloud4 deployments are broken...CLOUDSTACK-8891 Isolated network VR default iptables rules in INPUT chain are missing...CLOUDSTACK-8890 Can no longer create VPC or other basic resources on projects because of CLOUDST...CLOUDSTACK-8888 Xenserver 6.0.2 host stuck in disconnected state after upgrade to master...CLOUDSTACK-8883 [Blocker] KVM host goes into disconnected state when MS is restarted...CLOUDSTACK-8881 [Blocker] PF , static nat , LB , egress rules not working in case of isolated ne...CLOUDSTACK-8879 Depend on rados-java 0.2.0...CLOUDSTACK-8869 change systemvm base iso file from debian-7.8.0 to debian-7.9.0...CLOUDSTACK-8864 Not able to add TCP port forwarding rule in VPN for specific ports...CLOUDSTACK-8863 VM doesn’t reconnect to internet post VR RESTART/STOP-START/RECREATE...CLOUDSTACK-8848 Ensure power state is up to date when handling missing VMs in pwerReport...CLOUDSTACK-8844 Network Update from RVR offering to Standalone offering fails...CLOUDSTACK-8843 Guest VMs are not getting IPs as the DHCP port is not opened in VR...CLOUDSTACK-8838 [KVM] agent setup failed when physical interface name is in ensX format (CentOS7...CLOUDSTACK-8826 XenServer - Use device id passed as part of attach volume API properly...CLOUDSTACK-8825 Setting vm.allocation.algorithm to firstfitleastconsumed makes vm migration impo...CLOUDSTACK-8824 VM deployment fails when there is only ZWPS and deployement alogorithm is firstf...CLOUDSTACK-8820 Showing error when try to add advance zone using VMWare ESXi 6.0 host...CLOUDSTACK-8819 Virtual Template size is not correct when using S3 as image store....CLOUDSTACK-8814 Order of nics in non-VPC router changed resulting in services to fail...CLOUDSTACK-8799 fix CsRedundant.py to handle public interfaces and default routes when changing ...CLOUDSTACK-8792 Cannot live migrate VM with Libvirt prior to v1.0.1...CLOUDSTACK-8785 Proper enforcement of retry count (max.retries) for all work type handled by Hig...CLOUDSTACK-8783 MockServerTest fail on Ubuntu 12.04 if kerberos is not configured...CLOUDSTACK-8766 In zone based template listings, infinite scrolling pagination is broken...CLOUDSTACK-8763 Deleting a POD/Zone always fails due to a SQLException...CLOUDSTACK-8762 Check KVM disk files for activity before starting VM...CLOUDSTACK-8759 Destroying VPC router results in a new unusable VPC router...CLOUDSTACK-8754 VM migration triggered by dynamic scaling is failing...CLOUDSTACK-8749 KVM: link local route cleanup...CLOUDSTACK-8748 VM UUID accessible in CreateVMSnapshotCommand and RevertToVMSnapshotCommand...CLOUDSTACK-8742 registerSSHKeyPair does not work from the UI web interface....CLOUDSTACK-8737 Remove out-of-band VR reboot code based on persistent VR configuration changes...CLOUDSTACK-8733 Host stuck in rebalancing state during agent LB...CLOUDSTACK-8730 Site-to-site VPN functionality does not work...CLOUDSTACK-8725 RVR functionality is broken in case of isolated networks, conntrackd fails to st...CLOUDSTACK-8714 Restore VM (Re-install VM) with enable.storage.migration set to false fails, lat...CLOUDSTACK-8711 public_ip type resource count for an account is not decremented upon IP range de...CLOUDSTACK-8709 Received out-of-band alert from migrating user instance...CLOUDSTACK-8707 Site2Site vpn config esp policy set with esp lifetime...CLOUDSTACK-8704 Schedule restart of router VMs ahead of user VMs as part of HA...CLOUDSTACK-8703 Cloudstack tries to re-download templates on S3 while they are already their....CLOUDSTACK-8702 HttpUtils: refactor/add method to validate http session...CLOUDSTACK-8701 Allow SAML users to switch accounts...CLOUDSTACK-8696 Create Region fails with endpoint parameter validation exception...CLOUDSTACK-8690 VR remote access vpn config is not applied...CLOUDSTACK-8688 Default policy for INPUT and FORWARD chain is ACCEPT in VR filter table...CLOUDSTACK-8678 OOM Kills Guests...CLOUDSTACK-8668 VR does not start in basic zone since ip address are not being configured on it...

Continued on next page

8 Chapter 2. Issues Fixed in 4.6

Page 13: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

Table 2.1 – continued from previous pageBug ID DescriptionCLOUDSTACK-8666 Put host in Alert state only after alert.wait timeout...CLOUDSTACK-8656 fill empty catch blocks with info messages...CLOUDSTACK-8655 [Browser Based Upload Volume] Partially uploaded volumes are not getting destroy...CLOUDSTACK-8651 [Browser Based Upload Template] Partially uploaded templates doesn’t get cleaned...CLOUDSTACK-8640 Uploads to S3 Secondary Storage fail, stay at 0% completed...CLOUDSTACK-8638 Cloudstack deb packages don’t include update_host_passwd.sh...CLOUDSTACK-8628 Ceph RBD only cluster with KVM does not fence properly...CLOUDSTACK-8623 CPVM fails to start after MS is restarted during its initial start-up process...CLOUDSTACK-8622 Reinstate working sessions in browser...CLOUDSTACK-8621 Allow UI plugins to be shown on navigation bar...CLOUDSTACK-8613 VNC password lost during VM migration across KVM hosts...CLOUDSTACK-8610 [VMWARE] Unable to attach 7th Disk to a Windows server 2012R2 instance...CLOUDSTACK-8606 DB performance impacted due to VM sync....CLOUDSTACK-8603 Random list VM failures at scale (more than 1000 VMs) when VM has resource tags...CLOUDSTACK-8602 MigrateVirtualMachineWithVolume leaves old chain data for volume...CLOUDSTACK-8601 VMFS storage added as local storage can be re added as shared storage....CLOUDSTACK-8593 [Marvin] set __testName if it is not assigned a proper name in the test flow...CLOUDSTACK-8569 The latter snapshot export for the same volume will fail is 2 snapshot exports a...CLOUDSTACK-8567 Migrating primary storage causes name_label field to blank...CLOUDSTACK-8560 Images deployed from template do not have the correct size in database...CLOUDSTACK-8559 Source address spoofing prevention in Basic Networking only done for DNS...CLOUDSTACK-8551 Findbugs warning in LdapCreateAccountCmd.java and LdapImportUsersCmd.java...CLOUDSTACK-8548 Message translations in Japanese and Chinese...CLOUDSTACK-8545 Unneeded VR reboot after successful live migration...CLOUDSTACK-8537 Duplicated SSH Keys/ deployVirtualMachine returns wrong keypair name...CLOUDSTACK-8530 KVM hosts without active agent connection are still “Up”...CLOUDSTACK-8517 Cannot start SSVM/CPVM due to a NPE on LibvirtStartCommandWrapper...CLOUDSTACK-8505 Don’t allow non-POST http requests on default login request...CLOUDSTACK-8499 UI reload perfomance is poor in index.jsp...CLOUDSTACK-8491 Host maintenance fails if a vm on it is running a custom service offering VM...CLOUDSTACK-8488 network with LB rules fails to restart...CLOUDSTACK-8484 Hosts without tag are not listed while listing the hosts for migration for insta...CLOUDSTACK-8467 Usage server fixes...CLOUDSTACK-8455 In the ‘Upload template and upload ISO’ view, ‘extractable’ is written with lowe...CLOUDSTACK-8452 Exclude non-routing hosts from getting rebalanced as part of agent LB...CLOUDSTACK-8443 Support CentOS7 as KVM host...CLOUDSTACK-8438 Proper enforcement of hypervisor capability “max. guest limit”...CLOUDSTACK-8433 Deprecate and remove CloudStack AWSAPI which is not actively maintained or widel...CLOUDSTACK-8429 minor issues seen in travis.yml...CLOUDSTACK-8427 Some messages are hard-coded in javascript after Volume upload branch merge(0b83...CLOUDSTACK-8425 Job framework: Same internal job can execute simultaneously...CLOUDSTACK-8412 VM migration with storage fails in a clustered management server setup...CLOUDSTACK-8411 Volume is stuck in Copying state after a failed attach...CLOUDSTACK-8410 VMware ESXi host disconnects frequently...CLOUDSTACK-8406 Don’t allow creating shared network offering with userdata service and VR as the...CLOUDSTACK-8405 [vCenter 5.5] Restore VM on a migrated VM results in the deletion of the data di...CLOUDSTACK-8402 Adding the KVM host to management server is failing (java8)...CLOUDSTACK-8401 SG rules don’t get properly cleaned up on KVM...CLOUDSTACK-8399 After registering a template for Xen, it’s not possible to enable/disable hvm wi...

Continued on next page

2.1. Issues Fixed in 4.6.0 9

Page 14: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

Table 2.1 – continued from previous pageBug ID DescriptionCLOUDSTACK-8395 Basic Zone Security Group rules fail with XenServer 6.5...CLOUDSTACK-8386 CS is returning sec. storage even if it is full and there are other sec. storage...CLOUDSTACK-8372 Key column not getting encrypted when saving SSL certificate in keystore table...CLOUDSTACK-8352 [marvin] Integrate vcenter communication through marvin...CLOUDSTACK-8351 Cloudstack https configuration wrong in server.xml...CLOUDSTACK-8350 Volume attachment failed when user stops the VM during attaching DISK...CLOUDSTACK-8339 Allow non-root credentials for adding KVM hypervisor...CLOUDSTACK-8338 EL7 KVM host stats reporting is broken...CLOUDSTACK-8320 Upon a failed migration, a dummy volume is created which remains in ‘Expunging’ ...CLOUDSTACK-8319 [VMware] VM’s configuration files are left behind on source primary storage ...CLOUDSTACK-8318 Storage vMotion fails in case of VMFS storage....CLOUDSTACK-8315 CS API listVMSnapshot doesn’t have tags ‘project’ and ‘projectid’...CLOUDSTACK-8312 The storage usage of “Primary Storage Allocated” is incorrect....CLOUDSTACK-8304 maven repositories are checked for snapshots...CLOUDSTACK-8298 xenserver VR start failed when the VR start config size is more...CLOUDSTACK-8296 VMs cannot be migrated with XenMotion as network is not available...CLOUDSTACK-8295 max data volume limits to be updated with new values for all hypervisors...CLOUDSTACK-8285 IP address capacity don’t update if state if set to disable when first created...CLOUDSTACK-8273 baremetal-system-account allows interactive login...CLOUDSTACK-8248 VPC ACL Rules are dropping the CIDR...CLOUDSTACK-8247 KVM host cpu util doesn’t work...CLOUDSTACK-8246 Add Cluster - Guest traffic label displayed Incorrectly...CLOUDSTACK-8233 Can’t create VM on KVM on Ubuntu 12.04...CLOUDSTACK-8231 Fail to create load-balancing service on VPC...CLOUDSTACK-8229 [marvin] add zone wide primary storage support to deployDataCenter...CLOUDSTACK-8226 Upgrade to 4.5.0 from 4.3.2 fails - systemvms don’t start on KVM...CLOUDSTACK-8224 CloudStack 4.5 showing lock related exceptions (seems harmless)...CLOUDSTACK-8220 Fix CitrixResourceBase to support XenServer 6.5...CLOUDSTACK-8216 Should we encrypt sensistive information in CloudStack DB?...CLOUDSTACK-8200 Secondary storage and systemvm template detection fails with KVM and LocalStorag...CLOUDSTACK-8198 Localstorage on KVM breaks when multiple hosts are added...CLOUDSTACK-8195 Make getSPMetadata should return XML...CLOUDSTACK-8191 SAML users should be created in separate accounts...CLOUDSTACK-8190 XenServer traffic label has changed in 4.5, backward incompatibility is lost...CLOUDSTACK-8184 Usage server failed to start after upgrade to 4.5.0...CLOUDSTACK-8183 Exceptions from 4.3.2 to 4.5.0 upgrade, logs fill up disk very fast...CLOUDSTACK-8167 CreateSnapshot publishes volume Id instead of UUId...CLOUDSTACK-8166 Usage data boundary condition and NPE...CLOUDSTACK-8155 JSON response from Mgmt server has additional spaces, breaks a badly written cli...CLOUDSTACK-8146 Resource count of primary storage does not consider the detached volumes...CLOUDSTACK-8144 “snapshot(s)” text should be returned to “Snapshots”...CLOUDSTACK-8140 secstorage.service.offering in GS set to service offering ID Webui fails to star...CLOUDSTACK-8115 Update default ordering of HA investigators...CLOUDSTACK-8097 Failed to create snapshot from volume after vm live migration across clusters...CLOUDSTACK-8094 Label Issue for Migrate Volume Option in UI...CLOUDSTACK-8066 There is not way to know the size of the snapshot created...CLOUDSTACK-8064 UpdatePortForwardingRuleCmd implementation...CLOUDSTACK-8056 EN: Miss SC and UK keyboard option for VMware hypervisor when register a templat...CLOUDSTACK-8054 No event generated on host maintenance mode is completed...

Continued on next page

10 Chapter 2. Issues Fixed in 4.6

Page 15: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

Table 2.1 – continued from previous pageBug ID DescriptionCLOUDSTACK-8051 updateNetwork fail for NPE...CLOUDSTACK-8050 VM Guest OS type does not update if template guestostype changes...CLOUDSTACK-8043 Have all CloudStack tables’s primary keys auto-increment to avoid multi-master D...CLOUDSTACK-8038 Create a new reusable tinylinux appliance for all hypervisors...CLOUDSTACK-8037 Survey security of using SAML plugin in production and test against standard IDP...CLOUDSTACK-8035 SAML SP metadata changes with every CloudStack restart...CLOUDSTACK-8034 SAML Unique ID is restricted to 40 chars only...CLOUDSTACK-8023 UI > VM wizard > service offering > trigger event handler of event “cloudStack.m...CLOUDSTACK-8011 Upgrade Maven dependencies...CLOUDSTACK-8010 [UI] Add private Gateway button is seen as “label.add.private.gateway”...CLOUDSTACK-7986 [F5 LB] Failed to execute IPAssocCommand due to com.cloud.utils.exception.Execut...CLOUDSTACK-7977 Password generator adds 3 characters to length. Should also have minimum length...CLOUDSTACK-7976 Add validation for global params consoleproxy.url.domain and secstorage.cert.dom...CLOUDSTACK-7975 Add RHEL 6.5 support...CLOUDSTACK-7974 deleted VM entries still exists in /etc/hosts and /etc/dhcphosts.txt files on vi...CLOUDSTACK-7969 SC: Win8.1: Key translation fails for some EN-US keyboard keys...CLOUDSTACK-7964 listAccounts API is not listing correct value of resource limits....CLOUDSTACK-7952 listSslCerts returns private key...CLOUDSTACK-7951 cloudstack-agent jsvc gets too large virtual memory space....CLOUDSTACK-7940 Exception printed completely on the UI. Not in a readable format...CLOUDSTACK-7920 NPE in Volume sync causing ssvm agent to not connect ...CLOUDSTACK-7919 In vmware, when host crashed and the VR migrated because of HA, Vmsync didnt not...CLOUDSTACK-7909 Enabling the cluster from disabled state is changing the capacity_state to enabl...CLOUDSTACK-7905 Add OEL 6.5 32/64 bit guest_os support....CLOUDSTACK-7904 EN-UK: CentOS 6.5 GUI: Key translation fails for some EN- UK keyboard keys...CLOUDSTACK-7898 Add properties file in same folder as template...CLOUDSTACK-7892 UI > module > execute handlers attached to event ‘cloudStack.module.sharedFuncti...CLOUDSTACK-7840 UI control tip for ‘Add Primary Storage’ -> ‘Provider’ seems wrong...CLOUDSTACK-7838 UI - Update category names on Resources tab of a Zone...CLOUDSTACK-7831 [UI] Unlocalized string on Advanced Network -> Network tab...CLOUDSTACK-7808 Typo in Zone Creation Wizard...CLOUDSTACK-7803 Storage live migration of instance may not happen if instance has ISO attached....CLOUDSTACK-7792 Usage Events to be captured based on Volume State Machine...CLOUDSTACK-7773 CLONE - UI - listServiceOfferings API needs to be able to take virtualmachineid ...CLOUDSTACK-7771 Restore vm shouldnt go through if the template is already deleted...CLOUDSTACK-7715 Triage and fix Coverity defects...CLOUDSTACK-7707 Triage and fix Coverity defects...CLOUDSTACK-7650 with wrong checksum volume got uploaded ...CLOUDSTACK-7645 Many instances of ”???label.*???”...CLOUDSTACK-7639 cidrlist is not updated in the database after calling API updateNetworkACLItem...CLOUDSTACK-7539 [S3] Parallel deployment makes reference count of a cache in nfs secondary stagi...CLOUDSTACK-7412 Can’t create proper template from VM on S3 secondary storage environment...CLOUDSTACK-7395 [Automation] Multiple Networks with LB Service are not allowed within a VPC - Ex...CLOUDSTACK-7195 security_group.py should log exceptions instead of discarding them...CLOUDSTACK-7089 VNC passwords should not be logged...CLOUDSTACK-7064 Cloudstack web-application: Missing X-Content-Type-Options header...CLOUDSTACK-7063 Cloudstack web-application: Missing X-XSS-Protection header...CLOUDSTACK-6959 Unpatched OpenSwan vulnerabilities...CLOUDSTACK-6924 Exceptions are thrown when a data disk on local storage is attached/migrated to ...

Continued on next page

2.1. Issues Fixed in 4.6.0 11

Page 16: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

Table 2.1 – continued from previous pageBug ID DescriptionCLOUDSTACK-6900 If we download a volume and then migrate the same volume, then migration fails....CLOUDSTACK-6885 system-vm rsyslog logs rotation does not work properly...CLOUDSTACK-6697 update BigSwitch network plugin...CLOUDSTACK-6212 ‘vm_instance’ table has no AUTO_INCREMENT on ‘id’ field...CLOUDSTACK-5933 Problem with VMware snapshot when datastore has a space in its name...CLOUDSTACK-5824 Delete snapshot UI always success...CLOUDSTACK-5409 Project created in a VPC does not display s2s VPN Gateway...CLOUDSTACK-5242 Improper handling of anti-CSRF token...CLOUDSTACK-5238 Only secure password encoders should be in userPasswordEncoders list...CLOUDSTACK-5237 Default authenticator should use iterations...CLOUDSTACK-5236 LDAP authenticator adds second password...CLOUDSTACK-4611 [Ubuntu] ebtables-save command not exist on Ubuntu 12.04...CLOUDSTACK-4605 VPC router loses config after reboot...CLOUDSTACK-4442 Source NAT not applied when network starts up...CLOUDSTACK-4212 Can not deploy VM on the specific host on CloudStack UI...CLOUDSTACK-4201 listServiceOfferings API needs to be able to take virtualmachineid of SystemVM a...CLOUDSTACK-3682 NPE in BridgeVifDriver causing systemvm startup failure in KVM...CLOUDSTACK-3528 [UI]list calls are in the processing state forever with invalid name provided wi...CLOUDSTACK-3383 GetHostStatsCommand fails when agent is running Ubuntu 13.04 (raring)...CLOUDSTACK-3317 DVS does not support managementstorage network...CLOUDSTACK-2100 Need tooltips for new VM Snapshot dialog...CLOUDSTACK-1359 Clarify what we mean by GB in CloudStack documentation...CLOUDSTACK-255 Null pointer exception while creating portforwarding rule after performing Updat...CLOUDSTACK-83 hitting exception when trying to take two consecutive snapshot on same volume...

12 Chapter 2. Issues Fixed in 4.6

Page 17: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CHAPTER 3

Compatibility Matrix

3.1 Supported OS Versions for Management Server

This section lists the operating systems that are supported for running CloudStack Management Server. Note thatspecific versions of the operating systems are tested, so compatibility with CentOS 6.3 may not indicate compatibilitywith CentOS 6.2, 6.1 and so on.

• RHEL versions 6.3, 6.5, 6.6 and 7.0

• CentOS versions 6.6, 7.0

• Ubuntu 14.04 LTS

3.1.1 Software Requirements

• Java 1.7

• MySQL 5.6 (RHEL 7)

• MySQL 5.1 (RHEL 6.x)

3.2 Supported Hypervisor Versions

CloudStack supports three hypervisor families, XenServer with XAPI, KVM, and VMware with vSphere.

• LXC Host Containers on RHEL 7

• Windows Server 2012 R2 (with Hyper-V Role enabled)

• Hyper-V 2012 R2

• CentOS 6.2+ with KVM

• Red Hat Enterprise Linux 6.2 with KVM

• XenServer versions 6.1, 6.2 SP1 and 6.5 with latest hotfixes

Note: It is now required to enable HA on the XenServer pool in order to recover from a pool-master failure.Please refer to the XenServer documentation.

• VMware versions 5.0 Update 3a, 5.1 Update 2a, and 5.5 Update 2

• Oracle VM 3.0+

13

Page 18: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

• Bare metal hosts are supported, which have no hypervisor. These hosts can run the following operating systems:

– RHEL or CentOS, v6.2 or 6.3

Note: Use libvirt version 0.9.10 for CentOS 6.3

– Fedora 17

– Ubuntu 12.04

For more information, see the Hypervisor Compatibility Matrix in the ‘CloudStack Installation Guide‘_.

3.3 Supported External Devices

• Netscaler VPX and MPX versions 9.3, 10.1e and 10.5

• Netscaler SDX version 9.3, 10.1e and 10.5

• SRX (Model srx100b) versions 10.3 to 10.4 R7.5

• F5 11.X

• Force 10 Switch version S4810 for Baremetal Advanced Networks

3.4 Supported Browsers

The CloudStack Web-based UI should be compatible with any modern browser, but it’s possible that some browserswill not render portions of the UI reliably, depending on their support of Web standards. For best results, one of thefollowing browsers recommended:

• Internet Explorer versions 10 and 11

• Firefox version 31 or later

• Google Chrome version 36.0.1985

• Safari 6+

14 Chapter 3. Compatibility Matrix

Page 19: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CHAPTER 4

API Changes Introduced in 4.6

For the complete list of API commands and params consult the CloudStack Apidocs.

4.1 Added API commands

API DescriptionlistIdps Returns list of discovered SAML Identity ProvidersauthorizeSamlSso Allow or disallow a user to use SAML SSOlistSamlAuthorization Lists authorized users who can used SAML SSOlistAndSwitchSamlAccount Lists and switches to other SAML accounts owned by the SAML userremoveRawUsageRecords Safely removes raw records from cloud_usage tableaddBigSwitchBcfDevice Adds a BigSwitch BCF Controller devicedeleteBigSwitchBcfDevice delete a BigSwitch BCF Controller devicelistBigSwitchBcfDevices Lists BigSwitch BCF Controller deviceslinkDomainToLdap link an existing cloudstack domain to group or OU in ldapgetUploadParamsForVolume Upload a data disk to the cloudstack cloud.getUploadParamsForTemplate upload an existing template into the CloudStack cloud.

4.2 Updated API commands

API DescriptionaddNicToVirtualMachine Response: New parameters: userid, usernameaddCluster Request: New parameters: ovm3cluster (optional), ovm3pool (optional), ovm3vip (optional) Response: New parameters: ovm3vipcreateTemplate Request: New parameters: projectid (optional)registerSSHKeyPair Response: New parameters: account, domain, domainidlistClusters Response: New parameters: ovm3vipresetSSHKeyForVirtualMachine Response: New parameters: userid, usernamecreateSecurityGroup Response: New parameters: virtualmachinecount, virtualmachineidsupdateStoragePool Request: New parameters: enabled (optional)updateHostPassword Request: New parameters: update_passwd_on_host (optional)listSSHKeyPairs Response: New parameters: account, domain, domainidrecoverVirtualMachine Response: New parameters: userid, usernamelistCapabilities Response: New parameters: allowuserexpungerecovervm, allowuserviewdestroyedvmupdateVPC Response: New parameters: redundantvpcrouter

Continued on next page

15

Page 20: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

Table 4.1 – continued from previous pageAPI DescriptionupdatePortForwardingRule Request: New parameters: vmguestip (optional) Removed parameters: ipaddressid, privateip, protocol, publicportdeployVirtualMachine Response: New parameters: userid, usernameupdateTrafficType Request: New parameters: ovm3networklabel (optional), xennetworklabel (optional) Removed parameters: xenservernetworklabel Response: New parameters: ovm3networklabel, xennetworklabel Removed parameters: xenservernetworklabelcreateDomain Response: New parameters: cpuavailable, cpulimit, cputotal, ipavailable, iplimit, iptotal, memoryavailable, memorylimit, memorytotal, networkavailable, networklimit, networktotal, primarystorageavailable, primarystoragelimit, primarystoragetotal, projectavailable, projectlimit, projecttotal, secondarystorageavailable, secondarystoragelimit, secondarystoragetotal, snapshotavailable, snapshotlimit, snapshottotal, state, templateavailable, templatelimit, templatetotal, vmavailable, vmlimit, vmtotal, volumeavailable, volumelimit, volumetotal, vpcavailable, vpclimit, vpctotallistLBHealthCheckPolicies Request: New parameters: id (optional) Changed parameters: lbruleid (old version - required, new version - optional)listDiskOfferings Request: New parameters: isrecursive (optional), listall (optional)listSnapshots Response: New parameters: physicalsizeaddS3 Request: New parameters: connectionttl (optional), usetcpkeepalive (optional)attachIso Response: New parameters: userid, usernamelistDomains Response: New parameters: cpuavailable, cpulimit, cputotal, ipavailable, iplimit, iptotal, memoryavailable, memorylimit, memorytotal, networkavailable, networklimit, networktotal, primarystorageavailable, primarystoragelimit, primarystoragetotal, projectavailable, projectlimit, projecttotal, secondarystorageavailable, secondarystoragelimit, secondarystoragetotal, snapshotavailable, snapshotlimit, snapshottotal, state, templateavailable, templatelimit, templatetotal, vmavailable, vmlimit, vmtotal, volumeavailable, volumelimit, volumetotal, vpcavailable, vpclimit, vpctotalupdateCluster Response: New parameters: ovm3vipprepareTemplate Request: New parameters: storageid (optional)rebootVirtualMachine Response: New parameters: userid, usernamelistSecurityGroups Response: New parameters: virtualmachinecount, virtualmachineidsupdateVMAffinityGroup Response: New parameters: userid, usernameaddTrafficType Request: New parameters: ovm3networklabel (optional), xennetworklabel (optional) Removed parameters: xenservernetworklabel Response: New parameters: ovm3networklabel, xennetworklabel Removed parameters: xenservernetworklabelupdateTemplate Request: New parameters: requireshvm (optional)removeNicFromVirtualMachine Response: New parameters: userid, usernameupdateDefaultNicForVirtualMachine Response: New parameters: userid, usernamecreateVPC Response: New parameters: redundantvpcrouterresetPasswordForVirtualMachine Response: New parameters: userid, usernamechangeServiceForVirtualMachine Response: New parameters: userid, usernamestartVirtualMachine Response: New parameters: userid, usernamedetachIso Response: New parameters: userid, usernamemigrateVirtualMachine Response: New parameters: userid, usernameupdateDomain Response: New parameters: cpuavailable, cpulimit, cputotal, ipavailable, iplimit, iptotal, memoryavailable, memorylimit, memorytotal, networkavailable, networklimit, networktotal, primarystorageavailable, primarystoragelimit, primarystoragetotal, projectavailable, projectlimit, projecttotal, secondarystorageavailable, secondarystoragelimit, secondarystoragetotal, snapshotavailable, snapshotlimit, snapshottotal, state, templateavailable, templatelimit, templatetotal, vmavailable, vmlimit, vmtotal, volumeavailable, volumelimit, volumetotal, vpcavailable, vpclimit, vpctotallistVPCs Response: New parameters: redundantvpcrouterassignVirtualMachine Response: New parameters: userid, usernameupdateVirtualMachine Response: New parameters: userid, usernamelistServiceOfferings Request: New parameters: isrecursive (optional), listall (optional)samlSso Request: New parameters: idpid (required) Removed parameters: idpurlrestoreVirtualMachine Response: New parameters: userid, usernamelistDomainChildren Response: New parameters: cpuavailable, cpulimit, cputotal, ipavailable, iplimit, iptotal, memoryavailable, memorylimit, memorytotal, networkavailable, networklimit, networktotal, primarystorageavailable, primarystoragelimit, primarystoragetotal, projectavailable, projectlimit, projecttotal, secondarystorageavailable, secondarystoragelimit, secondarystoragetotal, snapshotavailable, snapshotlimit, snapshottotal, state, templateavailable, templatelimit, templatetotal, vmavailable, vmlimit, vmtotal, volumeavailable, volumelimit, volumetotal, vpcavailable, vpclimit, vpctotalmigrateVirtualMachineWithVolume Response: New parameters: userid, usernamestopVirtualMachine Response: New parameters: userid, usernamecreateSnapshot Request: New parameters: name (optional) Response: New parameters: physicalsizeupdateIso Request: New parameters: requireshvm (optional)destroyVirtualMachine Response: New parameters: userid, usernamerevertToVMSnapshot Response: New parameters: userid, usernamelistVirtualMachines Request: New parameters: keypair (optional), userid (optional) Response: New parameters: userid, usernamerestartVPC Request: New parameters: cleanup (optional), makeredundant (optional) Response: New parameters: redundantvpcrouterrevertSnapshot Response: New parameters: physicalsizecreateVpnCustomerGateway Request: New parameters: projectid (optional)

16 Chapter 4. API Changes Introduced in 4.6

Page 21: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CHAPTER 5

General Upgrade Notes

5.1 Java version upgraded to Java 1.7

As of Apache CloudStack 4.4, Java version required is 1.7 for the management-server, cloudstack-usage, KVM agentand system-VMs.

5.2 OVS plug-in

OVS plug-in functionality is disrupted if ovsdaemon crashes

A critical functionality issue came out with CLOUDSTACK-6779. On XenServer it is observed that on VIF unplugOvs-Vswitchd is crashing resulting in loosing all the openflow rules added to the bridge. Ovs daemon gets started andcreates a bridge but configure openflow rules are lost resulting in the disruption of connectivity for the VM’s on thehost.

5.3 Active-Directory Authentication (LDAP)

If using Active-Directory (LDAP/LDAPs) as user authentication; Upgrading to 4.3 and later require changes in GlobalSettings. After upgrading CloudStack to 4.3 or latest, following Global Settings must be change:

Global Settings Default Newldap.user.object inetOrgPerson userldap.username.attribute uid sAMAccountName

5.4 SystemVM 32bit deprecated

32bit versions of systemvm templates are in the process of behing deprecated. Upgrade instructions from this Re-lease Notes use 64bit templates. 32bit systemvm-templates are available for this version on http://cloudstack.apt-get.eu/systemvm/4.4/. Follow the dev mailing list for further updates.

5.5 Other Notes

If you are experiencing CloudStack UI issues, please consider upgrading your tomcat instance to version 6.0.43 (testedversion, but earlier versions prior to 6.0.37 might work as well), to address the tomcat response issues caused by latency

17

Page 22: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

between the browser/client and CloudStack Management server.

18 Chapter 5. General Upgrade Notes

Page 23: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CHAPTER 6

Upgrade Instruction from 4.5.x

This section will guide you from CloudStack 4.5.x to CloudStack 4.6.

Any steps that are hypervisor-specific will be called out with a note.

We recommend reading through this section once or twice before beginning your upgrade procedure, and workingthrough it on a test system before working on a production system.

Note: The following upgrade instructions should be performed regardless of hypervisor type.

Upgrade Steps:

1. Backup CloudStack database (MySQL)

2. Upgrade CloudStack management server(s)

3. Update hypervisors specific dependencies

6.1 Packages repository

Most users of CloudStack manage the installation and upgrades of CloudStack with one of Linux’s predominantpackage systems, RPM or APT. This guide assumes you’ll be using RPM and Yum (for Red Hat Enterprise Linux orCentOS), or APT and Debian packages (for Ubuntu).

Create RPM or Debian packages (as appropriate) and a repository from the 4.6 source, or check the Apache Cloud-Stack downloads page at http://cloudstack.apache.org/downloads.html for package repositories supplied by commu-nity members. You will need them for Management Server on Ubuntu or Management Server on CentOS/RHEL andHypervisor: KVM hosts upgrade.

Instructions for creating packages from the CloudStack source are in the CloudStack Installation Guide.

6.2 Update System-VM templates

1. While running the existing 4.5.x system, log in to the UI as root administrator.

2. In the left navigation bar, click Templates.

3. In Select view, click Templates.

4. Click Register template.

The Register template dialog box is displayed.

19

Page 24: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

5. In the Register template dialog box, specify the following values (do not change these):

20 Chapter 6. Upgrade Instruction from 4.5.x

Page 25: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

Hy-pervi-sor

Description

XenServerName: systemvm-xenserver-4.6Description: systemvm-xenserver-4.6URL: http://cloudstack.apt-get.eu/systemvm/4.6/systemvm64template-4.6.0-xen.vhd.bz2Zone: Choose the zone where this hypervisor is usedHypervisor: XenServerFormat: VHDOS Type: Debian GNU/Linux 7.0 (64-bit) (or the highest Debian release number available in thedropdown)Extractable: noPassword Enabled: noPublic: noFeatured: noRouting: no

KVM Name: systemvm-kvm-4.6Description: systemvm-kvm-4.6URL: http://cloudstack.apt-get.eu/systemvm/4.6/systemvm64template-4.6.0-kvm.qcow2.bz2Zone: Choose the zone where this hypervisor is usedHypervisor: KVMFormat: QCOW2OS Type: Debian GNU/Linux 7.0 (64-bit) (or the highest Debian release number available in thedropdown)Extractable: noPassword Enabled: noPublic: noFeatured: noRouting: no

VMware Name: systemvm-vmware-4.6Description: systemvm-vmware-4.6URL: http://cloudstack.apt-get.eu/systemvm/4.6/systemvm64template-4.6.0-vmware.ovaZone: Choose the zone where this hypervisor is usedHypervisor: VMwareFormat: OVAOS Type: Debian GNU/Linux 7.0 (64-bit) (or the highest Debian release number available in thedropdown)Extractable: noPassword Enabled: noPublic: noFeatured: noRouting: no

Hy-perV

Name: systemvm-hyperv-4.6Description: systemvm-hyperv-4.6URL: http://cloudstack.apt-get.eu/systemvm/4.6/systemvm64template-4.6.0-hyperv.vhd.zipZone: Choose the zone where this hypervisor is usedHypervisor: Hyper-VFormat: VHDOS Type: Debian GNU/Linux 7.0 (64-bit) (or the highest Debian release number available in thedropdown)Extractable: noPassword Enabled: noPublic: noFeatured: noRouting: no

6.2. Update System-VM templates 21

Page 26: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

6. Watch the screen to be sure that the template downloads successfully and enters the READY state. Do notproceed until this is successful.

6.3 Database Preparation

Backup current database

1. Stop your management server or servers. Run this on all management server hosts:

$ sudo service cloudstack-management stop

2. If you are running a usage server or usage servers, stop those as well:

$ sudo service cloudstack-usage stop

3. Make a backup of your MySQL database. If you run into any issues or need to roll back the upgrade, this willassist in debugging or restoring your existing environment. You’ll be prompted for your password.

$ mysqldump -u root -p cloud > cloud-backup_`date '+%Y-%m-%d'`.sql$ mysqldump -u root -p cloud_usage > cloud_usage-backup_`date '+%Y-%m-%d'`.sql

4. (KVM Only) If primary storage of type local storage is in use, the path for this storage needs to be verified toensure it passes new validation. Check local storage by querying the cloud.storage_pool table:

$ mysql -u cloud -p -e "select id,name,path from cloud.storage_pool where pool_type='Filesystem'"

If local storage paths are found to have a trailing forward slash, remove it:

$ mysql -u cloud -p -e 'update cloud.storage_pool set path="/var/lib/libvirt/images" where path="/var/lib/libvirt/images/"';

6.4 Management Server on Ubuntu

If you are using Ubuntu, follow this procedure to upgrade your packages. If not, skip to step Management Server onCentOS/RHEL.

Note: Community Packages: This section assumes you’re using the community supplied packages for CloudStack.If you’ve created your own packages and APT repository, substitute your own URL for the ones used in these examples.

The first order of business will be to change the sources list for each system with CloudStack packages. This meansall management servers, and any hosts that have the KVM agent. (No changes should be necessary for hosts that arerunning VMware or Xen.)

6.4.1 CloudStack apt repository

Start by opening /etc/apt/sources.list.d/cloudstack.list on any systems that have CloudStackpackages installed.

This file should have one line, which contains:

deb http://cloudstack.apt-get.eu/ubuntu precise 4.5

We’ll change it to point to the new package repository:

22 Chapter 6. Upgrade Instruction from 4.5.x

Page 27: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

deb http://cloudstack.apt-get.eu/ubuntu precise 4.6

Setup the public key for the above repository:

wget -qO - http://cloudstack.apt-get.eu/release.asc | sudo apt-key add -

If you’re using your own package repository, change this line to read as appropriate for your 4.6 repository.

1. Now update your apt package list:

$ sudo apt-get update

2. Now that you have the repository configured, it’s time to upgrade the cloudstack-management package.

$ sudo apt-get upgrade cloudstack-management

3. If you use CloudStack usage server

$ sudo apt-get upgrade cloudstack-usage

6.5 Management Server on CentOS/RHEL

If you are using CentOS or RHEL, follow this procedure to upgrade your packages. If not, skip to hypervisors section,then System-VMs and Virtual-Routers.

Note: Community Packages: This section assumes you’re using the community supplied packages for CloudStack.If you’ve created your own packages and yum repository, substitute your own URL for the ones used in these examples.

6.5.1 CloudStack RPM repository

The first order of business will be to change the yum repository for each system with CloudStack packages. Thismeans all management servers, and any hosts that have the KVM agent.

(No changes should be necessary for hosts that are running VMware or Xen.)

Start by opening /etc/yum.repos.d/cloudstack.repo on any systems that have CloudStack packages in-stalled.

This file should have content similar to the following:

[apache-cloudstack]name=Apache CloudStackbaseurl=http://cloudstack.apt-get.eu/rhel/4.5/enabled=1gpgcheck=0

If you are using the community provided package repository, change the base url tohttp://cloudstack.apt-get.eu/rhel/4.6/. If you want to use the CentOS7 repository use theurl http://cloudstack.apt-get.eu/centos7/4.6/

Setup the GPG public key if you wish to enable gpgcheck=1:

rpm --import http://cloudstack.apt-get.eu/RPM-GPG-KEY

If you’re using your own package repository, change this line to read as appropriate for your 4.6 repository.

1. Remove the deprecated dependency for awsapi.

6.5. Management Server on CentOS/RHEL 23

Page 28: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

$ sudo rpm -e --nodeps cloudstack-awsapi

2. Now that you have the repository configured, it’s time to upgrade the cloudstack-management.

$ sudo yum upgrade cloudstack-management

3. If you use CloudStack usage server

$ sudo yum upgrade cloudstack-usage

6.6 Hypervisor: XenServer

(XenServer only) Copy vhd-utils file on CloudStack management servers. Copy the file vhd-utils to/usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver.

wget -P /usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver \http://download.cloud.com.s3.amazonaws.com/tools/vhd-util

6.7 Hypervisor: VMware

Warning: For VMware hypervisor CloudStack management server packages must be build using “noredist”.Refer to Building from Source.

(VMware only) Additional steps are required for each VMware cluster. These steps will not affect running guests inthe cloud. These steps are required only for clouds using VMware clusters:

1. Stop the Management Server:

$ sudo service cloudstack-management stop

2. Generate the encrypted equivalent of your vCenter password:

$ java -classpath /usr/share/cloudstack-common/lib/jasypt-1.9.0.jar org.jasypt.intf.cli.JasyptPBEStringEncryptionCLI encrypt.sh input="_your_vCenter_password_" password="`cat /etc/cloudstack/management/key`" verbose=false

Store the output from this step, we need to add this in cluster_details table and vmware_data_center tables in place ofthe plain text password

1. Find the ID of the row of cluster_details table that you have to update:

$ mysql -u <username> -p<password>

select * from cloud.cluster_details;

2. Update the plain text password with the encrypted one

update cloud.cluster_details set value = '_ciphertext_from_step_1_'where id = _id_from_step_2_;

3. Confirm that the table is updated:

select * from cloud.cluster_details;

4. Find the ID of the correct row of vmware_data_center that you want to update

24 Chapter 6. Upgrade Instruction from 4.5.x

Page 29: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

select * from cloud.vmware_data_center;

5. update the plain text password with the encrypted one:

update cloud.vmware_data_center set password = '_ciphertext_from_step_1_'where id = _id_from_step_5_;

6. Confirm that the table is updated:

select * from cloud.vmware_data_center;

6.8 Hypervisor: KVM

6.8.1 KVM on Ubuntu

(KVM only) Additional steps are required for each KVM host. These steps will not affect running guests in the cloud.These steps are required only for clouds using KVM as hosts and only on the KVM hosts.

1. Configure the CloudStack apt repository as detailed above.

2. Stop the running agent.

$ sudo service cloudstack-agent stop

3. Update the agent software.

$ sudo apt-get upgrade cloudstack-agent

4. Verify that the file /etc/cloudstack/agent/environment.properties has a line that reads:

paths.script=/usr/share/cloudstack-common

If not, add the line.

5. Start the agent.

$ sudo service cloudstack-agent start

6.8.2 KVM on CentOS/RHEL

For KVM hosts, upgrade the cloudstack-agent package

1. Configure the CloudStack RPM repository as detailed above.

$ sudo yum upgrade cloudstack-agent

2. Verify that the file /etc/cloudstack/agent/environment.properties has a line that reads:

paths.script=/usr/share/cloudstack-common

If not, add the line.

3. Restart the agent:

$ sudo service cloudstack-agent stop$ sudo killall jsvc$ sudo service cloudstack-agent start

6.8. Hypervisor: KVM 25

Page 30: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

6.9 Restart management services

1. Now it’s time to start the management server

$ sudo service cloudstack-management start

2. If you use it, start the usage server

$ sudo service cloudstack-usage start

6.10 System-VMs and Virtual-Routers

Once you’ve upgraded the packages on your management servers, you’ll need to restart the system VMs. Ensure thatthe admin port is set to 8096 by using the “integration.api.port” global parameter. This port is used by the cloud-sysvmadm script at the end of the upgrade procedure. For information about how to set this parameter, see SettingGlobal Configuration Parameters in the Installation Guide. Changing this parameter will require management serverrestart. Also make sure port 8096 is open in your local host firewall to do this.

There is a script that will do this for you, all you need to do is run the script and supply the IP address for your MySQLinstance and your MySQL credentials:

# nohup cloudstack-sysvmadm -d IPaddress -u cloud -p password -a > sysvm.log 2>&1 &

You can monitor the log for progress. The process of restarting the system VMs can take an hour or more.

# tail -f sysvm.log

The output to sysvm.log will look something like this:

Stopping and starting 1 secondary storage vm(s)...Done stopping and starting secondary storage vm(s)Stopping and starting 1 console proxy vm(s)...Done stopping and starting console proxy vm(s).Stopping and starting 4 running routing vm(s)...Done restarting router(s).

26 Chapter 6. Upgrade Instruction from 4.5.x

Page 31: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CHAPTER 7

Upgrade Instruction from 4.4.x

This section will guide you from CloudStack 4.4.x to CloudStack 4.6.

Any steps that are hypervisor-specific will be called out with a note.

We recommend reading through this section once or twice before beginning your upgrade procedure, and workingthrough it on a test system before working on a production system.

Note: The following upgrade instructions should be performed regardless of hypervisor type.

Upgrade Steps:

1. Backup CloudStack database (MySQL)

2. Upgrade CloudStack management server(s)

3. Update hypervisors specific dependencies

7.1 Packages repository

Most users of CloudStack manage the installation and upgrades of CloudStack with one of Linux’s predominantpackage systems, RPM or APT. This guide assumes you’ll be using RPM and Yum (for Red Hat Enterprise Linux orCentOS), or APT and Debian packages (for Ubuntu).

Create RPM or Debian packages (as appropriate) and a repository from the 4.6 source, or check the Apache Cloud-Stack downloads page at http://cloudstack.apache.org/downloads.html for package repositories supplied by commu-nity members. You will need them for Management Server on Ubuntu or Management Server on CentOS/RHEL andHypervisor: KVM hosts upgrade.

Instructions for creating packages from the CloudStack source are in the CloudStack Installation Guide.

7.2 Update System-VM templates

Warning: Upgrading from 4.4 or older to 4.6.0 require 2 systemvm templates to be downloaded, for 4.5 and 4.6.

1. While running the existing 4.4.x system, log in to the UI as root administrator.

2. In the left navigation bar, click Templates.

3. In Select view, click Templates.

27

Page 32: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

4. Register 4.5 systemvm template:

(a) Click Register template.

The Register template dialog box is displayed.

(b) In the Register template dialog box, specify the following values (do not change these):

Hy-pervi-sor

Description

XenServerName: systemvm-xenserver-4.5Description: systemvm-xenserver-4.5URL: http://cloudstack.apt-get.eu/systemvm/4.5/systemvm64template-4.5-xen.vhd.bz2Zone: Choose the zone where this hypervisor is usedHypervisor: XenServerFormat: VHDOS Type: Debian GNU/Linux 7.0 (64-bit) (or the highest Debian release number availablein the dropdown)Extractable: noPassword Enabled: noPublic: noFeatured: noRouting: no

KVM Name: systemvm-kvm-4.5Description: systemvm-kvm-4.5URL: http://cloudstack.apt-get.eu/systemvm/4.5/systemvm64template-4.5-kvm.qcow2.bz2Zone: Choose the zone where this hypervisor is usedHypervisor: KVMFormat: QCOW2OS Type: Debian GNU/Linux 7.0 (64-bit) (or the highest Debian release number availablein the dropdown)Extractable: noPassword Enabled: noPublic: noFeatured: noRouting: no

VMware Name: systemvm-vmware-4.5Description: systemvm-vmware-4.5URL: http://cloudstack.apt-get.eu/systemvm/4.5/systemvm64template-4.5-vmware.ovaZone: Choose the zone where this hypervisor is usedHypervisor: VMwareFormat: OVAOS Type: Debian GNU/Linux 7.0 (64-bit) (or the highest Debian release number availablein the dropdown)Extractable: noPassword Enabled: noPublic: noFeatured: noRouting: no

5. Register 4.6 systemvm template:

(a) Click Register template.

The Register template dialog box is displayed.

(b) In the Register template dialog box, specify the following values (do not change these):

28 Chapter 7. Upgrade Instruction from 4.4.x

Page 33: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

Hy-pervi-sor

Description

XenServerName: systemvm-xenserver-4.6Description: systemvm-xenserver-4.6URL: http://cloudstack.apt-get.eu/systemvm/4.6/systemvm64template-4.6.0-xen.vhd.bz2Zone: Choose the zone where this hypervisor is usedHypervisor: XenServerFormat: VHDOS Type: Debian GNU/Linux 7.0 (64-bit) (or the highest Debian release number availablein the dropdown)Extractable: noPassword Enabled: noPublic: noFeatured: noRouting: no

KVM Name: systemvm-kvm-4.6Description: systemvm-kvm-4.6URL:http://cloudstack.apt-get.eu/systemvm/4.6/systemvm64template-4.6.0-kvm.qcow2.bz2Zone: Choose the zone where this hypervisor is usedHypervisor: KVMFormat: QCOW2OS Type: Debian GNU/Linux 7.0 (64-bit) (or the highest Debian release number availablein the dropdown)Extractable: noPassword Enabled: noPublic: noFeatured: noRouting: no

VMware Name: systemvm-vmware-4.6Description: systemvm-vmware-4.6URL: http://cloudstack.apt-get.eu/systemvm/4.6/systemvm64template-4.6.0-vmware.ovaZone: Choose the zone where this hypervisor is usedHypervisor: VMwareFormat: OVAOS Type: Debian GNU/Linux 7.0 (64-bit) (or the highest Debian release number availablein the dropdown)Extractable: noPassword Enabled: noPublic: noFeatured: noRouting: no

6. Watch the screen to be sure that the template downloads successfully and enters the READY state. Do notproceed until this is successful.

7.3 Database Preparation

Backup current database

1. Stop your management server or servers. Run this on all management server hosts:

7.3. Database Preparation 29

Page 34: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

$ sudo service cloudstack-management stop

2. If you are running a usage server or usage servers, stop those as well:

$ sudo service cloudstack-usage stop

3. Make a backup of your MySQL database. If you run into any issues or need to roll back the upgrade, this willassist in debugging or restoring your existing environment. You’ll be prompted for your password.

$ mysqldump -u root -p cloud > cloud-backup_`date '+%Y-%m-%d'`.sql$ mysqldump -u root -p cloud_usage > cloud_usage-backup_`date '+%Y-%m-%d'`.sql

4. (KVM Only) If primary storage of type local storage is in use, the path for this storage needs to be verified toensure it passes new validation. Check local storage by querying the cloud.storage_pool table:

$ mysql -u cloud -p -e "select id,name,path from cloud.storage_pool where pool_type='Filesystem'"

If local storage paths are found to have a trailing forward slash, remove it:

$ mysql -u cloud -p -e 'update cloud.storage_pool set path="/var/lib/libvirt/images" where path="/var/lib/libvirt/images/"';

7.4 Management Server on Ubuntu

If you are using Ubuntu, follow this procedure to upgrade your packages. If not, skip to step Management Server onCentOS/RHEL.

Note: Community Packages: This section assumes you’re using the community supplied packages for CloudStack.If you’ve created your own packages and APT repository, substitute your own URL for the ones used in these examples.

The first order of business will be to change the sources list for each system with CloudStack packages. This meansall management servers, and any hosts that have the KVM agent. (No changes should be necessary for hosts that arerunning VMware or Xen.)

7.4.1 CloudStack apt repository

Start by opening /etc/apt/sources.list.d/cloudstack.list on any systems that haveCloudStack packages installed.

This file should have one line, which contains:

deb http://cloudstack.apt-get.eu/ubuntu precise 4.4

We’ll change it to point to the new package repository:

deb http://cloudstack.apt-get.eu/ubuntu precise 4.5

Setup the public key for the above repository:

wget -qO - http://cloudstack.apt-get.eu/release.asc | sudo apt-key add -

If you’re using your own package repository, change this line to read as appropriate for your 4.6 repository.

1. Now update your apt package list:

$ sudo apt-get update

30 Chapter 7. Upgrade Instruction from 4.4.x

Page 35: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

2. Now that you have the repository configured, it’s time to upgrade the cloudstack-managementpackage.

$ sudo apt-get upgrade cloudstack-management

3. If you use CloudStack usage server

$ sudo apt-get upgrade cloudstack-usage

7.5 Management Server on CentOS/RHEL

If you are using CentOS or RHEL, follow this procedure to upgrade your packages. If not, skip to hypervisors section,then System-VMs and Virtual-Routers.

Note: Community Packages: This section assumes you’re using the community supplied packages for CloudStack.If you’ve created your own packages and yum repository, substitute your own URL for the ones used in these examples.

7.5.1 CloudStack RPM repository

The first order of business will be to change the yum repository for each system with CloudStack packages. Thismeans all management servers, and any hosts that have the KVM agent.

(No changes should be necessary for hosts that are running VMware or Xen.)

Start by opening /etc/yum.repos.d/cloudstack.repo on any systems that have CloudStack packages in-stalled.

This file should have content similar to the following:

[apache-cloudstack]name=Apache CloudStackbaseurl=http://cloudstack.apt-get.eu/rhel/4.4/enabled=1gpgcheck=0

If you are using the community provided package repository, change the base url tohttp://cloudstack.apt-get.eu/rhel/4.6/.

Setup the GPG public key if you wish to enable gpgcheck=1:

rpm --import http://cloudstack.apt-get.eu/RPM-GPG-KEY

If you’re using your own package repository, change this line to read as appropriate for your 4.6 repository.

1. Remove the deprecated dependency for awsapi.

$ sudo rpm -e --nodeps cloudstack-awsapi

2. Now that you have the repository configured, it’s time to upgrade the cloudstack-management.

$ sudo yum upgrade cloudstack-management

3. If you use CloudStack usage server

$ sudo yum upgrade cloudstack-usage

7.5. Management Server on CentOS/RHEL 31

Page 36: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

7.6 Hypervisor: XenServer

(XenServer only) Copy vhd-utils file on CloudStack management servers. Copy the file vhd-utils to/usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver.

wget -P /usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver \http://download.cloud.com.s3.amazonaws.com/tools/vhd-util

7.6.1 XenServer HA

As of Apache CloudStack 4.4, CloudStack is not responsible to promote a new pool master on a Citrix XenServerpool. In case of failure of the pool master host, the responsability of electing a new pool master as been delegated backto the HA feature of XenServer. CloudStack remain responsible to honored HA capability for Compute Offerings ofinstances. The XenServer HA feature must be enabled only for the pool master, not for virtual-machines.

Make sure XenServer has enabled HA on the pool.

To test if poolHA is currently turned on:

xe pool-list params=all | grep -E "ha-enabled|ha-config"

Output when poolHA is ON:

ha-enabled ( RO): trueha-configuration ( RO): timeout: 180

Output when poolHA is OFF:

ha-enabled ( RO): falseha-configuration ( RO):

To enable poolHA, use something like this:

xe pool-enable-ha heartbeat-sr-uuids={SR-UUID} ha-config:timeout=180

Please refer to the XenServer documentation, as there are multiple ways of configuring it either on NFS, iSCSI orFibre Channel. Be aware though, that the timeout setting is not documented. The default is 30 seconds so you maywant to bump that towards 120-180 seconds.

7.7 Hypervisor: VMware

Warning: For VMware hypervisor CloudStack management server packages must be build using “noredist”.Refer to Building from Source.

(VMware only) Additional steps are required for each VMware cluster. These steps will not affect running guests inthe cloud. These steps are required only for clouds using VMware clusters:

1. Stop the Management Server:

$ sudo service cloudstack-management stop

2. Generate the encrypted equivalent of your vCenter password:

$ java -classpath /usr/share/cloudstack-common/lib/jasypt-1.9.0.jar org.jasypt.intf.cli.JasyptPBEStringEncryptionCLI encrypt.sh input="_your_vCenter_password_" password="`cat /etc/cloudstack/management/key`" verbose=false

32 Chapter 7. Upgrade Instruction from 4.4.x

Page 37: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

Store the output from this step, we need to add this in cluster_details table and vmware_data_center tables inplace of the plain text password

3. Find the ID of the row of cluster_details table that you have to update:

$ mysql -u <username> -p<password>

select * from cloud.cluster_details;

4. Update the plain text password with the encrypted one

update cloud.cluster_details set value = '_ciphertext_from_step_1_' where id = _id_from_step_2_;

5. Confirm that the table is updated:

select * from cloud.cluster_details;

6. Find the ID of the correct row of vmware_data_center that you want to update

select * from cloud.vmware_data_center;

7. update the plain text password with the encrypted one:

update cloud.vmware_data_center set password = '_ciphertext_from_step_1_'where id = _id_from_step_5_;

8. Confirm that the table is updated:

select * from cloud.vmware_data_center;

7.8 Hypervisor: KVM

7.8.1 KVM on Ubuntu

(KVM only) Additional steps are required for each KVM host. These steps will not affect running guests in the cloud.These steps are required only for clouds using KVM as hosts and only on the KVM hosts.

1. Configure the CloudStack apt repository as detailed above.

2. Stop the running agent.

$ sudo service cloudstack-agent stop

3. Update the agent software.

$ sudo apt-get upgrade cloudstack-agent

4. Verify that the file /etc/cloudstack/agent/environment.properties has a line that reads:

paths.script=/usr/share/cloudstack-common

If not, add the line.

5. Start the agent.

$ sudo service cloudstack-agent start

7.8. Hypervisor: KVM 33

Page 38: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

7.8.2 KVM on CentOS/RHEL

For KVM hosts, upgrade the cloudstack-agent package

1. Configure the CloudStack RPM repository as detailed above.

$ sudo yum upgrade cloudstack-agent

2. Verify that the file /etc/cloudstack/agent/environment.properties has a line that reads:

paths.script=/usr/share/cloudstack-common

If not, add the line.

3. Restart the agent:

$ sudo service cloudstack-agent stop$ sudo killall jsvc$ sudo service cloudstack-agent start

7.9 Restart management services

1. If upgrading fresh installation of 4.4.0

If you are upgrading fresh installation of CloudStack 4.4.0, the following MySQL command must be executedbefore restarting the management server. If the system was running pre 4.4 and then upgraded to 4.4.0, theMySQL command is not required. Refer to: CLOUDSTACK-7813

use cloud;ALTER TABLE `snapshot_policy` ADD `display` TINYINT( 1 ) NOT NULL DEFAULT '1';

2. Now it’s time to start the management server

$ sudo service cloudstack-management start

3. If you use it, start the usage server

$ sudo service cloudstack-usage start

7.10 System-VMs and Virtual-Routers

Once you’ve upgraded the packages on your management servers, you’ll need to restart the system VMs. Ensure thatthe admin port is set to 8096 by using the “integration.api.port” global parameter. This port is used by the cloud-sysvmadm script at the end of the upgrade procedure. For information about how to set this parameter, see SettingGlobal Configuration Parameters in the Installation Guide. Changing this parameter will require management serverrestart. Also make sure port 8096 is open in your local host firewall to do this.

There is a script that will do this for you, all you need to do is run the script and supply the IP address for your MySQLinstance and your MySQL credentials:

# nohup cloudstack-sysvmadm -d IPaddress -u cloud -p password -a > sysvm.log 2>&1 &

You can monitor the log for progress. The process of restarting the system VMs can take an hour or more.

# tail -f sysvm.log

34 Chapter 7. Upgrade Instruction from 4.4.x

Page 39: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

The output to sysvm.log will look something like this:

Stopping and starting 1 secondary storage vm(s)...Done stopping and starting secondary storage vm(s)Stopping and starting 1 console proxy vm(s)...Done stopping and starting console proxy vm(s).Stopping and starting 4 running routing vm(s)...Done restarting router(s).

7.10. System-VMs and Virtual-Routers 35

Page 40: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

36 Chapter 7. Upgrade Instruction from 4.4.x

Page 41: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CHAPTER 8

Upgrade Instruction from 4.3.x

This section will guide you from CloudStack 4.3.x to CloudStack 4.6.

Any steps that are hypervisor-specific will be called out with a note.

We recommend reading through this section once or twice before beginning your upgrade procedure, and workingthrough it on a test system before working on a production system.

Note: The following upgrade instructions should be performed regardless of hypervisor type.

Upgrade Steps:

1. Backup CloudStack database (MySQL)

2. Upgrade CloudStack management server(s)

3. Update hypervisors specific dependencies

8.1 Packages repository

Most users of CloudStack manage the installation and upgrades of CloudStack with one of Linux’s predominantpackage systems, RPM or APT. This guide assumes you’ll be using RPM and Yum (for Red Hat Enterprise Linux orCentOS), or APT and Debian packages (for Ubuntu).

Create RPM or Debian packages (as appropriate) and a repository from the 4.6 source, or check the Apache Cloud-Stack downloads page at http://cloudstack.apache.org/downloads.html for package repositories supplied by commu-nity members. You will need them for Management Server on Ubuntu or Management Server on CentOS/RHEL andHypervisor: KVM hosts upgrade.

Instructions for creating packages from the CloudStack source are in the CloudStack Installation Guide.

8.2 Update System-VM templates

Warning: Upgrading from 4.4 or older to 4.6.0 require 2 systemvm templates to be downloaded, for 4.5 and 4.6.

1. While running the existing 4.3.x system, log in to the UI as root administrator.

2. In the left navigation bar, click Templates.

3. In Select view, click Templates.

37

Page 42: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

4. Register 4.5 systemvm template:

(a) Click Register template.

The Register template dialog box is displayed.

(b) In the Register template dialog box, specify the following values (do not change these):

Hy-pervi-sor

Description

XenServerName: systemvm-xenserver-4.5Description: systemvm-xenserver-4.5URL: http://cloudstack.apt-get.eu/systemvm/4.5/systemvm64template-4.5-xen.vhd.bz2Zone: Choose the zone where this hypervisor is usedHypervisor: XenServerFormat: VHDOS Type: Debian GNU/Linux 7.0 (64-bit) (or the highest Debian release number availablein the dropdown)Extractable: noPassword Enabled: noPublic: noFeatured: noRouting: no

KVM Name: systemvm-kvm-4.5Description: systemvm-kvm-4.5URL: http://cloudstack.apt-get.eu/systemvm/4.5/systemvm64template-4.5-kvm.qcow2.bz2Zone: Choose the zone where this hypervisor is usedHypervisor: KVMFormat: QCOW2OS Type: Debian GNU/Linux 7.0 (64-bit) (or the highest Debian release number availablein the dropdown)Extractable: noPassword Enabled: noPublic: noFeatured: noRouting: no

VMware Name: systemvm-vmware-4.5Description: systemvm-vmware-4.5URL: http://cloudstack.apt-get.eu/systemvm/4.5/systemvm64template-4.5-vmware.ovaZone: Choose the zone where this hypervisor is usedHypervisor: VMwareFormat: OVAOS Type: Debian GNU/Linux 7.0 (64-bit) (or the highest Debian release number availablein the dropdown)Extractable: noPassword Enabled: noPublic: noFeatured: noRouting: no

5. Register 4.6 systemvm template:

(a) Click Register template.

The Register template dialog box is displayed.

(b) In the Register template dialog box, specify the following values (do not change these):

38 Chapter 8. Upgrade Instruction from 4.3.x

Page 43: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

Hy-pervi-sor

Description

XenServerName: systemvm-xenserver-4.6Description: systemvm-xenserver-4.6URL: http://cloudstack.apt-get.eu/systemvm/4.6/systemvm64template-4.6.0-xen.vhd.bz2Zone: Choose the zone where this hypervisor is usedHypervisor: XenServerFormat: VHDOS Type: Debian GNU/Linux 7.0 (64-bit) (or the highest Debian release number availablein the dropdown)Extractable: noPassword Enabled: noPublic: noFeatured: noRouting: no

KVM Name: systemvm-kvm-4.6Description: systemvm-kvm-4.6URL:http://cloudstack.apt-get.eu/systemvm/4.6/systemvm64template-4.6.0-kvm.qcow2.bz2Zone: Choose the zone where this hypervisor is usedHypervisor: KVMFormat: QCOW2OS Type: Debian GNU/Linux 7.0 (64-bit) (or the highest Debian release number availablein the dropdown)Extractable: noPassword Enabled: noPublic: noFeatured: noRouting: no

VMware Name: systemvm-vmware-4.6Description: systemvm-vmware-4.6URL: http://cloudstack.apt-get.eu/systemvm/4.6/systemvm64template-4.6.0-vmware.ovaZone: Choose the zone where this hypervisor is usedHypervisor: VMwareFormat: OVAOS Type: Debian GNU/Linux 7.0 (64-bit) (or the highest Debian release number availablein the dropdown)Extractable: noPassword Enabled: noPublic: noFeatured: noRouting: no

6. Watch the screen to be sure that the template downloads successfully and enters the READY state. Do notproceed until this is successful.

8.3 Database Preparation

Backup current database

1. Stop your management server or servers. Run this on all management server hosts:

8.3. Database Preparation 39

Page 44: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

$ sudo service cloudstack-management stop

2. If you are running a usage server or usage servers, stop those as well:

$ sudo service cloudstack-usage stop

3. Make a backup of your MySQL database. If you run into any issues or need to roll back the upgrade, this willassist in debugging or restoring your existing environment. You’ll be prompted for your password.

$ mysqldump -u root -p cloud > cloud-backup_`date '+%Y-%m-%d'`.sql$ mysqldump -u root -p cloud_usage > cloud_usage-backup_`date '+%Y-%m-%d'`.sql

4. (KVM Only) If primary storage of type local storage is in use, the path for this storage needs to be verified toensure it passes new validation. Check local storage by querying the cloud.storage_pool table:

$ mysql -u cloud -p -e "select id,name,path from cloud.storage_pool where pool_type='Filesystem'"

If local storage paths are found to have a trailing forward slash, remove it:

$ mysql -u cloud -p -e 'update cloud.storage_pool set path="/var/lib/libvirt/images" where path="/var/lib/libvirt/images/"';

8.4 Management Server on Ubuntu

If you are using Ubuntu, follow this procedure to upgrade your packages. If not, skip to step Management Server onCentOS/RHEL.

Note: Community Packages: This section assumes you’re using the community supplied packages for CloudStack.If you’ve created your own packages and APT repository, substitute your own URL for the ones used in these examples.

The first order of business will be to change the sources list for each system with CloudStack packages. This meansall management servers, and any hosts that have the KVM agent. (No changes should be necessary for hosts that arerunning VMware or Xen.)

8.4.1 CloudStack apt repository

Start by opening /etc/apt/sources.list.d/cloudstack.list on any systems that have CloudStackpackages installed.

This file should have one line, which contains:

deb http://cloudstack.apt-get.eu/ubuntu precise 4.3

We’ll change it to point to the new package repository:

deb http://cloudstack.apt-get.eu/ubuntu precise 4.6

Setup the public key for the above repository:

wget -qO - http://cloudstack.apt-get.eu/release.asc | sudo apt-key add -

If you’re using your own package repository, change this line to read as appropriate for your 4.6 repository.

1. Now update your apt package list:

$ sudo apt-get update

40 Chapter 8. Upgrade Instruction from 4.3.x

Page 45: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

2. Now that you have the repository configured, it’s time to upgrade the cloudstack-management package.

$ sudo apt-get upgrade cloudstack-management

3. If you use CloudStack usage server

$ sudo apt-get upgrade cloudstack-usage

8.5 Management Server on CentOS/RHEL

If you are using CentOS or RHEL, follow this procedure to upgrade your packages. If not, skip to hypervisors section,then System-VMs and Virtual-Routers.

Note: Community Packages: This section assumes you’re using the community supplied packages for CloudStack.If you’ve created your own packages and yum repository, substitute your own URL for the ones used in these examples.

8.5.1 CloudStack RPM repository

The first order of business will be to change the yum repository for each system with CloudStack packages. Thismeans all management servers, and any hosts that have the KVM agent.

(No changes should be necessary for hosts that are running VMware or Xen.)

Start by opening /etc/yum.repos.d/cloudstack.repo on any systems that have CloudStack packages in-stalled.

This file should have content similar to the following:

[apache-cloudstack]name=Apache CloudStackbaseurl=http://cloudstack.apt-get.eu/rhel/4.3/enabled=1gpgcheck=0

If you are using the community provided package repository, change the base url tohttp://cloudstack.apt-get.eu/rhel/4.6/.

Setup the GPG public key if you wish to enable gpgcheck=1:

rpm --import http://cloudstack.apt-get.eu/RPM-GPG-KEY

If you’re using your own package repository, change this line to read as appropriate for your 4.6 repository.

1. Remove the deprecated dependency for awsapi.

$ sudo rpm -e --nodeps cloudstack-awsapi

2. Now that you have the repository configured, it’s time to upgrade the cloudstack-management.

$ sudo yum upgrade cloudstack-management

3. If you use CloudStack usage server

$ sudo yum upgrade cloudstack-usage

8.5. Management Server on CentOS/RHEL 41

Page 46: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

8.6 Hypervisor: XenServer

(XenServer only) Copy vhd-utils file on CloudStack management servers. Copy the file vhd-utils to/usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver.

wget -P /usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver \http://download.cloud.com.s3.amazonaws.com/tools/vhd-util

8.6.1 XenServer HA

As of Apache CloudStack 4.4, CloudStack is not responsible to promote a new pool master on a Citrix XenServerpool. In case of failure of the pool master host, the responsability of electing a new pool master as been delegated backto the HA feature of XenServer. CloudStack remain responsible to honored HA capability for Compute Offerings ofinstances. The XenServer HA feature must be enabled only for the pool master, not for virtual-machines.

Make sure XenServer has enabled HA on the pool.

To test if poolHA is currently turned on:

xe pool-list params=all | grep -E "ha-enabled|ha-config"

Output when poolHA is ON:

ha-enabled ( RO): trueha-configuration ( RO): timeout: 180

Output when poolHA is OFF:

ha-enabled ( RO): falseha-configuration ( RO):

To enable poolHA, use something like this:

xe pool-enable-ha heartbeat-sr-uuids={SR-UUID} ha-config:timeout=180

Please refer to the XenServer documentation, as there are multiple ways of configuring it either on NFS, iSCSI orFibre Channel. Be aware though, that the timeout setting is not documented. The default is 30 seconds so you maywant to bump that towards 120-180 seconds.

8.7 Hypervisor: VMware

Warning: For VMware hypervisor CloudStack management server packages must be build using “noredist”.Refer to Building from Source.

(VMware only) Additional steps are required for each VMware cluster. These steps will not affect running guests inthe cloud. These steps are required only for clouds using VMware clusters:

1. Stop the Management Server:

$ sudo service cloudstack-management stop

2. Generate the encrypted equivalent of your vCenter password:

$ java -classpath /usr/share/cloudstack-common/lib/jasypt-1.9.0.jar org.jasypt.intf.cli.JasyptPBEStringEncryptionCLI encrypt.sh input="_your_vCenter_password_" password="`cat /etc/cloudstack/management/key`" verbose=false

42 Chapter 8. Upgrade Instruction from 4.3.x

Page 47: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

Store the output from this step, we need to add this in cluster_details table and vmware_data_center tables inplace of the plain text password

3. Find the ID of the row of cluster_details table that you have to update:

$ mysql -u <username> -p<password>

select * from cloud.cluster_details;

4. Update the plain text password with the encrypted one

update cloud.cluster_details set value = '_ciphertext_from_step_1_' where id = _id_from_step_2_;

5. Confirm that the table is updated:

select * from cloud.cluster_details;

6. Find the ID of the correct row of vmware_data_center that you want to update

select * from cloud.vmware_data_center;

7. update the plain text password with the encrypted one:

update cloud.vmware_data_center set password = '_ciphertext_from_step_1_' where id = _id_from_step_5_;

8. Confirm that the table is updated:

select * from cloud.vmware_data_center;

8.8 Hypervisor: KVM

8.8.1 KVM on Ubuntu

(KVM only) Additional steps are required for each KVM host. These steps will not affect running guests in the cloud.These steps are required only for clouds using KVM as hosts and only on the KVM hosts.

1. Configure the CloudStack apt repository as detailed above.

2. Stop the running agent.

$ sudo service cloudstack-agent stop

3. Update the agent software.

$ sudo apt-get upgrade cloudstack-agent

4. Verify that the file /etc/cloudstack/agent/environment.properties has a line that reads:

paths.script=/usr/share/cloudstack-common

If not, add the line.

5. Start the agent.

$ sudo service cloudstack-agent start

8.8. Hypervisor: KVM 43

Page 48: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

8.8.2 KVM on CentOS/RHEL

For KVM hosts, upgrade the cloudstack-agent package

1. Configure the CloudStack RPM repository as detailed above.

$ sudo yum upgrade cloudstack-agent

2. Verify that the file /etc/cloudstack/agent/environment.properties has a line that reads:

paths.script=/usr/share/cloudstack-common

If not, add the line.

3. Restart the agent:

$ sudo service cloudstack-agent stop$ sudo killall jsvc$ sudo service cloudstack-agent start

8.9 Restart management services

1. Now it’s time to start the management server

$ sudo service cloudstack-management start

2. If you use it, start the usage server

$ sudo service cloudstack-usage start

8.10 System-VMs and Virtual-Routers

Once you’ve upgraded the packages on your management servers, you’ll need to restart the system VMs. Ensure thatthe admin port is set to 8096 by using the “integration.api.port” global parameter. This port is used by the cloud-sysvmadm script at the end of the upgrade procedure. For information about how to set this parameter, see SettingGlobal Configuration Parameters in the Installation Guide. Changing this parameter will require management serverrestart. Also make sure port 8096 is open in your local host firewall to do this.

There is a script that will do this for you, all you need to do is run the script and supply the IP address for your MySQLinstance and your MySQL credentials:

# nohup cloudstack-sysvmadm -d IPaddress -u cloud -p password -a > sysvm.log 2>&1 &

You can monitor the log for progress. The process of restarting the system VMs can take an hour or more.

# tail -f sysvm.log

The output to sysvm.log will look something like this:

Stopping and starting 1 secondary storage vm(s)...Done stopping and starting secondary storage vm(s)Stopping and starting 1 console proxy vm(s)...Done stopping and starting console proxy vm(s).Stopping and starting 4 running routing vm(s)...Done restarting router(s).

44 Chapter 8. Upgrade Instruction from 4.3.x

Page 49: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CHAPTER 9

Upgrade Instruction from 4.2.x

This section will guide you from CloudStack 4.2.x to CloudStack 4.6.

If you run into any issues during upgrades, please feel free to ask questions on [email protected] [email protected].

Warning: Depreciation of realhostip.com DNS and SSL certificateThe realhostip.com dynamic DNS resolution service is being retired this summer. In advance of that, CloudStack4.3 and later no longer uses realhostip.com DNS domains or SSL certificates to encrypt Console Proxy or file copycommunications.

Any steps that are hypervisor-specific will be called out with a note.

We recommend reading through this section once or twice before beginning your upgrade procedure, and workingthrough it on a test system before working on a production system.

Note: The following upgrade instructions should be performed regardless of hypervisor type.

Upgrade Steps:

1. Install new System-VM templates

2. Backup CloudStack database (MySQL)

3. Upgrade CloudStack management server(s)

4. Update hypervisors specific dependencies

5. Restart System-VMs and Virtual-Routers

9.1 Packages repository

Most users of CloudStack manage the installation and upgrades of CloudStack with one of Linux’s predominantpackage systems, RPM or APT. This guide assumes you’ll be using RPM and Yum (for Red Hat Enterprise Linux orCentOS), or APT and Debian packages (for Ubuntu).

Create RPM or Debian packages (as appropriate) and a repository from the 4.6 source, or check the Apache Cloud-Stack downloads page at http://cloudstack.apache.org/downloads.html for package repositories supplied by commu-nity members. You will need them for Management Server Ubuntu or Management Server CentOS/RHEL and Hyper-visor: KVM hosts upgrade.

Instructions for creating packages from the CloudStack source are in the CloudStack Installation Guide.

45

Page 50: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

9.2 Update System-VM templates

Warning: Upgrading from 4.4 or older to 4.6.0 require 2 systemvm templates to be downloaded, for 4.5 and 4.6.

1. While running the existing 4.2.x system, log in to the UI as root administrator.

2. In the left navigation bar, click Templates.

3. In Select view, click Templates.

4. Register 4.5 systemvm template:

(a) Click Register template.

The Register template dialog box is displayed.

(b) In the Register template dialog box, specify the following values (do not change these):

46 Chapter 9. Upgrade Instruction from 4.2.x

Page 51: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

Hy-pervi-sor

Description

XenServerName: systemvm-xenserver-4.5Description: systemvm-xenserver-4.5URL: http://cloudstack.apt-get.eu/systemvm/4.5/systemvm64template-4.5-xen.vhd.bz2Zone: Choose the zone where this hypervisor is usedHypervisor: XenServerFormat: VHDOS Type: Debian GNU/Linux 7.0 (64-bit) (or the highest Debian release number availablein the dropdown)Extractable: noPassword Enabled: noPublic: noFeatured: noRouting: no

KVM Name: systemvm-kvm-4.5Description: systemvm-kvm-4.5URL: http://cloudstack.apt-get.eu/systemvm/4.5/systemvm64template-4.5-kvm.qcow2.bz2Zone: Choose the zone where this hypervisor is usedHypervisor: KVMFormat: QCOW2OS Type: Debian GNU/Linux 7.0 (64-bit) (or the highest Debian release number availablein the dropdown)Extractable: noPassword Enabled: noPublic: noFeatured: noRouting: no

VMware Name: systemvm-vmware-4.5Description: systemvm-vmware-4.5URL: http://cloudstack.apt-get.eu/systemvm/4.5/systemvm64template-4.5-vmware.ovaZone: Choose the zone where this hypervisor is usedHypervisor: VMwareFormat: OVAOS Type: Debian GNU/Linux 7.0 (64-bit) (or the highest Debian release number availablein the dropdown)Extractable: noPassword Enabled: noPublic: noFeatured: noRouting: no

5. Register 4.6 systemvm template:

(a) Click Register template.

The Register template dialog box is displayed.

(b) In the Register template dialog box, specify the following values (do not change these):

9.2. Update System-VM templates 47

Page 52: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

Hy-pervi-sor

Description

XenServerName: systemvm-xenserver-4.6Description: systemvm-xenserver-4.6URL: http://cloudstack.apt-get.eu/systemvm/4.6/systemvm64template-4.6.0-xen.vhd.bz2Zone: Choose the zone where this hypervisor is usedHypervisor: XenServerFormat: VHDOS Type: Debian GNU/Linux 7.0 (64-bit) (or the highest Debian release number availablein the dropdown)Extractable: noPassword Enabled: noPublic: noFeatured: noRouting: no

KVM Name: systemvm-kvm-4.6Description: systemvm-kvm-4.6URL:http://cloudstack.apt-get.eu/systemvm/4.6/systemvm64template-4.6.0-kvm.qcow2.bz2Zone: Choose the zone where this hypervisor is usedHypervisor: KVMFormat: QCOW2OS Type: Debian GNU/Linux 7.0 (64-bit) (or the highest Debian release number availablein the dropdown)Extractable: noPassword Enabled: noPublic: noFeatured: noRouting: no

VMware Name: systemvm-vmware-4.6Description: systemvm-vmware-4.6URL: http://cloudstack.apt-get.eu/systemvm/4.6/systemvm64template-4.6.0-vmware.ovaZone: Choose the zone where this hypervisor is usedHypervisor: VMwareFormat: OVAOS Type: Debian GNU/Linux 7.0 (64-bit) (or the highest Debian release number availablein the dropdown)Extractable: noPassword Enabled: noPublic: noFeatured: noRouting: no

6. Watch the screen to be sure that the template downloads successfully and enters the READY state. Do notproceed until this is successful.

9.3 Database Preparation

Backup current database

1. Stop your management server or servers. Run this on all management server hosts:

48 Chapter 9. Upgrade Instruction from 4.2.x

Page 53: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

$ sudo service cloudstack-management stop

2. If you are running a usage server or usage servers, stop those as well:

$ sudo service cloudstack-usage stop

3. Make a backup of your MySQL database. If you run into any issues or need to roll back the upgrade, this willassist in debugging or restoring your existing environment. You’ll be prompted for your password.

$ mysqldump -u root -p cloud > cloud-backup_`date '+%Y-%m-%d'`.sql$ mysqldump -u root -p cloud_usage > cloud_usage-backup_`date '+%Y-%m-%d'`.sql

4. (KVM Only) If primary storage of type local storage is in use, the path for this storage needs to be verified toensure it passes new validation. Check local storage by querying the cloud.storage_pool table:

$ mysql -u cloud -p -e "select id,name,path from cloud.storage_pool where pool_type='Filesystem'"

If local storage paths are found to have a trailing forward slash, remove it:

$ mysql -u cloud -p -e 'update cloud.storage_pool set path="/var/lib/libvirt/images" where path="/var/lib/libvirt/images/"';

9.4 Management Server Ubuntu

If you are using Ubuntu, follow this procedure to upgrade your packages. If not, skip to step Management ServerCentOS/RHEL.

Note: Community Packages: This section assumes you’re using the community supplied packages for CloudStack.If you’ve created your own packages and APT repository, substitute your own URL for the ones used in these examples.

The first order of business will be to change the sources list for each system with CloudStack packages. This meansall management servers, and any hosts that have the KVM agent. (No changes should be necessary for hosts that arerunning VMware or Xen.)

9.4.1 CloudStack apt repository

Start by opening /etc/apt/sources.list.d/cloudstack.list on any systems that have CloudStackpackages installed.

This file should have one line, which contains:

deb http://cloudstack.apt-get.eu/ubuntu precise 4.2

We’ll change it to point to the new package repository:

deb http://cloudstack.apt-get.eu/ubuntu precise 4.6

Setup the public key for the above repository:

wget -qO - http://cloudstack.apt-get.eu/release.asc | sudo apt-key add -

If you’re using your own package repository, change this line to read as appropriate for your 4.6 repository.

1. Now update your apt package list:

$ sudo apt-get update

9.4. Management Server Ubuntu 49

Page 54: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

2. Now that you have the repository configured, it’s time to upgrade the cloudstack-management package.

$ sudo apt-get upgrade cloudstack-management

3. If you use CloudStack usage server

$ sudo apt-get upgrade cloudstack-usage

9.5 Management Server CentOS/RHEL

If you are using CentOS or RHEL, follow this procedure to upgrade your packages. If not, skip to hypervisors section,then System-VMs and Virtual-Routers.

Note: Community Packages: This section assumes you’re using the community supplied packages for CloudStack.If you’ve created your own packages and yum repository, substitute your own URL for the ones used in these examples.

9.5.1 CloustStack RPM repository

The first order of business will be to change the yum repository for each system with CloudStack packages. Thismeans all management servers, and any hosts that have the KVM agent.

(No changes should be necessary for hosts that are running VMware or Xen.)

Start by opening /etc/yum.repos.d/cloudstack.repo on any systems that have CloudStack packages in-stalled.

This file should have content similar to the following:

[apache-cloudstack]name=Apache CloudStackbaseurl=http://cloudstack.apt-get.eu/rhel/4.2/enabled=1gpgcheck=0

If you are using the community provided package repository, change the baseurl tohttp://cloudstack.apt-get.eu/rhel/4.6/.

Setup the GPG public key if you wish to enable gpgcheck=1:

rpm --import http://cloudstack.apt-get.eu/RPM-GPG-KEY

If you’re using your own package repository, change this line to read as appropriate for your 4.6 repository.

1. Remove the deprecated dependency for awsapi.

$ sudo rpm -e --nodeps cloudstack-awsapi

2. Now that you have the repository configured, it’s time to upgrade the cloudstack-management.

$ sudo yum upgrade cloudstack-management

3. If you use CloudStack usage server

$ sudo yum upgrade cloudstack-usage

50 Chapter 9. Upgrade Instruction from 4.2.x

Page 55: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

9.6 Hypervisor: Xen/XenServer

(XenServer only) Copy vhd-utils file on CloudStack management servers. Copy the file vhd-utils to/usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver.

wget -P /usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver \http://download.cloud.com.s3.amazonaws.com/tools/vhd-util

9.6.1 XenServer HA

As of Apache CloudStack 4.4, CloudStack is not responsible to promote a new pool master on a Citrix XenServerpool. In case of failure of the pool master host, the responsability of electing a new pool master as been delegated backto the HA feature of XenServer. CloudStack remain responsible to honored HA capability for Compute Offerings ofinstances. The XenServer HA feature must be enabled only for the pool master, not for virtual-machines.

Make sure XenServer has enabled HA on the pool.

To test if poolHA is currently turned on:

xe pool-list params=all | grep -E "ha-enabled|ha-config"

Output when poolHA is ON:

ha-enabled ( RO): trueha-configuration ( RO): timeout: 180

Output when poolHA is OFF:

ha-enabled ( RO): falseha-configuration ( RO):

To enable poolHA, use something like this:

xe pool-enable-ha heartbeat-sr-uuids={SR-UUID} ha-config:timeout=180

Please refer to the XenServer documentation, as there are multiple ways of configuring it either on NFS, iSCSI orFibre Channel. Be aware though, that the timeout setting is not documented. The default is 30 seconds so you maywant to bump that towards 120-180 seconds.

9.7 Hypervisor: VMware

Warning: For VMware hypervisor CloudStack management server packages must be build using “noredist”.Refer to Building from Source.

(VMware only) Additional steps are required for each VMware cluster. These steps will not affect running guests inthe cloud. These steps are required only for clouds using VMware clusters:

1. Stop the Management Server:

$ sudo service cloudstack-management stop

2. Generate the encrypted equivalent of your vCenter password:

$ java -classpath /usr/share/cloudstack-common/lib/jasypt-1.9.0.jar org.jasypt.intf.cli.JasyptPBEStringEncryptionCLI encrypt.sh input="_your_vCenter_password_" password="`cat /etc/cloudstack/management/key`" verbose=false

9.6. Hypervisor: Xen/XenServer 51

Page 56: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

Store the output from this step, we need to add this in cluster_details table and vmware_data_center tables inplace of the plain text password

3. Find the ID of the row of cluster_details table that you have to update:

$ mysql -u <username> -p<password>

select * from cloud.cluster_details;

4. Update the plain text password with the encrypted one

update cloud.cluster_details set value = '_ciphertext_from_step_1_' where id = _id_from_step_2_;

5. Confirm that the table is updated:

select * from cloud.cluster_details;

6. Find the ID of the correct row of vmware_data_center that you want to update

select * from cloud.vmware_data_center;

7. Update the plain text password with the encrypted one:

update cloud.vmware_data_center set password = '_ciphertext_from_step_1_' where id = _id_from_step_5_;

8. Confirm that the table is updated:

select * from cloud.vmware_data_center;

9.8 Hypervisor: KVM

9.8.1 KVM on Ubuntu

(KVM only) Additional steps are required for each KVM host. These steps will not affect running guests in the cloud.These steps are required only for clouds using KVM as hosts and only on the KVM hosts.

1. Configure the CloudStack apt repository as detailed above.

2. Stop the running agent.

$ sudo service cloudstack-agent stop

3. Update the agent software.

$ sudo apt-get upgrade cloudstack-agent

4. Verify that the file /etc/cloudstack/agent/environment.properties has a line that reads:

paths.script=/usr/share/cloudstack-common

If not, add the line.

5. Start the agent.

$ sudo service cloudstack-agent start

52 Chapter 9. Upgrade Instruction from 4.2.x

Page 57: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

9.8.2 KVM on CentOS/RHEL

For KVM hosts, upgrade the cloudstack-agent package

1. Configure the CloustStack RPM repository as detailed above.

$ sudo yum upgrade cloudstack-agent

2. Verify that the file /etc/cloudstack/agent/environment.properties has a line that reads:

paths.script=/usr/share/cloudstack-common

If not, add the line.

3. Restart the agent:

$ sudo service cloudstack-agent stop$ sudo killall jsvc$ sudo service cloudstack-agent start

9.9 Restart management services

1. Now it’s time to start the management server

$ sudo service cloudstack-management start

2. If you use it, start the usage server

$ sudo service cloudstack-usage start

9.10 Settings Changes

After upgrading to 4.2 and later, Settings mem.overporvisioning.factor andcpu.overporvisioning.factor are now at the cluster level and be set to 1 which is the default.

If Global Settings mem.overporvisioning.factor and cpu.overporvisioning.factor have beenchanged prior the upgrade to 4.2 and later, the upgrade process will be reset them to 1. Values can be changed byediting clusters settings.

All clusters created after the upgrade will get created with the Global Settings values formem.overporvisioning.factor and cpu.overporvisioning.factor.

9.11 System-VMs and Virtual-Routers

Once you’ve upgraded the packages on your management servers, you’ll need to restart the system VMs. Ensure thatthe admin port is set to 8096 by using the “integration.api.port” global parameter. This port is used by the cloud-sysvmadm script at the end of the upgrade procedure. For information about how to set this parameter, see SettingGlobal Configuration Parameters in the Installation Guide. Changing this parameter will require management serverrestart. Also make sure port 8096 is open in your local host firewall to do this.

There is a script that will do this for you, all you need to do is run the script and supply the IP address for your MySQLinstance and your MySQL credentials:

9.9. Restart management services 53

Page 58: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

# nohup cloudstack-sysvmadm -d IPaddress -u cloud -p password -a > sysvm.log 2>&1 &

You can monitor the log for progress. The process of restarting the system VMs can take an hour or more.

# tail -f sysvm.log

The output to sysvm.log will look something like this:

Stopping and starting 1 secondary storage vm(s)...Done stopping and starting secondary storage vm(s)Stopping and starting 1 console proxy vm(s)...Done stopping and starting console proxy vm(s).Stopping and starting 4 running routing vm(s)...Done restarting router(s).

54 Chapter 9. Upgrade Instruction from 4.2.x

Page 59: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CHAPTER 10

Known Issues in 4.6.0

Apache CloudStack uses Jira to track its issues. All new features and bugs for 4.6.0 have been tracked in Jira, andhave a standard naming convention of “CLOUDSTACK-NNNN” where “NNNN” is the issue number.

For the list of known issues, see Known Issues in 4.6.0.

Bug ID DescriptionCLOUDSTACK-9015 Redundant VPC Virtual Router’s state is BACKUP & BACKUP or MASTER & MASTER...CLOUDSTACK-9027 In the default egress allow network with existing egress rules to block traffic,...CLOUDSTACK-9035 Password file is stored only with Master when we Reset Password on the VM....CLOUDSTACK-9059 Snapshot on S3 fails when delta is zero...CLOUDSTACK-9060 Create volume / template from S3 snapshot fails...CLOUDSTACK-7375 [UI] RBD not available under list of protocols for primary storage during zone c...CLOUDSTACK-7618 Baremetal - AddHost() API docs should include parameters - cpunumber,cpuspeed,me...CLOUDSTACK-7839 Unable to live migrate an instance to another host in a cluster from which the t...CLOUDSTACK-7853 Hosts that are temporary Disconnected and get behind on ping (PingTimeout) turn ...CLOUDSTACK-7857 CitrixResourceBase wrongly calculates total memory on hosts with a lot of memory...CLOUDSTACK-8142 [Hyper-V] While creating system vms attach systemvm.iso directly from sec storag...CLOUDSTACK-8185 GUI and failed async commands issue...CLOUDSTACK-8389 Volume to Template Conversion Broken...CLOUDSTACK-8437 Automation: test_04_create_multiple_networks_with_lb_1_network_offering - Fails...CLOUDSTACK-8485 listAPIs are taking too long to return results...CLOUDSTACK-8694 monitorServices.py is not running as a cron job in VR...CLOUDSTACK-8695 Dashboard Alerts for VR Service failures does not contain the service’s name...CLOUDSTACK-8724 Multiple IP’s on management server break patchviasocket.pl...CLOUDSTACK-8768 [HyperV]Migrating volume from cluster wide storage to Zone wide storage or vicev...CLOUDSTACK-8770 [HyperV]Proper Message should be displayed when snapshot fails on Hyper-V...CLOUDSTACK-8775 [HyperV]NPE while attaching Local storage volume to instance whose root volume i...CLOUDSTACK-8787 Network Update from Standalone VR offering to RVR offering is failing with Runti...CLOUDSTACK-8796 the api calll linkdomaintoldap should fail if admin is given and an account isnt...CLOUDSTACK-8809 Secondary Storage does not clean-up after time-out...CLOUDSTACK-8813 No notification is sent when a node is added to or removed from a cluster...CLOUDSTACK-8845 list snapshot without id is failing with Unable to determine the storage pool of...CLOUDSTACK-8852 Cloudstack Database shows that management server is UP when it is actually stopp...CLOUDSTACK-8855 Improve Error Message for Host Alert State...CLOUDSTACK-8860 Improve error messages in VM deployment code path...CLOUDSTACK-8862 Issuing multiple attach-volume commands simultaneously can be problematic...CLOUDSTACK-8868 use PasswordGenerator.generateRandomPassword() to generate systemvm passwords...CLOUDSTACK-8885 None of the users is able to login to cloudstack when RabbitMQ connections are b...

Continued on next page

55

Page 60: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

Table 10.1 – continued from previous pageBug ID DescriptionCLOUDSTACK-8889 Primary Storage count for an account does not decrease when a Data Disk is delet...CLOUDSTACK-8896 Allocated percentage of storage can go beyond 100%...CLOUDSTACK-8902 Restart Network fails in EIP/ELB zone...CLOUDSTACK-8912 listGuestOsMapping doesn’t list by id or ostypeid....CLOUDSTACK-8929 The list of VMs that can be assigned to a load balancer rule is not updated afte...CLOUDSTACK-8994 Activity of the password server isn’t logged....CLOUDSTACK-9018 Egress rule with 0.0.0.0/0 - all (protocol) doesn’t get removed from the VR...CLOUDSTACK-9023 private keys get logged when UpdateCustomCertificate gets called...CLOUDSTACK-9036 IPV6 CIDR not recognized (Parser BUG)...CLOUDSTACK-9061 cannot deploy Instance when using Swift as Secondary Storage...CLOUDSTACK-8408 unused i18n keys...CLOUDSTACK-9056 Upgrade 4.4.1 to 4.6.0 fails: 4.5.0 KVM SystemVm template not found...CLOUDSTACK-8781 Superfluous field during VPC creation...CLOUDSTACK-8918 [Install] Db Error after install - Unknown column ‘iso_id1’ in ‘field list’...

10.1 All known issues

For the list of known issues, see Known Issues in 4.6.

Bug ID DescriptionCLOUDSTACK-8948 Volume migration not working in asynchronous way...CLOUDSTACK-8972 When Creating Jobs from GUI. Job does not start, no Notifications pending...CLOUDSTACK-7364 NetScaler won’t create the Public VLAN and Bind the IP to it...CLOUDSTACK-7406 Templates using Swift provider reports physical size, and not the virtual size i...CLOUDSTACK-7443 Cannot launch SSVMs when using Swift as Secondary Storage...CLOUDSTACK-7578 XenServerInvestigator should do better investigation in case of OVS or other net...CLOUDSTACK-7591 Dynamic scaling doesn’t work in CloudStack 4.4 with vmware...CLOUDSTACK-7751 Autoscaling without netscaler...CLOUDSTACK-7813 Management server is stuck after upgrade from 4.4.0 to 4.4.1...CLOUDSTACK-7827 storage migration timeout, loss of data...CLOUDSTACK-7907 UI heavily broken...CLOUDSTACK-8148 dvSwitch Broken with java.lang.NumberFormatException...CLOUDSTACK-8201 KVM Snapshot to Template to New Instance is not working...CLOUDSTACK-8302 Cleanup snapshot on KVM with RBD...CLOUDSTACK-8328 NPE while deleteing instance which has custom compute offering...CLOUDSTACK-8558 KVM snapshots are failing at Ubuntu 14.04 LTS...CLOUDSTACK-8691 deployVirtualMachine should not error when userdata is provided if at least one ...CLOUDSTACK-8747 The agent doesn’t reconnect if there are stopped VMs...CLOUDSTACK-8810 Async jobs are not cleaned due to foreign key constraint failure resulting in ma...CLOUDSTACK-8839 close concurrent ip disable static nat commands for virtual router will cause so...CLOUDSTACK-8909 Web Console not working with Hyper-V Windows Server 2012 R2...CLOUDSTACK-8914 cannot delete pod, NPE...CLOUDSTACK-9015 Redundant VPC Virtual Router’s state is BACKUP & BACKUP or MASTER & MASTER...CLOUDSTACK-9025 Unable to deploy VM instance from template if template spin from linked clone sn...CLOUDSTACK-9027 In the default egress allow network with existing egress rules to block traffic,...CLOUDSTACK-9035 Password file is stored only with Master when we Reset Password on the VM....CLOUDSTACK-9042 VR: Missing dhcp entries in /etc/dhpchosts.txt after starting a few VMs...CLOUDSTACK-9058 Password server causes Windows VMs to switch to blank passwords after each reboo...

Continued on next page

56 Chapter 10. Known Issues in 4.6.0

Page 61: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

Table 10.2 – continued from previous pageBug ID DescriptionCLOUDSTACK-9059 Snapshot on S3 fails when delta is zero...CLOUDSTACK-9060 Create volume / template from S3 snapshot fails...CLOUDSTACK-7365 Upgrading without proper systemvm template corrupt cloudstack management server...CLOUDSTACK-7375 [UI] RBD not available under list of protocols for primary storage during zone c...CLOUDSTACK-7449 “CloudRuntimeException: Can not see storage pool” after trying to add a new host...CLOUDSTACK-7618 Baremetal - AddHost() API docs should include parameters - cpunumber,cpuspeed,me...CLOUDSTACK-7640 Failed to delete template that failed to download...CLOUDSTACK-7750 Xen server can not mount secondary CIFS storage...CLOUDSTACK-7789 I was updated from version 4.4.0 of Apache CloudStack to 4.4.1. It does not work...CLOUDSTACK-7839 Unable to live migrate an instance to another host in a cluster from which the t...CLOUDSTACK-7853 Hosts that are temporary Disconnected and get behind on ping (PingTimeout) turn ...CLOUDSTACK-7857 CitrixResourceBase wrongly calculates total memory on hosts with a lot of memory...CLOUDSTACK-7858 Implement separate network throttling rate on VR’s Public NIC...CLOUDSTACK-7936 System VM’s are getting stuck in starting mode after Hypervisor reboot...CLOUDSTACK-8004 Xenserver Thin Provisioning...CLOUDSTACK-8073 listNetworkACLItem does not return cidrs...CLOUDSTACK-8092 Unable to start instance due to failed to configure ip alias on the router as a ...CLOUDSTACK-8142 [Hyper-V] While creating system vms attach systemvm.iso directly from sec storag...CLOUDSTACK-8158 After the host reboots, the system will run out vm management IP, no matter how ...CLOUDSTACK-8173 listCapacity api call returns less response tags than expected...CLOUDSTACK-8185 GUI and failed async commands issue...CLOUDSTACK-8189 security group can’t enable...CLOUDSTACK-8237 add nic with instance throw java.lang.NullPointerException ...CLOUDSTACK-8242 Cloudstack install Hosts for vmware...CLOUDSTACK-8260 listLBStickinessPolicies with lbruleid as argument gives empty return...CLOUDSTACK-8284 Primary_storage vlaue is not updating in resource_count table after VM deletion...CLOUDSTACK-8288 Deleting Instance deletes unrelated snapshots...CLOUDSTACK-8297 vnc listen address...CLOUDSTACK-8358 Cloudstack 4.4.2 Error adding devcloud host IOException scp error: Invalid locat...CLOUDSTACK-8371 Unable to Delete VPC After configuring site-to-site VPN...CLOUDSTACK-8389 Volume to Template Conversion Broken...CLOUDSTACK-8398 Changing compute offering checks account quota instead of project quota...CLOUDSTACK-8415 [VMware] SSVM shutdown during snapshot operation results in disks to be left beh...CLOUDSTACK-8434 tag filtering hanging on returning values for listVirtualMachines...CLOUDSTACK-8435 When the ssvm agent restarts, every template generated from a VM snapshot disapp...CLOUDSTACK-8436 Computing offering with High avaliability does not work properly....CLOUDSTACK-8437 Automation: test_04_create_multiple_networks_with_lb_1_network_offering - Fails...CLOUDSTACK-8442 [VMWARE] VM Cannot be powered on after restoreVirtualMachine ...CLOUDSTACK-8448 Attach volume - throws an exception, preferably should give a proper error on UI...CLOUDSTACK-8451 Static Nat show wrong remote IP in VM behind VPC...CLOUDSTACK-8469 wrong global config mount.parent - /var/lib/cloud/mnt ...CLOUDSTACK-8470 Available Primary Storage Capacity Displayed Incorrectly after Upgrade to ACS 4....CLOUDSTACK-8485 listAPIs are taking too long to return results...CLOUDSTACK-8532 Modification in setupClass to skip testcases rather than throwing exception...CLOUDSTACK-8533 Local variable accessed as a class variable...CLOUDSTACK-8544 IP Stuck in Releasing State Prevents VM Create...CLOUDSTACK-8547 Modify hypervisor check in testpath_snapshot_hardning.py testpath...CLOUDSTACK-8549 Update assert statements in testpath_disable_enable_zone.py testpath ...CLOUDSTACK-8550 Attempt to delete already deleted VM...

Continued on next page

10.1. All known issues 57

Page 62: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

Table 10.2 – continued from previous pageBug ID DescriptionCLOUDSTACK-8552 Update test_concurrent_snapshots_limits.py asesrt statement...CLOUDSTACK-8553 Unable to launch VM from template because of permission issue...CLOUDSTACK-8555 Skip testcase for HyperV as it doesn’t support volume resize operationa...CLOUDSTACK-8556 Unable to delete attached volume in cleanup...CLOUDSTACK-8572 Unable to deploy VM as no storage pool found in UP state in setup...CLOUDSTACK-8574 Skip testcases including data disk creation for LXC if storagePool type is not R...CLOUDSTACK-8576 Skip tests as snapshots and template are not supported on LXc...CLOUDSTACK-8577 [Automation] fixing script test/integration/component/maint/testpath_disable_en...CLOUDSTACK-8583 [Automation]fixing issue related to script test/integration/component/test_stop...CLOUDSTACK-8584 Management Server does not start - “cluster node IP should be valid local addres...CLOUDSTACK-8587 Storage migration issue on secondary storage...CLOUDSTACK-8588 Remove redundant skip test for LXC ...CLOUDSTACK-8599 CS reports failure for a successful migration in case of low vCenter session tim...CLOUDSTACK-8608 Fix unpleasant admin experience with VMware fresh installs/upgrades - System VM’...CLOUDSTACK-8609 [VMware] VM is not accessible after a migration across clusters....CLOUDSTACK-8611 CS waits indefinitely for CheckS2SVpnConnectionsCommand to return...CLOUDSTACK-8612 [VMware] Make vCenter session timeout configurable for volume snapshot...CLOUDSTACK-8618 Name or displaytext can not be same across different templates...CLOUDSTACK-8619 Adding secondary IP address results in error...CLOUDSTACK-8620 [Automation-lxc]skip test cases if rbd storage is not available in lxc setup ...CLOUDSTACK-8626 [Automation]fixing test/integration/component/test_ps_max_limits.py for lxc hyp...CLOUDSTACK-8627 Unable to remove IP from NIC....CLOUDSTACK-8631 [Automation]fixing test/integration/component/test_ss_max_limits.py...CLOUDSTACK-8639 fixing calculation mistakes in component/test_ss_domain_limits.py...CLOUDSTACK-8657 java.awt.HeadlessException exception in console proxy on mouse clicks in XenServ...CLOUDSTACK-8670 Delay in VM’s console...CLOUDSTACK-8674 Custom ISO with reboot –eject in kickstart does not get detached at reboot...CLOUDSTACK-8679 Changes to RabbitMQ events notification framework not documented anywhere...CLOUDSTACK-8680 problem parsing RabbitMQ events...CLOUDSTACK-8684 Upgrade from 4.3.1 to 4.5.1 does not update resource for existing XenServer 6.0....CLOUDSTACK-8694 monitorServices.py is not running as a cron job in VR...CLOUDSTACK-8695 Dashboard Alerts for VR Service failures does not contain the service’s name...CLOUDSTACK-8699 Extra acquired public ip is assigned to wrong eth device...CLOUDSTACK-8724 Multiple IP’s on management server break patchviasocket.pl...CLOUDSTACK-8732 Unable to resize RBD volume: “Cannot determine resize type from pool type RBD”...CLOUDSTACK-8768 [HyperV]Migrating volume from cluster wide storage to Zone wide storage or vicev...CLOUDSTACK-8770 [HyperV]Proper Message should be displayed when snapshot fails on Hyper-V...CLOUDSTACK-8771 [Automation]Volume migration between pools times out in ACS, but the migration c...CLOUDSTACK-8775 [HyperV]NPE while attaching Local storage volume to instance whose root volume i...CLOUDSTACK-8782 If pagesize is greater than default.page.size in API call, and default.page.size...CLOUDSTACK-8787 Network Update from Standalone VR offering to RVR offering is failing with Runti...CLOUDSTACK-8793 Project Site-2-Site VPN Connection Fails to Register Correctly...CLOUDSTACK-8796 the api calll linkdomaintoldap should fail if admin is given and an account isnt...CLOUDSTACK-8800 Improve the listVirtualMachines API call to include memory utilization informati...CLOUDSTACK-8809 Secondary Storage does not clean-up after time-out...CLOUDSTACK-8813 No notification is sent when a node is added to or removed from a cluster...CLOUDSTACK-8827 VM snapshot stuck in Creating state when management service is stopped...CLOUDSTACK-8831 Powered off VM’s are not removed from ESXi Host when putting the Host in Mainten...CLOUDSTACK-8835 alerts for template download failure...

Continued on next page

58 Chapter 10. Known Issues in 4.6.0

Page 63: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

Table 10.2 – continued from previous pageBug ID DescriptionCLOUDSTACK-8845 list snapshot without id is failing with Unable to determine the storage pool of...CLOUDSTACK-8846 Performance issue in GUI - API command listVirtualMachines ...CLOUDSTACK-8849 Usage job should stop usage generation in case of any exception...CLOUDSTACK-8850 revertSnapshot command does not work...CLOUDSTACK-8852 Cloudstack Database shows that management server is UP when it is actually stopp...CLOUDSTACK-8854 Apple Mac OS/X VM get created without USB controller in ESXi hypervisors...CLOUDSTACK-8855 Improve Error Message for Host Alert State...CLOUDSTACK-8858 listVolumes API fails for a particular domain with NPE...CLOUDSTACK-8859 Incorrect Count displayed for VPC Tier Public IP Address...CLOUDSTACK-8860 Improve error messages in VM deployment code path...CLOUDSTACK-8862 Issuing multiple attach-volume commands simultaneously can be problematic...CLOUDSTACK-8867 Improve console proxy experience ...CLOUDSTACK-8868 use PasswordGenerator.generateRandomPassword() to generate systemvm passwords...CLOUDSTACK-8871 Basic zone security group ingress/egress rules are not working for some cidrs...CLOUDSTACK-8874 Nslookup is failing from the remote access vpn client...CLOUDSTACK-8877 Show error msg on VPN user add failure....CLOUDSTACK-8885 None of the users is able to login to cloudstack when RabbitMQ connections are b...CLOUDSTACK-8889 Primary Storage count for an account does not decrease when a Data Disk is delet...CLOUDSTACK-8896 Allocated percentage of storage can go beyond 100%...CLOUDSTACK-8897 baremetal:addHost:make host tag info mandtory in baremetal addhost Api call...CLOUDSTACK-8899 baremetal VM deployment via service offering with host tag fail...CLOUDSTACK-8902 Restart Network fails in EIP/ELB zone...CLOUDSTACK-8907 When creating a pod a gateway should not be required, it should be optional....CLOUDSTACK-8908 After copying the template charging for that template is stopped ...CLOUDSTACK-8912 listGuestOsMapping doesn’t list by id or ostypeid....CLOUDSTACK-8921 snapshot_store_ref table should store actual size of back snapshot in secondary ...CLOUDSTACK-8922 Unable to delete IP tag...CLOUDSTACK-8929 The list of VMs that can be assigned to a load balancer rule is not updated afte...CLOUDSTACK-8936 wrong values from network.throttling.rate / vm.network.throttling.rate...CLOUDSTACK-8937 Xenserver - VM migration with storage fails in a clustered management server set...CLOUDSTACK-8938 Assigning portforward in Isolated “Offering for Isolated networks with Source Na...CLOUDSTACK-8939 VM Snapshot size with memory is not correctly calculated in cloud.usage_event (X...CLOUDSTACK-8942 snapshot of root drives failing...CLOUDSTACK-8944 Template download possible from new secondary storages before the download is 10...CLOUDSTACK-8945 rp_filter=1 not set on VPC private gateway initially, but is set after restart o...CLOUDSTACK-8956 NSX/Nicira Plugin does not support NSX v4.2.1...CLOUDSTACK-8966 listCapacity produces wrong result for CAPACITY_TYPE_MEMORY and CAPACITY_TYPE_CP...CLOUDSTACK-8977 cloudstack UI creates a session for users not yet logged in...CLOUDSTACK-8980 CloudStack 4.5.2 not reporting correct total capacities on MariaDB-server 10.1...CLOUDSTACK-8994 Activity of the password server isn’t logged....CLOUDSTACK-9018 Egress rule with 0.0.0.0/0 - all (protocol) doesn’t get removed from the VR...CLOUDSTACK-9023 private keys get logged when UpdateCustomCertificate gets called...CLOUDSTACK-9024 Restart network fails if redundant router is missing...CLOUDSTACK-9036 IPV6 CIDR not recognized (Parser BUG)...CLOUDSTACK-9050 Virtual Router Static-NAT rules bind to wrong public interface...CLOUDSTACK-9061 cannot deploy Instance when using Swift as Secondary Storage...CLOUDSTACK-7342 Fail to delete template while using Swift as Secondary Storage...CLOUDSTACK-7782 The 4.4.1 web UI is missing “Acquire new IP address” buton in NIC section...CLOUDSTACK-7988 Template status is empty while the template is creating....

Continued on next page

10.1. All known issues 59

Page 64: CloudStack Release Notes Documentation · 6.10 System-VMs and Virtual-Routers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 7 Upgrade Instruction from 4.4.x27

CloudStack Release Notes Documentation, Release 4.6.0

Table 10.2 – continued from previous pageBug ID DescriptionCLOUDSTACK-8199 Incorrect size when volumes and templates created from image snapshots...CLOUDSTACK-8209 VM migration fails across KVM hosts if hosts have same hostname even if differen...CLOUDSTACK-8228 Allow adding hosts from different subnets in same POD...CLOUDSTACK-8281 VPN Gateway don’t create when create Site-to-Site VPN...CLOUDSTACK-8300 Add index on archived field in cloud.event table...CLOUDSTACK-8354 [VMware] restoreVirtualMachine should forcefully power off VM...CLOUDSTACK-8370 volume download link will not be deleted...CLOUDSTACK-8408 unused i18n keys...CLOUDSTACK-8446 VM reboot operation should make sure there’s a VR running...CLOUDSTACK-8519 SystemVMs do not connect to MS running on Java 8...CLOUDSTACK-8578 listVirtualMachines does not return deleted machines when zone is specified...CLOUDSTACK-8614 Usage records have no valid records for migrated volumes...CLOUDSTACK-8806 Powered off VM’s not showing up in ...CLOUDSTACK-8807 Cloudstack WebUI sometimes bothers about the selected project, sometimes not...CLOUDSTACK-8973 Unusual response when creating a template from a snapshot with Swift as secondar...CLOUDSTACK-8982 Disk Offering properties do no show the domain which are included in...CLOUDSTACK-9017 VPC VR DHCP broken for multihomed guest VMs...CLOUDSTACK-9028 GloboDNS doen´t work with “Shared Networks”...CLOUDSTACK-9029 Proper support to identify CentOS 7 version number on Host...CLOUDSTACK-9056 Upgrade 4.4.1 to 4.6.0 fails: 4.5.0 KVM SystemVm template not found...CLOUDSTACK-9057 upgrade to 4.6 requires 4.5 templates...CLOUDSTACK-7819 Cannot add tags to project...CLOUDSTACK-8202 Templates /IOS items order list is not persistent...CLOUDSTACK-8557 Issue while starting Clound-Manager...CLOUDSTACK-8781 Superfluous field during VPC creation...CLOUDSTACK-8918 [Install] Db Error after install - Unknown column ‘iso_id1’ in ‘field list’...

60 Chapter 10. Known Issues in 4.6.0