Running Oracle in EC2 Ahbaid Gaffoor Amazon/A9

Running Oracle in EC2

Ahbaid GaffoorAmazon.com/A9.com

2 Oracle on EC2, NoCOUG Aug 20th 2009

Overview• Section 1: Pricing and Licensing• Section 2: Getting Started with AWS• Section 3: Installing Oracle• Section 4: Secure Backup


Section 1Pricing and Licensing

Section 1: Pricing and Licensing1. Amazon Web Services (AWS) Overview2. Pricing of relevant AWS Services3. Oracle Licensing and Support4. Oracle Secure Backup Cloud Module


1.1 AWS Overview:• Amazon Elastic Compute Cloud (EC2)• Amazon Simple Storage Service (S3)• Amazon Cloud Front• Amazon SimpleDB• Amazon Simple Queue Service (SQS)• Amazon Elastic MapReduce


1.2 AWS Pricing EC2:• Elastic Compute Cloud (EC2)– Prices http://aws.amazon.com/ec2/#pricing – Amazon Machine Image (AMI):

• On Demand, Reserved 1 Year, 3 Years

– Standard CPU AMI:• Small $0.10/hr, $325/yr ($0.03/hr),$500/3yr• Large $0.40/hr, $1300/yr($0.12/hr),

$2000/3yr• XLarge $0.80/hr, $2600/yr($0.24/hr),$4000/3yr

– High CPU AMI:• Medium $0.20/hr, $650/yr($0.06/hr),$1000/3yr• XLarge $0.80/hr, $2600/yr($0.24/hr),$4000/3yr


1.2 AWS Pricing EC2 (Cont’d):• Elastic Compute Cloud (EC2)– Elastic IP• Public, Static IP• IP Map/Re-map > 100/month $0.10 each• $0.01 non-attached per hour

– Elastic Block Store (EBS)• $0.10 GB/month provisioned• $0.10 per 1MM/month I/O requests

– EBS Snapshots to S3• $0.15 GB/month • $0.01 per 1,000 PUT requests (when saving a snapshot)• $0.01 per 10,000 GET requests (when loading a snapshot)


1.2 AWS Pricing S3:• Simple Storage Service (S3)– Prices http://aws.amazon.com/s3/#pricing – Operations: PUT, GET, DELETE– Storage• $0.15GB/Month < 50TB• $0.14GB/Month > 50TB, < 400TB• $0.13GB/Month > 400TB, < 500TB• $0.12GB/Month > 500TB

– Data Transfer• $0.10GB all data transfer in


1.2 AWS Pricing S3 (Cont’d):– Requests• $0.01 per 1,000 PUT, COPY, POST or LIST request• DELETES are free• $0.01 per 10,000 GET and all other requests

– AWS Import/Export• Device Handling $80.00 each• Data loading $2.49 per hr (hourly increment)


1.2 AWS Pricing Import/Export:– Not Database exp/imp– AWS Import/Export• Device Handling $80.00 each• Data loading $2.49 per hr (hourly increment)• http://aws.amazon.com/importexport/• Calculator:

http://awsimportexport.s3.amazonaws.com/aws-import-export-calculator.html


1.2 AWS Data Transfer Pricing:• Data Transfer:– Regions: US, EU– Sub-region (zone)– Free within zones on private IP– Elastic IP or Public IP outside AWS, regional charges


1.3 Oracle Licensing:• Existing or New License• http://www.oracle.com/corporate/pricing/cloud-

licensing.pdf• Cost of AMI• Pre-built Oracle AMI (11g)• Roll your own AMI


1.3 Oracle Support:• Virtualization Support – AWS• Database Support• Oracle Secure Backup Cloud Module• http://www.oracle.com/technology/tech/cloud/f

aq.html#support• No RAC


http://www.oracle.com/technology/tech/cloud/faq.html#support

http://www.oracle.com/technology/tech/cloud/faq.html#support

1.4 Oracle Secure Backup Cloud Module:• Backups to S3 via. RMAN• 9i R2 and higher• Pre-installed on Oracle AMIs• EC2 and non-EC2 databases• Requires S3 and OTN accounts• Integrated with Enterprise Manager



Section 2Getting Started with AWS

Section 2: Getting Started with AWS1. AWS account2. AWS EC2 Console3. EC2 Security Groups4. EC2 Key Pairs5. EC2 Amazon Machine Images (AMIs)6. EC2 Elastic IP7. EC2 EBS Volumes8. EC2 Snapshots9. Using EC2 Command Line tools16 Oracle on EC2, NoCOUG Aug 20th 2009

2.1 AWS account• Amazon.com account• Sign up for services at http://aws.amazon.com• EC2 Console: http://console.aws.amazon.com


http://aws.amazon.com/

http://console.aws.amazon.com/

2.2 AWS EC2 Console


2.2 AWS EC2 Console• Security Groups• Key Pairs• AMIs• Instances• Elastic IPs• EBS Volumes• EBS Snapshots


2.3 EC2 Security Groups


2.3 EC2 Security Groups - Create


2.3 EC2 Security Groups – Configuration


2.4 EC2 Key Pairs


2.4 EC2 Key Pairs – Create


2.4 EC2 Key Pairs – Save PEM file


2.4 EC2 Key Pairs – Save PEM file• Only one opportunity• Make a copy• Make another offline copy• Cannot be retrieved or restored• PEM?


2.5 EC2 AMIs


2.5 EC2 AMIs – List Options• Show/Hide (Owner, Platform, Architecture)• Oracle owner id = 725966715235• Linux only


2.5 EC2 AMIs – Launch Instance


2.5 EC2 AMIs – Instance Options


2.5 EC2 AMIs – Availability Zones• us-east-1a• us-east-1b• us-east-1c• us-east-1d


2.5 EC2 AMIs – Instance Launch


2.5 EC2 Instances - Pending


2.5 EC2 Instances – Launched


2.5 EC2 Instances – Command Line Tools• Scriptable command line tools:– ec2-bundle-instance– ec2-confirm-product-instance– ec2-describe-instances– ec2-describe-reserved-instances– ec2-describe-reserved-instances-offerings– ec2-monitor-instances– ec2-purchase-reserved-instances-offering– ec2-reboot-instances– ec2-run-instances– ec2-terminate-instances– ec2-unmonitor-instances


2.6 EC2 Elastic IP• Static IP tied to account• Assign to any account instance• Unassigned is more expensive• Redirect failed services• Scriptable command line tools:– ec2-allocate-address– ec2-associate-address– ec2-disassociate-address– ec2-release-address


2.6 EC2 Elastic IPs


2.6 EC2 Elastic IP - Allocate


2.6 EC2 Elastic IP - Allocated


2.6 EC2 Elastic IP - Associate


2.6 EC2 Elastic IP - Associated


2.7 EC2 Elastic Block Store (EBS) Volumes• Persistent Storage• Pick zone and region• Assign to an instance within a zone• Scriptable command line tools:– ec2-create-volume– ec2-delete-volume– ec2-attach-volume– ec2-detach-volume– ec2-describe-volume


2.7 EC2 EBS Volumes


2.7 EC2 EBS Volumes - Create


2.7 EC2 EBS Volumes - Creating


2.7 EC2 EBS Volumes - Created


2.7 EC2 EBS Volumes - Attach


2.7 EC2 EBS Volumes - Attached


2.8 EC2 EBS Snapshots• Copy of EBS Volume into S3• S3 replicates snapshots across zones• Snapshots restorable in any zone• Snapshots used to copy EBS volumes within

zones• Scriptable command line tools:– ec2-create-snapshot– ec2-delete-snapshot– ec2-describe-snapshot


2.8 EC2 EBS Snapshots


2.8 EC2 EBS Snapshots - Create


2.8 EC2 EBS Snapshots - Created


2.9 Using EC2 Command Line Tools• Requires at least Java 5 runtime• SSH Acces for Linux (Putty for Windows SSH)• RDC for windows (not covered)• AWS -> Resources – Developer tools – EC2-API

tools (ec2-api-tools.zip)• Setup ENV variables:– JAVA_HOME– EC2_HOME is path to unzipped files– EC2_PRIVATE_KEY (PEM file path)– EC2_CERT (your X.509 cert file path)



Section 3Installing Oracle

Section 3: Installing Oracle1. Connecting to a new instance2. Mount EBS Volumes3. Create database


3.1 Connecting to a New Instance• PEM file is private key• First connection SSH as root• Linux SSH command line connect using PEM file– “ssh -i <PEM_file> root@<ip_address>”

• Windows Putty SSH Client– PuttyGen to load and convert PEM file– Save Windows equivalent Private Key file– Create Session in Putty using new Private Key file for

authentication


3.1 Connecting – License Acceptance


3.1 Connecting – Oracle Password


3.1 Connecting – No DB auto creation


3.2 Mount EBS Volumes• Create Partitions on devices– “fdisk /dev/sdf”

• Create Filesystems – “mkfs.ext3 /dev/sdf1”

• Create mount points, mount, set permissions– “mkdir /m1”– “mount /dev/sdf1 /m1; chown –R oracle:dba /m1”

• Edit /etc/fstab to automount– “/dev/sdf1 /m1 ext3 defaults 1 1”

• Repeat for EBS Volumes60 Oracle on EC2, NoCOUG Aug 20th 2009

3.2 Mount EBS Volume – Create FS


3.2 Mount EBS Volume – /etc/fstab


3.2 Create Database - Choices• 11g Oracle Home: – /u01/app/oracle/product/11.1.0/db_1

• Oracle provided script:– /home/oracle/scripts/run_dbca.sh (as root)– Customize database post creation

• DBA crafted scripts (better)• Free script:– http://ocpdba.net/dbcreate/index.html (10g)


http://ocpdba.net/dbcreate/index.html

3.2 Create Database - Recommendations• Create separate EBS Volume for /admin• /admin used for:– DB Creation scripts– Admin scripts– DB files (init.ora, spfile, broker files, etc.)

• Symlinks from /admin/<dbname>/<file> to Oracle software home

• EBS volume snapshot used for new DB hosts


3.2 Create Database - Recommendations• Allow only SSH port to be open in Security Group• Tunnel SQL*Net across SSH outside the cloud• If opened, restrict listener port to fixed IPs


3.2 Create Database - Cloning• /admin EBS Snapshot cloneable to new Instances• EBS volume snapshots (cold db) used for new db

cloning of database files


3.2 Create Database - Performance• CPU & Memory fixed• Within the cloud fastest for I/O• I/O can be scaled– Multiple EBS Volumes– Oracle ASM– Stripe across EBS Volumes



Section 4Oracle Secure Backup (OSB)

Cloud Module

Section 4: OSB Cloud Module1. OSB Pre-requisites2. OSB Setup3. OSB RMAN Integration4. OSB Performance5. RMAN / OSB / S3 Use cases


4.1 OSB Pre-requisites• Download Cloud Backup Installer• Included in Oracle AMIs– “/home/oracle/scripts/osbws/osbws_install.jar”

• S3• Oracle 9i R2 and higher• OTN account


4.2 OSB Setup – Installer Options• List options for OSB Installer– “su – oracle”– “java -jar ~oracle/scripts/osbws/osbws_install.jar”– “more ~oracle/scripts/osbws/osbws_readme.txt”


4.2 OSB Setup – Installer Options• Required– AWSID AWS account access key ID– AWSKey AWS account secret access key– otnUser & otnPass OTN Credentials for download– walletDir Stores credentials for use– libDir Location for platform specific

download (RMAN SBT library)

• Optional platform and proxy parameters• Optional Recommended– configFile Initialization parameter file used

by future RMAN jobs– Default: $ORA_HOME/dbs/osbsws<ORACLE_SID>.ora


4.2 OSB Setup – Sample Installer Script

# install_osb.sh# Set before running: AWSID, AWSKEY, OTNUSER, OTNPASS# libDir stores software specific to the platform for RMAN SBT library parms use

java -jar ~oracle/scripts/osbws/osbws_install.jar \-AWSID $AWSID \-AWSKEY $AWSKEY \-otnUser $OTNUSER \-otnPass $OTNPASS \-walletDir /admin/osbws/wallet \-configFile /admin/osbws/osb_config.dat \-libDir /admin/osbws/software


4.2 OSB Setup – Install Platform Library


4.3 OSB RMAN Integration• RMAN SBT Parms configuration• Installed to libDir parameter in installation• RMAN Command:

RMAN> configure channeldevice type sbt parms “SBT_LIBRARY=/admin/osbws/sofware/libosbws11.so ENV=(OSB_WS_PFILE=/admin/osbws/osb_config.dat)

“;

• Ready for backups


4.4 OSB RMAN Performance• 11g Multiple RMAN Channels• 11g datafiles can be backed up across multiple

channels• 11g Fast Backup Compression• RMAN block change tracking


4.5 RMAN / OSB / S3 Use Cases• Cloning• Scalable backups• Moving databases• Regional Backup/Recovery Availability


Thank Youahbaid@{amazon.com|a9.com|att.net}

http://redoblog.wordpress.comhttp://ocpdba.net

Documents

Running Oracle in EC2 Ahbaid Gaffoor Amazon/A9