03/07/05 NorCal OAUG Training Day Paper v2.0 Jeff Slavitz, Computer Creations Inc.1 Here We Go Again! Upgrading to 11.5.10 Jeff Slavitz Computer Creations

03/07/05 NorCal OAUG Training Day Paper v2.0

Jeff Slavitz, Computer Creations Inc. 1

Here We Go Again!Upgrading to 11.5.10

Jeff SlavitzComputer Creations Inc.

[email protected]



Question:

What Unix command will eliminate all performance problems with your Oracle

Financials database?



Answer:

rm –rf $ORACLE_HOME



• Introduction• Upgrade experiences• Ask questions!• Feel free to contact me• Who has already upgraded to 11.5.10?• Who is in process of upgrading?• Any functional users?• Any cell phones?



• Planning an upgrade

• Staging Rapid Install

• Installing the Vision database

• Upgrading using the Maintenance Pack

• Lessons learned and general tips

• Questions and Answers

Agenda



Planning the Upgrade

• This isn’t Character Mode any more!

• Review Maintenance Pack Installation instructions, Metalink note 259484.1

• Check required operating system patches

• Develop upgrade and problem blog

• Request LOTS of disk space for intermediate backups



Plan the Upgrade Timetable

• Plan on a minimum of three test upgrades

• Testing – Manual and Automated

• How long will it take?

• Determine the best Production downtime window

• Plan major milestone dates

• Document customizations



Technology Stack Decisions

Minimum for Maintenance Pack

Rapid Install

Oracle 9.2.0.4 Oracle 9.2.0.5

9iAS 1.0.2.2.2 9iAS 1.0.2.2.2

JDK 1.3.1 JDK 1.4.2

JInitiator 1.1.8.16 JInitiator 1.3.1.18

Discoverer 4.1.46 Discoverer 4.1.48

Developer 6.0.8.24 Developer 6.0.8.24



Stage Rapid Install• Rapid Install stage area requires 24 GB• Three ways to stage Rapid Install:• Rapid Install manual – use adautostg.pl

– Verify ulimit parameters, Metalink note 294932.1

• OR manually copy from 11.5.10 media– Copy Start Here – Disk 1 to stage/startCD– Copy APPL_TOP Disk 1 – 2 to stage/oraApps– Copy RDBMS – Disk 1 to stage/oraDB– Copy Tools – Disk 1 to stage/oraiAS– Copy Databases – Disk 1-3 to stage/oraAppsDB



Stage Rapid Install

• OR use electric download, Metalink note 287281.1– Download multi-part zip files – Unzip files as for manual copy

• Apply latest Rapid Install patch, currently 4132885



Installing the Vision Database• Follow Oracle Applications Installation manual• Disk space requirement: 86 gig

9.2.0.5 Oracle Home 3 gig

APPL_TOP

COMMON_TOP

8.0.6 Oracle Home

iAS Oracle Home

26 gig

Datafiles 57 gig



Installing the Vision Database• Enable X-windows on your PC• In Rapid Install stage area:

cd startCD/Disk1/rapidwiz• Start Rapid Install: rapidwiz



Installing the Vision Database• When prompted to select database, choose Vision• Rapid Install does the rest!



The 11.5.10 Maintenance Pack

• Rapid Install used to install:– Vision– New database and technology stack– Upgrade 10.x or 11.0 database

• 11.5.10 Maintenance Pack, patch 3140000– Used to upgrade an existing 11i instance– 11.5.10 Install media or download from

Metalink



Maintenance Pack Overview• Maintenance Pack instructions, note 259484.1• Pre-Upgrade steps

– AD minipack I.1

– Latest AutoConfig template

– Configure database for new products and tablespaces

– Technology stack upgrade

– Many smaller patches

• Apply patch 3140000• Post-upgrade steps



Technology Stack Upgrade

• Install new technology stack:– Manually– Rapid Install techstack option

• Technology Stack Validation Utility– Run on database and all application tiers– Should pass all checks before upgrading



Rapid Install Tech Stack• From stage area: rapidwiz –techstack

• For details, Rapid Install manual chapter 5



Rapid Install Tech Stack

• Installs 9.2.0.5 Oracle Home

• Installs 8.0.6 Oracle Home along with

9iAS 1.0.2.2.2 Oracle Home

• You must manually do necessary product upgrade steps

• Are you already patched higher?

• Will not install JDK 1.4.2



Rapid Install Tech Stack• New tech stack code installed to new path• To retain existing tech stack path install it twice.

For example:– Original 8.0.6 and iAS ORACLE_HOME at

/ora01/PROD/…

– Install new tech stack to /ora01/PRODupg

– Use new OUI to remove Oracle Home at /ora01/PROD

– Install new tech stack again to /ora01/PROD

– Use OUI to remove tech stack at /ora01/PRODupg



Upgrading JDK and JInitiator

• Oracle recommends using JDK 1.4.2 with 11.5.10

• Download JDK 1.4.2 for your operating system, Metalink note 130091.1

• Upgrade to JInitiator 1.3.1 using Metalink note 124606.1

• Requires users to download new JInitiator



Tips for Applying Maintenance Pack

• Correct errors found by pre-upgrade validation scripts

• Turn off custom triggers and applications before applying patch 3140000

• Save time and apply custom AutoConfig changes after upgrade is complete

• Work in parallel with Oracle Support



Tips for Applying Maintenance Pack

• Skip adpatch workers that fail for applications you are not using

• Open a tar to confirm no cross-application issues

• Manually re-run script that failed when problem resolved



Skipping Adpatch Workers

• Select option 8 on adctrl menu to skip adpatch workers



Hung Adpatch Workers

• Most workers end in a few minutes. If one runs abnormally long it may be hung.

• Confirm with ‘top’

• Use adctrl option 3 to shutdown all workers

• Hung workers will not shutdown

• kill -9 `ps –ef | grep adwork | cut –c 9-14`

• You may also need to kill adpatch job



Hung Adpatch Workers• Hung workers still show status of ‘Running’• Use adctrl option 4 to fail all jobs• Then adctrl option 2 to restart all failed jobs• Restart adpatch



Maintenance Pack Problems• Adpatch.log:• FAILED: file MTL_COPY_ORG_REPORT_TEMP.xdf

• Adworker.log:Error in executing statement ALTER TABLE INV.MTL_COPY_ORG_REPORT_TEMP MODIFY ...

ORA-00600: internal error code, arguments: [25012], [68], [0], [], [], [], [], []

• Work-around is to set "_disable_multiple_block_sizes" = true in the database init.ora



Maintenance Pack Problems• Adpatch.log:

FAILED: file aftcm049.sql

• Adworker.log:ORA-20000: Oracle Error Mkr4= -904

ORA-00904: "RULESET_NAME": invalid identifier • Problem caused by Advanced Queue corruption

that occurs when upgrading to 9.2.0.x from 8.1.7.x. Follow note 231074.1 and run the three patch scripts provided.



Maintenance Pack Problems

• For errors uploading .ldt files, upload manually using adodfcmp:

adodfcmp userid=jtf/xxx touser=apps/xxx priv_schema=system/xxx changedb=yes mode=tables odffile=xxx.odf logfile=xxx

• Specifying ‘changedb=no’ will show changes without making them



Maintenance Mode• New feature with 11.5.10/AD.I

• Adpatch requires maintenance mode

• Use adadmin option 5



Maintenance Mode



Maintenance Mode

• Be sure to disable Maintenance Mode or users cannot login to Financials



Adpatch Hotpatch

• If you want to apply a patch without enabling maintenance mode and disabling user access:adpatch options=hotpatch

• The Maintenance Utilities manual indicates this causes severe performance degradation



Helpful Tips

• Transfer setups between instances using FNDLOAD, Metalink note 274667.1 – Concurrent program definitions– Responsibilities– Menus– Profile Options– Value Sets– And more!



Pre-Compiling JSPs

• Java Server Pages (JSP) compiled when user first accesses a page

• May result in noticeable delay

• Perceived as ‘performance’ problem

• Pre-compile all or first used JSPs



Pre-Compiling JSPs• Compiled JSPs normally stored on web tier

at $OA_HTML/_pages/_oa__html• $IAS_ORACLE_HOME/Apache/Jserv/

etc/zone.properties• Unix command ‘ls –ltr’ shows:

– Pages used– Order pages were last compiled

• Use ojspCompile.sh as explained in Metalink note 215268.1



Pre-Compiling JSPs• Compile JSPs using a regular expression$JTF_TOP/admin/scripts/ojspCompile.pl --compile -s \ '%' -log $LOGFILE --flush $JTF_TOP/admin/scripts/ojspCompile.pl --compile -s \ 'Apps%' -log $LOGFILE --flush

• Compile an individual JSP $JTF_TOP/admin/scripts/ojspCompile.pl --compile -s \ 'jtflogin.jsp' -log $LOGFILE --flush



Managing AutoConfig

• AutoConfig re-writes:– Oracle 9i init.ora, tnsnames.ora, listener.ora,

sqlnet.ora– Oracle 8.0.6 listener.ora, tnsnames.ora

• Make your system AutoConfig independent using ifiles:

– ifile last line in above files– ifile name defined in context file



OATM

• Convert database to Oracle Application Tablespace Model. See Metalink note 248857.1

– Reduces over 300 datafiles to 12– Saves a lot of disk space!– Easier to manage– Migrate tablespaces incrementally– Large tablespaces can take a LONG time to

migrate



Question:

What has all the excitement of Fear Factor, but you can do it in the comfort of your own

office?



Answer: Upgrading to 11.5.10!

• Spend the time to plan your upgrade before starting it

• Long for the days of \ Row Erase?

• Keep careful notes of what you’ve done

• Use the tools Oracle provides to make your system easier to upgrade and maintain



Questions?Other tips and techniques?

Want a copy of this presentation?

Feel free to email or call me …

Jeff [email protected]

(415) 388 - 3003

Documents

03/07/05 NorCal OAUG Training Day Paper v2.0 Jeff Slavitz, Computer Creations Inc.1 Here We Go Again! Upgrading to 11.5.10 Jeff Slavitz Computer Creations