Upload
jayson-austin
View
221
Download
3
Tags:
Embed Size (px)
Citation preview
Copyright 2007, Information Builders. Slide 1
Performance and Tuning Tips
Mark Nesson/Vashti Ragoonath October 2008
Copyright 2007, Information Builders. Slide 3
Performance and Tuning TipsOverview
Performance Testing Used to eliminate bottlenecks and establish a baseline Should be conducted in a controlled environment Must have a clear set of expectations
Number of concurrent users Response times for queries
Meet users expectations and Service Level Response times
Tuning
Repetitive process of: Running tests to identify bottlenecks Tuning one component at a time and redoing tests Increasing load to identify all bottlenecks
..until objectives are met
Copyright 2007, Information Builders. Slide 4
Performance and Tuning TipsOverview
Bottlenecks can exist at different levels: Application Level
Developers can look for inefficiencies in their code Database Level
Use query optimizers and database profilers to check for bottlenecks
Operating System Level Administrators can use utilities tools like PerfMon on Windows
and on UNIX top, vmstat, iostat to track CPU, RAM, Disk Space utilization
Network Level Network Administrators can use utilities like netstat, packet
sniffers like tcpdump and others like ethereal
Copyright 2007, Information Builders. Slide 5
Performance and Tuning TipsTuning Components
External Tuning Components Operating System Database Server Application Server Java Virtual Machine Network WebFOCUS Tuning Components Application Data Adapters Dialect Specific or Generic Reporting Server Workspace Manager Reporting Server Java Services ReportCaster Distribution Server
Copyright 2007, Information Builders. Slide 6
Performance and Tuning TipsExternal Tuning Components - OS
Operating System Work with the OS Administrators to identify bottlenecks. If the
system is maxed out on CPU and RAM use the system utilities to identify which processes are taking up all the resources. Maybe some jobs can be run at off-peak hours or deferred and a lower CPU priority.
Check all configuration files to ensure they are in sync with the current releases of installed software. Upgrades may require updates to old configuration files that could improve performance overall on the system.
Track usage patterns on the machines to identify problems and failures which can be fixed easily.
Copyright 2007, Information Builders. Slide 7
Performance and Tuning TipsExternal Tuning Components – Database
Database Server Verify that the database optimizer runs as recommended to
generate good data statistics. Example: Oracle ANALYZE command creates optimizer statistics to choose methods of fast access to the data. If the statistics were not generated properly, performance will be affected.
Fix Indexes. Use EXPLAIN to see what the optimizer does with SQL statements. Does it do a full table scan? Does the table have appropriate indexes for the queries? You may have to rebuild indexes.
Spread the Database Over Disks and I/O Channels. e.g: Partition tables and indexes over multiple disks
Copyright 2007, Information Builders. Slide 8
Performance and Tuning TipsExternal Tuning Components – App Server
Use Pre-compiled JavaServer Pages Disable Dynamic Application Reloading Tune Thread Pool
Initial Thread Pool size Minimum number of threads in pool
Maximum Thread Pool size Maximum number of concurrent threads in pool
Thread inactivity timeout Time spent waiting for client response before being
returned to pool Growable thread pool
Number of threads the pool should increase by when it’s maxed out
Copyright 2007, Information Builders. Slide 9
Performance and Tuning TipsExternal Tuning Components – JVM
Java Virtual Machine (JVM) Tune Heap Size so garbage collection time is minimized and
clients can still be processed. Initial Heap Size Maximum Heap Size
Garbage Collection Use the -verbosegc option to track frequency and times of
garbage collection
Copyright 2007, Information Builders. Slide 10
Performance and Tuning TipsExternal Tuning Components – Network
Network Network administrators will be able to identify and tune
bottlenecks are with the use of: packet sniffers such as tcpdump network protocol analyzers such as ethereal utilities such as netstat, ping, traceroute and others
Copyright 2007, Information Builders. Slide 11
Performance and Tuning TipsDemo: JVM Tuning
Let’s see a live demo of tuning the Tomcat thread pool Test Case 1 – Low thread pool
Tomcat parameters: Low thread pool(15), 256MB Heap size, 25 concurrent users, request sleeps for 15 secs, 100 available tscom agents
Capture baseline performance statistics Tune the Tomcat JVM: Large thread pool(75), 256MB Heap
size, 25 concurrent users, request sleeps for 15 secs, 100 available tscom agents
Capture performance statistics Response times improved by a little less than 25%
Copyright 2007, Information Builders. Slide 12
Performance and Tuning TipsDemo: JVM Tuning
INFO: Find registry server-registry.xml at classpath resourceOct 28, 2008 12:41:25 PM org.apache.catalina.startup.Catalina startINFO: Server startup in 65125 msOct 28, 2008 12:42:31 PM
com.amberpoint.util.soa.servlet.ServiceDeploymentServlet$ServiceInitializer run url, then contact that service at that URL to get it started.Oct 28, 2008 12:43:24 PM org.apache.tomcat.util.threads.ThreadPool
logFullSEVERE: All threads (15) are currently busy, waiting. Increase
maxThreads (15) or check the servlet status
Copyright 2007, Information Builders. Slide 13
Performance and Tuning TipsDemo: JVM Tuning
Copyright 2007, Information Builders. Slide 14
Performance and Tuning TipsDemo: JVM Tuning
Copyright 2007, Information Builders. Slide 15
Performance and Tuning TipsWebFOCUS Tuning Components – Application
Application Verify that requests are generating optimized SQL Enforcing all RDBMS efficiencies Data Adapters Enable OPTIMIZATION flags ( SET OPTIMIZATION) Fetch data in larger blocks (SET FETCHSIZE)
Test for optimum performance Has show to increase performance by 5%
Set ISOLATION Level RU (Read Uncommitted)
Copyright 2007, Information Builders. Slide 16
Performance and Tuning Tuning Components –Reporting Server
Workspace Manager -Data Services maximum number_ready deployment * private connection_pooling Queuing idle_session_limit idle_agent_limit cpu_limit memory_limit connection_limit max_connections_per_user * agent_refresh sched_priority
Copyright 2007, Information Builders. Slide 17
Performance and Tuning Tuning Components –Java Services
Workspace Manager –Configuration Java Services Most commonly used to:
Rendering output format of flex on the Reporting Server With the JSCOM3
Tuning Parameters Initial Java Heap Size Maximum Java Heap Size Java Thread Stack Size JVM_OPTIONS
Specify other performance type options
Copyright 2007, Information Builders. Slide 18
Performance and TuningDemo: Graph Processing
Let’s see a live demo of how Java Services is used for processing graphs. JSCOM Listener under Java Services Can have a cluster of JSCOM Listeners Can be configurable
Graph request generates 5 flex reports. Using the default JSCOM3 Listener we will run 1, 3, 5 concurrent users and look at the response time.
We then add a second JSCOM Listener and rerun our test. Is there an improvement in the response times? Yes there is…
Copyright 2007, Information Builders. Slide 19
Demo: JSCOM/FLEX Processing (broflex)#JSCOM3 HEAPSIZE #THREADS RESP
1 default 1 3
1 default 5 12
1 default 10 29
1 default 15 38
1 768 1 3
1 768 5 8
1 768 10 18
1 768 15 24
3 768 1 3
3 768 5 6
3 768 10 13
3 768 15 19
Copyright 2007, Information Builders. Slide 20
Performance and Tuning Tuning Components –ReportCaster
ReportCaster Configuration General Tab
Maximum Threads Data Server (NODE)
Maximum Connections Data Server (CLUSTER)
Weight Maximum Connection Algorithm to determine which server to send request to:
Weight * maximum connection = priority Request will be routed to server with highest priority
Copyright 2007, Information Builders. Slide 21
Performance and TuningDemo: ReportCaster Compression
Let’s see a live demo of how we can have a scalable distribution server by using ReportCaster compression. Run request with embedded graphical images and distribute in
uncompressed PDF format to Report Library. Check to see what the original file size is in the BOTLIB table
and make sure it was not flagged as compressed in the BOTSCHED table. Column AUDITOR in table BOTSCHED has a flag to
indicate if data is compressed. Column REPORTSIZE in table BOTLIB has file size before
compression. Column LIBFIELD1 in table BOTLIB has compressed file
size. Clone and schedule the same request and distribute in
compressed PDF format to Report Library. Check the file sizes. View both reports from Report Library
Copyright 2007, Information Builders. Slide 22
Performance and TuningDemo: ReportCaster Compression
You can distribute the same report via EMAIL and use the ZIP option to minimize space allocation.
You can also ZIP and distribute Active Reports for your users and they can slice and dice that data without being connected.
We now have Active Reports in Connected mode but more details in another presentation that we will be doing.
Copyright 2007, Information Builders. Slide 23
Performance and TuningConclusion
Questions and Comments.