Upload
bryan-hancock
View
216
Download
1
Embed Size (px)
Citation preview
Test Harness & Website
Mike Phenow
Trilinos User Group MeetingNovember 4th, 2004 - 9:30 am
Contents• Test harness
– Overview
– Design
– Nightly
– Local
– Future
• Website– Trilinos
– Developer
– Package
• Questions
Test Harness ~ Overview• Current test-harness.plx grew out of Jim
Willenbring’s test-harness, which evolved from his earlier trilinos-check, which is based on Paul Lin's salsa-check, which was adapted from Gary Hennigan's Salsa-Check.sh
• Provides a standard framework for running tests (particularly for developers)
• Enables reasonable automation
• http://software.sandia.gov/trilinos/developer/test_harness.html• Trilinos/testharness/README• % perl test-harness.plx -h
Test Harness ~ Overview
Most important flags:
- Currently provides no testing functionality
- For successfully built packages, will run any executable test scripts in:
Trilinos/packages/PACKAGE/tests/scripts/(daily|weekly)/(mpi|serial)/
-f FILE run with given config file
-g FILE generate a default config file named FILE
-h print help
Test Harness ~ Design
configure
invoke-configure
build
test
report
starttest harness config
invoke-configure element
invoke-configure element
invoke-configure elementfix
fix
create
Test Harness ~ Design
dependencies:
amesos = \--enable-amesos \--with-ml_amesos
anasazi = \--enable-anasazi \--with-loca-anasazi
aztecoo = \--enable-aztecoo \--enable-komplex \--enable-ml_aztecoo \...
potentially-brokenpackage
configure optionsto be removed,
if broken
Anatomy of an invoke-configure:
Test Harness ~ Design
elements-machine/MACHINE_CONFIG_FILE
+ elements-trilinos/TRILINOS_CONFIG_FILE
Trilinos/SERIAL_DIR/invoke-configure
elements-machine/MACHINE_CONFIG_FILE
elements-machine/MACHINE_MPI_CONFIG_FILE
+ elements-trilinos/TRILINOS_CONFIG_FILE
Trilinos/MPI_DIR/invoke-configure
• Most important config-file options– MACHINE_CONFIG_FILE– MACHINE_MPI_CONFIG_FILE– TRILINOS_CONFIG_FILE
– REPORT_METHOD• SEND_TO_DEFAULTS
– SERIAL_DIR– MPI_DIR
• HOST_FILE• MPI_STARTUP_CMD• MPI_SHUTDOWN_CMD• MPIGO_CMD
Test Harness ~ Design
Test Harness ~ Nightly
• Platforms:– Linux: herouxsmp.cs.csbsju.edu– Linux: software.sandia.gov– SunOS: paunchy.sandia.gov– Dec/OSF1: stratus.sandia.gov
• Changing configure options:– Trilinos/test-harness/elements-trilinos/– Trilinos/test-harness/elements-machine/– e.g. osf-stratus
Test Harness ~ Local
http://software.sandia.gov/trilinos/developer/test_harness.html
create elements-machine/MY_MACHINEcreate elements-machine/MY_MACHINE_MPIcreate elements-trilinos/MY_OPTIONS
perl test-harness.plx –g config/MY_CONFIGedit config/MY_CONFIGperl test-harness.plx –p config/MY_CONFIG
perl test-harness.plx –f config/MY_CONFIG
Test Harness ~ Future
test machine
test machine
database
test machine test machine
test machine
test machine
Major Platforms Developer Machines
results results
queries results
browser
developer
queries results
Website ~ Trilinos
• http://software.sandia.gov/trilinos• First stop for many users• Central location for information• Needs to be continually re-evaluated
Website ~ Developer
• http://software.sandia.gov/trilinos/developer• Source for developer information and tools• Potential for more knowledge-sharing
Website ~ Package
• http://software.sandia.gov/trilinos/packages• Natural place for posting critical information for users
• Doxygen documentation:– Trilinos/packages/PACKAGE/DoxyfileWeb– (Trilinos/packages/common)– http://software.sandia.gov/trilinos/developer/doxygen.html
• Package pages:– TrilinosWeb/packages/PACKAGE/