19/9/2005 AB/CO Review 1

Support for Technical Services and Technical Infrastructure

operations

AB/CO ViewpointAlastair Bland AB/CO/IN

19/9/2005 AB/CO Review 2

Contents• Thanks• Who we are• What we provide• Who supplies us• Good News• Bad News• What we want from you• Discussion• Lists of Machines

19/9/2005 AB/CO Review 3

Thanks

• Peter and Tono’s talks listed extremely well what AB/CO provide to TS AB/OP/TI– And we who provide this service have always

been very happy to work for the TCR• One minor omission

– We also provide HPs (HPSLZ18/HPTISDEV) and Front Ends (SVMTCR/S2MTCR/SVLSR*) for the Safety Commission Radiation Protection tools used in the TCR

19/9/2005 AB/CO Review 4

Who we are

Linux, HPs

AlarmsAlarms

Proliants, HPs

Front Ends

LinuxLinux

Front EndsHardware

Linux, HPs

19/9/2005 AB/CO Review 5

What we provide (1)• Managed machines, where you want them

– This is not what IT normally provide, they only provide infrastructure, not daily management and assurance that the user’s application is working

– 95% of our machines are very well managed (we know what is on them, what they do, how they are now, how to fix them)

– We do not have time to clean up the other 5% due to work on new installations. Unfortunately the TIM machines (TCRPL1,2,3,4,7,8,9,10) are in this category

• Considerable freedom for users– Main user as defined in NETOPS database can become root and “fix”

things. However it will not come back after a re-install if you do not tell us what you did!

– We will support/help you with almost anything you could want on a machine

• Java• SonicMQ + Oracle Container for Java (oc4j) • VMWare + WindowsXP + Wizcon (we support the machine, you support

these apps)• Multi-headed graphics cards in consoles• …• Exceptions: we would not support MySql, you have to use Oracle instead

19/9/2005 AB/CO Review 6

What we provide (2)

• Alarm System– The new LASER system is now available and

operational– The Alarm Team aims at providing 24/7

support but it is always on a best effort basis• Now?

– Cannot guarantee solving all alarm problems in 4 to 8 hours

• There are dependencies on other systems

19/9/2005 AB/CO Review 7

Who supplies us

• IT/CS– Network: excellent service

• IT/ADC– SLC3 and RHEL3 Linux: very good products

• IT/DES– Oracle: good service but we need to work more closely with Nilo to get

rid of dependencies on IT infrastructure at run time• IT/IS

– Windows: very good product– PC Desktops: very good machines, now seem reliable

• HP: – HPUX fileserver purchases and old workstation support going fine– Proliants working very well

• If you are willing to pay for one!

19/9/2005 AB/CO Review 8

Good News

• TCRSRV1 (and ABSRV1) file servers work reliably. These machine have a backup

• Linux SLC3 and RHEL3 work very well• Windows Consoles as provided by AB/CO (we usually add Exceed, Java

and Yacoma console manager) work well as long as the user is in the Administrator group

• Front Ends working reliably for your legacy systems• SLC3 and Windows updates generally do not destroy the machine• LEMON monitoring of Linux machines is a good example of CERN added

value• XCLUC system is in good shape for the TCR

– Will be able to provide surveillance of Schneider and Siemens PLCs as well through this system

• Excellent Remote Reboot system for HP Proliants, Front Ends, Technical Consoles and in the future PLCs

• Excellent Remote Console system for HP Proliants, Front Ends

19/9/2005 AB/CO Review 9

Bad News

• XCLUC system is in bad shape for the rest of our clients• No backup for any of the HP Proliants

– Like Russian Roulette with more bullets– Send a petition to Pierre if you disagree with this

• No life support systems should be run with any of machines!– We have no redundancy– Many single points of failure

• For example: if TCRSRV1 is down then none of our Services machines can reboot correctly

• We do not intend to provide Single Point of Entry Helpdesk service– Unless you can convince Pierre to set it up

• We do not intend to provide Service Level Agreements (SLA)– Unless Pierre will do the paperwork

• There is no Piquet Service for any Service machine– The CO Piquet only handles PS Front Ends and PS Linux consoles

• Computer Security level very low– Mainly due to our need to use NFS

19/9/2005 AB/CO Review 10

What we would like from you• Help us to remove the old HPUX 10.20 systems

– Move remaining TCR home directories from STSRV1 to TCRSRV1

– Remove or upgrade• ACSPS1, ELSRV1, HAVANA, HAMAR, MMISRV1, SRVTDS1,

SRVTDS2, STPUB1

• Help us to upgrade– Electrical Front Ends from LynxOS 2.5.1 to 4.0.0– Services LHC Front Ends from LynxOS 3.1.0 to 4.0.0

• Use Servers and Consoles that are as similar as possible to your new PS, SPS and LHC colleagues

Reliable Electricity and Cooling!

19/9/2005 AB/CO Review 11

Discussion• The PS usually likes to move very quickly to new

technologies or upgrades because they can shutdown for up to 2 months per year

• On the SL side we normally run 364.5 days per year so our systems become fossilized– 0.5 day downtime for PCR Emergency Stop Tests– All this is due to TCR requirements

• And many other little differences between PS and SL way of doing things which we must treat with a higher priority than putting in place support channels for your Services requests …

• Mea Culpa: We will get later and later with delivering our promises due to the huge number of machines we are managing (see lists that follow)

19/9/2005 AB/CO Review 12

HP Proliantsabcmw1 bdisrv1 cs-ccr-q2ds1 lasertest1abcopl1 cs-ccr-abpo1 cs-ccr-q2ds2 lasertest2abcopl10 cs-ccr-cv1 cs-ccr-q4ds1 lsasrv1abcopl11 cs-ccr-cv2 cs-ccr-q4ds2 sljas2abcopl12 cs-ccr-cv3 cs-ccr-q6ds1 sljas3abcopl2 cs-ccr-cv4 cs-ccr-q6ds2 tcrpl1abcopl4 cs-ccr-cv5 cs-ccr-q8ds1 tcrpl10abcopl5 cs-ccr-cv6 cs-ccr-q8ds2 tcrpl2abcopl6 cs-ccr-cv7 cs-ccr-q8ds3 tcrpl3abcopl7 cs-ccr-cv8 cs-ccr-sm18as tcrpl4abcopl8 cs-ccr-leir1 cs-ccr-spareg3 tcrpl5abjas1 cs-ccr-oas1 cs-ccr-spareg4 tcrpl6abjas2 cs-ccr-oas2 elogsrv tcrpl7abpvss1 cs-ccr-oas3 laser1 tcrpl8absps1 cs-ccr-pic01 laser2 tcrpl9bdidev1 cs-ccr-pm1

Services Machines

19/9/2005 AB/CO Review 13

Linux Workstationsabinf1 abpc10168 abpc10309 abpc10883 cpsvistea mcrsrv pslinux2 pspc8471abjas3 abpc10169 abpc10310 abpc10898 cpsvistef pcabco2 pslxgwis pspc8472abjas99 abpc10170 abpc10311 abpc10912 ctfvistar pcatmel01 pslxgwmw pspc8473abpc10002 abpc10171 abpc10312 abpc10921 cwo-197-rex pcgw10 pslxgwpc pspc8479abpc10004 abpc10172 abpc10313 abpc10957 cwo-233-lei1 pcgw11 pslxstat pspc8501abpc10005 abpc10173 abpc10314 abpc11037 cwo-363-lei1 pclnxabws01 pslxtst pspc8503abpc10025 abpc10180 abpc10315 abpc11039 cwo-363-lei3 pclnxabws02 pspc7744 pspc8539abpc10054 abpc10182 abpc10329 abpcl18 cwo-936-tst2 pclnxabws03 pspc7842 pspc8586abpc10055 abpc10183 abpc10369 abpcl24 cwo-936-tst4 pcopav01 pspc7892 pspc8588abpc10065 abpc10184 abpc10386 abpcl29 cwo-ccc-proto1 pcslbi61 pspc7900 pspc8592abpc10102 abpc10185 abpc10388 abpcl30 cwo-ccc-proto2 pcslco69 pspc8061 pspc8602abpc10103 abpc10186 abpc10390 abpcl33 cwo-ccc-proto3 pcslux10 pspc8064 pspc8623abpc10115 abpc10187 abpc10409 abpcl37 cwo-ua83-hwc1 pcslux12 pspc8158 pspc8638abpc10116 abpc10201 abpc10496 abpcl41 cwo-ua83-hwc3 pcslux13 pspc8284 pspc8688abpc10117 abpc10209 abpc10511 abpcl53 cwo-ua83-hwc5 pcslux15 pspc8303 pspc8770abpc10119 abpc10218 abpc10519 abpcl54 gpsvistar pcslux20 pspc8314 pspc8782abpc10120 abpc10284 abpc10529 abpcl70 hpslmob14 pcslux4 pspc8339 pspc8809abpc10132 abpc10298 abpc10553 abpctomo hpslmob15 pcslux5 pspc8367 pspcnmnabpc10133 abpc10303 abpc10794 adevistar hpslweb pcslux6 pspc8435 pspctomoabpc10165 abpc10306 abpc10851 athens hrsvistar pcslux7 pspc8447 seattleabpc10166 abpc10307 abpc10852 cernab10001 jena pcsps184 pspc8467 slwwwabpc10167 abpc10308 abpc10862 cpsvistar linvistar psbvistar

Services Machines

19/9/2005 AB/CO Review 14

HPUXabsrv2 hamar mmisrv1 srvtds2absrv3 havana modena stdev1acsad1 hpdepot pcrsrv1 stdev2acsean hpjvm pcrsrv5 stpub1acserv1 hprfdev pcrsrv9 stspracsps1 hpsld1 repsrv stsrv1bomlep hpslz14 rfsrv1 sttds1btsrv1 hpslz18 samoa tcrsrv2bursa hpslz20 sljas1 tcrsrv3eanorth hpslz22 spssrv tinoselsrv1 hpslz30 srvtds1 zoralephaifa hptisdev

Services Machines

19/9/2005 AB/CO Review 15

Windows Consolesc1l864 c1npcr c2lsh8 cwo-a-labce1c1lsdh2 c1nx80 c2npcr cwo-ccc-proto4c1lsh4 c1sb80 c2sba3 cwo-ccc-proto5c1lsh8 c1sb81 c2sba5 cwo-ccc-proto6c1m036 c1sba3 c3l864 cwo-sa6-q1c1m269 c1sba4 c3sba3 cwo-sh2-q3c1n117 c1sba5 cs-a-hepcs1 cwo-sh4-q3c1n201 c1sba6 cwe-36-qin1 cwo-sh6-q1c1n351 c1sba7 cwo-36-q1 cwo-sh8-q1c1n394 c1sca4 cwo-363-lei2 cwo-shc4-q1c1n403 c1spcr cwo-363-lei4 cwo-ua83-hwc2c1n438 c1w272 cwo-936-tst3 cwo-ua83-hwc4c1n472 c2l864 cwo-a-anrs1 pcslco57c1n494 c2lsdh2 cwo-a-anrs3 qsc1hcows1c1na58 c2lsh4 cwo-a-hepcs1 qsc1hcows2c1na60

Services Machines

19/9/2005 AB/CO Review 16

LynxOS and Linux Front Ends (1)aadevxi1 blr61s cfc-sr1-rr1i dadebsyn dctfrfm2 dpsbbdi2 gpsba2 pcgw17aadevxi2 blr80s cfc-sr1-rr1j dadedgtz dctfrfm3 dpsbbdr gpsba3 pcgw18abcpci01 bmu02t cfc-sr1-sl1b dadeec dctfshb dpsbbgen gpsba4 pcgw19abcpci02 bmu10s cfc-sr1-sr1a dadekik1 dctfstr2 dpsbblm gpsba5 pcgw20abcpci03 bmu10t cfc-sr2-rl2b dadekik2 dctfstrk dpsbblmlhc gpsba6 pcgw21abcpci04 bmu20s cfc-sr2-rr2f dadepow1 dctftim dpsbbtu gpsba7 pcgw22abdsc01 bmu30s cfc-sr7-bt7ab dadepow2 dctfumal dpsbbume gpsbb4 pcgw23acmccr bmu40s cfc-sr7-dl7de dadepow3 dctfvacu dpsbejec gpsccr pcgw24acmmnr bmu40t cfc-sr7-dr7bc daderf dfbdv3 dpsbfbs gw1sm18 pcgw97aspsvxi1 bsmn87t cfc-sr8-rl8b dcpsfil dleirf dpsbtrg m1sba7 ppcbidv4aspsvxi2 bsp50s cfc-sr8-rl8c dcpsfmr dleirf2 dpsbtsm m1sbb3 ppcbidv5aspsvxi3 bsp80s cfc-sr8-rl8g dcpsft16 dleirfbt dpsbttr m1sbb4 ppcbidv6aspsvxi4 bstpcr cfc-sr8-rl8h dcpsinrg dleiripu dpsbvacu m1ssr8 ppcbidv7aspsvxi5 btv10s cfc-sr8-rr8d dcpsk45 dleitim drfqtst m2sba1 ppcbidv8aspsvxi6 btv40s cfc-sr8-rr8e dcpsk71 dleitraf dsps01 m2sba2 ppcbidv9bco20s btv41s cfc-sr8-rr8f dcpsllg dleitst1 dsps05 m2sba3 ppcbiht1bco50s btv50s cfc-sr8-rr8i dcpslls dleitst2 dsps15 m2sba4 ppcbipm1bco80s btv60s cfc-sr8-rr8j dcpsmsf dlinins2 dsps18 m2sba5 ppcbiql1bct10s btvi87t cfc-sr8-sl8b dcpsmsf2 dlininst dsps20 m2sba6 ppccodv1bct30s bws40s cfc-sr8-sr8a dcpsph dlinpow1 dsps32 m3sba2 ppccodv10bct40s bws41s cfv-170-rxpow dcpspow dlinrf dsrf01 m3sba3 ppccodv11bfct02t bws50s cfv-sr1-blmc dcpspuct dlinstim dtstbd m3sba6 ppccodv14bfct10t bws51s cfv-sr1-blml dcpsqmea dlintraf dtstgunp m4sba6 ppccodv15bfct30s cfc-170-rxplcgw cfv-sr1-blmr dcpsrfm1 dlinvacu ellse1 mosba6

ppccodv16bfct40t cfc-ba7-bti2cd cfv-sr1-bpmb1la dcpsrfm2 dln3ecr ellse2 mrsba3

ppccodv18bfct60t cfc-hca4-bti8cd cfv-sr1-bpmb1lb dcpsrg1 dln3ins1 ellse3

nasb80 ppccodv2bfct87t cfc-sh8-ql1mi cfv-sr1-bpmb1ra dcpsrg2 dln3ins2 ellse4 nasb81

ppccodv20bfgwba5 cfc-sh8-ql1nj cfv-sr1-bpmb1rb dcpsrg3 dln3pow ellse5 nasb82

ppccodv3bfp40s cfc-sh8-ql8cd cfv-sr1-bpmb2la dcpstej dln3rf ellse6 nesba2

ppccodv4bfp50s cfc-sh8-ql8ef cfv-sr1-bpmb2lb dcpstest dln3rf1 ellse7 nxsba2

ppccodv5bfs10s cfc-sh8-qr7ua cfv-sr1-bpmb2ra dcpstfb dln3tim ellse8 pcbttj

ppccodv6bfs20s cfc-sh8-qr7zb cfv-sr1-bpmb2rb dcpstinj dln3tra1 ellse9 pcbtts

ppccodv7bht40s cfc-sh8-qr8gh cfv-sr8-blmc dcpstof dln3vacu elms04 pcdev5 ppccodv8

Services Machines

19/9/2005 AB/CO Review 17

LynxOS and Linux Front Ends (2)blmi40t cfc-sh8-qr8kl cfv-sr8-blml dcpstr6t dmcrgwtg elms23 pcgw00 ppccodv9blmi70t cfc-sr1-bt1ab cfv-sr8-blmr dcpstrct dmcrmtga elms59 pcgw01 ppcfip4blmi87t cfc-sr1-dl1de cfv-sr8-bpmb1la dcpstrdc dmcrmtgb elmtcr pcgw02 ppcpcdv1blmn41t cfc-sr1-dr1bc cfv-sr8-bpmb1lb dcpstrtt dmcrmtgc elsa85 pcgw03 ppcpcdv2blr10s cfc-sr1-dt1fa cfv-sr8-bpmb1ra dcpsvac1 dmcrmtgd elsb81 pcgw04 ppcpcdv3blr11s cfc-sr1-gl1ab cfv-sr8-bpmb1rb dcpsvac2 dmcrmtgl elsba3 pcgw05 ppcpcdv4blr20s cfc-sr1-rl1a cfv-sr8-bpmb2la dctfblm dmcrmtgp elshdm pcgw06 ppcpcdv5blr21s cfc-sr1-rl1c cfv-sr8-bpmb2lb dctfgunp dmcrpls gplsr2 pcgw07 ppcpcdv6blr30s cfc-sr1-rl1d cfv-sr8-bpmb2ra dctfimag dmcrsos gplsr6 pcgw08 ppcpcdv7blr40s cfc-sr1-rl1g cfv-sr8-bpmb2rb dctfmdk dmcrsync gplsr8 pcgw09 ppcrf1blr41s cfc-sr1-rl1h cfv-sr8-cibti8 dctfmtv1 dmcrtest gpsb80 pcgw12 ppcrf2blr50s cfc-sr1-rr1b cfv-us85-ctdis1 dctfpow1 dmcrtrg2 gpsb81 pcgw14 ppcrf3blr51s cfc-sr1-rr1e cpcidv1 dctfpow2 dmcrvos gpsb82 pcgw15 ppcrf4blr60s cfc-sr1-rr1f dadebdr dctfrfm1 dpsbbdi gpsba1 pcgw16 ppcrf5ppcrf6 psdsc10 radb80 rvlsr1 svlsr5 v11d17 v1n494 v2n472ppcstie1 psdsc11 radba3 rvsba6 svlsr6 v1ebcr v1nb80 v2nb80ppcstmc1 psdsc12 radmon s2mtcr svlsr7 v1n117 v1nx80 v2nb81ppctigs1 psdsc13 rflinux00 sosba1 svlsr8 v1n201 v20d17 v2nb82psdsc01 psdsc14 rflynx sosba3 svmtcr v1n351 v21d17 v2nx80psdsc04 psdsc15 rfsba2 sosca4 tango v1n394 v2n117 v31d17psdsc05 psdsc16 rfscf1 svlsr1 v10d09 v1n403 v2n201 v3n351psdsc07 psdsc17 rfscf2 svlsr2 v10d17 v1n438 v2n351 v3n438psdsc08 psdsc18 rmspcr svlsr3 v11d04 v1n472 v2n438 wxsba6psdsc09 pspc7996 rmstcr svlsr4

Services Machines