79
:: Kelly K. Cota joined the chat. :: :: John Fritz *Contractor* joined the chat. :: :: Anwar M Fahad joined the chat. :: :: Marty Hebert *Contractor* joined the chat. :: :: Hema Pabba joined the chat. :: :: Pedro Matheus Dias joined the chat. :: :: [email protected] - Mahesh Prasad1/India/IBM joined the chat. :: :: Ritu Sharma joined the chat. :: :: Yamanuri Sudheer joined the chat. :: :: [email protected] - Vishal Namboori1/India/IBM joined the chat. :: :: [email protected] - Zohar Mann/Los Angeles/IBM joined the chat. :: :: Anuj Kumar joined the chat. :: :: Belinda Brotherson *Contractor* joined the chat. :: :: Venkata Rama Rao Bommireddipalli joined the chat. :: :: [email protected] - Howard Grapek/Boulder/Contr/IBM joined the chat. :: :: [email protected] - Mahesh Prasad1/India/IBM is in a meeting :: :: [email protected] - Zohar Mann/Los Angeles/IBM is in a meeting :: :: John Fritz *Contractor* joined the chat. :: :: Ritu Sharma joined the chat. :: :: Anwar M Fahad joined the chat. :: Fritz ie Moi So who do we need tro help on this? 3:31:0 1 AM Anwar M Fa... we need the CMS application, intel 3:32:4 9 AM Fritz ie Moi CMS or CEMS 3:34:0 2 AM ? ? 3:34:0 8 AM Anwar M Fa... for some reason data it being removed and it needs to be 3:34:2 6 AM

Chat

Embed Size (px)

Citation preview

Page 1: Chat

:: Kelly K. Cota joined the chat. :: :: John Fritz *Contractor* joined the chat. :: :: Anwar M Fahad joined the chat. :: :: Marty Hebert *Contractor* joined the chat. :: :: Hema Pabba joined the chat. :: :: Pedro Matheus Dias joined the chat. :: :: [email protected] - Mahesh Prasad1/India/IBM joined the chat. :: :: Ritu Sharma joined the chat. :: :: Yamanuri Sudheer joined the chat. :: :: [email protected] - Vishal Namboori1/India/IBM joined the chat. :: :: [email protected] - Zohar Mann/Los Angeles/IBM joined the chat. :: :: Anuj Kumar joined the chat. :: :: Belinda Brotherson *Contractor* joined the chat. :: :: Venkata Rama Rao Bommireddipalli joined the chat. :: :: [email protected] - Howard Grapek/Boulder/Contr/IBM joined the chat. :: :: [email protected] - Mahesh Prasad1/India/IBM is in a meeting :: :: [email protected] - Zohar Mann/Los Angeles/IBM is in a meeting :: :: John Fritz *Contractor* joined the chat. :: :: Ritu Sharma joined the chat. :: :: Anwar M Fahad joined the chat. :: Fritz ie MoiSo who do we need tro help on this?  

3:31:01 AM

Anwar M Fa...we need the CMS application, intel 

3:32:49 AM

Fritz ie MoiCMS or CEMS 

3:34:02 AM

??  

3:34:08 AM

Anwar M Fa...for some reason data it being removed and it needs to be checked. It is not happening from NAS. 

3:34:26 AM

Fritz ie Moiyes, again CMS is that a team or is it CEMs?  

3:35:02 AM

Anwar M Fa...CMS 

3:36:23 AM

Fritz ie Moiok  

3:37:18 AM

?OK, we are loking for CMS in Remedy and elsewhere.  

3:42:09 AM

Anwar M Fa...ok 

3:42:40 AM

Page 2: Chat

Fritz ie MoiIntel dispatcher gaveus bhavani shankar to try to help 

4:00:37 AM

Anwar M Fa...allright 

4:01:26 AM

Fritz ie Moido we have any idea about the names of the files which appear enpty now?  

4:01:54 AM

?any idea of the type of files?  

4:02:02 AM

Anwar M Fa...more than 2TB is gone 

4:02:09 AM

?i have attached the screenshot in the INC 

4:02:32 AM

Fritz ie Moiyes, I saw the display mentioning the CMS application 

4:04:06 AM

Anwar M Fa...there could have been many types of files in this qtree, It does not look like manual deletion. could be an application. 

4:05:04 AM

Fritz ie Moithere could be  

4:06:13 AM

Anwar M Fa...INC 1750746 

4:06:19 AM

?The qtree was at 2160GB full and now it is at 100GB. 

4:08:04 AM

Fritz ie Moican you pull any names that may help locate who uses this space or what the application might be?  

4:09:28 AM

Anwar M Fa...I am trying to pull information on all the CMS qtrees i can 

4:18:13 AM

?security can give us better information 

4:18:41 AM

:: Ramya Yalamanchili joined the chat. :: :: Satish Jain joined the chat. :: Bhavani And...Hi all 

4:21:18 AM

Satish JainHi  

4:21:22 AM

Fritz ie MoiSatish the thought for netback up is to check to see if a backup or restore has caused this.  

4:22:23 AM

Satish Jaincould u give me server name 

4:23:40 AM

Fritz ie Moihe share path is \\erdhfdnas002\HFD_flx_306$\CMSData 

4:24:20 AM

?Anwar, have you engaged anyone from NAS engineering?  

4:26:43 AM

Anwar M Fa...NetApp, vendor? 

4:27:20 AM

Page 3: Chat

?I have checked the filer and nothing is wrong with it, no errors. 

4:28:14 AM

Fritz ie MoiAnwar, Bhavani is from Intel please tell him what you want him to check?  

4:29:16 AM

?Anwar or Ritu I got an intel peson here please tell them what you want checked now.  

4:34:43 AM

Anwar M Fa...Yes john, Bhavani is looking at the screenshot attachent in the INC 

4:35:25 AM

Fritz ie MoiAnwar, the service Manager wants to know if you have engaged NAS engineering.  

4:36:05 AM

?? 

4:36:11 AM

:: Yamanuri Sudheer joined the chat. :: :: Yamanuri Sudheer joined the chat. :: Fritz ie MoiAnwar?  

4:42:29 AM

Satish JainWe did not perform any restore..on this server...so restore is not the cause  

4:42:57 AM

Anwar M Fa...I have not engaged the vendor yet, I am opening a case with netapp right now. 

4:43:17 AM

Fritz ie MoiAnwar, I did not ask if you engaged a vendor; I asked if you engaged NAS engineering?  

4:44:03 AM

?Bhavani, can you post wat you are working on for this?  

4:45:03 AM

?Bhavani, can you post what you are working on for this?  

4:45:19 AM

Anwar M Fa...John I am from NAS 

4:45:39 AM

Bhavani And...I am not find anything, checking with my team are they done any home driver migraction 

4:46:30 AM

Fritz ie MoiAnwar, are you NAS engineering? If not have you engaged them?  

4:47:17 AM

?This is an "all hands on deck" situation 

4:48:12 AM

Anwar M Fa...Yes I am from NAS engineering 

4:49:47 AM

?There only one team for NAS Storage 

4:50:07 AM

Fritz ie MoiDo you have US support now? If not we need them, now.  

4:51:02 AM

? 4:53:2

Page 4: Chat

We need you to enfgge them are you?   6 AM

Anwar M Fa...I am checking with Kelly 

4:53:35 AM

Fritz ie MoiKelly who?  

4:53:47 AM

Anwar M Fa...Kelly Cota 

4:54:00 AM

Fritz ie MoiDo you have her on the phone?  

4:54:47 AM

Anwar M Fa...John, I trying to get Marty Hebert here. 

4:59:42 AM

?I cant get to him, have left voice messages. 

5:04:00 AM

Fritz ie MoiDid you speak to Kelly?  

5:06:25 AM

Ritu Sharma... yes john i spoke to kelly she is available 

5:07:45 AM

Fritz ie MoiDid you try Marty cell phone?  

5:08:44 AM

Ritu Sharma... yes i did and tried to contact daniel too left a vm  

5:09:14 AM

Fritz ie MoiMaerty on Mobile: 1-972-533-2716 ?  

5:09:40 AM

Ritu Sharma... he is available now i think kelly able to rech him 

5:10:08 AM

:: Marty Hebert *Contractor* joined the chat. :: Marty Heber... 

5:10:22 AM

:: Kelly K. Cota joined the chat. :: Kelly K. Cotahi 

5:10:38 AM

Marty Heber... 5:10:4

Page 5: Chat

Hello, trying to get into my vpn  3 AM

Kelly K. Cotadid Venkata join also? 

5:10:45 AM

?please invite 

5:10:54 AM

Ritu Sharma... sure i m doin it  

5:11:16 AM

Fritz ie MoiMarty please join a call on this 1-866-365-4406 pc 0225524, thank you 

5:12:04 AM

:: Ritu Sharma left the chat. :: :: Yamanuri Sudheer left the chat. :: :: Ritu Sharma joined the chat. :: Kelly K. CotaKelly joined 

5:15:40 AM

?Ritu and Anwar, per the sev 1 critical incident process you need to involve your first line mgmt if the issue is not resolved within 1 hr, do you remember this process the storage team is to follow? 

5:20:34 AM

Ritu Sharma... i tried to call him but he is not reachable 

5:21:06 AM

Kelly K. Cotadid you go to his manager 

5:22:54 AM

Bhavani And...I Checked with Team and found there is No Data Migration Activity is Not Performed by the Intel Team from Past 2 Days 

5:23:27 AM

:: Hema Pabba joined the chat. :: Kelly K. Cotaplease call Mahesh Prasad as the second line and I will call Debi to update her 

5:26:00 AM

Ritu Sharma... k i m doin it 

5:26:17 AM

Anwar M Fa...allright 

5:26:18 AM

:: Ritu Sharma left the chat. :: Kelly K. Cotaimpact to customer is ? 

5:31:57 AM

Fritz ie MoiKelly, I believe that is unknown as of yet.  

5:32:58 AM

:: Vishal Namboori joined the chat. :: Kelly K. Cotawho is opening the yellow event 

5:33:28 AM

Fritz ie Moi 

5:33:37 AM

Page 6: Chat

?corinne lawrence  

5:33:44 AM

?hartford Service Manager 

5:34:05 AM

Kelly K. Cotaso how can we have a sev1 incident and not know what the impact to our customer is 

5:34:22 AM

:: Ritu Sharma joined the chat. :: :: Vishal Namboori left the chat. :: Fritz ie MoiNAS concern that we had 2.11 TB of data go to 100MB of data and do not kow if that is a thing that should have happened or not. EITSM and Service Manager have not been able to access the impact or not so they're erring on the side of caution.  

5:36:39 AM

?The other piece is they still see the file structures just all 0 bytes 

5:37:29 AM

Kelly K. Cotado we know who owns the data and has anyone called them? 

5:37:58 AM

Fritz ie Moino we do not know. The one query that NAS ran through DFM showed the CMS application had 2.11 TB with an SA name Rick Sevigny who is gone from IBM 

5:41:44 AM

?now getting localized to the nested share not the whole Q tree  

5:42:25 AM

?per Marty 

5:42:41 AM

Kelly K. Cotahas anyone lookied into change mgmt to see if something was done inadertently? 

5:43:36 AM

Fritz ie MoiSD has checked and found nothing that seems tied to this 

5:44:25 AM

:: Venkata Rama Rao Bommireddipalli joined the chat. :: Venkata Ra...i am on 

5:51:00 AM

:: Vishal Namboori joined the chat. :: Marty Heber...Ritu, can you give Zohar a call for another set of eyes 

5:51:58 AM

Ritu Sharma... ok i m doin it

5:52:13 AM

Kelly K. CotaI totally agree Marty, lets get an architect to review before we make any decision and not waste any more time 

5:52:29 AM

:: [email protected] - Mahesh Prasad1/India/IBM joined the chat. :: :: Hema Pabba left the chat. :: Ritu Sharma... zohar

is not pickin left a

5:55:15 AM

Page 7: Chat

vm  

Kelly K. Cotacall an alternate number for him if you have one 

5:55:57 AM

?if you don't then need to engage his manager STeve poss 

5:56:06 AM

Ritu Sharma... i dont have his alternate no called him twice not available 

5:57:53 AM

Kelly K. Cotacall steve poss then 

5:58:15 AM

Ritu Sharma... k callin him 

5:59:08 AM

Venkata Ra...Anwar..Can u engage Steve Poss  

5:59:11 AM

Kelly K. Cotaif he can't reach Zohar he can get someone else from his team perhaps 

5:59:15 AM

Ritu Sharma... he is not available too 

5:59:42 AM

Fritz ie MoiRitu did you try his mobile? Phone: 1-630-907-0658 Mobile: 1-630-215-5856  

6:00:36 AM

?Steve Poss 

6:00:53 AM

Ritu Sharma... i tried his phone lemme try his mobile 

6:01:12 AM

? i talked to steve he is calling zohar to get online he would

6:06:37 AM

Page 8: Chat

update kelly on the same  

:: Yamanuri Sudheer joined the chat. :: Marty Heber...Is it possible to verify how long it takes for the data to go back to 0? My small test case is still showing data. 

6:19:53 AM

6:20:02 AM

:: Zohar Mann joined the chat. :: Kelly K. Cotamarty is calling netapp right now Zohar 

6:23:40 AM

Zohar Manncan someone post the number here pls? 

6:26:50 AM

Fritz ie MoiTech conf call opening 1-866-423-8350 Participant Passcode: 4210624480  

6:26:54 AM

?line is open now 

6:27:39 AM

:: Yamanuri Sudheer joined the chat. :: Kelly K. Cotazohar per our crit sit process this has been going on since 9:21 last night so that is why you are now engaged to lend another set of eyes 

6:33:27 AM

Fritz ie MoiAnwar, are you joining the tech call? We moved to 1-866-423-8350 Participant Passcode: 4210624480 

6:45:02 AM

Anwar M Fa...Joining 

6:45:35 AM

Fritz ie MoiOK, we are awating MArty's return from engageing Netapps 

6:47:39 AM

?Marty what file did you restore? We can have it checked to see if it still has bytes associated with it.  

6:49:02 AM

Zohar Mannwant to make sure we don't have more than 1 nas admin making changes- Is Marty on point or someone from steady state team right now? 

6:49:22 AM

Anwar M Fa...Marty only 

6:49:37 AM

Zohar Mannk thx 

6:49:42 AM

Fritz ie Moisuper  

6:49:50 AM

Marty Heber...\\erdhfdnas002\cmsdata$\CMSdata\ShrData\!Drive Failure\Alex\ALEX_TEST_FILES\M_Etes 

6:52:38 AM

?this folder and it is still showing data 

6:52:51 AM

Page 9: Chat

?meaning not 0 

6:52:54 AM

Fritz ie Moithank you 

6:53:21 AM

?When did that get restored?  

6:53:33 AM

Marty Heber...before I left the call 

6:53:51 AM

Zohar Mannso based on DFM, it looks like capacity went way down after 10PM last night 

6:53:54 AM

?10PM ET 

6:54:22 AM

Anwar M Fa...2160GB to a 100GB on the qtree 

6:55:12 AM

Zohar Mann7/28/2010 9:45 2,318,798,311,424.007/28/2010 20:45 726,029,418,496.007/28/2010 21:24 - 

6:57:34 AM

?

 

7:00:48 AM

:: Hema Pabba joined the chat. :: Zohar MannI see over 50 nested shares- any idea if problem is isolated to specific shares? 

7:13:36 AM

Fritz ie MoiZohar I thought Marty got it erdhfdnas002/cmsdata$/CMSdata/ShrData

7:17:17 AM

:: Satish Jain left the chat. :: Zohar MannHas the security team been engaged? 

7:21:37 AM

Kelly K. Cotabrb 

7:21:53 AM

Fritz ie Moiyes Zohar 

7:22:04 AM

Marty Heber...All, my test restore is still OK. Should be try some more restores while we try and figure out what happened 

7:22:06 AM

Fritz ie MoiSecurity is checking s add or deletion or no loger employed could have effected this.  

7:22:39 AM

?thanks Marty 

7:28:41 AM

?Marty, did you quantify this to 46G + or - ? 

7:29:11 AM

Marty Heber...46G you talking size ?? 

7:35:40 AM

Page 10: Chat

Fritz ie Moiyes 

7:36:24 AM

Kelly K. Cotashould we try the restore that the customer tried and see if it holds? 

7:39:37 AM

:: Venkata Rama Rao Bommireddipalli left the chat. :: Marty Heber...That would be a great idea. Can we get the path? 

7:40:37 AM

:: Venkata Rama Rao Bommireddipalli joined the chat. :: Zohar MannCMSshrdata /vol/HFD_flx_306/CMSdata/cmsdata/ShrData CMS ShrDataAD1\CBG_CMSShrdata / ChangeAD1\CLShrapps Admins / ChangeAD1\CMS_CMSShrData / ChangeAD1\cmsPerfAnalytics / Full ControlAD1\CMSShrData / ChangeERDHFDNAS002\CMSshrdataaccess / ChangeAD1\CMSSpectrum Approver / ChangeERDHFDNAS002\CMSusers / ChangeAD1\COR_CMSSHRDATA / ChangeAD1\ECCC Admins / Full Controleveryone / ChangeAD1\PLC_CMSShrData / ChangeAD1\RSD-ATS-ERDHFDNAS002-CMSShrData-RO / ReadAD1\RSD-ATS-ERDHFDNAS002-CMSShrData-RW / ChangeAD1\RSD-Claims-ERDHFDNAS002-CMSShrData-ECM-RW / ChangeAD1\RSD-ECM-ECM-RW / ChangeAD1\RSD-ERDHFDNAS002-CMSShrData-UCM-RO / ReadAD1\RSD-ERDHFDNAS002-CMSShrData-UCM-RW / ChangeAD1\RSD-IM-AD1-Prod-HIG-Corp-RSD-CMSShrData-Warehouse-RW / ChangeAD1\XXFTP035 / Read 

7:47:19 AM

:: Belinda Brotherson *Contractor* joined the chat. :: Marty Heber...\\erdhfdnas002\cmsshrdata\CLCS Commission Project\2010 ISD Playbooks 

7:59:25 AM

Zohar MannIt would be good to announce if customer is on call (or this chat via shared screen). 

8:13:23 AM

Fritz ie MoiI do not think we hae cutomers on the tech call 

8:19:07 AM

?Zohan, I do not think we have customers on the tech call  

8:19:34 AM

Zohar MannMike was on listening with Bridget I think? 

8:19:39 AM

Fritz ie MoiAh, ha mentioned Kathy I missed Bridget 

8:20:03 AM

bbrotherson...who from this chat room in on the technical bridge? 

8:20:03 AM

Zohar MannI am 

8:20:12 AM

Page 11: Chat

Kelly K. CotaI am 

8:20:14 AM

Bhavani And...I am 

8:20:20 AM

Zohar Mann15 callers on the bridge when I rejoined 

8:20:28 AM

Fritz ie MoiI'm checking with Mike on Bridget  

8:20:32 AM

bbrotherson...when i get a chance, I'm going to do a roll call on the bridge...dont' want to interrupt the current flow though... 

8:20:59 AM

?Zohan, did Jim join after you? 

8:21:14 AM

Fritz ie Moiyes  

8:21:20 AM

?BB 

8:21:22 AM

bbrotherson...ok...so that would be about 16 

8:21:30 AM

Fritz ie MoiBridget is not on the call any longer 

8:24:35 AM

Kelly K. Cotadropping from the call 

8:30:14 AM

bbrotherson...ok 

8:30:19 AM

Fritz ie Moithank you Kelly 

8:30:28 AM

Kelly K. Cotasure I will check back in shortly 

8:30:49 AM

?on another urgent call 

8:30:52 AM

Fritz ie Moinp!  

8:31:01 AM

bbrotherson...backup team? who is still here? 

8:34:20 AM

Yamanuri Su...iam there from backup team  

8:34:54 AM

:: Anuj Kumar joined the chat. :: Yamanuri Su...vishal is there from restore ops team 

8:35:11 AM

?do you need any assistance from backup team 

8:35:47 AM

bbrotherson...the customer is asking about the possibility of a restore 

8:36:09 AM

?would you please join the conf call? 

8:36:21 AM

Yamanuri Su...iam in home 

8:36:31 AM

Page 12: Chat

bbrotherson...1-866-423-8350 Participant Passcode: 4210624480  

8:36:34 AM

?ok 

8:36:36 AM

?is there someone that could patch you? 

8:36:44 AM

Yamanuri Su...i willl ask anuj to join the call 

8:36:44 AM

bbrotherson...ok 

8:36:46 AM

?that will work 

8:36:49 AM

Yamanuri Su...both are in meeting  

8:37:00 AM

?once meeting gets completed then let you know 

8:37:12 AM

?please provide me the details so that i will check from backup end 

8:37:32 AM

?hi anuj 

8:38:24 AM

?are you there? 

8:38:33 AM

?please join the call 

8:38:48 AM

?1-866-423-8350 Participant Passcode: 4210624480 

8:39:02 AM

:: Venkata Rama Rao Bommireddipalli left the chat. :: :: Venkata Rama Rao Bommireddipalli joined the chat. :: Anuj KumarHi Sudheer,, i am joining it after cadence call 

8:47:47 AM

?i will finish it in next 15 min 

8:48:01 AM

Yamanuri Su...ok anuj 

8:48:08 AM

?i asked vishal to check  

8:48:24 AM

:: Pedro Matheus Dias joined the chat. :: :: Howard (Howie) Grapek *Contractor* joined the chat. :: Yamanuri Su...Hi John 

8:51:06 AM

bbrotherson...welcome Pedro 

8:51:09 AM

:: Srinivas R Baddam joined the chat. :: Yamanuri ...Manish from backup team will join the chat 

6:21:35 PM

Pedro Mat...Belinda.. good morning  

6:21:38 PM

Page 13: Chat

?Good morning everyone 

6:21:41 PM

Belinda Br...good morning 

6:21:48 PM

?i need a restore resource on the conference call  

6:22:08 PM

Pedro Mat...no one has joined yet? 

6:22:23 PM

Yamanuri ...yes 

6:22:23 PM

:: Manish H Ghildyal joined the chat. :: Yamanuri ...i asked vishal to join the call 

6:22:32 PM

:: Venkatesh Pillalamarri *Contractor* joined the chat. :: Belinda Br...let me check... i just had a "ding" on the call 

6:22:58 PM

?he is not answering on the call yet 

6:23:04 PM

[email protected] will join at 9.. and I'm asking vinny to join now from the US to help understand the issue and help drive the global resources.  

6:23:05 PM

Yamanuri ...hi manish 

6:23:37 PM

?please join the call 

6:23:41 PM

?1-866-423-8350 Participant Passcode: 4210624480 

6:23:53 PM

?i updated to vishal 

6:23:59 PM

:: [email protected] - Vishal Namboori1/India/IBM is available :: Yamanuri ...he will give you details 

6:24:07 PM

:: [email protected] - Jo-Ann Martin/Southbury/IBM joined the chat. :: :: [email protected] - Jo-Ann Martin/Southbury/IBM is available :: Pedro Mat...Vishal is joining now 

6:25:59 PM

:: Hema Pabba is away :: :: Hema Pabba is available :: :: Bhavani S Ande joined the chat. :: :: John Fritz *Contractor* left the chat. :: :: Kelly K. Cota is away :: :: John Fritz *Contractor* joined the chat. :: :: Kelly K. Cota is available :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM joined the chat. ::

Page 14: Chat

:: [email protected] - Michael G Morin/Poughkeepsie/IBM is available :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM left the chat. :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM is offline :: :: [email protected] - Raju Yadav/India/IBM joined the chat. :: :: [email protected] - Raju Yadav/India/IBM is in a meeting :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM joined the chat. :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM is available :: :: Bhavani S Ande left the chat. :: :: Bhavani S Ande is offline :: Belinda Br...Vinnie has stated on the call that the last full backup was from the 10th... there are incrementals...but 

6:40:42 PM

?so we need to track that as an follow-up item as to why this full backup hasn't been successful lately 

6:41:05 PM

Venkatesh...Most recent attempted FULL was on 25 

6:46:34 PM

Belinda Br...who has Domain Admin level access that can copy these files? 

6:47:19 PM

Venkatesh...Backed up 486,879,232 in 4.53 hours and then went for a tape change. The tape change resulted in a bad tape 

6:47:20 PM

Belinda Br...ouch 

6:47:26 PM

Venkatesh...the failed backup not subsequently remediated 

6:47:50 PM

Belinda Br...who has Domain Admin level access that can copy / restore these files? 

6:49:40 PM

:: [email protected] - Raju Yadav/India/IBM is away :: :: [email protected] - Raju Yadav/India/IBM is in a meeting :: [email protected] wouldnt we have the customers do their own restores as they identify the file is missing? 

7:03:04 PM

?i thought we said we have issue because we do not have permissions? 

7:03:17 PM

?did i miss something 

7:03:23 PM

Belinda Br...i don't think so... i don't completely understand who has the permissions so my question is to the general audience to confirm that i'm not missing something 

7:03:52 PM

Page 15: Chat

[email protected] 

7:04:07 PM

:: John Fritz *Contractor* is away :: :: Ritu Sharma is away :: :: [email protected] - Jo-Ann Martin/Southbury/IBM is away :: zoharman...permissions: everyone 

7:17:09 PM

Belinda Br...is that as it should be? 

7:17:23 PM

zoharman...CMSshrdata /vol/HFD_flx_306/CMSdata/cmsdata/ShrData CMS ShrDataAD1\CBG_CMSShrdata / ChangeAD1\CLShrapps Admins / ChangeAD1\CMS_CMSShrData / ChangeAD1\cmsPerfAnalytics / Full ControlAD1\CMSShrData / ChangeERDHFDNAS002\CMSshrdataaccess / ChangeAD1\CMSSpectrum Approver / ChangeERDHFDNAS002\CMSusers / ChangeAD1\COR_CMSSHRDATA / ChangeAD1\ECCC Admins / Full Controleveryone / ChangeAD1\PLC_CMSShrData / ChangeAD1\RSD-ATS-ERDHFDNAS002-CMSShrData-RO / ReadAD1\RSD-ATS-ERDHFDNAS002-CMSShrData-RW / ChangeAD1\RSD-Claims-ERDHFDNAS002-CMSShrData-ECM-RW / ChangeAD1\RSD-ECM-ECM-RW / ChangeAD1\RSD-ERDHFDNAS002-CMSShrData-UCM-RO / ReadAD1\RSD-ERDHFDNAS002-CMSShrData-UCM-RW / ChangeAD1\RSD-IM-AD1-Prod-HIG-Corp-RSD-CMSShrData-Warehouse-RW / ChangeAD1\XXFTP035 / Read  

7:17:34 PM

?top line is the share. lines under it are the user or group and their access priv 

7:18:00 PM

:: [email protected] - Jo-Ann Martin/Southbury/IBM is available :: Pedro Mat...(will be back soon 

7:20:03 PM

:: Anwar M Fahad is away :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM left the chat. :: :: Hema Pabba left the chat. :: :: Pedro Matheus Dias is away :: :: Ritu Sharma is available :: :: Pedro Matheus Dias is available :: :: Yamanuri Sudheer left the chat. :: :: Gerald L. Gase joined the chat. :: Kelly K. Cotaany updates? 

8:06:14 PM

Page 16: Chat

Gerald L. G...Jim Hoover (Hartford Info Security) is investigating logs to detect anything from an ID perspective. 

8:08:09 PM

Kelly K. Cotagood 

8:08:59 PM

:: [email protected] - Michael G Morin/Poughkeepsie/IBM joined the chat. :: Gerald L. G...Snap Mirror is at 100GB as of 10:26 (45 minutes for 100GB).  

8:09:10 PM

:: [email protected] - Michael G Morin/Poughkeepsie/IBM is available :: Kelly K. Cotaand we are in the middle of a volume snapmirror to another aggregate that has free space. 

8:09:26 PM

?how much data has been transferred 

8:09:36 PM

?want to estimate the completion time 

8:10:19 PM

?in the meantime assume someone is working with the customer to get a prioritized list for the restore of what is first? 

8:10:48 PM

?or has a decision been made on how to do that yet? 

8:10:59 PM

zoharman...I think the restore plan is still pending unless they worked it out on the call while I was away. 

8:13:43 PM

:: [email protected] - Michael G Morin/Poughkeepsie/IBM is away :: :: Venkata Rama Rao Bommireddipalli left the chat. :: :: Venkata Rama Rao Bommireddipalli is offline :: Kelly K. CotaI am only in this st chat not on the call 

8:15:09 PM

:: Venkata Rama Rao Bommireddipalli joined the chat. :: Gerald L. G...Sorry Kelly. I am listening to updates from Jim Hoover and others. Doesn't appear to be anything from an individual user event nor any virus scan.  

8:16:00 PM

:: Anwar M Fahad is available :: Kelly K. Cotaok thats good 

8:17:36 PM

Gerald L. G...Good for that piece. But still leaves question as to what happened. 

8:18:35 PM

Kelly K. Cotano one found a script yet, did we hear back from Netapp on the logs? 

8:20:40 PM

Gerald L. G...Marty did indicate Symptoms look like something that could be caused archiving but not conclusive  

8:20:41 PM

Kelly K. CotaI know they are huge 

8:20:42 PM

Page 17: Chat

Gerald L. G...Marty just stepped away from the call to ask. 

8:21:03 PM

Kelly K. Cotaand we ruled out permission problems right? 

8:21:07 PM

Gerald L. G...Not sure. Belinda, was that ruled out earlier? It wasn't mentioned in the during the last 15 minutes. 

8:23:13 PM

zoharman...Did I hear correctly earlier that a tape restore was requested for this qtree yesterday? 

8:23:56 PM

Belinda Br...i am not aware of a previous restore request 

8:30:17 PM

zoharman...what was the name of the tape backup resource that was on the call before? 

8:33:18 PM

Belinda Br...Vinnie 

8:35:26 PM

:: Ritu Sharma is away :: Belinda Br...Ventatesh Pillalamari aka. Vinnie 

8:37:11 PM

:: Manish H Ghildyal is away :: [email protected] here too. and on phone with vinny, whats up?  

8:37:35 PM

?oh, i see the question - i'll check in a couple of minutes.  

8:38:03 PM

:: Kelly K. Cota joined the chat. :: :: Kelly K. Cota left the chat. :: zoharman...did vinnie say that a backup or a restore attempted yesterday at ~1300? 

8:38:18 PM

:: Manish H Ghildyal is available :: zoharman...Belinda- have you created a timeline yet for the isssue? 

8:40:56 PM

vinamboo...Restore attempted 13:06:57 

8:41:01 PM

Belinda Br...i am working on a timeline for the investigation 

8:41:30 PM

?i have not started the overall event timeline 

8:41:36 PM

?this issue started around 17:05 yesterday 

8:42:29 PM

zoharman...but the data deletion started earlier 

8:42:38 PM

Belinda Br...the INC was opened at 00:57 this morning 

8:42:54 PM

?the first I have heard of issues was from 5:05 pm ET yesterday evening 

8:43:19 PM

Page 18: Chat

zoharman...we need to refine the time but based on the vague graph I pasted, the deletions appear to perhaps have started around 12 noon yesterday (07/28). Maybe a little earlier. reserach required. 

8:44:19 PM

Belinda Br...7/28/2010 - 5:04 pm is when the data started tp disappear... some disappeared closer to 7:00 pm 

8:44:30 PM

?oh really? 

8:44:41 PM

?Zohar: are you referring to 12 noon ET? 

8:45:13 PM

:: [email protected] - Jo-Ann Martin/Southbury/IBM is away :: :: [email protected] - Jo-Ann Martin/Southbury/IBM is available :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM is available :: :: [email protected] - Raju Yadav/India/IBM left the chat. :: zoharman...yes. trying to get a more granular report now 

8:54:00 PM

:: [email protected] - Mahesh Prasad1/India/IBM left the chat. :: Belinda Br...Kishore is now on the call as well 

9:00:38 PM

?we are discussing the best method for copying the data back to its original location 

9:00:52 PM

:: Kishore Guduru joined the chat. :: :: Kishore Guduru is in a meeting :: zoharman...These times are ET: 

9:16:15 PM

?7/28/2010 10:00 2,318,798,311,4247/28/2010 22:00 726,029,418,4967/29/2010 8:00 117,892,698,112 

9:16:31 PM

Belinda Br...is that the total file size you have listed? 

9:17:01 PM

zoharman...that was the qtee used capacity in bytes 

9:17:59 PM

Venkatesh...Regarding the restore question -  

9:18:25 PM

?It started at 07/28/10 14:57:56  

9:18:30 PM

?Appeared like it hung for a long time 

9:18:51 PM

?Then finally the failure of that restore: 

9:18:59 PM

?07/29/10 01:06:00 - Error ndmpagent(pid=2070) aborting operation - no mover progress 

9:19:00 PM

Page 19: Chat

?The data that was attempted for restore was: 

9:19:34 PM

?/vol/HFD_flx_306/CMSdata/CMSdata/ShrData/ on erdhfdnas002 

9:19:46 PM

Belinda Br...what is the size now? 

9:20:14 PM

?has it decreased again since 8am? 

9:20:22 PM

:: Ritu Sharma left the chat. :: :: Ritu Sharma joined the chat. :: Belinda Br...Vinnie, why did we attempt a restore? 

9:23:36 PM

?Zohar: what is the current size of the directory? 

9:26:21 PM

zoharman...Have to get that from the NAS Admin- I'm not logged into the filer, just a reporting tool (non realtime). 

9:26:58 PM

Belinda Br...ok 

9:27:08 PM

?i can ask then...i thought you may have it handy 

9:27:14 PM

zoharman...but I'm very curious about the restore attempt 

9:27:42 PM

Belinda Br...Howie... can you join the call for a few? 

9:27:51 PM

?and Zohar, you might be interested as well 

9:28:07 PM

zoharman...k 

9:28:12 PM

?I'm going to try my landline- again pls tell me if noisy 

9:28:31 PM

Venkatesh...Somebody from the global restore team needs to answer that question 

9:28:47 PM

Belinda Br...sure 

9:28:48 PM

?Howie... can you join? 

9:31:34 PM

?who is still here from Restore team? 

9:32:01 PM

:: [email protected] - Vishal Namboori1/India/IBM left the chat. :: :: [email protected] - Vishal Namboori1/India/IBM joined the chat. :: vinamboo...This is Vishal from Restore Team 

9:33:04 PM

Belinda Br...IMAGE [smile] 

9:33:10 PM

Page 20: Chat

?Vishal, can you please join the bridge line? 

9:33:22 PM

?need more information on the attempted restore from yesterday 

9:33:38 PM

?NAS team... please confirm the current size of the directory. 

9:34:43 PM

vinamboo...joined the call 

9:35:26 PM

Belinda Br...thank you for joining Vishal 

9:35:30 PM

?Vishal, do you know how requested the restore from yesterday? 

9:36:09 PM

:: Ritu Sharma is available :: Venkatesh...Vishal, the restore is P&C jobid 1974868, to erdhfdnas002:/vol/HFD_flx_306/CMSdata/CMSdata/ShrData/ queued at 07/28/10 13:06:59, but actually went active at 07/28/10 14:57:56 

9:38:10 PM

Belinda Br...is there an INC? 

9:38:27 PM

vinamboo...yes 

9:38:32 PM

Belinda Br...can you provide the INC from the restore request 

9:38:45 PM

vinamboo...INC1747899 

9:38:48 PM

Belinda Br...thank you...looking it up now 

9:38:54 PM

vinamboo...INC1739065 this is the correct one 

9:39:54 PM

Belinda Br...ok 

9:40:02 PM

?so you were trying to restore the 2009 PL Forum folder? 

9:41:16 PM

vinamboo...yes 

9:41:24 PM

Belinda Br...did you restore the whole path erdhfdnas002/vol/HFD_flx_306/CMSData/ShrData? 

9:42:09 PM

vinamboo...I need to check with my colleague who initiated the restore: give me 5 min 

9:43:22 PM

Belinda Br...ok 

9:43:26 PM

?we need information on where the restore error'd out as well 

9:43:40 PM

vinamboo...ok 

9:43:47 PM

Belinda Br... 9:44:3

Page 21: Chat

what is the current size of the NAS share directory?  0 PM

?have we lost any more data since 08:00 am ET?  

9:44:43 PM

?I need to determine if the system is now stable 

9:44:51 PM

:: [email protected] - Vishal Namboori1/India/IBM left the chat. :: :: [email protected] - Vishal Namboori1/India/IBM joined the chat. :: zoharman...Marty- can you please check /etc/log/backup to see if it had restore data? 

9:52:16 PM

:: [email protected] - Sreekanth Jayaprakash/India/IBM joined the chat. :: :: [email protected] - Sreekanth Jayaprakash/India/IBM is available :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM is away :: :: Ritu Sharma left the chat. :: Belinda Br...Vishal, who kicked off the restore? 

10:02:18 PM

:: Ritu Sharma joined the chat. :: Belinda Br...we need to understand what steps were taken to ensure we are taking the correct restore actions 

10:02:44 PM

:: Anwar M Fahad left the chat. :: :: Anwar M Fahad is offline :: :: Shivaram Aswathaiah joined the chat. :: :: Anwar M Fahad joined the chat. :: Belinda Br...Marty, can you tell me current size of share on the NAS? 

10:08:50 PM

Marty Heb...Here are all the impacted Shares in this QTree

CMSdata$ /vol/HFD_flx_306/CMSdataCMSsoftware$ /vol/HFD_flx_306/CMSdata/cmssoftwareCMSelecmrkt /vol/HFD_flx_306/CMSdata/cmsdata/elecmrktCMSwinapps /vol/HFD_flx_306/CMSdata/cmssoftware/winappsCMSshrapps /vol/HFD_flx_306/CMSdata/cmsdata/shrappsCMSabr$ /vol/HFD_flx_306/CMSdata/cmsdata/abrCMSmassauto /vol/HFD_flx_306/CMSdata/cmsdata/shrapps/massautoCMSEndorsement$ /vol/HFD_flx_306/CMSdata/Cmsdata/Endorsement StudyCMScontrollers$ /vol/HFD_flx_306/CMSdata/cmsdata/Controllers-RO Controllers-ROCMSlars /vol/HFD_flx_306/CMSdata/cmsdata/shrData/Loss Control/Lars Loss Control LARSCMSmicrocenter /vol/HFD_flx_306/CMSdata/cmsdata/shrData/Microcenter Local Presence Microcenter Local PresenceCMSmiddle_market /vol/HFD_flx_306/CMSdata/cmsdata/shrData/Middle

10:08:58 PM

Page 22: Chat

Market Account Score Middle Market Account ScoreCMSfrmtest$ /vol/HFD_flx_306/CMSdata/cmsdata/formtest CMS Product Registrycmsteradata$ /vol/HFD_flx_306/CMSdata/cmssoftware/teradata Teradata software locationCMSprtword$ /vol/HFD_flx_306/CMSdata/cmsdata/prtword CMS Product RegistryCMSfrmprod$ /vol/HFD_flx_306/CMSdata/cmsdata/formprod CMS Product Registrycmsstforms$ /vol/HFD_flx_306/CMSdata/cmsdata/stateforms CMS Product RegistryCMSprlword$ /vol/HFD_flx_306/CMSdata/cmsdata/prlword CMS Product RegistryCMSmrkting /vol/HFD_flx_306/CMSdata/cmsdata/Mrkting CMS Marketing ShareCMSbkfsoftwr /vol/HFD_flx_306/CMSdata/cmsdata/ShrData/warehouse/software BKF Software for FTPCMSshrdata /vol/HFD_flx_306/CMSdata/cmsdata/ShrData CMS ShrDataCMSscicp /vol/HFD_flx_306/CMSdata/CMSdata/reference/scic paperless CMS SCIC Paperless (admin share)EDW Admin /vol/HFD_flx_306/CMSdata/cmsdata/ShrData/EDW AdminEDW /vol/HFD_flx_306/CMSdata/cmsdata/ShrData/EDWCMSLCAIT /vol/HFD_flx_306/CMSdata/cmsdata/shrData/CMSLCAITCMSPLForms /vol/HFD_flx_306/CMSdata/cmsdata/shrapps/pl_formsCMSreference /vol/HFD_flx_306/CMSdata/CMSdata/reference CMS ReferenceCMSncciw /vol/HFD_flx_306/CMSdata/cmsdata/shrapps/ncci worksheetscs_Prd$ /vol/HFD_flx_306/CMSdata/cmsdata/shrdata/cs_Prdcs_Ctst$ /vol/HFD_flx_306/CMSdata/cmsdata/shrdata/cs_Ctstcs_Dev$ /vol/HFD_flx_306/CMSdata/cmsdata/shrdata/cs_Devcs_Trn$ /vol/HFD_flx_306/CMSdata/cmsdata/shrdata/cs_Trncs_Pspt$ /vol/HFD_flx_306/CMSdata/cmsdata/shrdata/cs_Psptcs_Ctst2$ /vol/HFD_flx_306/CMSdata/cmsdata/shrdata/cs_Ctst2cs_Dev2$ /vol/HFD_flx_306/CMSdata/cmsdata/shrdata/cs_Dev2CMStraining /vol/HFD_flx_306/CMSdata/cmsdata/Training Materials CMS TrainingHR /vol/HFD_flx_306/CMSdata/cmsdata/ShrData/HRscorecard$ /vol/HFD_flx_306/CMSdata/CMSdata/ShrData/ucm hidden share for manage scorecard folderCMS20052007lmp /vol/HFD_flx_306/CMSdata/cmsdata/ShrData/2005-2007 Local Market PlansCMSlmp /vol/HFD_flx_306/CMSdata/cmsdata/ShrData/Local Market PlanningIFORMS_VALIDATION /vol/HFD_flx_306/CMSdata/cmsdata/shrapps/IFORMS_VALIDATIONCFO Finance /vol/HFD_flx_306/CMSdata/cmsdata/ShrData/CFO FinanceThird Party Pricing Model (TPPM) /vol/HFD_flx_306/CMSdata/cmsdata/shrapps/Third Party Pricing Model (TPPM)CMSal /vol/HFD_flx_306/CMSdata/cmsdata/shrdata/agency licensing & contractingCFO$ /vol/HFD_flx_306/CMSdata/cmsdata/shrdata/cfo Share for Mary Beth MillerDFSANCHOR-SmartCard$

Page 23: Chat

/vol/HFD_flx_306/CMSdata/cmsdata/ShrData/SmartCardDFSANCHOR-Warehouse$ /vol/HFD_flx_306/CMSdata/cmsdata/ShrData/WarehouseDFSANCHOR-BKFITSupport$ /vol/HFD_flx_306/CMSdata/cmsdata/ShrData/BKF IT SupportDFSANCHOR-MicrosoftVisualStudio$ /vol/HFD_flx_306/CMSdata/cmsdata/ShrData/Microsoft Visual StudioStaffingCoordinators /vol/HFD_flx_306/CMSdata/cmsdata/ShrData/Staffing CoordinatorsCHERYL_from actuarial /vol/HFD_flx_306/CMSdata/cmsdata/ShrData/CHERYL_from actuarialEarley /vol/HFD_flx_306/CMSdata/cmsdata/ShrData/ECM/EarleyStrategic Initiatives Folder /vol/HFD_flx_306/CMSdata/cmsdata/ShrData/Strategic initiatives Strategic Initiatives FolderDFSAnchor_eBT_Rpt_DB$ /vol/HFD_flx_306/CMSdata/CMSdata/ShrData/eBT_Rpt_DB eBT Reporting Database - Harris, Chuck (Comm Lines, IT)DFS_Anchor_CMSBKFSoftwr$ /vol/HFD_flx_306/CMSdata/cmsdata/ShrData/warehouse/software BKF For FTP 

?Belinda,

it is kind of misleading due to the snaps eating into the real space.

bash-2.05$ rsh erdhfdnas002 df -V -g HFD_flx_306Filesystem total used avail capacity Mounted on/vol/HFD_flx_306/ 2239GB 1915GB 323GB 86% /vol/HFD_flx_306//vol/HFD_flx_306/.snapshot 248GB 2047GB 0GB 823% /vol/HFD_flx_306/.snapshot 

10:10:10 PM

?The snaps are 2047 GB 

10:10:27 PM

?much larger than the 248 GB reserved 

10:10:43 PM

Belinda Br...trying to determine if we are still loosing data...from this status...7/28/2010 10:00 2,318,798,311,4247/28/2010 22:00 726,029,418,4967/29/2010 8:00 117,892,698,112 

10:10:57 PM

?have we lost any more after 8am? 

10:11:08 PM

:: Venkatesh Pillalamarri *Contractor* left the chat. :: Marty Heb...I do not think we still are. My numbers have not changed in the past 3 or 4 hours. 

10:14:37 PM

:: Anuj Kumar joined the chat. :: Marty Heb...And data that has been restored since 5 AM EST is still there 

10:15:15 PM

:: Anuj Kumar left the chat. ::

Page 24: Chat

Belinda Br...Marty, can you please rejoin the bridge 

10:18:17 PM

Marty Heb...I did not know I left 

10:18:26 PM

?ok 

10:18:27 PM

Belinda Br...have HIG mgmt on the call for status... Dan S at this point 

10:18:31 PM

?Bridget may be joining soon too 

10:18:48 PM

:: Anuj Kumar joined the chat. :: vinamboo...Belinda ,Shivram joined from the Restore team:I'm logging out for the day. 

10:29:27 PM

Belinda Br...did you speak to who started the restore? 

10:29:55 PM

vinamboo...Shivram worked on this: 

10:30:08 PM

?He will update you. 

10:30:15 PM

Shivaram ...Hi 

10:30:16 PM

:: [email protected] - Vishal Namboori1/India/IBM left the chat. :: :: [email protected] - Howard Grapek/Boulder/Contr/IBM is away :: :: Venkata Rama Rao Bommireddipalli is away :: :: Pedro Matheus Dias is away :: :: [email protected] - Sreekanth Jayaprakash/India/IBM left the chat. :: :: [email protected] - Sreekanth Jayaprakash/India/IBM joined the chat. :: :: Anuj Kumar left the chat. :: :: Shivaram Aswathaiah is away :: zoharman...Hi Belinda 

10:50:01 PM

?Are you sending out status updates for mgmt? 

10:50:12 PM

:: Shivaram Aswathaiah is available :: :: Avinash Gautam joined the chat. :: zoharman...Hello. Who is sending out the status updates for mgmt for this issue? 

10:54:59 PM

:: [email protected] - Sreekanth Jayaprakash/India/IBM left the chat. :: :: [email protected] - Jo-Ann Martin/Southbury/IBM is away :: :: [email protected] - Sreekanth Jayaprakash/India/IBM joined the chat. :: :: [email protected] - Sreekanth Jayaprakash/India/IBM is

Page 25: Chat

available :: Belinda Br...i will prepare a status and send soon 

10:57:29 PM

:: John Fritz *Contractor* is available :: zoharman...thx 

10:58:09 PM

:: Manish H Ghildyal is away :: :: Manish H Ghildyal is available :: Kelly K. Cota Belind

a please include myself 

11:07:23 PM

?and Debi ralston too 

11:07:29 PM

:: Sheelnidhi Gupta joined the chat. :: Belinda Br...ok 

11:08:17 PM

:: Frank D. (Frank) Breen joined the chat. :: :: Pedro Matheus Dias is available :: :: [email protected] - Jo-Ann Martin/Southbury/IBM is available :: :: Venkata Rama Rao Bommireddipalli is in a meeting :: :: Shivaram Aswathaiah is away :: :: Shivaram Aswathaiah is available :: :: Shivaram Aswathaiah is away :: :: Shivaram Aswathaiah is available :: :: [email protected] - Howard Grapek/Boulder/Contr/IBM is available :: :: Anuj Kumar joined the chat. :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM is available :: :: Shivaram Aswathaiah is away :: :: Shivaram Aswathaiah is available :: :: [email protected] - Sreekanth Jayaprakash/India/IBM left the chat. :: :: [email protected] - Sreekanth Jayaprakash/India/IBM is offline :: :: Pedro Matheus Dias is away :: :: Ritu Sharma is away :: :: Pedro Matheus Dias is available :: :: Sheelnidhi Gupta is away :: :: Ritu Sharma is available :: Belinda Br...sent a quick status 

11:53:09 PM

Page 26: Chat

?i will work on adding some more details as soon as I can 

11:53:23 PM

:: Ritu Sharma is away :: :: Sheelnidhi Gupta is available :: :: Sheelnidhi Gupta is away :: :: Ritu Sharma is available :: :: Pedro Matheus Dias is away :: :: Ritu Sharma is away :: :: Pedro Matheus Dias is available :: :: Ritu Sharma is available :: :: Venkata Rama Rao Bommireddipalli is away :: :: Pedro Matheus Dias is away :: :: Pedro Matheus Dias left the chat. :: Frank D. (...marty where is the location you are snapping 

12:24:49 AM

:: [email protected] - Michael G Morin/Poughkeepsie/IBM left the chat. :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM is offline :: :: Venkata Rama Rao Bommireddipalli left the chat. :: :: [email protected] - Jo-Ann Martin/Southbury/IBM left the chat. :: :: Manish H Ghildyal left the chat. :: :: Avinash Gautam is away :: :: Sheelnidhi Gupta is available :: :: Anuj Kumar left the chat. :: Marty Heb...http://www.microsoft.com/windowsserver2003/technologies/management/powershell/download.mspx 

12:57:35 AM

:: Sheelnidhi Gupta is away :: :: Avinash Gautam is available :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM joined the chat. :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM is available :: :: [email protected] - Zohar Mann/Los Angeles/IBM is away :: :: Ritu Sharma is away :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM left the chat. :: :: [email protected] - Howard Grapek/Boulder/Contr/IBM left the chat. :: :: Venkata Rama Rao Bommireddipalli joined the chat. :: :: Avinash Gautam left the chat. :: :: Sheelnidhi Gupta left the chat. ::

Page 27: Chat

:: Sheelnidhi Gupta is offline :: :: Ritu Sharma is available :: :: Venkata Rama Rao Bommireddipalli is in a meeting :: Frank D. (...Here is the script 

1:37:20 AM

?I tested and it works fine.  

1:37:32 AM

:: Sheelnidhi Gupta joined the chat. :: Frank D. (...robocopy c:\test1 c:\test /MIR /X0 /COPY:DATSOU /R:1 /W:1 /TEE /V /NP /LOG+:test 

1:37:34 AM

?we will change source and dest. based on needs..  

1:37:50 AM

Belinda Br...ok 

1:37:56 AM

:: Avinash Gautam joined the chat. :: :: Sheelnidhi Gupta is available :: :: [email protected] - Zohar Mann/Los Angeles/IBM is in a meeting :: :: Sheelnidhi Gupta is away :: :: Ritu Sharma is away :: :: Sheelnidhi Gupta is available :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM joined the chat. :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM is available :: :: Sheelnidhi Gupta is away :: :: Sheelnidhi Gupta is available :: :: Sheelnidhi Gupta is away :: :: Venkata Rama Rao Bommireddipalli left the chat. :: :: Sheelnidhi Gupta is available :: :: Venkata Rama Rao Bommireddipalli joined the chat. :: :: Venkata Rama Rao Bommireddipalli left the chat. :: :: Venkata Rama Rao Bommireddipalli joined the chat. :: :: Sheelnidhi Gupta is away :: :: Shivaram Aswathaiah is away :: :: Sheelnidhi Gupta is available :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM left the chat. :: zoharman...Hi Marty. You guys getting ready for turnover? 

2:17:16 AM

Marty Heb...should be soon. we said 5 pm est 

2:17:28 AM

zoharman... 2:17:50 AM

Page 28: Chat

I'd like to be on that call pls 

:: Shivaram Aswathaiah is available :: Marty Heb...OK I will tell you when I hear from Daniel 

2:18:11 AM

:: Sheelnidhi Gupta left the chat. :: Frank D. (...marty 

2:19:51 AM

Marty Heb...yes 

2:19:56 AM

Frank D. (...snap is going to what filer 

2:20:03 AM

?and a share called temp 

2:20:18 AM

Marty Heb...same erdhfdnas002 

2:20:19 AM

:: Avinash Gautam is away :: Frank D. (...so \\erdhfdnas002\temp 

2:20:28 AM

Marty Heb...the share does not exist until the snap is done, but yes 

2:20:34 AM

:: Avinash Gautam is available :: :: Ritu Sharma is available :: :: Ritu Sharma is away :: :: Avinash Gautam left the chat. :: :: [email protected] - Qamaruddin A Mohammed/India/IBM joined the chat. :: Kishore Gu...Qamar from our team will be joining...I am leaving for the day 

2:49:03 AM

qmohamm...Hi All 

2:50:00 AM

Belinda Br...hello 

2:51:19 AM

:: Ritu Sharma is available :: :: Daniel Esposito *Contractor* joined the chat. :: :: Kishore Guduru left the chat. :: Daniel Esp...Good evening, taking over NAS responsibility from Marty, performing a turnover now 

2:53:11 AM

Frank D. (...Hey dan  

2:53:26 AM

Marty Heb...is the call still going on? 

2:53:28 AM

Frank D. (...yes 

2:53:31 AM

?call is on.  

2:53:38 AM

Page 29: Chat

?Dan when copy is done.  

2:53:54 AM

?Can we get a report on Qtree Size..  

2:54:08 AM

Daniel Esp...one sec 

2:54:17 AM

Frank D. (...to see about how much data is missing.  

2:54:20 AM

Daniel Esp...1.1tb copied so far 

2:54:36 AM

Frank D. (...marty before you leave.. when was this kicked off.  

2:55:08 AM

Marty Heb...9:41 AM EST 

2:55:34 AM

?we are at 1121 

2:55:49 AM

?gb 

2:55:51 AM

Frank D. (...so we are 50 percent 

2:55:55 AM

Marty Heb...yes 

2:56:15 AM

Frank D. (...so we might as well break from call as we will not be able to start till 10 or 11 easy 

2:56:59 AM

:: [email protected] - Michael G Morin/Poughkeepsie/IBM joined the chat. :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM is available :: zoharman...Belinda- you there? 

3:03:27 AM

Belinda Br...yes 

3:03:41 AM

zoharman...I'm getting iinquiries for status updates from upper mgmt. Are you sending any more of those out? 

3:04:37 AM

:: Venkata Rama Rao Bommireddipalli left the chat. :: zoharman...Regarding the theory of this being possibly caused by a botched restore- have we seen any detailed logs from the backup infrastructure or NAS filer supporting this idea? 

3:06:42 AM

Belinda Br...we are going to close the bridge line...it will reopen at 6:30 pm ET for the next status 

3:07:21 AM

zoharman...Also, Daniel will research turning on CIFS auditing with a high enough level to capture user IDs and actions, if needed.  

3:07:43 AM

Daniel Esp... 3:10:1

Page 30: Chat

is there anyone from netbackup on the chat?  7 AM

Shivaram ...Hi daniel, i am from netbackup 

3:11:10 AM

Daniel Esp...Do you know anything about this backup job that hung yesterday? 

3:11:34 AM

Shivaram ...can you please give me details of backup job 

3:15:29 AM

:: Gerald L. Gase is away :: Daniel Esp...from was was passed onto me, yesterday afternoon, somewhere around 1300est, a restore job was kicked off for this data location 

3:19:18 AM

?that restore ran for a certain amount of time, appeared to be hung and had to be killed 

3:23:10 AM

[email protected] 

3:23:42 AM

?can i get a quick update on this issue 

3:24:18 AM

Shivaram ...yes the restore was hung, it was not kileed but it failed 

3:24:24 AM

Daniel Esp...can you send me the job report? 

3:24:38 AM

?verbatim? 

3:24:46 AM

?(verbose) 

3:24:54 AM

Belinda Br...sure, Mike... 

3:27:07 AM

?the copy of data is just over halfway complete 

3:27:23 AM

?we are running scripts to remove all the 0 kb files now... there are some issues with permissions but Jim from security is working thru those 

3:27:51 AM

[email protected] it's easier to talk i can call  

3:28:11 AM

Belinda Br...sure 

3:28:16 AM

?912-332-7702 

3:28:20 AM

Daniel Esp...Shivaram, can you get the job log for the restore? 

3:29:16 AM

Shivaram ...just give me 2 min, checking 

3:30:20 AM

Daniel Esp...thanks 

3:30:28 AM

:: Anwar M Fahad is away ::

Page 31: Chat

Frank D. (...Dan where are we on copy.  

3:45:01 AM

Daniel Esp...one sec, will check 

3:46:19 AM

:: [email protected] - Michael G Morin/Poughkeepsie/IBM is away :: Daniel Esp...1.26tb 

3:48:48 AM

:: [email protected] - Michael G Morin/Poughkeepsie/IBM is available :: :: [email protected] - Zohar Mann/Los Angeles/IBM left the chat. :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM is away :: :: Ritu Sharma is away :: Daniel Esp...Using NetBackup (Version 5.0) to restore files from a NetworkAppliance (Using NDMP) restores files with correct names to thecorrect location but the files have no data. Out of 23 files, only 3were restored correctly with the data intact. All other files fromt herestore were restored with 0 Kb of data in them and of course were notable to be opened. We have tried to turn off DAR on the server andtried to restore more files after a manual backup without any luck. 

4:01:07 AM

Belinda Br...bridge is open 

4:01:46 AM

?1-866-423-8350 Participant Passcode: 4210624480  

4:01:54 AM

Daniel Esp...Shivaram, can you call syemantec and open a case asking about this in the current cersion 

4:02:03 AM

?*version 

4:02:24 AM

:: [email protected] - Michael G Morin/Poughkeepsie/IBM is available :: Shivaram ...ok, i am logging the case] 

4:05:45 AM

Daniel Esp...thank you 

4:06:48 AM

:: [email protected] - Michael G Morin/Poughkeepsie/IBM is away :: :: Ritu Sharma is away :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM is available :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM is away :: :: Ritu Sharma is available :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM is available :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM left the chat. ::

Page 32: Chat

qmohamm...I am leaving for the day Narsima Peddi is joining the chat 

4:43:51 AM

:: Narsimhulu Peddi joined the chat. :: Narsimhul...Hi All 

4:45:46 AM

:: [email protected] - Qamaruddin A Mohammed/India/IBM left the chat. :: :: Frank D. (Frank) Breen is away :: Belinda Br...welcome 

4:53:23 AM

?we are just monitoring the data copy and working with netbackup vendor at this time 

4:53:44 AM

Narsimhul...ok 

4:53:59 AM

Belinda Br...if you can just monitor the chat room in case you are needed, that'd be great 

4:54:01 AM

:: Ritu Sharma is away :: Narsimhul...ok 

4:54:16 AM

Belinda Br...i'm going to step away for awhile... but will check status of the chat room every now and again... the next call is at 10pm ET 

4:54:53 AM

:: Belinda Brotherson *Contractor* is away :: :: Narsimhulu Peddi is offline :: :: John Fritz *Contractor* is offline :: :: Gerald L. Gase is offline :: :: Shivaram Aswathaiah is offline :: :: Ritu Sharma is offline :: :: Belinda Brotherson *Contractor* is offline :: :: Anwar M Fahad is offline :: :: Frank D. (Frank) Breen is offline :: :: Daniel Esposito *Contractor* is offline :: :: Bhavani S Ande joined the chat. :: :: Belinda Brotherson *Contractor* joined the chat. :: :: Kelly K. Cota joined the chat. :: :: Marty Hebert *Contractor* joined the chat. :: :: John Fritz *Contractor* joined the chat. :: :: Frank D. (Frank) Breen joined the chat. :: :: Gerald L. Gase joined the chat. :: :: Daniel Esposito *Contractor* joined the chat. :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM joined the chat. :: :: [email protected] - Vishal Namboori1/India/IBM joined the

Page 33: Chat

chat. :: Belinda Br...sorry guys...i'm still stuck in morning status calls...will be back as soon as i can 

5:37:24 PM

:: Ritu Sharma joined the chat. :: Frank D. (...sure np 

5:39:47 PM

:: [email protected] - Vishal Namboori1/India/IBM is away :: :: Ritu Sharma is available :: :: [email protected] - Vishal Namboori1/India/IBM is available :: Daniel Esp...155gb 

6:04:01 PM

:: [email protected] - Vishal Namboori1/India/IBM is away :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM is away :: :: [email protected] - Vishal Namboori1/India/IBM is available :: Daniel Esp...158gb 

6:24:33 PM

?biggest problem with the speed at which we repopulate data is the amount of data that has to be scanned through 

6:25:20 PM

Frank D. (...yes 

6:25:42 PM

Daniel Esp...28% 2615 5857 0 13237 15431 17045 24318 0 0 3031% 2349 5804 0 19669 23476 17478 24646 0 0 3053% 1767 5676 0 47792 52986 17770 16946 0 0 3149% 2056 5893 0 23131 27580 22635 12 0 0 3145% 2121 4322 0 13995 14993 24120 16 0 0 3145% 1896 3904 0 17894 19635 22603 0 0 0 3153% 1725 4147 0 50762 52072 14404 12 0 0 31 

6:26:01 PM

:: [email protected] - Michael G Morin/Poughkeepsie/IBM is available :: :: [email protected] - Vishal Namboori1/India/IBM is away :: :: [email protected] - Vishal Namboori1/India/IBM is available :: :: [email protected] - Vishal Namboori1/India/IBM is away :: :: [email protected] - Vishal Namboori1/India/IBM is available :: :: [email protected] - Vishal Namboori1/India/IBM is away :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM is away :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM is available :: :: Anwar M Fahad joined the chat. :: :: Anwar M Fahad is available :: Daniel [email protected] - Shivaram Aswathaiah/India/IBM: The restore command writes file system data from tape to disk using a predefined process.The process in the following table shows how the restore command

6:55:27 PM

Page 34: Chat

works.Stage Action1 Data ONTAP catalogs the files that need to be extracted from the tape.2 Data ONTAP creates directories and empty files.3. Data ONTAP reads a file from tape, writes it to disk, and sets the permissions (including ACLs) on it. 

?http://now.netapp.com/NOW/knowledge/docs/ontap/rel657_gf/html/ontap/tapebkup/recover4.htm\ 

6:55:33 PM

Belinda Br...gotta run to another meeting... bridge will stay open... and i will be back soon 

7:02:00 PM

Marty Heb...Filesystem total used avail capacity Mounted on/vol/HFD_flx_306/ 2239GB 165GB 2073GB 7% /vol/HFD_flx_306/ 

7:06:42 PM

:: Manish K Srivastava joined the chat. :: :: Manish K Srivastava left the chat. :: Daniel Esp...back 

7:09:09 PM

:: [email protected] - Vishal Namboori1/India/IBM is available :: Belinda Br...welcome 

7:10:47 PM

:: Venkata Rama Rao Bommireddipalli joined the chat. :: :: Venkata Rama Rao Bommireddipalli is in a meeting :: Daniel Esp...168gb  

7:16:26 PM

:: Bhavani S Ande left the chat. :: :: Bhavani S Ande is offline :: Marty Heb...We have 629 users are attached to the CMSshrdata share. 

7:18:44 PM

John Fritz ...07/30/2010 

7:23:39 PM

Frank D. (...dan i fired up 2 more servers.  

7:27:33 PM

?check NAS status.  

7:27:41 PM

Marty Heb...45 of the 629 are write locks the rest are read only locks. 

7:28:11 PM

:: Gerald L. Gase is away :: :: Gerald L. Gase is available :: Belinda Br...is the bridge still ok? 

7:33:32 PM

Marty Heb...yes 

7:33:42 PM

Belinda Br...ok, i had to drop from the call per my crazy other phone line 

7:33:59 PM

Page 35: Chat

Marty Heb...169GB 

7:34:21 PM

Daniel Esp...7.8% complete 

7:34:49 PM

Frank D. (...how is nas. perf 

7:36:58 PM

?7 systems  

7:37:03 PM

?now 

7:37:05 PM

Marty Heb...172GB  

7:50:55 PM

Kelly K. Cotawhats the magic number we need to get to 2.2? 

7:51:18 PM

Frank D. (...2002 

7:51:32 PM

?2200 

7:51:37 PM

Marty Heb...CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape kB/s Cachein out read write read write age20% 51 4683 0 22732 27526 17139 17818 0 0 1986% 60 3102 0 14972 20542 21446 2691 0 0 1949% 59 5754 0 18866 24994 10764 16064 0 0 1922% 91 3601 0 17350 22071 15656 18458 0 0 1931% 68 3890 0 16922 22520 5333 14515 0 0 1927% 89 5680 0 25943 39285 24259 15988 0 0 1996% 65 5541 0 11711 22454 30738 11 0 0 2096% 65 2497 0 7932 14059 13550 4354 0 0 2027% 143 8285 0 25575 39915 14933 24915 0 0 2034% 82 8386 0 19119 19889 13200 14150 0 0 2023% 46 5547 0 10743 16233 11141 12663 0 0 2035% 42 4817 0 9628 15585 16960 11092 0 0 2056% 59 5753 0 11286 16446 26204 24 0 0 2089% 61 2424 0 6102 9168 5724 2697 0 0 2020% 84 5945 0 13122 19582 11976 15636 0 0 2020% 49 3942 0 10595 16364 8623 11788 0 0 2024% 47 3462 0 11701 17325 14867 9763 0 0 2027% 32 2557 0 13653 19907 17201 0 0 0 2030% 50 3881 0 10948 16775 18265 24 0 0 20 

7:52:01 PM

:: Gerald L. Gase left the chat. :: Frank D. (...860-281-5552 - cell 

8:06:12 PM

John Fritz ...\\erdhfdnas002\CMSShrData\Retention 

8:14:04 PM

?\\erdhfdnas002\CMSShrData\Filings Assistance

\\erdhfdnas002\CMSShrData\Spectrum Product Development 

8:14:41 PM

Page 36: Chat

:: Gerald L. Gase joined the chat. :: Marty Heb...179GB 

8:31:17 PM

:: [email protected] - Riyaz A Mela/India/IBM joined the chat. :: :: [email protected] - Riyaz A Mela/India/IBM is available :: John Fritz ...thank you 

8:32:38 PM

:: [email protected] - Riyaz A Mela/India/IBM is away :: Marty Heb...bash-2.05$ rsh erdhfdnas002 df -V -g HFD_flx_306Filesystem total used avail capacity Mounted on/vol/HFD_flx_306/ 2239GB 182GB 2056GB 8% /vol/HFD_flx_306/ 

8:39:19 PM

:: [email protected] - Riyaz A Mela/India/IBM is available :: Marty Heb...CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape kB/s Cachein out read write read write age27% 44 5127 0 43598 40341 16408 26805 0 0 3424% 68 4999 0 40761 37075 13789 23203 0 0 3420% 89 3969 0 26455 23765 12084 26621 0 0 3427% 57 4678 0 32844 24111 14062 23057 0 0 3271% 69 2866 0 28209 20756 21844 45792 0 0 3264% 55 3464 0 29803 26074 24884 25801 0 0 3237% 39 4587 0 29807 27530 14080 24232 0 0 3226% 30 4303 0 28128 26225 20427 25934 0 0 3225% 32 4014 0 39090 35037 17147 22725 0 0 3228% 45 4750 0 56342 51980 17390 25331 0 0 3242% 61 5155 0 64761 56804 14809 38625 0 0 3330% 51 4429 0 54381 50960 30339 48454 0 0 3332% 66 4890 0 58097 52951 19972 41126 0 0 3362% 59 4081 0 40055 37216 27503 55074 0 0 3386% 32 2396 0 21844 25517 15828 21642 0 0 3329% 58 4920 0 46919 54310 37825 27223 0 0 3325% 42 3880 0 47323 48393 21934 23568 0 0 3331% 37 4071 0 45447 46328 18865 24000 0 0 3534% 64 4168 0 45100 44620 24181 44919 0 0 35 

8:40:00 PM

:: Venkata Rama Rao Bommireddipalli is away :: :: Gerald L. Gase is available :: :: [email protected] - Zohar Mann/Los Angeles/IBM joined the chat. :: :: [email protected] - Zohar Mann/Los Angeles/IBM is available :: Frank D. (...John these are done.  

8:45:28 PM

?Spectrum Product Development 

8:45:29 PM

?RetentionScores 

8:45:49 PM

?Retention Analysis 

8:46:31 PM

Page 37: Chat

:: Ritu Sharma is away :: Frank D. (...The rest are still going.  

8:47:01 PM

:: [email protected] - Michael G Morin/Poughkeepsie/IBM is away :: Frank D. (...Retention Dividends Corp File 

8:54:21 PM

?done 

8:54:23 PM

Marty Heb...Filesystem total used avail capacity Mounted on/vol/HFD_flx_306/ 2239GB 191GB 2047GB 9% /vol/HFD_flx_306/ 

8:57:07 PM

:: [email protected] - Riyaz A Mela/India/IBM left the chat. :: :: [email protected] - Riyaz A Mela/India/IBM is offline :: Marty Heb...bash-2.05$ rsh erdhfdnas002 sysstat 1CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape kB/s Cachein out read write read write age36% 55 5101 0 56768 59196 21504 31100 0 0 2276% 31 2585 0 33680 34522 27165 32035 0 0 2291% 132 4994 0 36445 40723 31869 83877 0 0 2241% 636 4453 0 52819 56994 29126 46419 0 0 1937% 1238 4938 0 56631 59139 22766 50109 0 0 1947% 756 4326 0 54182 56634 18344 50096 0 0 1935% 6 4501 0 50299 54663 20971 48615 0 0 1937% 15 5349 0 58083 62332 19265 51001 0 0 1973% 11 2829 0 28798 31963 18426 38067 0 0 2297% 21 3570 0 33610 37996 20518 61109 0 0 2243% 28 6576 0 63395 69606 30885 46845 0 0 2235% 18 5187 0 54606 62878 19785 51350 0 0 2237% 33 5088 0 57747 61590 20809 46406 0 0 2240% 75 5053 0 53450 56622 24862 49541 0 0 2276% 181 3235 0 30789 33084 20577 35005 0 0 2258% 454 6580 0 60337 60595 29024 65821 0 0 2242% 464 5456 0 60746 64478 35471 41678 0 0 2241% 301 5564 0 63201 64601 24415 53184 0 0 2246% 250 4867 0 53044 55195 29904 50028 0 0 20CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape kB/s Cachein out read write read write age42% 191 5123 0 53786 61460 26604 40414 0 0 20^C 93% 14 3533 0 26060 29710 17292 39033 0 0 21bash-2.05$ rsh erdhfdnas001 sysstat 1CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape kB/s Cachein out read write read write age23% 1816 3123 0 1952 8080 7353 24 0 0 5823% 1901 3051 0 2674 8580 12191 0 0 0 5826% 1933 3181 0 5313 8243 10245 7649 0 0 5817% 1560 3183 0 4196 8485 13998 26401 0 0 5831% 1894 3355 0 7234 9047 12496 14050 0 0 5823% 1512 3225 0 2572 8986 11649 0 0 0 5829% 217 2987 0 3833 9901 8232 24 0 0 5724% 368 2702 0 3995 10420 11405 0 0 0 58

9:07:29 PM

Page 38: Chat

19% 177 3495 0 2626 9907 8675 8 0 0 5827% 180 3041 0 3756 9886 10123 23 0 0 5821% 197 3957 0 4210 10562 11505 0 0 0 5821% 202 2419 0 1759 11258 11677 0 0 0 5833% 809 2865 0 3136 11584 12291 24 0 0 5822% 81 2753 0 1453 10987 14399 8 0 0 5833% 497 2937 0 2533 12344 18867 7840 0 0 5827% 2408 2980 0 2621 12622 9646 27437 0 0 5839% 1727 3042 0 2042 12516 16294 17306 0 0 5833% 973 2877 0 16781 11974 11366 0 0 0 5823% 480 3360 0 1926 13457 12032 665 0 0 58CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape kB/s Cachein out read write read write age24% 308 3108 0 2332 12940 13337 0 0 0 5823% 392 3910 0 2543 14121 9236 0 0 0 58 

:: [email protected] - Michael G Morin/Poughkeepsie/IBM is available :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM is away :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM is available :: Marty Heb...209GB  

9:29:46 PM

:: [email protected] - Zohar Mann/Los Angeles/IBM is in a meeting :: :: [email protected] - Michael G Morin/Poughkeepsie/IBM left the chat. :: Marty Heb...02:a0:98:08:95:0a 

9:34:59 PM

?157.209.175.202 

9:35:39 PM

?Filesystem total used avail capacity Mounted on/vol/HFD_flx_306/ 2239GB 215GB 2024GB 10% /vol/HFD_flx_306/ 

9:44:03 PM

:: Venkata Rama Rao Bommireddipalli left the chat. :: :: Ritu Sharma is available :: Frank D. (...\\Erdhfdnas002\Cmsshrdata\00-P&CTD\HSI\Training Coordinator Files\letter 

9:56:21 PM

?done 

9:56:22 PM

Marty Heb...Filesystem total used avail capacity Mounted on/vol/HFD_flx_306/ 2239GB 227GB 2011GB 10% /vol/HFD_flx_306/ 

9:58:52 PM

Frank D. (...Filings Assistance 

10:03:55 PM

:: Daniel Esposito *Contractor* is away ::

Page 39: Chat

Marty Heb...972-533-2716 

10:10:45 PM

?Filesystem total used avail capacity Mounted on/vol/HFD_flx_306/ 2239GB 246GB 1992GB 11% /vol/HFD_flx_306/

 

10:16:05 PM

:: [email protected] - Zohar Mann/Los Angeles/IBM is available :: :: Shivaram Aswathaiah joined the chat. :: :: [email protected] - Zohar Mann/Los Angeles/IBM left the chat. :: :: Frank D. (Frank) Breen is away :: :: Ritu Sharma is away :: :: [email protected] - Vishal Namboori1/India/IBM left the chat. :: :: Ritu Sharma is available :: :: Frank D. (Frank) Breen is away :: Marty Heb...Filesystem total used avail capacity Mounted on/vol/HFD_flx_306/ 2239GB 269GB 1969GB 12% /vol/HFD_flx_306/ 

10:57:21 PM

:: Ritu Sharma is away :: John Fritz ...thank you 

10:58:45 PM

?BTW Marty Howie maybe ready for some EV resolution activity in about 15 minutes, we will see.  

10:59:21 PM

?BRB 10-15 I have my phones if needed sooner 

10:59:48 PM

:: [email protected] - Sreekanth Jayaprakash/India/IBM joined the chat. :: :: [email protected] - Sreekanth Jayaprakash/India/IBM is available :: :: Ritu Sharma is available :: :: Belinda Brotherson *Contractor* left the chat. :: :: Ritu Sharma is away :: :: Frank D. (Frank) Breen is away :: :: Anwar M Fahad is away :: Marty Heb...Filesystem total used avail capacity Mounted on/vol/HFD_flx_306/ 2239GB 278GB 1960GB 12% /vol/HFD_flx_306/ 

11:17:01 PM

:: Frank D. (Frank) Breen is available :: :: Ritu Sharma is available :: :: Anwar M Fahad is available :: Frank D. (...John.. did you get this is done.  

11:33:41 PM

Page 40: Chat

?Filings Assistance 

11:33:42 PM

?Spectrum Product Development is done 

11:34:54 PM

?erdhfdnas002\HFD_flx_306$\CMSdata\CMSdata\ShrData\Controllers is done 

11:36:16 PM

John Fritz ...not yet Frank i'll pass thoise on to Joe B now that : 

11:36:30 PM

?Filings AssistanceSpectrum Product Development erdhfdnas002\HFD_flx_306$\CMSdata\CMSdata\ShrData\Controllers is done  

11:36:54 PM

Frank D. (...\\erdhfdnas002\HFD_flx_306$\CMSdata\CMSdata\ShrData\BI Staffing is done  

11:36:57 PM

John Fritz ...are all done  

11:36:58 PM

Frank D. (...yes 

11:37:01 PM

?that I listed here.  

11:37:15 PM

?not all on xls  

11:37:30 PM

?so the 4 i said are done,.  

11:37:56 PM

?ilings AssistanceSpectrum Product Development erdhfdnas002\HFD_flx_306$\CMSdata\CMSdata\ShrData\Controllers is done 2:06:56 PM: [email protected] - Frank Breen/Hartford/IBM: \\erdhfdnas002\HFD_flx_306$\CMSdata\CMSdata\ShrData\BI Staffing is done  

11:38:06 PM

John Fritz ...OK, Frank, I got 4 done now to pass along that Joe B does not have yet, thank you. 

11:39:14 PM

:: Ritu Sharma joined the chat. :: :: Ritu Sharma is away :: :: Ritu Sharma left the chat. :: Frank D. (...k 

11:42:13 PM

?Are you on the bridge.  

11:45:04 PM

John Fritz ...no we were going to open it at 3pm again  

11:45:41 PM

Frank D. (...ok 

11:45:44 PM

?finr 

11:45:46 PM

Page 41: Chat

John Fritz ...Do we need to talk?  

11:45:47 PM

Frank D. (...can wait till 3 

11:45:59 PM

John Fritz ...I was hopin you were sleeping  

11:46:07 PM

Frank D. (...setting up more jobs 

11:46:36 PM

John Fritz ...great!  

11:46:40 PM

?Marty?  

11:47:35 PM

Marty Heb...yes 

11:47:46 PM

?282 gb 

11:47:58 PM

?Filesystem total used avail capacity Mounted on/vol/HFD_flx_306/ 2239GB 282GB 1956GB 13% /vol/HFD_flx_306/ 

11:48:15 PM

John Fritz ...thank ou 

11:48:44 PM

?you 

11:48:47 PM

Marty Heb...np 

11:48:54 PM

?All most at 300

Filesystem total used avail capacity Mounted on/vol/HFD_flx_306/ 2239GB 299GB 1939GB 13% /vol/HFD_flx_306/ 

12:13:55 AM

:: [email protected] - Sreekanth Jayaprakash/India/IBM left the chat. :: :: [email protected] - Sreekanth Jayaprakash/India/IBM is offline :: Kelly K. Cotawhat time is the next yellow event update John 

12:19:41 AM

John Fritz ...6pm 

12:23:45 AM

Kelly K. Cotacan you please ensure Sheri Beckett is on copy , she is covering for Nichole Williford, thanks 

12:24:10 AM

John Fritz ...I can try.  

12:25:15 AM

Kelly K. Cotaty 

12:25:51 AM

John Fritz ...ymw 

12:25:59 AM

Page 42: Chat

Frank D. (...john  

12:34:23 AM

?bridge # 

12:34:28 AM

Marty Heb...Filesystem total used avail capacity Mounted on/vol/HFD_flx_306/ 2239GB 320GB 1918GB 14% /vol/HFD_flx_306/ 

12:36:08 AM

Frank D. (...marty. 

12:36:37 AM

Marty Heb...Frank 

12:36:42 AM

Frank D. (...can you give me the # 

12:36:46 AM

Marty Heb...320 GB 

12:36:52 AM

Frank D. (...Bridge 

12:36:56 AM

?line 

12:36:58 AM

Marty Heb...oooh 

12:36:59 AM

?Tech conf call opening 1-866-423-8350 Participant Passcode: 4210624480  

12:37:21 AM

:: [email protected] - Zohar Mann/Los Angeles/IBM joined the chat. :: :: [email protected] - Zohar Mann/Los Angeles/IBM is in a meeting :: :: Shivaram Aswathaiah is away :: :: Shivaram Aswathaiah is available :: :: Ritu Sharma joined the chat. :: John Fritz ...Marty can you check and post a new status complete 

1:31:00 AM

?? 

1:31:01 AM

Marty Heb...Filesystem total used avail capacity Mounted on/vol/HFD_flx_306/ 2239GB 384GB 1854GB 17% /vol/HFD_flx_306/ 

1:31:25 AM

John Fritz ...super  

1:31:34 AM

?thank you 

1:32:04 AM

Marty Heb...current performance

bash-2.05$ rsh erdhfdnas002 sysstat 1

1:37:36 AM

Page 43: Chat

CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape kB/s Cachein out read write read write age33% 11 5025 0 26187 34057 34466 39161 0 0 1543% 4 4833 0 38336 49259 24655 69750 0 0 1534% 1 4816 0 40500 48287 28175 25143 0 0 1538% 13 5166 0 43733 50925 16056 51682 0 0 1537% 79 4808 0 36685 43399 23892 42234 0 0 1593% 26 2004 0 8708 12349 38130 19762 0 0 1599% 91 4556 0 22143 27206 45451 69369 0 0 1573% 32 3276 0 24965 30884 28126 20279 0 0 1573% 178 7697 0 45791 53701 63201 51877 0 0 1569% 121 3715 0 20764 26644 43113 42867 0 0 1554% 18 5082 0 34653 48149 40064 25968 0 0 1587% 20 2291 0 17007 26883 30184 18193 0 0 1556% 40 4306 0 41790 58487 48771 19416 0 0 1439% 24 4888 0 47242 57620 39956 22299 0 0 1457% 20 4022 0 39718 52741 33314 17326 0 0 1441% 11 5236 0 57500 65332 29799 20949 0 0 14 

?Filesystem total used avail capacity Mounted on/vol/HFD_flx_306/ 2239GB 408GB 1830GB 18% /vol/HFD_flx_306/ 

1:58:28 AM

?Hey John, what time are we going to meet again on the brdige? 

2:03:57 AM

John Fritz ...hm  

2:04:48 AM

?I hat eot say I think we need a short call at 5 

2:05:11 AM

Marty Heb...ok 5 est 

2:05:21 AM

Frank D. (...can we do it now.  

2:05:22 AM

Marty Heb...sure 

2:05:26 AM

Frank D. (...as I am going to head out to see whats up 

2:05:39 AM

John Fritz ...sure  

2:05:46 AM

Marty Heb...Filesystem total used avail capacity Mounted on/vol/HFD_flx_306/ 2239GB 412GB 1826GB 18% /vol/HFD_flx_306/ 

2:07:32 AM

:: [email protected] - Zohar Mann/Los Angeles/IBM left the chat. :: :: [email protected] - Zohar Mann/Los Angeles/IBM is offline :: Marty Heb...Filesystem total used avail capacity Mounted on/vol/HFD_flx_306/ 2239GB 420GB 1818GB 19% /vol/HFD_flx_306/ 

2:18:33 AM

Page 44: Chat

:: Daniel Esposito *Contractor* is available :: :: Daniel Esposito *Contractor* is away :: :: Kelly K. Cota is away :: Marty Heb...Diali in check in9:00 PM

8:00 AM

10:30 AM

4:30 PM 

2:28:36 AM

?Tech conf call opening 1-866-423-8350 Participant Passcode: 4210624480  

2:28:52 AM

?My mobile 972-533-2716 

2:33:59 AM

John Fritz ...Frank's 860-281-5552 

2:35:10 AM

?Marty, can you post a % curently  

2:44:55 AM

Marty Heb...Filesystem total used avail capacity Mounted on/vol/HFD_flx_306/ 2239GB 439GB 1800GB 20% /vol/HFD_flx_306/ 

2:46:26 AM

John Fritz ...Marty can you tell when files are restored?  

2:46:49 AM

Marty Heb...That I can not see. 

2:47:00 AM

John Fritz ...that's wht I thought  

2:47:07 AM

Marty Heb...Need frank or one of his team 

2:47:22 AM

John Fritz ...yes  

2:47:28 AM

:: [email protected] - David Allen/Boulder/IBM joined the chat. :: :: Shivaram Aswathaiah is away :: :: Shivaram Aswathaiah is available :: :: Shivaram Aswathaiah is away :: :: Frank D. (Frank) Breen is away :: :: Frank D. (Frank) Breen is available :: Frank D. (...whats up 

2:54:21 AM

?what do you need.  

2:54:26 AM

Daniel Esp...good afternoon 

2:55:30 AM

Page 45: Chat

:: [email protected] - Zohar Mann/Los Angeles/IBM joined the chat. :: Frank D. (...i guess you could call it that.  

2:55:48 AM

:: [email protected] - Zohar Mann/Los Angeles/IBM is in a meeting :: Daniel Esp...lol, how is everything going Frank? 

2:56:47 AM

Frank D. (...Dest = \\erdhfdnas002\HFD_flx_306$\CMSdata\CMSdata\ShrData\WCLOB\ is retored  

2:56:49 AM

?not good.  

2:56:54 AM

?not good.  

2:56:56 AM

?could be better.  

2:57:05 AM

Daniel Esp...don't you have anyone to take this over for you? 

2:57:35 AM

Frank D. (...no. you only get me.  

2:58:04 AM

Daniel Esp...you've been at it a while now, haven't you? 

2:58:05 AM

Frank D. (...yes 

3:02:33 AM

?its all good 

3:02:45 AM

Marty Heb...Frank go see your wife  

3:02:47 AM

Frank D. (...I got a call.  

3:03:00 AM

?she is alright and will come home.  

3:03:22 AM

Marty Heb...Good to know 

3:03:29 AM

Frank D. (...yes 

3:03:32 AM

Gerald L. G...Good news!! 

3:03:32 AM

Marty Heb...still wife comes before work 

3:03:36 AM

Frank D. (...So I am checking all the requested Jobs 

3:04:14 AM

?Gerald do you or Dave need this info 

3:04:37 AM

John Fritz ...super news on the wfe !  

3:05:03 AM

Page 46: Chat

Frank D. (...yeah.  

3:05:14 AM

?ty 

3:05:23 AM

John Fritz ...I need to know if we have started or scirpted.  

3:05:56 AM

Frank D. (...you have a new list.  

3:06:31 AM

Marty Heb...All, Daniel is taking over for me for a while. I am going to eat dinner 

3:06:57 AM

Frank D. (...marty enjoy..  

3:08:40 AM

Daniel Esp...gl marty 

3:09:32 AM

John Fritz ...not any more than wha tI fwd to you  

3:09:59 AM

Frank D. (...ok..  

3:10:15 AM

?lets start with the latest two 

3:10:28 AM

?\\erdhfdnas002\CMSShrData\Billing is Runing 

3:10:48 AM

?\\erdhfdnas002\CMSShrData\WCLOB done 

3:11:00 AM

:: [email protected] - Zohar Mann/Los Angeles/IBM left the chat. :: :: [email protected] - Zohar Mann/Los Angeles/IBM joined the chat. :: :: [email protected] - Zohar Mann/Los Angeles/IBM is in a meeting :: John Fritz ...Frank where do you want the update sent ?  

3:28:15 AM

Frank D. (...what update.. new things to restore.  

3:28:55 AM

?IBM 

3:29:00 AM

John Fritz ...the spread sheet when we send status  

3:33:35 AM

:: [email protected] - David Allen/Boulder/IBM left the chat. :: Frank D. (...Ok 

3:34:21 AM

?Completed\\erdhfdnas002\CMSShrData\Retention \\erdhfdnas002\CMSShrData\RetentionAnalysis \\erdhfdnas002\cmsshrdata\Alternative Risk \\erdhfdnas002\cmsshrdata\Alternative Risk\\erdhfdnas002\cmsshrdata\BI Staffing

3:34:35 AM

Page 47: Chat

\\erdhfdnas002\cmsshrdata\Billing\PrintKey \\erdhfdnas002\CMSShrData\Filings Assistance \\erdhfdnas002\cmsshrdata\clcs commission project \production support\release to production\\erdhfdnas002\cmsshrdata\Rose P\Ky Tax Procedures\ky tax info  

:: Ritu Sharma left the chat. :: Frank D. (...Running\\erdhfdnas002\cmsshrdata\QATMML\Validation DB\Application\Middle Market\Production\\ERDHFDNAS002\CMSSHRDATA\bkf it support\vss work\\\erdhfdnas002\ECM\CMSshrdata\\erdhfdnas002\ECM\CMSshrdata\Erdhfdnas002\Cmsshrdata\CL Product Strategy  

3:34:47 AM

:: Ritu Sharma joined the chat. :: Frank D. (...Pending - setting up.  

3:35:09 AM

?\\erdhfdnas002\CMSshrdata\eBTSMarketingCommunications\EBC\Broker of Record for CL \\erdhfdnas002\cmsshrdata\SNERO_SC\FLOW \\erdhfdnas002\CMSShrData\Spectrum Product \\erdhfdnas002\CMSshrdata\WC Quote Rescore\Working Files \\erdhfdnas002\QATMML\MM Northeast and SE\Local MML Stuff incl.\\erdhfdnass002\Filings Assistance\Filing Material Cmsshrdata\\ernashfdnas002\\Claims\Shared\Shared\Claim_Account_Management\DCAR  

3:35:13 AM

:: [email protected] - Zohar Mann/Los Angeles/IBM left the chat. :: :: Shivaram Aswathaiah is available :: Gerald L. G...Frank, question for you. In the spreadsheet we are carrying \\erdhfdnas002\cmsshrdata\Billing as a "hot item". Your update for completed is \\erdhfdnas002\cmsshrdata\Billing\PrintKey. Is there more of Billing? I assume a lot more. Will you update us when the Parent completes? Make sense? 

3:46:11 AM

Frank D. (...Billing is running 

3:48:21 AM

?not completed.  

3:48:27 AM

?\ernashfdnas002\\Claims\Shared\Shared\Claim_Account_Management\DCAR  

3:48:57 AM

?can not find tis  

3:49:02 AM

?can not find this.  

3:49:11 AM

?I need a correct path.  

3:49:16 AM

? 3:49:4

Page 48: Chat

these are all scheduled and running.   1 AM

?\erdhfdnas002\cmsshrdata\QATMML\Validation DB\Application\Middle Market\Production\\erdhfdnas002\QATMML\MM Northeast and SE\Local MML Stuff incl.\\ERDHFDNAS002\CMSSHRDATA\bkf it support\vss work\\\erdhfdnas002\ECM\CMSshrdata\\erdhfdnas002\ECM\CMSshrdata\Erdhfdnas002\Cmsshrdata\CL Product Strategy \\erdhfdnas002\cmsshrdata\SNERO_SC\FLOW\\erdhfdnas002\cmsshrdata\SNERO_SC\FLOW\\erdhfdnas002\CMSshrdata\eBTSMarketingCommunications\EBC\Broker of Record for CL \\erdhfdnas002\CMSshrdata\WC Quote Rescore\Working Files  

3:50:00 AM

?\billing\CCS\Meetings\2005\ 

3:52:20 AM

:: John Fritz *Contractor* is away :: Frank D. (...current location of Billing restore.  

3:52:34 AM

:: Ritu Sharma left the chat. :: Gerald L. G...Frank, we are going to send you the update communication with the updated spreadsheet. Which side do you want it? Outlook or Notes.  

3:54:47 AM

Frank D. (...Dest = \\erdhfdnas002\HFD_flx_306$\CMSdata\CMSdata\ShrData\WC Quote Rescore\ 

3:55:36 AM

?completed.  

3:55:40 AM

?notes 

3:56:03 AM

Gerald L. G...OK. Looks like it already went to your Outlook side but I am forwarding to Notes.  

3:57:35 AM

Frank D. (...billing is 200gb 

3:59:22 AM

?we have restored 89gb 

3:59:31 AM

?so far 

3:59:34 AM

Gerald L. G...OK. Thanks.  

3:59:41 AM

?I think I know this answer so bear with me for the dumb question... \\erdhfdnas002\HFD_flx_306$\CMSdata\CMSdata\ShrData\WC Quote Rescore\ is complete. Does that include the sub directory Working Files? (\\erdhfdnas002\HFD_flx_306$\CMSdata\CMSdata\ShrData\WC Quote Rescore\Working Files) 

4:02:15 AM

Frank D. (...yes 

4:02:35 AM

Daniel Esp... 4:03:1

Page 49: Chat

508gb  8 AM

Gerald L. G...Thanks and sorry. I figured that was the way the restore worked but just needed to make sure before marking "Working Directory" off.  

4:03:40 AM

?And Dan, Marty was pasting the following. Filesystem total used avail capacity Mounted on/vol/HFD_flx_306/ 2239GB 439GB 1800GB 20% /vol/HFD_flx_306/

So with your update are you saying....Filesystem total used avail capacity Mounted on/vol/HFD_flx_306/ 2239GB 508GB 1800GB 23% /vol/HFD_flx_306/  

4:07:46 AM

Frank D. (...Dest = \\erdhfdnas002\HFD_flx_306$\CMSdata\CMSdata\ShrData\CL Product Strategy\ 

4:11:27 AM

?Completed 

4:11:30 AM

?Dest = \\erdhfdnas002\HFD_flx_306$\CMSdata\CMSdata\ShrData\Rose P\ 

4:11:53 AM

?Completed 

4:11:56 AM

Daniel Esp...1.1gb/minute, 25 hours remaining at that rate 

4:12:16 AM

Frank D. (...Dest = \\erdhfdnas002\HFD_flx_306$\CMSdata\CMSdata\ShrData\BI Staffing\ 

4:12:30 AM

?Completed 

4:12:35 AM

:: John Fritz *Contractor* is offline :: :: Gerald L. Gase is offline :: :: Kelly K. Cota is offline :: :: Shivaram Aswathaiah is offline :: :: Anwar M Fahad is offline :: :: Daniel Esposito *Contractor* is offline :: :: Frank D. (Frank) Breen is offline :: :: Marty Hebert *Contractor* joined the chat. :: :: Daniel Esposito *Contractor* joined the chat. :: :: Gerald L. Gase joined the chat. :: :: John Fritz *Contractor* joined the chat. :: :: [email protected] - Madhusudan Kapai/India/IBM joined the chat. :: :: [email protected] - David Allen/Boulder/IBM joined the chat. :: :: Ritu Sharma joined the chat. :: :: Frank D. (Frank) Breen joined the chat. :: :: [email protected] - Sreekanth Jayaprakash/India/IBM joined the chat. ::

Page 50: Chat

Frank D. (...ok 

7:15:27 PM

?Dan or Marty.. numbers should be up.  

7:46:46 PM

?I have each server running multiple scripts against very large restore points.  

7:47:11 PM

:: [email protected] - Madhusudan Kapai/India/IBM is available :: :: [email protected] - David Allen/Boulder/IBM is available :: :: Daniel Esposito *Contractor* is available :: :: Ritu Sharma is available :: Daniel Esp...wow, 873gb 

8:01:17 PM

?60% 28 5516 0 31446 32604 33375 38724 0 0 1944% 55 7770 0 42246 44172 44451 57007 0 0 1961% 314 7497 0 35550 38067 42304 47798 0 0 1951% 358 9182 0 38774 41532 40535 47293 0 0 1977% 43 7569 0 32725 35794 46703 38839 0 0 1964% 72 7986 0 33966 37366 41838 47647 0 0 1960% 58 6803 0 27580 30697 35446 26481 0 0 1995% 60 5820 0 28692 29813 39817 30386 0 0 1953% 67 9800 0 39496 40258 40933 40919 0 0 1950% 102 9383 0 40284 41930 40486 45449 0 0 1653% 65 9357 0 43400 45915 45558 43930 0 0 1678% 55 7344 0 34545 36415 43166 11905 0 0 16 

8:02:04 PM

Frank D. (...yeah.  

8:02:15 PM

?seems better 

8:02:23 PM

Daniel Esp...7/31/2010 6:00 747 72 245 0.297/31/2010 7:18 764 17 78 0.227/31/2010 7:55 775 11 37 0.307/31/2010 10:31 873 98 156 0.63Average gb/min 0.48

1/0/1900 2:36  

8:04:05 PM

?it was 2 hours 36 minutes since the last status 

8:04:57 PM

?41% 

8:05:28 PM

?this is where Frank should take credit 

8:08:19 PM

?7/31/2010 10:31 873 98 156 0.637/31/2010 10:46 899 26 15 1.73

8:17:20 PM

Page 51: Chat

Average gb/min 0.52 

:: John Fritz *Contractor* is offline :: :: Gerald L. Gase is offline :: :: Daniel Esposito *Contractor* is offline :: :: Ritu Sharma is offline :: :: [email protected] - David Allen/Boulder/IBM is offline :: :: Frank D. (Frank) Breen is offline :: :: [email protected] - Madhusudan Kapai/India/IBM is offline :: :: Daniel Esposito *Contractor* joined the chat. :: :: Marty Hebert *Contractor* joined the chat. :: :: Gerald L. Gase joined the chat. :: :: John Fritz *Contractor* joined the chat. :: :: [email protected] - Sreekanth Jayaprakash/India/IBM joined the chat. :: :: [email protected] - David Allen/Boulder/IBM joined the chat. :: :: [email protected] - Madhusudan Kapai/India/IBM joined the chat. :: :: Frank D. (Frank) Breen joined the chat. :: :: Ritu Sharma joined the chat. :: :: John Fritz *Contractor* is offline :: :: Daniel Esposito *Contractor* is offline :: :: [email protected] - Sreekanth Jayaprakash/India/IBM is offline :: :: Ritu Sharma is offline :: :: [email protected] - Madhusudan Kapai/India/IBM is offline :: :: [email protected] - David Allen/Boulder/IBM is offline :: :: Frank D. (Frank) Breen is offline :: :: Gerald L. Gase is offline :: :: Daniel Esposito *Contractor* joined the chat. :: :: Manish K Srivastava joined the chat. :: :: Gerald L. Gase joined the chat. :: :: John Fritz *Contractor* joined the chat. :: :: [email protected] - Sreekanth Jayaprakash/India/IBM joined the chat. :: :: [email protected] - David Allen/Boulder/IBM joined the chat. :: :: Frank D. (Frank) Breen joined the chat. :: :: Marty Hebert *Contractor* joined the chat. :: :: Anwar M Fahad joined the chat. :: :: Ritu Sharma joined the chat. :: :: Ritu Sharma left the chat. ::

Page 52: Chat

:: Ritu Sharma joined the chat. :: :: Gerald L. Gase is offline :: :: John Fritz *Contractor* is offline :: :: Ritu Sharma is offline :: :: [email protected] - David Allen/Boulder/IBM is offline :: :: Anwar M Fahad is offline :: :: Frank D. (Frank) Breen is offline :: :: Manish K Srivastava is offline :: :: Daniel Esposito *Contractor* is offline :: :: Daniel Esposito *Contractor* joined the chat. :: :: Marty Hebert *Contractor* joined the chat. :: :: Gerald L. Gase joined the chat. :: :: John Fritz *Contractor* joined the chat. :: :: Ritu Sharma joined the chat. :: :: [email protected] - David Allen/Boulder/IBM joined the chat. :: :: Frank D. (Frank) Breen joined the chat. :: :: [email protected] - Sreekanth Jayaprakash/India/IBM joined the chat. :: :: [email protected] - Sreekanth Jayaprakash/India/IBM is offline :: :: Gerald L. Gase is offline :: :: Daniel Esposito *Contractor* is offline :: :: John Fritz *Contractor* is offline :: :: Ritu Sharma is offline :: :: [email protected] - David Allen/Boulder/IBM is offline :: :: Frank D. (Frank) Breen is offline :: :: Daniel Esposito *Contractor* joined the chat. :: :: Marty Hebert *Contractor* joined the chat. :: :: Gerald L. Gase joined the chat. :: :: John Fritz *Contractor* joined the chat. :: :: Ritu Sharma joined the chat. :: :: [email protected] - David Allen/Boulder/IBM joined the chat. :: :: Frank D. (Frank) Breen joined the chat. :: :: [email protected] - Sreekanth Jayaprakash/India/IBM joined the chat. :: :: [email protected] - Andre St Pierre/Phoenix/Contr/IBM joined the chat. :: :: [email protected] - Andre St Pierre/Phoenix/Contr/IBM is available :: :: [email protected] - Sreekanth Jayaprakash/India/IBM is available :: [email protected], can I get the latest update, please? 

6:20:02 PM

Daniel Esp... 6:20:0

Page 53: Chat

Date / Time Total Increase Since Last Update Minutes Since Last Update Rate / Minute

8/1/2010 1:50 1827 8/1/2010 8:43 1914 87 413 0.21Average gb/min 2.02Percent Complete 0.90

 

4 PM

[email protected].. read my mind  

6:20:11 PM

Daniel Esp...sure  

6:20:13 PM

:: [email protected] - Sreekanth Jayaprakash/India/IBM is away :: :: [email protected] - Sreekanth Jayaprakash/India/IBM is available :: Daniel Esp...Date / Time Total Increase Since Last Update Minutes Since Last Update Rate / Minute

8/1/2010 1:50 1827 8/1/2010 8:43 1914 87 413 0.218/1/2010 8:58 1935 21 15 1.40

Average gb/min 2.02Percent Complete 0.91

 

6:30:41 PM

?speed is picking up again 

6:31:24 PM

[email protected] Frank kicked off some more jobs 

6:31:41 PM

?? 

6:31:43 PM

Daniel Esp...54% 757 3232 0 29298 38571 106451 44399 0 47283 1058% 110 4289 0 32516 42912 97634 40787 0 50019 1042% 23 3435 0 33175 43302 106914 100944 0 51932 1043% 105 3373 0 29993 38513 96271 80161 0 52846 1055% 76 3575 0 29339 38814 112836 21359 0 65373 10 

6:32:17 PM

?that's what I am thinking 

6:32:20 PM

:: [email protected] - Sreekanth Jayaprakash/India/IBM is away :: [email protected], writes are back up 

6:34:08 PM

Frank D. (...yeah 

6:44:57 PM

? 6:45:0

Page 54: Chat

a few  0 PM

Daniel Esp...Date / Time Total Increase Since Last Update Minutes Since Last Update Rate / Minute8/1/2010 1:50 1827 8/1/2010 8:43 1914 87 413 0.218/1/2010 8:58 1935 21 15 1.408/1/2010 9:23 1976 41 25 1.64Average gb/min 1.74Percent Complete 0.93

 

6:55:13 PM

?brb 

6:55:25 PM

Frank D. (...David are you there.  

7:06:02 PM

[email protected], Frank, I'm here 

7:06:14 PM

:: John Fritz *Contractor* is offline :: :: [email protected] - Sreekanth Jayaprakash/India/IBM is offline :: :: Gerald L. Gase is offline :: :: Ritu Sharma is offline :: :: [email protected] - David Allen/Boulder/IBM is offline :: :: [email protected] - Andre St Pierre/Phoenix/Contr/IBM is offline :: :: Daniel Esposito *Contractor* is offline :: :: Frank D. (Frank) Breen is offline :: :: Daniel Esposito *Contractor* joined the chat. :: :: Marty Hebert *Contractor* joined the chat. :: :: Gerald L. Gase joined the chat. :: :: John Fritz *Contractor* joined the chat. :: :: Ritu Sharma joined the chat. :: :: [email protected] - David Allen/Boulder/IBM joined the chat. :: :: Frank D. (Frank) Breen joined the chat. :: :: [email protected] - Sreekanth Jayaprakash/India/IBM joined the chat. :: :: [email protected] - Andre St Pierre/Phoenix/Contr/IBM joined the chat. :: :: Manish K Srivastava joined the chat. :: :: [email protected] - Sreekanth Jayaprakash/India/IBM is away :: :: [email protected] - Sreekanth Jayaprakash/India/IBM is offline :: :: Gerald L. Gase is offline :: :: John Fritz *Contractor* is offline :: :: Ritu Sharma is offline :: :: [email protected] - David Allen/Boulder/IBM is offline :: :: Frank D. (Frank) Breen is offline ::

Page 55: Chat

:: Manish K Srivastava is offline :: :: Daniel Esposito *Contractor* is offline :: :: [email protected] - Andre St Pierre/Phoenix/Contr/IBM is offline :: :: Daniel Esposito *Contractor* joined the chat. :: :: Marty Hebert *Contractor* joined the chat. :: :: Gerald L. Gase joined the chat. :: :: John Fritz *Contractor* joined the chat. :: :: Ritu Sharma joined the chat. :: :: [email protected] - David Allen/Boulder/IBM joined the chat. :: :: Frank D. (Frank) Breen joined the chat. :: :: [email protected] - Sreekanth Jayaprakash/India/IBM joined the chat. :: :: Manish K Srivastava joined the chat. :: Daniel Esp...Date / Time Total Increase Since Last Update Minutes Since Last Update Rate / Minute8/1/2010 1:50 1827 8/1/2010 8:43 1914 87 413 0.218/1/2010 8:58 1935 21 15 1.408/1/2010 9:23 1976 41 25 1.648/1/2010 10:38 2017 41 75 0.55

Average gb/min 1.74Percent Complete 0.93

 

8:26:54 PM

:: [email protected] - Sreekanth Jayaprakash/India/IBM is available :: :: [email protected] - Andre St Pierre/Phoenix/Contr/IBM joined the chat. :: Daniel Esp...Date / Time Total Increase Since Last Update Minutes Since Last Update Rate / Minute8/1/2010 1:50 1827 8/1/2010 8:43 1914 87 413 0.218/1/2010 8:58 1935 21 15 1.408/1/2010 9:23 1976 41 25 1.648/1/2010 10:38 2017 41 75 0.558/1/2010 11:12 2020 3 34 0.09

Average gb/min 1.74Percent Complete 0.94

 

8:58:18 PM

Frank D. (...We are on X:\N Burch 

8:58:18 PM

? 8:58:1

Page 56: Chat

X is mapped  9 PM

?to gold copy 

8:58:19 PM

?so we are moving.  

8:58:19 PM

?on master 

8:58:19 PM

:: [email protected] - Sreekanth Jayaprakash/India/IBM is available :: :: [email protected] - Sreekanth Jayaprakash/India/IBM is available :: :: [email protected] - Andre St Pierre/Phoenix/Contr/IBM is away :: :: Ritu Sharma left the chat. :: :: Ritu Sharma joined the chat. :: :: Manish K Srivastava left the chat. :: :: [email protected] - Sreekanth Jayaprakash/India/IBM is away :: Frank D. (...Largest dir left for copy are less than 3gb 

9:03:58 PM

?2gb 

9:04:00 PM

Daniel Esp...2036 

9:04:56 PM

?Date / Time Total Increase Since Last Update Minutes Since Last Update Rate / Minute8/1/2010 1:50 1827 8/1/2010 8:43 1914 87 413 0.218/1/2010 8:58 1935 21 15 1.408/1/2010 9:23 1976 41 25 1.648/1/2010 10:38 2017 41 75 0.558/1/2010 11:12 2020 3 34 0.098/1/2010 11:35 2036 16 23 0.70Average gb/min 1.74Percent Complete 0.94

 

9:06:15 PM

:: Ritu Sharma left the chat. :: Frank D. (...free space is holding steady 

9:09:04 PM

?322 

9:09:18 PM

?gb 

9:09:18 PM

Daniel Esp...if needed, use cell 

9:09:32 PM

:: Ritu Sharma joined the chat. :: Frank D. (...folder 1090 the o's 

9:26:25 PM

Page 57: Chat

:: [email protected] - Sreekanth Jayaprakash/India/IBM is available :: :: [email protected] - Sreekanth Jayaprakash/India/IBM left the chat. :: :: [email protected] - Sreekanth Jayaprakash/India/IBM joined the chat. :: :: [email protected] - Sreekanth Jayaprakash/India/IBM is away :: :: [email protected] - Sreekanth Jayaprakash/India/IBM is available :: :: John Fritz *Contractor* is offline :: :: [email protected] - Sreekanth Jayaprakash/India/IBM is offline :: :: Ritu Sharma is offline :: :: [email protected] - David Allen/Boulder/IBM is offline :: :: Gerald L. Gase is offline :: :: Daniel Esposito *Contractor* is offline :: :: Frank D. (Frank) Breen is offline :: :: [email protected] - Andre St Pierre/Phoenix/Contr/IBM is offline :: :: Daniel Esposito *Contractor* joined the chat. :: :: Marty Hebert *Contractor* joined the chat. :: :: Gerald L. Gase joined the chat. :: :: John Fritz *Contractor* joined the chat. :: :: [email protected] - Andre St Pierre/Phoenix/Contr/IBM joined the chat. :: :: [email protected] - David Allen/Boulder/IBM joined the chat. :: :: Frank D. (Frank) Breen joined the chat. :: :: [email protected] - Sreekanth Jayaprakash/India/IBM joined the chat. :: :: [email protected] - Sreekanth Jayaprakash/India/IBM left the chat. :: :: [email protected] - Sreekanth Jayaprakash/India/IBM joined the chat. :: :: [email protected] - Sreekanth Jayaprakash/India/IBM is available :: :: [email protected] - Sreekanth Jayaprakash/India/IBM is away :: Daniel Esp...Date / Time Total Increase Since Last Update Minutes Since Last Update Rate / Minute8/1/2010 9:23 1976 41 25 1.648/1/2010 10:38 2017 41 75 0.558/1/2010 11:12 2020 3 34 0.098/1/2010 11:35 2036 16 23 0.708/1/2010 12:38 2063 27 63 0.438/1/2010 13:28 2067 4 50 0.08Average gb/min 1.28Percent Complete 0.96

10:59:57 PM

Page 58: Chat

 

[email protected], Daniel 

11:01:00 PM

:: [email protected] - David Allen/Boulder/IBM is away :: :: Ritu Sharma joined the chat. :: :: Ritu Sharma is away :: :: [email protected] - Andre St Pierre/Phoenix/Contr/IBM is available :: :: Frank D. (Frank) Breen is away :: :: [email protected] - Sreekanth Jayaprakash/India/IBM is available :: Frank D. (...folder 1210 Product Fairs 

11:27:06 PM

:: Frank D. (Frank) Breen is available :: :: Sheelnidhi Gupta joined the chat. :: Daniel Esp...Date / Time Total Increase Since Last Update Minutes Since Last Update Rate / Minute8/1/2010 9:23 1976 41 25 1.648/1/2010 10:38 2017 41 75 0.558/1/2010 11:12 2020 3 34 0.098/1/2010 11:35 2036 16 23 0.708/1/2010 12:38 2063 27 63 0.438/1/2010 13:28 2067 4 50 0.088/1/2010 16:02 2069 2 34 0.06

Average gb/min 1.21Percent Complete 0.96

 

11:36:48 PM

?236gb free 

11:36:48 PM

:: [email protected] - Sreekanth Jayaprakash/India/IBM is away :: :: Frank D. (Frank) Breen is away :: :: Frank D. (Frank) Breen is available :: :: Ritu Sharma left the chat. :: Frank D. (...I see 287 free - 2.02 tb restored. we are in the Q's  

12:21:06 AM

?Folder 1250 

12:21:22 AM

:: Daniel Esposito *Contractor* is away :: :: Gerald L. Gase is offline :: :: Daniel Esposito *Contractor* is offline :: :: [email protected] - Sreekanth Jayaprakash/India/IBM is offline :: :: John Fritz *Contractor* is offline :: :: Sheelnidhi Gupta is offline ::

Page 59: Chat

:: [email protected] - Andre St Pierre/Phoenix/Contr/IBM is offline :: :: [email protected] - David Allen/Boulder/IBM is offline :: :: Frank D. (Frank) Breen is offline :: :: Daniel Esposito *Contractor* joined the chat. :: :: Marty Hebert *Contractor* joined the chat. :: :: Gerald L. Gase joined the chat. :: :: John Fritz *Contractor* joined the chat. :: :: [email protected] - Andre St Pierre/Phoenix/Contr/IBM joined the chat. :: :: [email protected] - David Allen/Boulder/IBM joined the chat. :: :: Frank D. (Frank) Breen joined the chat. :: :: Sheelnidhi Gupta joined the chat. :: :: [email protected] - Sreekanth Jayaprakash/India/IBM joined the chat. :: :: John Fritz *Contractor* is offline :: :: Gerald L. Gase is offline :: :: Daniel Esposito *Contractor* is offline :: :: Sheelnidhi Gupta is offline :: :: Frank D. (Frank) Breen is offline :: :: [email protected] - David Allen/Boulder/IBM is offline :: :: [email protected] - Andre St Pierre/Phoenix/Contr/IBM is offline :: :: Daniel Esposito *Contractor* joined the chat. :: :: Marty Hebert *Contractor* joined the chat. :: :: Gerald L. Gase joined the chat. :: :: John Fritz *Contractor* joined the chat. :: :: [email protected] - Andre St Pierre/Phoenix/Contr/IBM joined the chat. :: :: [email protected] - David Allen/Boulder/IBM joined the chat. :: :: Frank D. (Frank) Breen joined the chat. :: :: Anwar M Fahad joined the chat. :: :: [email protected] - Sreekanth Jayaprakash/India/IBM joined the chat. :: :: Sheelnidhi Gupta joined the chat. :: Marty Heb...Date / Time Total Increase Since Last Update Minutes Since Last Update Rate / Minute07/31/2010 10:46 899 26 15 1.7307/31/2010 11:02 932 33 16 2.0607/31/2010 11:15 955 23 13 1.7707/31/2010 13:30 1167 212 135 1.5707/31/2010 14:56 1331 164 86 1.9107/31/2010 15:41 1444 113 45 2.5107/31/2010 16:20 1546 102 39 2.6207/31/2010 17:03 1627 81 43 1.8807/31/2010 17:21 1657 30 18 1.67

6:54:53 AM

Page 60: Chat

07/31/2010 18:28 1715 58 67 0.8707/31/2010 19:28 1728 13 60 0.2207/31/2010 21:30 1731 3 122 0.0207/31/2010 22:50 1774 43 80 0.5408/01/2010 0:39 1815 41 109 0.3808/01/2010 1:50 1827 12 71 0.1708/01/2010 16:33 2097 270 883 0.3108/01/2010 17:14 2107 10 41 0.2408/01/2010 18:16 2115 8 62 0.1308/01/2010 19:34 2128 13 78 0.1708/01/2010 21:23 2146 18 109 0.17

Average gb/min 1.05Percent Complete 0.99

 

?216 GB free 

6:54:59 AM

Frank D. (...Job has completed.  

6:56:25 AM

?all files restored.  

6:56:32 AM

Marty Heb...SWEET 

6:56:36 AM

Daniel Esp... 

6:56:44 AM

?MArty, what's the latest numbers? I am not logged in 

6:57:08 AM

Marty Heb...I just pasted them. look up a little 

6:57:25 AM

6:57:31 AM

Daniel Esp...oh, so those are final, cool 

6:57:40 AM

Marty Heb...bash-2.05$ rsh erdhfdnas002 df -V -g HFD_flx_306Filesystem total used avail capacity Mounted on/vol/HFD_flx_306/ 2363GB 2146GB 216GB 91% /vol/HFD_flx_306/ 

6:57:47 AM

?here is the df 

6:57:49 AM

Daniel Esp...do we have a chat lined up for the morning? 

6:58:08 AM

Marty Heb...Don't know. probably a good idea  

6:58:45 AM

[email protected]. good news!! 

6:59:02 AM

? 6:59:1

Page 61: Chat

I can start one about 7:30 if that works for folks  7 AM

Marty Heb...Works for me 

6:59:23 AM

[email protected] know Frank will be out in the morning.. 

6:59:58 AM

?Frank, should I invite Mike V to that? 

7:00:05 AM

Frank D. (...He has not called me back.  

7:00:19 AM

[email protected] first customer touchpoint is scheduled for 09:00, but I'm sure we'll give an update on the DOM call at 7;30, also 

7:00:36 AM

:: [email protected] - Sreekanth Jayaprakash/India/IBM is available :: Frank D. (...David .. Mike would not be able to go into any detail.  

7:06:00 AM

?So I would not suggest he attend.  

7:06:12 AM

[email protected].. I'll be giving status on the 7:30 

7:06:50 AM

Frank D. (...sure.  

7:06:55 AM

[email protected] need him or someone from your team on the 09:00 to determine the next steps 

7:07:13 AM

Frank D. (...i will contact Mike in the AM.  

7:07:14 AM

[email protected] 

7:07:56 AM

:: Frank D. (Frank) Breen left the chat. :: :: [email protected] - Andre St Pierre/Phoenix/Contr/IBM is away :: :: [email protected] - Andre St Pierre/Phoenix/Contr/IBM is available :: :: Ritu Sharma joined the chat. :: :: [email protected] - Sreekanth Jayaprakash/India/IBM is away :: :: [email protected] - Sreekanth Jayaprakash/India/IBM is available :: :: [email protected] - Andre St Pierre/Phoenix/Contr/IBM left the chat. :: :: [email protected] - Andre St Pierre/Phoenix/Contr/IBM is offline :: :: [email protected] - Andre St Pierre/Phoenix/Contr/IBM joined the chat. :: :: [email protected] - Andre St Pierre/Phoenix/Contr/IBM is away :: :: [email protected] - Andre St Pierre/Phoenix/Contr/IBM is available :: :: [email protected] - Sreekanth Jayaprakash/India/IBM is away ::

Page 62: Chat

:: Ritu Sharma is away :: :: Ritu Sharma is available :: :: John Fritz *Contractor* is offline :: :: Gerald L. Gase is offline :: :: [email protected] - Sreekanth Jayaprakash/India/IBM is offline :: :: Daniel Esposito *Contractor* is offline :: :: [email protected] - David Allen/Boulder/IBM is offline :: :: [email protected] - Andre St Pierre/Phoenix/Contr/IBM is offline :: :: Anwar M Fahad is offline :: :: Sheelnidhi Gupta is offline :: :: Ritu Sharma is offline :: :: Daniel Esposito *Contractor* joined the chat. :: :: Anwar M Fahad joined the chat. :: :: Gerald L. Gase joined the chat. :: :: Manish K Srivastava joined the chat. :: :: Ritu Sharma joined the chat. :: :: Manish K Srivastava left the chat. :: :: Manish K Srivastava joined the chat. :: :: Ritu Sharma is away :: :: Ritu Sharma is available :: :: Anwar M Fahad left the chat. :: :: Anwar M Fahad joined the chat. :: :: Manish K Srivastava is away :: :: Ritu Sharma left the chat. :: :: Anwar M Fahad is away :: :: Anwar M Fahad is available :: :: Manish K Srivastava is available :: :: Daniel Esposito *Contractor* is away :: :: Daniel Esposito *Contractor* is available :: :: Gerald L. Gase left the chat. :: :: Daniel Esposito *Contractor* is away :: :: Anwar M Fahad left the chat. :: :: Anwar M Fahad joined the chat. :: :: Manish K Srivastava left the chat. :: :: Daniel Esposito *Contractor* is offline :: :: Anwar M Fahad is offline :: :: Daniel Esposito *Contractor* joined the chat. :: :: Anwar M Fahad joined the chat. :: :: Anwar M Fahad is away ::