Daily HO 25012012 Night Shift

Embed Size (px)

Citation preview

Date Date Shift name Site Outage

12/31/2011

Update 9/12/2012(Night Shift) Update 30/12/2011 (Morning shift)Attention: Problem Mgmt via TT_Interim Solution ( Active Since 07 Sept)

Please do check alarms in Netcool aswell according to Puneet, Please read toda

TT No.743182 TT746183 752584 752414 TT# 723838 TT#732475 TT#735143 761435 761760 766387 765783 761331 766376 765785 766870 758087 767342 767342 768263 769271 769271

Site #4741 NERH3 509065 Multiple sites 3255,3145,3131,3259 4501 5557 9260 2343 609255 606480 4525 6176, 6177, 6119, 6180 9070 5601,5601 2322 2310 3247 9477 9236 9503

Technogy Impact(2G2G 3G 3G3G 3G 3G 3G 3G 3G 3G 2G 2G 2G 3G All 2G 2G 2G 3G 3G 3G

Sectors (CellsEnvironmental alarms Affected) H/W fault All All All All All All All All All All All All All All All All All All

TT No.

Site #

723270

3642

Technogy Impact(2G900/1800 &3G 850/U2100) 3G

Sectors (Cells Affected)All

IMP TT# 753363 Huawei Swap impacted the Optus stes TT#747234 TT# 735143 9259 756732

755604 744730

758100 755043 TT 759591

759602

TT 723270

TT 742823

TT#745021

TT#760808

TT#762771

TT#766236

TT#766342

1658_BankstownCentral_2

TT#766324

CR 118799

TT# 767665 TT# 767663 TT # 767667 TT # 758225 TT # 759242 TT # 759906 TT # 760059 TT # 760072 TT # 760059 TT # 768567

Start Time 1/25/2012 ShiftHO_Night_25012012 Send SMS to puneet incase of any cell or site outage as we used to do it. Start Time End Time

Please see attached alarm monitoring and action instruction sent by Song for potential one-way the quantification of impact for Possible One way speech alarm, If this alarm appears on all c

All planned site access & visit must be done via valid CR. But, genuine problem like Cross Feeder, Interference Check on site for

Site Name AitkenvaleNERH3 Semaphore_2 Multiple cells Queen street,Russell st Cairns CBD Athelstone RMIT TheEntrance MaidavaleSouth MandurahForum Cairns2 Multiple Sites Manning

Start Time12/21/2011 1/1/2012 1/1/2012 11/22/2011 12/21/2011 12/6/2011 1/13/2012 1/15/2012 1/21/2012 1/20/2012 1/21/2012 1/21/2012 1/20/2012 1/23/2012

End Time

Outage Duration

E1 is fluctuating E1 is fluctuating E1 is fluctuating unstable unstable 1/22/2012 10 hrs still down Unstable unstable still down down still down Still down RF unit maintenance link failure still down still down Links are fluctuating very frequently

Ngunnawal Kambah PortMelbourne GeelongEast BertSaunderResv Guilfordstation

1/21/2012 1/23/2012 1/23/2012 1/24/2012 1/25/2012 1/25/2012

Site Name

Start Time

End Time

Outage Duration

KiewaValley

Unstable

Please put the TT memos in the M2000 and update the whole issue. 5 sites have SDH sonet alarm. Follow up. Please get the Update form Hadi regaring the Five TT covering the impact on Optus sites. 3 are our isue and need to be resolved. Puneet 3605_Pretty Sally _RF unit RF channel fault _Please follow up with NSN Site 5557_Athelstone E1/T1 Excessive bit error rate alarm Fan stalled, silca is booked. FMU Unit faulty after testing. Silcar to replace it. High VSWR @site9895_Entrance Nth. TT sent to NSN-Huawei FMT.

9185 has RTWP low. TT sent to BO. Request from BO. Please follow the instruction in TT744730. Two MRFU boards for 2G site need to be reset at midnight. Site ID 300940 Need to book silcar during business hours. The TT has been reopened as the problem still exists.Also escalated the isue to Kordia. Please follow up with GNOC. 8 out of 16 E1s unstable for 3G Site South Bank 2. E1 excessive bit error rate in the E1s. The alarms have cleared for now. UMTS cell max power mismatch. Possibly due to TT TT 759096 which was raised for CR which was incorrectly closed. Site ID 303642 KiewaValley_2 .Alos in DOR. Sites went down at 20:41 12/01/12 and is unstable since. Updated GNOC.They will engage Kordia. BBU CPRI Error. CPRI Cable or the MRFU Board faulty. TT sent to Kordia since site is ORCA 8. TRX blocked at site 5085. TT status is closed but the alarm is still there. Please follow up.

E1 mapping issue at 5501. Ericsson is taking care of this issue.

BBU CPRI interfacealarma in site 3119. Site passed ORCA 8 and the TT forworded to NSN FMT.

Site 2310 is fluctuating. Please follow up the TT.

The site 3380 is down due to Tx issue and forworded to NSN. Please follow up.

Local cell blocked since 20th Jan, 2011. Please investigate.

Call drop issue received fron GNOC. Please investigate and update the ticket.

5011 , 5012 . Link upgrade between 2 sites. Contact sujan mob: 0433047983

CR time is 3.00AM to 10.AM of Queensland time.

Board hardwarefault at 6209. Please follow up. Board not in position at 4383. Please follow up. Site 9617 down due to transmission. Please follow up. Cancel silca ref no: 14769723. Alarm cleared. Silca need to be booked for VSWR. Silca need to be booked for VSWR. Silca update required Silca update required Silca update required WBBP-WBBP interface abnormal, BBU board maintanence link failure at site 9123

7:00 AM 7:00 PM 7:00 AM Points to Remember (New Updates for NOC-FO Team)_Process Adherence at all Time

Pending Issues & Outages to Follow Up Fault (Desciption) Site is Up but has Environmental false alarms standby DPUe card faulty TX Fault. NSN GNOC following up with Optus since joint site.Cell Missmatch between RNC and MSS the site 3255 ,3145,3131 ,3259 have 4E1 and they are fluctuating. Please follow up with NSN. 4501 site have 3 E1 problem among 8 E1s. Escalated to NSN FMT. Please mfollow up this issue. E1 is fluctuating in 3G sites. TT escalated to NSN. TT with Kordia.. TT is with NSN-GNOC. TX issue Site restored. Please monitor for stability and close the TT if needed. Site down due to TX fault. TT with telstra who is working on this issue. Site was unstable and also degrading the few other sites. Check TT for more information Tech from kordia will attend the site ASAP Kordia investigating the TT. Kordia investigating the TT. TT is with NSN-GNOC. And followup with GNOC for further update. TX issue. Telstra Link issue. TT is with Telstra RF unit maintenance link failure issue, ORCA 8,TT with Kordia Site down without any alarms, Please investigate with NSN-GNOC and reply to Alex's mail Still down, Transmission Issue. TT is with Kordia Links are fluctuating very frequently, TT is with

Fault (Desciption) Site is unstable and Kordia claming as no TX issue and it might be faulty equipment. So need to investiagte into this issue.

Non Technical Issue to follow up

Handover From: Handover From: Handover To:

Current Status (In Hand with-MSP FMT/TX Huawei FMT Huawei BO Huawei-RANHuawei-Performance Kordia Kordia Kordia

Last Update from TT False Environmental alarms Fawzi is checking this

Action to Follow Up openOpen

Follow up with NSN FMT Follow up with NSN FMT Follow up with NSN FMT

Open Open Open

NSN-GNOC NSN GNOC NSN GNOC NSN GNOC NSN GNOC NSN GNOC kordianmc NSN GNOC Telstra Kordia NSN-GNOC Kordia Kordia

Follow up with NSN-GNOC monitor the site for any issues. Follow up with GNOC Follow up with GNOC Follow up with GNOC Folllowup with GNOC

Open open open open open open open

Follow up with GNOC

open

Follow up with GNOC Follow up with GNOC

open Open

Resolved By (MSP FMT/TX Kordia/HuaweiNOC-BO/NPM/Field Services-Silcar)

Last Update from TT refer TT for more info from Kordia

Status of Fault (Cleared/Closed ) Open

T/H/P/E A/L/U/Z/I N/R/O/M

Created By RahulTanveer

Last Comment by

Tanveer Siva Prasun

Lokesh

TT Closed (Yes/NO) Created By

Start Time

End Time

CR#

Status

Outage?

Summary

State

Sites Affected

Company

0700

1400

114484

completed

yes

Link upgrade

9721

Kordia

0700

1400

114690

completed

yes

Link upgrade

940

Kordia

Category

Type

Item

Shift Handover RepDate Shift name A 1 2 SMS Notification (Active Since: 01 Sept Till 30 Sept ) 08.12.2011 Night Start Time End Time

Points to Remember (New Updates for NAttention:Detailed Incident Report_Critical Incidents ( Active Since 30 Aug) Attention: Problem Mgmt via TT_Interim Solution ( Active Since 3 07 Sept) For

For RIC & Operat

All planned site access & visit must be done via valid CR. But, genuine problem li

B

Pending Issues & OTT No. Site # Technogy Impact(2G- Sectors 900/1800 &3G (Cells 850/U2100) Affected) Site Name Start Time End Time Outage Duration

#

1 651368

6170

3G U850

All

Yangebup

9/5/2011 21:00

9/9/2011 19:00

1/3/1900 22:00

2 3 4 5 6 7 8 9 10

9/9/2011 19:00 9/9/2011 19:00 9/9/2011 19:00 9/9/2011 19:00 9/9/2011 19:00 9/9/2011 19:00 9/9/2011 19:00 9/9/2011 19:00 9/9/2011 19:00

Resolved Issues &C TT No. Site # Technogy Impact(2G- Sectors 900/1800 &3G (Cells 850/U2100) Affected) Site Name Start Time End Time Outage Duration

1 651368

6170

3G U850

All

Yangebup

9/5/2011 21:00

9/9/2011 17:00

1/3/1900 20:00

2 3 4 5 6 7 8 9 D RIC Update on time Assist Abigroup guy to start RIC Activity

Non Technical

19:00 7:00

Hand Over from (Team) Handing Over to (Team)

P/H/T/F R/Y/Y/S

Tracker must be maintained

Fault (Desciption)>> 060911 at 18:22 Pm-> TX Fault is Rectified by Kordia but 2G-1800 is still down due to HW fault. NOC-BO Team Fauzi is looking after this fault now.

Current Status (In Hand with-MSP FMT/TX Kordia/Huawei- NOCBO/NPM)

Last Update from TT

Action to Follow Last Created By Up Comment by

Huawei- NOC-BO

>> At 1758 PM-> Silcar Technician went to site and Pl take a Follow up confirm no issue with from Fauzi in Jumper.TT forwared to NSNMorning FMT

Tanveer

Yassir

Fault (Desciption)>> 060911 at 18:22 Pm-> TX Fault is Rectified by Kordia but 2G-1800 is still down due to HW fault. NOC-BO Team Fauzi is looking after this fault now.

Resolved By (MSP FMT/TX Kordia/HuaweiNOC-BO/NPM/Field Services-Silcar)

Last Update from TT

Status of Fault (Cleared/Closed Created By )

TT Closed (Yes/NO)

Huawei- NOC-BO

>> At 1758 PM-> Silcar Technician went to site and Pl take a Follow up confirm no issue with with MSP-GNOC Jumper.TT forwared to NSN- to close the Ticket. FMT

Tanveer

Yassir

As per Standerd process As per Puneet mail at 17:50 Pm