Maintaining And Troubleshooting Hw - Mss15.pdf
This document was uploaded by user and they confirmed that they have the permission to share it. If you are author or own the copyright of this book, please report to us by using this DMCA report form. Report DMCA
Overview
Download & View Maintaining And Troubleshooting Hw - Mss15.pdf as PDF for free.
More details
- Words: 39,363
- Pages: 206
Open MSS 15, Product Documentation, version 6 Maintaining and Troubleshooting Hardware DN0966621 Issue 11-0
Maintaining and Troubleshooting Hardware
The information in this document applies solely to the hardware/software product (“Product”) specified herein, and only as specified herein. Reference to “Nokia” later in this document shall mean the respective company within Nokia Group of Companies with whom you have entered into the Agreement (as defined below). This document is intended for use by Nokia's customers (“You”) only, and it may not be used except for the purposes defined in the agreement between You and Nokia (“Agreement”) under which this document is distributed. No part of this document may be used, copied, reproduced, modified or transmitted in any form or means without the prior written permission of Nokia. If You have not entered into an Agreement applicable to the Product, or if that Agreement has expired or has been terminated, You may not use this document in any manner and You are obliged to return it to Nokia and destroy or delete any copies thereof. The document has been prepared to be used by professional and properly trained personnel, and You assume full responsibility when using it. Nokia welcomes your comments as part of the process of continuous development and improvement of the documentation. This document and its contents are provided as a convenience to You. Any information or statements concerning the suitability, capacity, fitness for purpose or performance of the Product are given solely on an “as is” and “as available” basis in this document, and Nokia reserves the right to change any such information and statements without notice. Nokia has made all reasonable efforts to ensure that the content of this document is adequate and free of material errors and omissions, and Nokia will correct errors that You identify in this document. Nokia's total liability for any errors in the document is strictly limited to the correction of such error(s). Nokia does not warrant that the use of the software in the Product will be uninterrupted or error-free. NO WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO ANY WARRANTY OF AVAILABILITY, ACCURACY, RELIABILITY, TITLE, NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE, IS MADE IN RELATION TO THE CONTENT OF THIS DOCUMENT. IN NO EVENT WILL NOKIA BE LIABLE FOR ANY DAMAGES, INCLUDING BUT NOT LIMITED TO SPECIAL, DIRECT, INDIRECT, INCIDENTAL OR CONSEQUENTIAL OR ANY LOSSES, SUCH AS BUT NOT LIMITED TO LOSS OF PROFIT, REVENUE, BUSINESS INTERRUPTION, BUSINESS OPPORTUNITY OR DATA THAT MAY ARISE FROM THE USE OF THIS DOCUMENT OR THE INFORMATION IN IT, EVEN IN THE CASE OF ERRORS IN OR OMISSIONS FROM THIS DOCUMENT OR ITS CONTENT. This document is Nokia proprietary and confidential information, which may not be distributed or disclosed to any third parties without the prior written consent of Nokia. Nokia is a registered trademark of Nokia Corporation. Other product names mentioned in this document may be trademarks of their respective owners. Copyright © 2017 Nokia. All rights reserved.
f
Important Notice on Product Safety This product may present safety risks due to laser, electricity, heat, and other sources of danger. Only trained and qualified personnel may install, operate, maintain or otherwise handle this product and only after having carefully read the safety information applicable to this product. The safety information is provided in the Safety Information section in the “Legal, Safety and Environmental Information” part of this document or documentation set.
Nokia is continually striving to reduce the adverse environmental effects of its products and services. We would like to encourage you as our customers and users to join us in working towards a cleaner, safer environment. Please recycle product packaging and follow the recommendations for power use and proper disposal of our products and their components. If you should have questions regarding our Environmental Policy or any of the environmental services we offer, please contact us at Nokia for any additional information.
2
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Table of Contents This document has 206 pages
Summary of changes .................................................................. 10
1 1.1 1.1.1 1.1.2 1.1.2.1 1.1.2.2 1.1.3 1.1.3.1 1.1.3.2 1.1.3.3
Hardware troubleshooting............................................................ 11 Problem with a blade, RTM or AMC............................................. 11 General hardware problems......................................................... 11 Power problems........................................................................... 12 The site / cabinet/ shelf has a power failure.................................13 There is a power failure in the blade............................................ 13 Software related problems........................................................... 13 The blade does not boot up......................................................... 13 The blade fails to boot up with newly upgraded software............ 13 The embedded software in the hardware units is not consistent with the product release............................................................... 13 The BIOS information in a CPU unit is not consistent with the product release............................................................................ 14 The login banner shows that the blade is in debug mode............14 There are problems with the computer unit start-up.................... 14 LED signals and what they mean.................................................14 Power good LED is not lit / is blinking.......................................... 14 Out-of-service LED is lit / is blinking.............................................15 Hot swap LED remains lit after the hot swap latch has been closed...........................................................................................16 Hot swap LED keeps blinking after the hot swap latch has been closed...........................................................................................16 Connectivity problems..................................................................16 Blade does not answer to ping.....................................................16 BIOS/U-boot POST is not displayed on the console....................17 Communication cannot be established between the Ethernet nodes........................................................................................... 17 Problem with SFP, SFP+ or XFP transceiver............................... 18 Problem with shelf manager.........................................................18 Description .................................................................................. 18 Symptoms ................................................................................... 19 Recovery procedures .................................................................. 19 The embedded software in the hardware units are not consistent with the product release............................................................... 19 The health LED/power good LED is not lit green or the out of service LED is lit...........................................................................19 The hot swap LED is not lit when the hot swap latch has been pulled or remains lit when the latch has been closed...................20
1.1.3.4 1.1.3.5 1.1.3.6 1.1.4 1.1.4.1 1.1.4.2 1.1.4.3 1.1.4.4 1.1.5 1.1.5.1 1.1.5.2 1.1.5.3 1.2 1.3 1.3.1 1.3.2 1.3.3 1.3.3.1 1.3.3.2 1.3.3.3
2 2.1 2.1.1
Replacing hardware units.............................................................21 Replacing a blade........................................................................ 21 Removing a blade from the shelf................................................. 22
DN0966621 Issue: 11-0
© 2017 Nokia
3
Maintaining and Troubleshooting Hardware
2.1.2 2.2 2.3 2.4 2.5 2.5.1 2.5.2 2.6 2.6.1 2.6.2 2.7 2.8 2.9 2.9.1 2.9.2 2.10 2.10.1 2.10.2 2.10.3 2.11 2.12 2.13 2.14 2.14.1 2.14.2 2.15 2.15.1 2.15.2 2.16 2.16.1 2.16.2 2.16.3 2.17 2.17.1 2.17.2 2.17.3 2.18 2.19 2.19.1 2.19.2 2.20 2.20.1 2.20.2
4
Installing a blade.......................................................................... 23 Replacing a CPU blade (ACPI4-A or ACPI4-B)........................... 25 Replacing a CPU blade (ACPI5-A) ............................................. 29 Replacing a hub blade (AHUB3-A or AHUB3-B)..........................34 Replacing memory modules on the ACPI4-A or ACPI4-B blade...... 38 Removing a memory module....................................................... 39 Installing a memory module......................................................... 39 Replacing memory modules on the ACPI5-A blade.....................40 Removing a memory module....................................................... 41 Installing a memory module......................................................... 45 Replacing a rear transition module.............................................. 47 Replacing the hard disk drive on CPRT4-A..................................51 Replacing the HDD on CPRT5-A for VMU................................... 55 Removing the HDD...................................................................... 57 Installing the HDD........................................................................ 58 Replacing SFP, SFP+ and XFP transceivers............................... 62 Removing an SFP copper transceiver or an SFP/SFP+/XFP optical transceiver........................................................................ 64 Installing an SFP copper transceiver or an SFP/SFP+/XFP optical transceiver....................................................................................64 Removing and installing an SFP/SFP+/XFP filler plug.................65 Checking and replacing the air filter.............................................65 Replacing a fuse on Passive PEM Board.................................... 68 Replacing a power adapter module (APAMO-A)..........................71 Replacing a power distribution unit (ADPDU-A)...........................72 Removing a power distribution unit (ADPDU-A).......................... 73 Installing a power distribution unit (ADPDU-A)............................ 76 Replacing a power distribution unit (ADPD2-A)........................... 82 Removing a power distribution unit (ADPD2-A)........................... 83 Installing a power distribution unit (ADPD2-A)............................. 85 Replacing a power entry module (ADPEM-A)..............................90 Removing a power entry module (ADPEM-A)..............................90 Installing a power entry module (ADPEM-A)................................93 Replacing a PEM (ADPEM-A) fuse..............................................96 Replacing a power entry module (ADPE2-A)...............................98 Removing a power entry module (ADPE2-A)...............................99 Installing a power entry module (ADPE2-A)...............................102 Replacing a PEM (ADPE2-A) fuse.............................................104 Replacing a power supply unit (AAPSU-A)................................ 107 Replacing a fan module............................................................. 109 Removing a fan module..............................................................110 Installing a fan module................................................................111 Replacing a shelf in cabinet (EC208-A)......................................111 Removing a shelf from the cabinet (EC208-A)........................... 112 Installing a shelf into the cabinet (EC208-A).............................. 126
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
2.21 2.21.1 2.21.2 2.22 2.22.1 2.22.2 2.23 2.23.1 2.23.2 2.24 2.24.1 2.24.2 2.25 2.25.1 2.25.2 2.26 2.26.1 2.26.2 2.27
2.29 2.29.1 2.29.2
Replacing a shelf (ASA16-A) in cabinet (CAB216-A).................148 Removing a shelf (ASA16-A) from the cabinet (CAB216-A)...... 149 Installing a shelf (ASA16-A) into the cabinet (CAB216-A)......... 155 Replacing a shelf (ASH16-A) in cabinet (CAB216-A)................ 160 Removing a shelf (ASH16-A) from the cabinet (CAB216-A)......161 Installing a shelf (ASH16-A) into the cabinet (CAB216-A)......... 167 Replacing a shelf manager........................................................ 173 Removing a shelf manager........................................................ 175 Installing a shelf manager.......................................................... 176 Replacing a shelf alarm display................................................. 176 Removing the shelf alarm display.............................................. 177 Installing the shelf alarm display................................................ 177 Replacing a shelf alarm panel....................................................178 Removing the shelf alarm panel.................................................178 Installing the shelf alarm panel...................................................179 Replacing a shelf data module (SHCDM-A)...............................179 Removing a shelf data module (SHCDM-A).............................. 180 Installing a shelf data module (SHCDM-A)................................ 182 Replacing a shelf data module (SHCDM-B) in shelf set (ASH16SET-A)........................................................................... 185 Removing a shelf data module (SHCDM-B) in shelf set (ASH16SET-A)........................................................................... 185 Installing a shelf data module (SHCDM-B) in shelf set (ASH16SET-A)........................................................................... 189 Replacing a shelf data module (SHCDM-B) in shelf set (ASH16SET-B)........................................................................... 193 Removing a shelf data module (SHCDM-B) in shelf set (ASH16SET-B)........................................................................... 193 Installing a shelf data module (SHCDM-B) in shelf set (ASH16SET-B)........................................................................... 197 Replacing a cable tray with fiber optic cable tray....................... 200 Removing the cable tray............................................................ 200 Installing the fiber optic cable tray..............................................201
3 3.1 3.2 3.3
SEL interpretation...................................................................... 202 Overview.................................................................................... 202 Getting SEL information............................................................. 202 Analyzing SEL information......................................................... 203
2.27.1 2.27.2 2.28 2.28.1 2.28.2
DN0966621 Issue: 11-0
© 2017 Nokia
5
Maintaining and Troubleshooting Hardware
List of Figures
6
Figure 1
Removing a blade...............................................................................22
Figure 2
Installing a blade.................................................................................24
Figure 3
Memory modules on ACPI4-A............................................................ 40
Figure 4
The Hot Swap LED on the ACPI5-A...................................................44
Figure 5
Removing and installing a memory module on ACPI5-A....................45
Figure 6
Removing the RTM.............................................................................49
Figure 7
Installing the RTM...............................................................................50
Figure 8
Hard disk drive on CPRT4-A.............................................................. 53
Figure 9
The HDD0 on the CPRT5-A............................................................... 56
Figure 10
Tighten two screws of the HDD0 carrier............................................. 58
Figure 11
Orientation of transceiver modules.....................................................63
Figure 12
Replacing the air filter.........................................................................66
Figure 13
Air filter label stickers..........................................................................67
Figure 14
Fuses on PPB in ASA16SET-A.......................................................... 68
Figure 15
Removing a power adapter module (APAMO-A)................................ 71
Figure 16
Installing a power adapter module (APAMO-A).................................. 72
Figure 17
Power distribution units (ADPDU-A) in the cabinet............................ 73
Figure 18
ADPDU-A circuit breakers.................................................................. 74
Figure 19
ADPDU-A cabling............................................................................... 75
Figure 20
Replacing a ADPDU-A....................................................................... 76
Figure 21
Installing mounting ears to the ADPDU-As.........................................77
Figure 22
Installing a ADPDU-A......................................................................... 78
Figure 23
ADPDU-A grounding cable.................................................................79
Figure 24
ADPDU-A power feed cabling............................................................ 80
Figure 25
ADPDU-A cabling............................................................................... 81
Figure 26
ADPDU-A circuit breakers.................................................................. 82
Figure 27
Power distribution units (ADPD2-A) in the cabinet............................. 83
Figure 28
ADPD2-A circuit breakers...................................................................84
Figure 29
ADPD2-A cabling................................................................................85
Figure 30
Unfastening a power distribution unit (ADPD2-A).............................. 85
Figure 31
ADPD2-A circuit breakers...................................................................86
Figure 32
ADPD2-A grounding cable................................................................. 86
Figure 33
ADPD2-A optional grounding accessories......................................... 87
Figure 34
PDU input and output power cable position....................................... 88
Figure 35
Power distribution unit (ADPDU-A) circuit breakers........................... 91
Figure 36
ADPEM-A power feed cabling (straight).............................................92
Figure 37
ADPEM-A power feed cabling (angled)..............................................92
Figure 38
Replacing a power entry module (ADPEM-A).................................... 93
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Figure 39
ADPEM-A power feed cabling (straight).............................................94
Figure 40
ADPEM-A power feed cabling (angled)..............................................94
Figure 41
Power distribution unit (ADPDU-A) circuit breakers........................... 95
Figure 42
ADPEM-A fuses..................................................................................96
Figure 43
ADPD2-A circuit breakers...................................................................99
Figure 44
Unscrewing the fixing screws on the PEM....................................... 100
Figure 45
Disengaging the PEM.......................................................................101
Figure 46
PEM power feed cabling...................................................................101
Figure 47
ADPE2-A fuses.................................................................................105
Figure 48
Removing a power supply unit (AAPSU-A)...................................... 108
Figure 49
Replacing a fan module.................................................................... 110
Figure 50
Power distribution unit (ADPDU-A) circuit breakers......................... 122
Figure 51
Removing the rear cable tray........................................................... 123
Figure 52
Removing a fan module....................................................................124
Figure 53
Removing the shelf...........................................................................125
Figure 54
Removing a shelf data module (SHCDM-A).....................................126
Figure 55
Installing the shelf - front view.......................................................... 127
Figure 56
Installing the shelf - rear view........................................................... 128
Figure 57
Placement of labels in ATCA 16-slot shelf ACH16SET-A.................130
Figure 58
LEDs of BI interfaces........................................................................134
Figure 59
LEDs of FI interfaces........................................................................ 135
Figure 60
Removig the PSU (AAPSU-A)..........................................................151
Figure 61
Positioning holes for the ISTR-A installation support frame............. 152
Figure 62
ISTR-A installation support frame with the pin and spring................153
Figure 63
Installing ISTR-A installation support frame..................................... 153
Figure 64
Removing a shelf (ASA16-A) from the cabinet (CAB216-A)............ 154
Figure 65
Removing a shelf (ASA16-A) from the cabinet (CAB216-A) - rear view. 154
Figure 66
Installing the rear cable tray............................................................. 155
Figure 67
Removing the cable tray claws.........................................................156
Figure 68
Installing a shelf (ASA16-A) into the cabinet (CAB216-A) - front view... 157
Figure 69
Installing a shelf (ASA16-A) into the cabinet (CAB216-A) - rear view.... 157
Figure 70
ADPD2-A circuit breakers.................................................................162
Figure 71
Positioning holes for the ISTR-A installation support frame............. 164
Figure 72
ISTR-A installation support frame with the pin and spring................165
Figure 73
Installing ISTR-A installation support frame..................................... 165
Figure 74
Removing a shelf (ASH16-A) from the cabinet (CAB216-A)............ 166
Figure 75
Removing a shelf (ASH16-A) from the cabinet (CAB216-A) - rear view ..........................................................................................................166
DN0966621 Issue: 11-0
© 2017 Nokia
7
Maintaining and Troubleshooting Hardware
8
Figure 76
Installing the rear cable tray............................................................. 167
Figure 77
Removing the cable tray claws.........................................................168
Figure 78
Installing a shelf (ASH16-A) into the cabinet (CAB216-A) - front view... 169
Figure 79
Installing a shelf (ASH16-A) into the cabinet (CAB216-A) - rear view.... 170
Figure 80
Replacing the shelf manager............................................................173
Figure 81
Replacing the shelf alarm display ....................................................176
Figure 82
Shelf alarm display label stickers..................................................... 178
Figure 83
Replacing the shelf alarm panel (SHALP-A).................................... 178
Figure 84
Replacing a shelf data module (SHCDM-A)..................................... 179
Figure 85
Replacing a shelf data module (SHCDM-A)..................................... 181
Figure 86
Shelf data module (SHCDM-A) label stickers...................................183
Figure 87
ADPD2-A circuit breakers.................................................................186
Figure 88
Unscrewing the fixing screws on the PEM....................................... 187
Figure 89
Replacing a shelf data module (SHCDM-B) in shelf set (ASH16SET-A) for old version................................................................................... 188
Figure 90
Replacing a shelf data module (SHCDM-B) in shelf set (ASH16SET-A) for new version................................................................................. 189
Figure 91
Shelf data module (SHCDM-B) label stickers...................................191
Figure 92
Replacing a shelf data module (SHCDM-B) in shelf set (ASH16SET-B) for old version................................................................................... 196
Figure 93
Replacing a shelf data module (SHCDM-B) in shelf set (ASH16SET-B) for new version................................................................................. 196
Figure 94
Shelf data module (SHCDM-B) label stickers...................................198
Figure 95
Removing the cable tray...................................................................200
Figure 96
Installing the fiber optic cable tray.................................................... 201
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
List of Tables Table 1
steps for changing unit state to SE-NH.............................................. 30
Table 2
steps for changing unit state to TE .................................................... 32
Table 3
steps for changing unit state to WO-EX ............................................ 34
Table 4
ID of faulty memory module................................................................38
Table 5
Approved ACPI5-A DIMM memory module types.............................. 41
Table 6
Recommended memory configurations..............................................41
Table 7
Steps for changing the related unit state into SE-NH......................... 42
Table 8
Steps for changing the related unit state into TE................................46
Table 9
Steps for changing the related unit state into WO-EX........................ 46
Table 10
Mapping of PDU input and shelf.........................................................87
Table 11
Power cable connection between ADPD2-A and ADPE2-A...............88
Table 12
Power cable connection between ADPD2-A and ADPE2-A...............89
Table 13
Relation between PDU circuit breakers, PDU outputs and shelves. 100
Table 14
Relation between PDU circuit breakers, PDU outputs and shelves. 102
Table 15
Power cable connection between ADPD2-A and ADPE2-A.............103
Table 16
Relation between PDU circuit breakers, PDU outputs and shelves. 162
Table 17
Relation between PDU circuit breakers, PDU outputs and shelves. 168
Table 18
Relation between PDU circuit breakers, PDU outputs and shelves. 171
Table 19
Compatibility of SHCDM-B and ASH16-A........................................ 185
Table 20
Relation between PDU circuit breakers and shelves........................187
Table 21
Compatibility of SHCDM-B and ASH16-A........................................ 193
DN0966621 Issue: 11-0
© 2017 Nokia
9
Summary of changes
Maintaining and Troubleshooting Hardware
Summary of changes Changes between document issues are cumulative. Therefore, the latest document issue contains all changes made to previous issues. Changes made between issues 11-0 and 10-3 The following topics have been updated: • • • • •
Replacing a CPU blade (ACPI5-A) Replacing a hub blade (AHUB3-A or AHUB3-B) Replacing a rear transition module Replacing the hard disk drive on CPRT4-A Replacing the HDD on CPRT5-A for VMU
Changes made between issues 10-3 and 10-2 The following sections have been updated: • • • •
Blade does not answer to ping Replacing a hub blade (AHUB3-A or AHUB3-B) Replacing a PEM (ADPE2- A) fuse Replacing a shelf data module (SHCDM-B) in shelf set (ASH16SET-A)
Changes made between issues 10-2 and 10-1 Section Replacing a hub blade (AHUB3-A or AHUB3-B) has been updated.
10
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Hardware troubleshooting
1 Hardware troubleshooting 1.1 Problem with a blade, RTM or AMC This section describes the most common problem situations with ATCA Field Replaceable Units (FRUs).
1.1.1 General hardware problems Description This section describes the most common problem situations with ATCA Field Replaceable Units (FRUs). Possible causes for the problem are: • • • • • • • •
The FRU is not properly seated. The FRU has been installed in an incorrect slot. One of the cables is not properly connected. There is a hardware fault in the blade. The blade malfunctions. The blade overheats. CPU BIOS output does not include the expected data. Incorrect memory configuration.
Recovery procedures The FRU is not properly seated The blade, RTM or AMC does not fit into its slot correctly. 1. Uninstall the FRU. 2. Re-install the FRU according to installation manual. 3. If the FRU cannot be installed correctly, replace the FRU. The FRU has been installed in an incorrect slot The blade, RTM or AMC is not installed in the slot designated to it in the configuration. 1. Uninstall the FRU. 2. Install FRU in the correct slot, as shown in User Guide. One of the cables is not properly connected One of the cables is either connected to the wrong unit or is incorrectly plugged in. 1. Remove the cable. 2. Install the cable as shown in the network element’s Quick Guide. There is a hardware fault in the blade For example one of the rear connectors has been damaged.
DN0966621 Issue: 11-0
© 2017 Nokia
11
Hardware troubleshooting
Maintaining and Troubleshooting Hardware
1. Replace the FRU. The blade malfunctions The blade does not function. 1. Check the system event log (SEL) through the shelf manager. Use the clia sel [-v] command. To understand the contents of the SEL, refer to the sensor tables in the blade user guides for more information. The blade overheats 1. Check that filler blades have been installed in all empty slots to maintain airflow and emissions properly. 2. Check temperatures at the air intake, on the overheating module, and at the platform’s air exhaust. On the basis of the information, determine whether the overheating may be caused by warm facility air, a module failure, or a failed fan module. 3. Move the blade to a different slot to see if that resolves the problem. 4. Check the shelf’s air filter for possible obstructions and dirt. CPU BIOS output does not include the expected data Check that the memory modules are properly in place. 1. Remove the blade. 2. Remove the memory modules from their DIMM sites and then re-install them. 3. Re-install the blade in the shelf. Incorrect memory configuration If the DIMM memory modules have been incorrectly installed, the system issues an alarm. To clear the alarm, do the following: 1. Remove the blade. 2. Re-install the memory modules to their correct DIMM sites. 3. Re-install the blade in the shelf. If the DIMM memory modules in a pair are not identical, the system will issue an alarm. To clear the alarm: 1. Remove the blade. 2. Install identical memory modules to their correct DIMM sites. 3. Re-install the blade to the shelf.
g
Note: If the blade needs to be sent to the HWS for repair, remove the memory modules before the sending. In this case, retain the original configurations of the memory modules and make sure they do not get mixed.
1.1.2 Power problems
12
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
1.1.2.1
Hardware troubleshooting
The site / cabinet/ shelf has a power failure If there is no operating current for the network element, verify the following: • • •
1.1.2.2
Verify that the shelf is receiving power from the site power supply. Verify power cables leading from the PDUs to the PEMs. If the steps above do not restore operating power to the shelf, replace the shelf.
There is a power failure in the blade If there is no operating current for the blade, verify the following: • •
Verify that other components in the shelf are powered. If not, see The shelf has a power failure above. If the steps above do not restore power to the blade, replace the blade.
1.1.3 Software related problems 1.1.3.1
The blade does not boot up If U-Boot is functioning but Linux does not boot up, try the following: 1. 2. 3. 4.
1.1.3.2
Verify that the blade hardware is not damaged. Verify if there are network problems. Disable the BMC watchdog to diagnose the bootup. Restore Linux software from U-Boot.
The blade fails to boot up with newly upgraded software The blade’s embedded software may be corrupted. •
1.1.3.3
Re-load the software through U-Boot or from the secondary flash.
The embedded software in the hardware units is not consistent with the product release First required actions before troubleshooting any software related problem: • •
Verify that the embedded software has correct versions in the hardware units according to the product release. Update the embedded software to the required versions if necessary.
For details, see the separate embedded software checking and updating instructions.
DN0966621 Issue: 11-0
© 2017 Nokia
13
Hardware troubleshooting
1.1.3.4
Maintaining and Troubleshooting Hardware
The BIOS information in a CPU unit is not consistent with the product release First required actions before troubleshooting any BIOS related problem: • •
1.1.3.5
The login banner shows that the blade is in debug mode •
1.1.3.6
Verify that the BIOS information in the CPU unit conforms to the product release. Update the BIOS if necessary, either from the Flash tool or USB Flash device.
Restore valid shelf FRU information.
There are problems with the computer unit start-up 1. Check the states of the SHMUs in the shelf where the failing computer unit is. If the states are not WO and SP, analyze and change the states. 2. Check if alarm 3481 SHMU COMMUNICATION FAILURE is on. If yes, analyze and correct. 3. Check the slot (and shelf) number of the ACPI4-A/ACPI4-B blade in the failing computer unit. 4. Change the functional state of the failing computer to SE-NH. 5. Delete the ACPI4-A/ACPI4-B blade from the failing computer unit. 6. Create the ACPI4-A/ACPI4-B blade to the failing computer unit using the correct slot and shelf numbers. 7. Change the failing computer unit to normal operational state. Results •
The boot printouts show correct unit address, for example 0005:
•
UNIT ADDRESS SET FROM IPMI: 0005 The boot loading is done correctly and the unit is started to normal operational state.
1.1.4 LED signals and what they mean See the blade user guide for descriptions of LEDs and their functions for the specific blade type.
1.1.4.1
Power good LED is not lit / is blinking 1. Check that other components in the shelf are powered. If not, check power cabling, the PEMs and PDUs. 2. Make sure that the blade is inserted correctly. 3. Make sure that the blade and the memory modules are properly seated: a) Remove the blade. b) Remove and re-install the memory modules. c) Re-install the blade to the shelf.
14
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Hardware troubleshooting
d) Make sure the hot swap latch is pushed in all the way. 4. Make sure that the connector pins have not been damaged. If the pins show no sign of damage, try the following: a) Insert the blade into a different slot to see if the power good LED lights up. b) Insert a different blade to the original slot to see if its power good LED lights up. 5. Check that the blade is not in the hot-swap state. The power good LED is off when the blade is in this state. 6. Check that the blade’s power indicator debug LEDs are on. If the debug LEDs are not on when there is power to the shelf, replace the blade.
1.1.4.2
Out-of-service LED is lit / is blinking One of the voltages may have exceeded a threshold or there may be a fault in the DC converter. 1. Log in to the shelf manager. 2. Check the SEL of the shelf. Use the clia sel command 3. Check the board-specific event log for voltage alarms. Use the clia sel command.
t
Tip: For the documentation of sensor alarms, see the alarm reference manuals or the blade-specific user guides. The shelf manager may have a power failure. 1. One of the voltages may have exceeded a threshold or there may be a fault in the DC converter. a) Log in to the shelf manager. b) Check the SEL of the shelf. Use the clia sel command. c) Check the FRU-specific event log for voltage alarms. Use the clia sel command. 2. If the LED is flashing, the FRU data of the carrier may be missing or corrupted. a) Log in to the shelf manager. b) Check the FRU data. Use the clia fruinfo command. c) Update the FRU data if it is incorrect. Use the clia frudataw command. 3. The embedded software may be corrupted. a) Re-install software 4. If you are unable to solve the problem, replace the blade.
DN0966621 Issue: 11-0
© 2017 Nokia
15
Hardware troubleshooting
1.1.4.3
Maintaining and Troubleshooting Hardware
Hot swap LED remains lit after the hot swap latch has been closed 1. Re-open the latch slightly and close it again. 2. If the hot swap LED still remains lit, check the FRU status. Use the clia board <slot number of hub> command.
1.1.4.4
Hot swap LED keeps blinking after the hot swap latch has been closed The FRU information of the blade may be incorrect. 1. Log in to the shelf manager. 2. Check the FRU data. Give command clia fruinfo . 3. Update the FRU data if it is incorrect. Give command clia frudataw .
1.1.5 Connectivity problems 1.1.5.1
Blade does not answer to ping If the blade does not answer to ping, verify the following: 1. Check the link LED state. If the link LED is off, check that the network cable has been connected correctly and is properly attached. 2. Check that the IP address of the CPU blade is correct. a) Connect to the blade through the serial port. b) Give command ifconfig eth0. c) Try to ping the unit's own IP address using command ping. 3. Check that the IP address of the HUB blade is correct. See the User Guide for bladespecific instructions on ping. If there is a connectivity problem to the SWU with LAN management, for example, command ZYFF shows NOK in IP ADDRESS CONFIGURED, you can renew the IP address in the hub blade management interface. a) Connect to the blade through the serial port. b) If you are using a AHUB3-A, enter the following commands: (dtl1 is taken as example)
g
Note: dtl0 is the management interface for the EMB SWU and dtl1 is for the CNW SWU. 1). Renew the dtl1 IP address. ifdown dtl1 ifup dtl1
16
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Hardware troubleshooting
2). Show the dtl1 IP address configuration. ifconfig dtl1
If the dtl1 IP address is lost and the renew command is not effective, you have to configure it manually. 3). Configure the dtl1 IP address manually. ifconfig dtl1 netmask
4). Check that the dtl1 interface has a correct IP address. ifconfig dtl1
c) If you are using a AHUB3-B, enter the following commands:
g
Note: The default interface in BI is the management interface for the EMB SWU and mgmt2 in LMP is for the CNW SWU. 1). Renew the IP address. SWITCH(enable)# en bi SWITCH(enable-bi)# ip address dhcp renew
2). Check that the dhcpd service is up. Switch from the AHUB main menu to Enable-BI mode. SWITCH(enable-bi)# en bi SWITCH(enable-bi)# show dhcp client
3). Restart dhcpd in Enable-BI mode. SWITCH(enable-bi)# configure terminal SWITCH(enable-bi)# dhcp client enable
d) Try to ping the unit's own IP address using command ping.
1.1.5.2
BIOS/U-boot POST is not displayed on the console CPU, HUB and packet processing blades support console redirection. If the BIOS or U-boot POST is not displayed on the console, check the following: 1. Verify that the terminal settings are correct. 2. Verify that the cables to the console are of the correct type. 3. Verify that the cables to the console are correctly plugged in.
1.1.5.3
Communication cannot be established between the Ethernet nodes Verify the following: 1. 2. 3. 4. 5. 6. 7.
DN0966621 Issue: 11-0
Connect to the blade through the serial or the Ethernet maintenance ports. Check the state of the ports. Verify that an IP address has been assigned to the node. Verify that an appropriate subnet mask is assigned to the node. Verify that the node is within a reachable VLAN. Verify that routing instructions do not prevent the communication. Check the SEL to verify that the node’s Ethernet backplane has been activated.
© 2017 Nokia
17
Hardware troubleshooting
Maintaining and Troubleshooting Hardware
1.2 Problem with SFP, SFP+ or XFP transceiver Description If an Ethernet connection is not working properly, there may be a fault in the SFP, SFP+ or XFP transceiver. Symptoms • •
Statistics reports show that data packets are lost or there is a high count of one type of data packet and the count climbs rapidly. One of the LEDs indicates that there may be an Ethernet link/port failure.
Recovery procedures 1. Check that the transceiver and optical cable are properly connected and the cable is not crimped. 2. Check the LEDs that indicate the status of the blade/AMC module to which the transceiver is attached. • • •
The power good LED is on. The hot-swap LED is off. The out-of-service LED is off.
If the LEDs show that the blade/AMC may be faulty, see the blade/AMC-specific troubleshooting instructions given in this document. 3. Check the status of the Ethernet ports and links. a) For correct LED behaviour, see the blade-specific user guides. b) For user interface commands, see the command reference manuals. 4. Check the transceiver information. 5. If the port and link status was correct, replace the transceiver at the other end of the link. 6. If the link is not recovered, replace the cable connecting the transceivers. 7. If the link still does not work, replace the transceiver at this end of the link.
1.3 Problem with shelf manager 1.3.1 Description A shelf manager is not functioning properly. Possible causes for the problem are: • • • • •
18
The embedded software in the hardware units is not consistent with the product release. The shelf manager is not properly seated in the shelf manager slot. One of the voltages is too high/low. One of the temperatures is too high. The DC converter is malfunctioning.
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
• • •
Hardware troubleshooting
The IP address of the shelf manager is incorrect. The shelf manager firmware is corrupted. There is a hardware fault in the shelf manager.
1.3.2 Symptoms The following symptoms may indicate a problem in the shelf manager: • •
g
The health LED/power good LED is not lit green or the out of service LED is lit. The hot swap LED is not lit when the hot swap latch has been opened or remains lit when the latch has been closed. Note: The ATCA hardware platform occasionally exhibits a certain IPMI O&M event asserted that is visible in System Event Log. The event is Voltage out of limit, generated from sensor I2C_PWR_A of shelf manager A (ASMGR-A, the left one in the shelf). The asserted event is followed immediately by the corresponding deasserted event.
1.3.3 Recovery procedures Note that in the case of 2N-redundant configuration, the same recovery procedures apply for both single unit failure, and the simultaneous malfunction of both redundant units.
1.3.3.1
The embedded software in the hardware units are not consistent with the product release First required actions before troubleshooting any software related problem: • •
Verify that the embedded software has correct versions in the hardware units according to the product release. Update the embedded software to the required versions if necessary.
For instruction, see embedded software checking and updating instructions.
1.3.3.2
The health LED/power good LED is not lit green or the out of service LED is lit 1. Make sure the shelf manager is seated properly. a) Remove the shelf manager as instructed in section Removing a shelf manager. b) Re-install the shelf manager as instructed in section Installing a shelf manager. 2. If the problem persists, replace the shelf manager with another one to make sure the shelf manager is functioning properly.
DN0966621 Issue: 11-0
© 2017 Nokia
19
Hardware troubleshooting
1.3.3.3
Maintaining and Troubleshooting Hardware
The hot swap LED is not lit when the hot swap latch has been pulled or remains lit when the latch has been closed 1. If the Hot Swap LED is not lit when you have pulled on the hot swap handle, try pulling the handle out again a little more firmly. 2. If the LED remains lit after you have inserted a shelf manager, try pulling the handle and pushing it back in. 3. The shelf manager firmware may be corrupted and you may need to upgrade the firmware.
20
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
2 Replacing hardware units 2.1 Replacing a blade Purpose If a blade is faulty, or it needs to be upgraded or serviced, you need to remove the blade from the shelf and install a new blade in its place.
t
Tip: When sending a faulty blade to Hardware Services (HWS) for a replacement or repair, remember to remove the memory modules, hard disk drive, AMC modules or SFP/SFP+/XFP transceivers, if any of these have been integrated in the blade.
w
NOTICE: For ACAR1-B, there must be AMC modules or fillers fitted in at least the two centermost AMC slots before it is removed. This ensures a smooth removal not scratching the gasket of a blade in adjacent slot. Before you start First make sure the fault is in the blade and not in the slot or in the shelf. Bring the new blade in its inner package close to the shelf, and place it on an ESDprotected surface.
w
NOTICE: Electrostatic discharge (ESD) may damage hardware components. To avoid ESD damage: • •
Before handling hardware units, check that the site is an ESD-protected area (EPA). If the area is not ESD-protected, create a temporary EPA. When handling hardware units, wear an ESD wrist strap or use a corresponding protection method, and do not touch the connector surfaces.
When removing a blade from the shelf permanently or for a longer period of time, you must install a filler blade in its place. This is to ensure adequate cooling airflow and proper EMC shield in the shelf.
t
DN0966621 Issue: 11-0
Tip: When removing or installing a blade, it is not necessary to remove the AMCs equipped on the blade or the corresponding RTM. But before removing a blade or RTM with AMCs residing on it, the AMCs must be shut down and all the cables connected to the AMCs must be disconnected first.
© 2017 Nokia
21
Replacing hardware units
Maintaining and Troubleshooting Hardware
2.1.1 Removing a blade from the shelf Procedure 1
Unscrew the two retaining screws at the top and bottom of the blade's front panel.
2
Gently open the lower ejector latch (hot swap handle) so that the blue hot swap LED starts blinking.
g
Note: Do not open the latch all the way yet. Opening the latch notifies the hardware management system that you are going to remove the blade and tells it to finish all processes. The hot swap LED starts blinking.
3
Wait until the hot swap LED turns into a steady blue. This may take a few seconds.
4
Disconnect the cables, if any, from the blade.
5
Open both ejector latches.
6
Unseat the blade.
7
Gently slide the blade out of the slot and place it on an ESD-protected surface. Figure 1
22
Removing a blade
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
8
Replacing hardware units
If you are not going to replace the blade with a new one immediately, install a filler blade in the empty slot. This is to ensure adequate cooling and proper EMC shield in the shelf.
9
Remove the memory modules, hard disk drive, AMC modules and SFP/SFP+/XFP transceivers, if any of these have been installed in the blade.
2.1.2 Installing a blade Before you start For the new AHUB3-B and AHUB4-A blades to be installed, make sure that the fourth jumper on the DIP switch is set to ON. For more information on the jumper settings, see the corresponding hub blade user guides. Procedure 1
If the memory module is missing, then install it and verify that the memory module configuration meets the network element requirements. For more information, please refer to Replacing memory modules chapter of the relevant blade.
DN0966621 Issue: 11-0
© 2017 Nokia
23
Replacing hardware units
Maintaining and Troubleshooting Hardware
2
Determine the slot in which to install the blade.
3
Check that the EMC gasket is correctly in place and that its contacts are clean.
4
Open both ejector latches by turning them outwards.
5
Hold the blade from the ejector latches and slide it into the shelf along the guide rails. Figure 2
g
Installing a blade
Note: Carefully support the blade or RTM during installation. Do not pull or push the blade from the ejector latches.
6
When the ejector latches reach the latch rail on the shelf, close both latches at the same time by turning the latches inwards toward the center of the front panel.
7
Wait until the blue hot swap LED turns off and the power LED turns solid green.
8
Tighten the retaining screws at the top and bottom of the front panel.
9
Connect the cables, if any, to the blade.
10 Verify that the embedded software in the hardware units and the BIOS information in the CPU units are consistent with the product release, and
24
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
update if necessary. See a document that describes embedded software management for details. Post requisites
g
Note: If you are replacing an AMPP1-A blade, follow the steps below to clear the fastpath configuration: 1. Connect to the blade through the serial port. 2. Enter the following command: rm/etc/fastpath/fastpath.cfg 3. Restart the blade.
2.2 Replacing a CPU blade (ACPI4-A or ACPI4-B) Purpose The following example shows how to replace an ACPI4-A or ACPI4-B blade with one of the same type in the active OMU.
g
Note: When replacing the ACPI4-A or ACPI4-B of an OMU, all updates to the unit’s hard disk must be prevented to ensure that no data is lost during the time when the unit is out of use. If there are updates left pending during this time, they are buffered, and pushed to the disk when the disk updates are enabled again. With other units, the disk updates are not blocked. ACPI4-A and ACPI4-B is used also for IPDU in those configurations where the IP director unit is included. In a failure situation, there is an automatic switchover from the active to the standby unit. During the short time when the standby unit is being activated, there may be a momentary traffic breakdown, and some data packets may be lost, but otherwise the traffic handling continues normally. After replacing a CPU blade, the BIOS settings of the new blade should be checked. For instructions on how to check BIOS settings of CPU blades, see Commissioning document. Before you start Check first that the fault is in the blade and not in the slot or in the shelf. For instructions, see chapter Hardware troubleshooting. Bring the new blade in its inner package close to the shelf, and place it on an ESDprotected surface. When removing a blade from the shelf permanently or for a longer period of time, you must install a filler blade in its place. This is to ensure adequate cooling airflow and proper EMC shield in the shelf.
DN0966621 Issue: 11-0
© 2017 Nokia
25
Replacing hardware units
w
Maintaining and Troubleshooting Hardware
NOTICE: Electrostatic discharge (ESD) may damage hardware components. To avoid ESD damage: • •
Before handling hardware units, check that the site is an ESD-protected area (EPA). If the area is not ESD-protected, create a temporary EPA. When handling hardware units, wear an ESD wrist strap or use a corresponding protection method, and do not touch the connector surfaces.
Procedure 1
Disable disk updates. a) Copy the data files from OMU to the disks.
g
Note: This is done only when replacing the OMU hardware.
ZDFC:OMU,0; b) Copy the databases from memory to the disks. With command DBL, you can check which databases are used by the unit.
ZDBC:EQUIPM,0:; ZDBC:ILDATA,0:; ... ... c) Prevent file updates to the disk. ZDUP:OMU:; d) Prevent database file updates to the disk. ZDBP:EQUIPM,0:DISK; ZDBP:ILDATA,0:DISK; e) Change the state of the HDD into BL-US. ZISC:,OMU:WDU,0:WO-ID; ZISC:,OMU:WDU,0:BL-US;
2
Change the state of the unit into SE-NH.
ZUSC:OMU,0:SP; ZUSC:OMU,0:TE; ZUSC:OMU,0:SE; ZUSC:OMU,0:SE;
3
Remove a blade from the shelf. See Removing a blade from the shelf.
4
Install a blade. See Installing a blade.
26
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
5
Replacing hardware units
Check the BIOS settings of the new blade. For details, see Commissioning document.
6
Change the working state of the unit into TE-EX.
ZUSC:OMU,0:SE; ZUSC:OMU,0:TE;
7
g
Check the HPM.1 version of the blade. Note: Check whether the soft versions are consistent. If they are consistant, no upgrade is required. If they are inconsistent, an upgrade is needed.
ZWDN:UT=OMU,UI=0; LOADING PROGRAM VERSION 13.53-0 EXECUTION STARTED 1 VALID PLUG-IN UNITS FOUND EXECUTION STARTED AT 2015-05-05 05:30:47 50% DONE, PLEASE WAIT 0 H, 14 MIN AND 49 SEC 100% DONE, PLEASE WAIT 0 H, 0 MIN AND 0 SEC FUNCTIONAL PLUG-IN UNIT VERSION UNIT TYPE INDEX CURRENT -> AFTER UPDATE ----------- ------------- -------------------------------OMU-0 ACPI4_B-0 acpi4-b_kn_ipmc_05.52.6094 -> ---current version acpi4-b_kn_ipmc_05.52.6094 R_ABESW_1436 disk version acpi4-b_kn_ipmc_05.52.6094 -> backup version acpi4-b_kn_ipmc_05.52.6094 R_ABESW_1436 disk version acpi4-b_kn_bios_04.02.0000 -> acpi4-b_kn_bios_04.02.0000 R_ABESW_1436 acpi4-b_kn_bios_04.02.0000 -> acpi4-b_kn_bios_04.02.0000 R_ABESW_1436 acpi4-b_kn_fpga_05.02.0000 -> acpi4-b_kn_fpga_05.02.0000 R_ABESW_1436
-------
COMMAND EXECUTED
As displayed in the example above, an upgrade is not needed. Because the current SW version is consistent with the disk version.
DN0966621 Issue: 11-0
© 2017 Nokia
27
Replacing hardware units
8
g
Maintaining and Troubleshooting Hardware
Update the HPM.1 version, if needed. Note: This must be done by experienced personnel who have sufficient knowledge of the system. Follow the instructions given in the command reference manual. This command updates the IPMI, FPGA and BIOS.
ZWDO:UT=OMU,UI=0,PT=ACPI4_A,PI=0;
9
g
Check the version of the FRU data package. Note:
ZWDP:UT=OMU,UI=0;
10 Replace the FRU package, if needed.
g
Note: Check whether the soft versions are consistent. If they are consistant, no upgrade is required. If they are inconsistent, an upgrade is needed. This must be done by experienced personnel who have sufficient knowledge of the system. Follow the instructions given in the command reference manual. Example:
ZWDQ:UT=OMU,UI=0,PT=ACPI4_A,PI=0; LOADING PROGRAM VERSION 13.53-0 EXECUTION STARTED 1 VALID PLUG-IN UNITS FOUND EXECUTION STARTED AT 2015-05-05 05:38:42 33% DONE, PLEASE WAIT 0 H, 14 MIN AND 57 SEC 66% DONE, PLEASE WAIT 0 H, 14 MIN AND 55 SEC 100% DONE, PLEASE WAIT 0 H, 0 MIN AND 0 SEC FUNCTIONAL PLUG-IN UNIT VERSION UNIT TYPE INDEX CURRENT -> AFTER UPDATE ----------- ------------- -------------------------------OMU-0 ACPI4_B-0 acpi4-b_kn_frud_03.10.0000 -> ---current version acpi4-b_kn_frud_03.12.0000 RABESW3_1429 --disk version COMMAND EXECUTED
EMBEDDED SOFTWARE HANDLING COMMAND <WD_>
As displayed in the example above, an upgrade is needed. Because the current SW version is inconsistent with the disk version.
28
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
11 Run diagnostics on the unit.
ZUDU:OMU,0;
12 Check the diagnostics report.
ZUDH:OMU,0;
13 Change the working state of the WDU. If the diagnostics report shows that the unit is healthy, change the state of the HDD into WO-BU.
ZISC:,OMU:WDU,0:WO-ID; ZISC:,OMU:WDU,0:WO-BU;
14 Enable disk updates. a) Enable file updates to the disk.
g
Note: This is done only when replacing the OMU hardware.
ZDUR:OMU; b) Enable database file updates to the disk.
ZDBR:EQUIPM,0:DISK; ZDBR:ILDATA,0:DISK; ... ...
15 Change the working state of the OMU.
ZUSC:OMU,0:SP; ZUSC:OMU,0:WO;
16 Check that there are no alarms active.
ZAHO:OMU;
2.3 Replacing a CPU blade (ACPI5-A) Purpose The following example shows how to replace an ACPI5-A blade with one of the same type in the active CHU.
DN0966621 Issue: 11-0
© 2017 Nokia
29
Replacing hardware units
g
Maintaining and Troubleshooting Hardware
Note: For other units, the disk updates are not blocked. ACPI5-A is also used for IPDU in those configurations where the IP director unit is included. In case of failure, there is an automatic switchover from the active unit to the standby unit. During the short time when the standby unit is being activated, there may be a momentary traffic breakdown, and some data packets might be lost, otherwise the traffic handling continues normally. After replacing a CPU blade, the BIOS settings of the new blade must be checked. For instructions on how to check BIOS settings of CPU blades, see Commissioning document. Before you start Check if there is a fault in the blade, see Commissioning document. Place the new blade on an ESD-protected surface in its inner package close to the shelf. When removing a blade from the shelf permanently or for a longer period of time, you must install a filler blade in its place to ensure an adequate cooling airflow and a proper EMC shield in the shelf.
w
NOTICE: Electrostatic discharge (ESD) might damage hardware components. To avoid ESD damage: • •
Before handling hardware units, check that the site is an ESD-protected area (EPA). If the area is not ESD-protected, create a temporary EPA. When handling hardware units, wear an ESD wrist strap or use a corresponding protection method, and do not touch the connector surfaces.
Procedure 1
Change HDD state to BL-US if corresponding CPRT5-A is installed with HDD.
ZISC:,CHU:WDU,0:WO-ID; ZISC:,CHU:WDU,0:BL-US;
2
Change the unit state to SE-NH. Table 1
steps for changing unit state to SE-NH Unit Type
Native unit (IPDU for example)
Steps •
g
Note: When the IPDU is in WO-EX state, execute the following steps. If it is in SP-EX state, ignore the first step and execute the other steps.
ZUSC:IPDU,0:SP;
30
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Table 1
Replacing hardware units
steps for changing unit state to SE-NH (Cont.) Unit Type
Steps • • •
virtualized (into several child units) VMU (CHU for example)
ZUSC:IPDU,0:TE; ZUSC:IPDU,0:SE; ZUSC:IPDU,0:SE;
a) Check the slot of the CHU. Get the master and the module number of the related VMU.
ZWTI:P:CHU; b) Check all child units in the VMU.
ZUSI:VMU,index; c) Change all related child units to SENH. •
• • •
g
Note: When the child unit is in WO-EX state, execute the following steps. If it is in SP-EX state, ignore the first step and execute the other steps.
ZUSC:child index:SP; ZUSC:child index:TE; ZUSC:child index:SE; ZUSC:child index:SE;
unit,child unit unit,child unit unit,child unit unit,child unit
d) Change the VMU to SE-NH. • • • •
3
ZUSC:VMU,index:BL; ZUSC:VMU,index:TE; ZUSC:VMU,index:SE; ZUSC:VMU,index:SE;
Remove a blade from the shelf. See Removing a blade from the shelf.
4
Install a blade. See Installing a blade.
DN0966621 Issue: 11-0
© 2017 Nokia
31
Replacing hardware units
5
Maintaining and Troubleshooting Hardware
Check the BIOS settings of the new blade. For instructions, see Commissioning document.
6
Change the working state of the unit to TE-EX. Table 2
steps for changing unit state to TE Unit type
Steps
Native unit (IPDU for example)
ZUSC:IPDU,0:SE; ZUSC:IPDU,0:TE;
• •
virtualized (into several child units) VMU (CHU for example)
ZUSC:VMU,index:SE; ZUSC:VMU,index:TE;
• •
g 7
g
Note: The state of the child unit is changed automatically.
Check the HPM.1 version of the blade. Note: Check whether the soft versions are consistent. If they are consistent, no upgrade is required. If they are inconsistent, an upgrade is needed.
ZD8I:D8I:UT=VMU,UI=index::ALL; D8I:UT=VMU,UI=12::ALL; LOADING PROGRAM VERSION 1.22-0 EXECUTION STARTED
MSCi
MSS06
UNIT -----------VMU-12
2016-12-13
PIU TYPE -------ACPI5_A
ESW -----IPMC BIOS FPGA
STATUS -----OK OK OK
09:48:17
ACTIVE -----------02.02.0004 01.05.0009 10.00.0000
BACKUP -----------02.02.0004 01.05.0009 10.00.0000
[ALL] TOTAL 1 UNIT(S) FOUND, 1 SUCCESS, 0 FAILED DISK VERSIONS: ACPI5_A
IPMC BIOS FPGA
02.02.0004 01.05.0009 10.00.0000
COMMAND EXECUTED
32
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
As displayed in the example, an upgrade is needed because the current IPMC versions (active and backup) are inconsistent with the disk IPMC version. And the BIOS version is also different. 8
g
Update the HPM.1 version if needed. Note: Update must be performed by an experienced person who has sufficient knowledge of the system. For instructions, see command reference. a) Update the HPM.1 version.
ZD8U:UT=VMU,UI=index,PT=ACPI5_A; b) Check the embedded software uploading status until uploading is complete.
ZD8S:FUL; c) Check the embedded software that has not been activated yet (optional).
ZD8I:UT=VMU,UI=index::UNACT:; d) Activate the new embedded software in the backup flash bank after the uploading has finished.
ZD8A:UT=VMU,UI=index,ST=NON-WO,:; For more information on HPM.1, see Updating Embedded Software document.
9
g
Check the version of the FRU data package. Note: Check whether the soft versions are consistent. If they are consistent, no upgrade is required. If they are inconsistent, an upgrade is needed.
ZWDP:UT=VMU,UI=index; EXECUTION STARTED 1 VALID PLUG-IN UNITS FOUND EXECUTION STARTED AT 2015-05-04 15:01:22 100% DONE, PLEASE WAIT 0 H, 0 MIN AND 0 SEC FUNCTIONAL PLUG-IN UNIT VERSION UNIT TYPE INDEX CURRENT -> AFTER UPDATE ----------- ------------- -------------------------------VMU-8 ACPI5_A-1 acpi5-a_em_frud_02.01.0027 -> ---current version acpi5-a_em_frud_02.01.0027 RABESW_1431 ---disk version
As displayed in the example, an upgrade is not needed because the current version is consistent with the disk version.
10 Replace the FRU package if needed.
g
DN0966621 Issue: 11-0
Note: Update must be performed by an experienced person who has sufficient knowledge of the system. For instructions, see command reference.
© 2017 Nokia
33
Replacing hardware units
Maintaining and Troubleshooting Hardware
Example:
ZWDQ:UT=VMU,UI=index,PT=ACPI5_A,PI=0; 11 Run the diagnostic on the unit.
ZUDU:VMU,index;
12 Check the diagnostic report.
ZUDH:VMU,index;
13 Change the working state of the WDU if corresponding CPRT5-A is installed with HDD. If the diagnostic report shows that the unit is healthy, change the state of the HDD to WO-BU.
ZISC:,CHU:WDU,0:WO-ID; ZISC:,CHU:WDU,0:WO-BU;
14 Change the unit state to WO-EX . Table 3
steps for changing unit state to WO-EX Unit type
Steps
Native unit (IPDU for example)
ZUSC:IPDU,0:SP;
virtualized (into several child units) VMU (CHU for example)
ZUSC:VMU,index:WO;
g
Note: The state of the child unit is changed automatically.
15 Check that there are no active alarms.
ZAHO:VMU,index;
2.4 Replacing a hub blade (AHUB3-A or AHUB3-B) Purpose The following example shows how to replace a hub blade in the active EMB (basic interface) or CNW (fabric interface).
34
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
The hub blade includes a configuration file of the CNW and of the EMB. When the blade is replaced with one of the same type, the configuration file can be stored to the OMU disk file before it is removed. From the OMU disk, the file is loaded back to the new switch after the old blade has been replaced. If the blade is replaced with a different type (for example, a newer blade variant), the configuration file of the old blade cannot be used. In this case, the default configuration is loaded to the new blade from the software build after the blade has been replaced. Before you start Check first the fault is in the blade and not in the slot or in the shelf. For instructions, see chapter Hardware troubleshooting. Bring the new blade in its inner package close to the shelf, and place it on an ESDprotected surface.
g
Note: Electrostatic discharge (ESD) may damage hardware components. To avoid ESD damage: Before handling hardware units, check that the site is an ESD-protected area (EPA). If the area is not ESD-protected, create a temporary EPA. When handling hardware units, wear an ESD wrist strap or use a corresponding protection method, and do not touch the connector surfaces.
• •
Procedure 1
Download the configuration file from the switch. Load the configuration file of the switch to the OMU disk.
ZYFM:DCF:SWU,0;
2
Change the state of the units into SE-NH. •
•
3
The EMB:
ZUSC:EMB,0:SP; ZUSC:EMB,0:TE; ZUSC:EMB,0:SE; ZUSC:EMB,0:SE; The CNW: ZUSC:CNW,0:TE; ZUSC:CNW,0:SE; ZUSC:CNW,0:SE;
Check bond0 switchover if needed. In function units, if interfaces EL0 and EL1 are configured to bond0, use the following command to check bond0 switchover. EL0 and ELI should have been switched over after the CNW state change in step 2. ZQRI;
DN0966621 Issue: 11-0
© 2017 Nokia
35
Replacing hardware units
Maintaining and Troubleshooting Hardware
From the printouts, you can see that the Ethernet interface assigned with an IP address is the active interface. If the switchover fails, use the following commands to manually switch over the interfaces for bond0: ZQRW:GISU,14::BOND0; ZQRW:GISU,14::EL0;
In this example, EL1 interface is now the active interface. 4
Remove a blade from the shelf. See Removing a blade from the shelf.
5
Install a blade. See Installing a blade.
6
Change the state of the switch into SE-OU;
ZUSC:EMB,0:SE; ZUSC:CNW,0:SE;
7
Change the state of the switch into TE-EX.
ZUSC:EMB,0:TE; ZUSC:CNW,0:TE;
8
Check the connection between the OMU and the HUB.
ZW6T:SWU,0;
g
Note: If the connection is broken, see section Blade does not answer to ping.
9
Check the eSW versions. Sub-steps a) Check the FRU version.
ZWDP:UT=SWU,UI=0;
36
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
b) Check the IPMI version and the UCSW version. •
Use one D8 command to check the IPMI and the UCSW versions at the same time. ZD8I:UT=SWU,UI=0:ALL:ALL;
•
If ZD8I does not support SWU, use the following commands to check the IPMI and the UCSW versions seperately. 1. Check the IPMI version. ZWDD:UT=SWU,UI=0,;
2. Check the UCSW version. ZUSC:SWU,0:SE; ZYFM:ISW:SWU,0;
g
Note: For the UCSW version used in the network element, see the Release Note. An upgrade of eSW is needed when one of the following conditions is met: • • •
The FRU version in the new switch is inconsistent with the disk version. The IPMI version in the new switch is inconsistent with the disk version. The UCSW software in the new switch is older than the one in the network element.
See section Updating embedded software of an AHUB3-A/B blade of the Updating Embedded Software document for upgrade instructions.
10 Upload configuration file to LAN switch.
g
Note: This step is only required when the configuration file is not uploaded in any previous steps.
ZYFM:UCF:SWU,0; ZYFM:UCF:SWU,60;
11 Reconfigure the time zone settings. See section Opening the first MML session via Telnet of the Commissioning document.
12 Run diagnostics on the unit.
g
DN0966621 Issue: 11-0
Note: Change the units to TE state with the ZUSC command before running diagnostics if needed.
© 2017 Nokia
37
Replacing hardware units
Maintaining and Troubleshooting Hardware
ZUDU:EMB,0; Or
ZUDU:CNW,0; 13 Check the diagnostics report.
ZUDH:EMB,0; And
ZUDH:CNW,0;
14 Change the working state of the unit. If the diagnostic report shows that the unit is healthy, change its state into WO-EX. The EMB:
•
ZUSC:EMB,0:SP; ZUSC:EMB,0:WO; The CNW: ZUSC:CNW,0:WO;
•
15 Check that the switch supervision is functioning.
ZYFF;
2.5 Replacing memory modules on the ACPI4-A or ACPI4-B blade You may need to change the memory configuration of the ACPI4-A or ACPI4-B blade or replace a faulty memory module. For a description of supported memory configurations, see the section Memory modules in the blade-specific user guide. Before you start The value in data byte 3 of IPMI sensor #70 "Memory/PICMG Front Board" indicates the ID of the faulty memory module. The following table can be used to identify its location on the ACPI4 blade. Table 4
ID of faulty memory module
Description
38
Value in data 3
Socket naming
Channel 0, DIMM 0
1
J14
Channel 0, DIMM 1
2
J13
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Table 4
Replacing hardware units
ID of faulty memory module (Cont.)
Description
Value in data 3
Socket naming
Channel 1, DIMM 0
3
J16
Channel 1, DIMM 1
4
J15
Channel 2, DIMM 0
5
J18
Channel 2, DIMM 1
6
J17
In the ACPI4-A blade, memory slots J14, J16 and J18 can be used. In the ACPI4-B blade, all memory slots (J13, J14, J15, J16, J17 and J18) can be used.
2.5.1 Removing a memory module Procedure 1
Remove the blade from the shelf. For instructions, see Replacing a blade.
2
Place the blade on an anti-static surface so that you are facing the front plate connectors.
3
Remove the cover plate which protects the memory modules.
4
5
To release the memory module, push the retaining clips on each side of the socket sideways.
Pull out the memory module from the socket.
2.5.2 Installing a memory module Procedure 1
DN0966621 Issue: 11-0
Insert the new memory module into the socket.
© 2017 Nokia
39
Replacing hardware units
Maintaining and Troubleshooting Hardware
Align the notches on the module with the socket’s key inserts. 2
g
Push down the memory module gently but firmly until it is properly seated and the retaining clips lock on each side. Note: Memory modules must be correctly installed in their sockets, for the blade to function properly.
3
Install the cover plate that protects the memory modules and fasten it with screws. Figure 3
Memory modules on ACPI4-A
J13 J14 J15 J16 J17 J18
Channel Channel Channel 0 1 2 DN0945381
2.6 Replacing memory modules on the ACPI5-A blade Purpose You might need to change the memory configurations on the ACPI5-A blade or replace a faulty memory module. For a description of supported memory configurations, see the section about memory modules in the ACPI5-A and CPRT5-A user guide. ACPI5-A memory modules
40
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
The ACPI5-A has eight 240 pin, straight-up sockets for DIMM memory modules and can be equipped with up to 128GB DDR3 SDRAM. The table below shows the DIMM memory modules that are approved for ACPI5-A. Table 5
Approved ACPI5-A DIMM memory module types
Type
Size
MRB3L04
4 GB
MRB3L08
8 GB
MRB3L16
16 GB
Memory configuration rules The following memory configurations are recommended for ACPI5-A. In addition, other memory configurations are also possible. Table 6
Recommended memory configurations
Total memory
Configuration
Populated DIMM slots
32 GB
8 x 4 GB
All
64 GB
8 x 8 GB
All
128 GB
8 x 16GB
All
g
Note: The memory slots are illustrated in the figure 4. All DIMM memory slots must always be installed in the ACPI5-A. To avoid thermal and compatibility issues, only Nokia approved memory modules must be used. Other memory configurations are possible from technical perspective, but any asymmetric configurations (not all slots installed or mixing different size of DIMMs) would slower the performance. Thus other configurations are not accepted. The combined use of 4/8/16G DIMMs in one ACPI5-A blade is not allowed.
2.6.1 Removing a memory module Procedure
g
1
DN0966621 Issue: 11-0
Note: Perform this operation only when replacing the CPU blade that related CPRT5-A is installed with HDD. Take the CHU unit as an example.
© 2017 Nokia
41
Replacing hardware units
Maintaining and Troubleshooting Hardware
Change the state of the HDD into BL-US.
ZISC:,CHU:WDU,0:WO-ID; ZISC:,CHU:WDU,0:BL-US; 2
Change the state of the unit into SE-NH. Table 7
Steps for changing the related unit state into SE-NH Unit Type
Steps
Native unit (IPDU for example)
•
• • •
virtualized (into several child units) VMU (CHU for example)
g
Note: When the IPDU is WO-EX state, execute the following steps. If it is SPEX state, ignore the first step and execute the other steps.
ZUSC:IPDU,0:SP; ZUSC:IPDU,0:TE; ZUSC:IPDU,0:SE; ZUSC:IPDU,0:SE;
a) Check the slot of the CHU. Get the master and the module number of the related VMU.
ZWTI:P:CHU; b) Check all child units in the related VMU.
ZUSI:VMU,index; c) Change all child units into SE-NH. •
• • •
g
Note: When the child unit is WOEX state, execute the following steps. If it is SP-EX state, ignore the first step and execute the other steps.
ZUSC:child index:SP; ZUSC:child index:TE; ZUSC:child index:SE; ZUSC:child index:SE;
unit,child unit unit,child unit unit,child unit unit,child unit
d) Change the VMU to SE-NH. • •
42
© 2017 Nokia
ZUSC:VMU,index:BL; ZUSC:VMU,index:TE;
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Table 7
Replacing hardware units
Steps for changing the related unit state into SE-NH (Cont.) Unit Type
Steps • •
3
ZUSC:VMU,index:SE; ZUSC:VMU,index:SE;
Hot swap the blade and remove it from the shelf. a) Unscrew the two retaining screws from the top and bottom of the front panel. b) Gently open the ejector latches (hot swap handle), and the blue hot swap LED starts blinking. c) Wait until the hot swap LED turns into steady blue. d) Remove the blade from the shelf.
DN0966621 Issue: 11-0
© 2017 Nokia
43
Replacing hardware units
Maintaining and Troubleshooting Hardware
Figure 4
The Hot Swap LED on the ACPI5-A Reset Reset
SER
SER
OutofServiceLED InServiceLED SFP0
SFP0 SFP1
APP
APP LED SFP1
U1/U2/U3LEDs 2xUSB U1 U2 U3
HotSwapLED
DN09105793
For instructions, see Replacing a blade.
44
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
4
Place the blade on an anti-static surface so that you are facing the front plate connectors.
5
To release the memory module, push the retaining clips on each side of the socket sideways. The memory module is automatically lifted up.
6
Pull out the memory module from the socket.
2.6.2 Installing a memory module Procedure 1
Insert the new memory module into the socket. Align the notches on the module with the socket’s key inserts.
2
g
Push down the memory module gently but firmly until it is properly seated and the retaining clips lock on each side automatically. Note: Memory modules must be correctly installed in their sockets, for the blade to function properly. Figure 5
Removing and installing a memory module on ACPI5-A
DN09105887
3
Put the blade into the shelf properly. a) Put the blade into the shelf and close the ejector latches. b) Wait until the blue hot swap LED is on, then blinking and finally off.
DN0966621 Issue: 11-0
© 2017 Nokia
45
Replacing hardware units
Maintaining and Troubleshooting Hardware
c) Tighten the screws.
4
Change the working state of the unit into TE-EX. Table 8
Steps for changing the related unit state into TE Unit type
Native unit (IPDU for example)
Steps • •
virtualized (into several child units) VMU (CHU for example)
• •
ZUSC:IPDU,0:SE; ZUSC:IPDU,0:TE; ZUSC:VMU,index:SE; ZUSC:VMU,index:TE;
g 5
Note: The state of the child unit is changed automatically.
Run the diagnostic on the unit.
ZUDU:VMU,index;
6
Check the diagnostic report.
ZUDH:VMU,index;
g
7 Note: Perform this operation only when replacing the CPU blade that related CPRT5-A is installed with HDD. Take the CHU unit as an example. Change the working state of the WDU. If the diagnostic report shows that the unit is healthy, change the state of the HDD into WO-BU.
ZISC:,CHU:WDU,0:WO-ID; ZISC:,CHU:WDU,0:WO-BU;
8
Change the unit into WO-EX state. Table 9
Steps for changing the related unit state into WO-EX Steps
Unit type Native unit (IPDU for example)
46
© 2017 Nokia
ZUSC:IPDU,0:SP;
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Table 9
Replacing hardware units
Steps for changing the related unit state into WO-EX (Cont.) Steps
Unit type virtualized (into several child units) VMU (CHU for example)
9
ZUSC:VMU,index:WO;
g
Note: The state of the child unit is changed automatically.
Check that there are no active alarms.
ZAHO:CHU; ZAHO:VMU,index;
2.7 Replacing a rear transition module Purpose If a rear transition module (RTM) is faulty, or it needs to be upgraded or serviced, you need to remove it from the shelf and install a new RTM in its place.
t
Tip: When sending a faulty RTM to Hardware Services (HWS) for a replacement or repair, remember to remove the hard disk drive or SFP/SFP+/XFP transceivers, if any of these have been integrated in the RTM. Before you start Before replacing a faulty RTM, make sure that the corresponding blade is functioning properly and that the fault is in the RTM and not in the slot or the shelf. For troubleshooting instructions, refer to section Problem with a blade, RTM or AMC.
w
NOTICE: Electrostatic discharge (ESD) may damage hardware components. To avoid ESD damage: • •
Before handling hardware units, check that the site is an ESD-protected area (EPA). If the area is not ESD-protected, create a temporary EPA. When handling hardware units, wear an ESD wrist strap or use a corresponding protection method, and do not touch the connector surfaces.
If applicable, bring the new RTM in its inner package close to the shelf to an ESDprotected surface. When permanently removing an RTM from the slot, install an RTM filler in its place.
DN0966621 Issue: 11-0
© 2017 Nokia
47
Replacing hardware units
Maintaining and Troubleshooting Hardware
Procedure 1
Change the state of the unit into SE-NH. When replacing the CPRT4-A RTM for an OMU unit, change the state of the OMU unit, for example:
ZUSC:OMU,0:SP; ZUSC:OMU,0:TE; ZUSC:OMU,0:SE; ZUSC:OMU,0:SE; When replacing the CPRT4-B RTM for an IPDU unit, change the state of the IPDU unit, for example:
ZUSC:IPDU,0:SP; ZUSC:IPDU,0:TE; ZUSC:IPDU,0:SE; ZUSC:IPDU,0:SE; When replacing the HBRT3-A RTM for an SWU unit, change the state of the SWU unit, for example:
ZUSC:SWU,0:TE; ZUSC:SWU,0:SE; ZUSC:SWU,0:SE; When replacing the CPRT5-A RTM for a VMU unit, change the state of the VMU unit, for example:
ZUSC:VMU,0:BL; ZUSC:VMU,0:TE; ZUSC:VMU,0:SE; ZUSC:VMU,0:SE;
g
Note: After changing the VMU unit state, the state of all child units on this VMU is changed to SE-NH.
2
Remove a rear transition module from the shelf. a) Unscrew the two retaining screws from the top and bottom of the front panel. b) Gently open the lower ejector latch (hot swap handle) so that the blue hot swap LED starts blinking. Do not open the latch all the way yet. Opening the latch notifies the hardware management system that you are going to remove the blade and tells it to finish all processes. The hot swap LED starts blinking. c) Wait until the hot swap LED turns into a steady blue. This may take a few seconds. d) Disconnect the cables, if any, from the RTM. e) Open both ejector latches.
48
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
f)
Unseat the RTM by turning both ejector latches gently toward the center of the RTM front panel. g) Gently slide the RTM out of the slot and place it on an ESD-protected surface. Figure 6
Removing the RTM
1 2
Alternative A
3
AlternativeB 1. Pushin 1.Lift 2. Pullout
2. Pullout
DN0960584
h) If you are not going to replace the RTM with a new one immediately, install an RTM filler in the empty slot. This is to ensure adequate cooling and proper EMC shield in the shelf.
3
Install a rear transition module. a) Determine the slot in which to install the RTM. Make sure that the corresponding blade is functioning properly and that you are installing the RTM to the correct slot in reference to the blade. Check the switch settings, if there are any. b) Check that the EMC gasket is correctly in place and that its contacts are clean. c) Open both ejector latches by turning them outwards, into a horizontal position. d) Insert the RTM into the shelf.
DN0966621 Issue: 11-0
© 2017 Nokia
49
Replacing hardware units
Maintaining and Troubleshooting Hardware
Figure 7
Installing the RTM
1
2
DN0960518
Carefully support the RTM during installation. Do not pull or push the RTM from the ejector latches. e) When the ejector latches reach the latch rail on the shelf, close both latches at the same time by turning them inwards toward the center of the RTM front panel. f) Wait until the blue hot swap LED turns off and the power LED turns solid green. g) Connect the cables, if any, to the RTM. h) Verify that the embedded software in the hardware units is consistent with the product release, and update it if needed. See a document that describes embedded software management for details.
4
Change the state of the unit into TE-EX. After replacing the CPRT4-A RTM for an OMU unit, change the state of the OMU unit, for example:
ZUSC:OMU,0:SE; ZUSC:OMU,0:TE; After replacing the CPRT4-B RTM for an IPDU unit, change the state of the IPDU unit, for example:
ZUSC:IPDU,0:SE; ZUSC:IPDU,0:TE; After replacing the HBRT3-A RTM for an SWU unit, change the state of the SWU unit, for example:
ZUSC:SWU,0:SE; ZUSC:SWU,0:TE; After replacing the CPRT5-A RTM for a VMU unit, change the state of the VMU unit, for example:
ZUSC:VMU,0:SE; ZUSC:VMU,0:TE;
50
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
g
Replacing hardware units
Note: Upon command execution, the VMU unit restarts along with all its child units. After the restart, the state of the VMU unit is changed to TE-EX.
5
Change the state of VMU into WO-EX.
ZUSC:VMU,0:WO;
g
Note: Upon command execution, the VMU unit restarts along with all its child units. After the restart, the state of the VMU unit is changed to WO-EX. The child units of the VMU unit, however, resume their initial state ( for example SP-EX or WO-EX).
2.8 Replacing the hard disk drive on CPRT4-A Purpose Units that store or process large amounts of data can be equipped with a hard disk. OMU always has one hard disk for the active unit and one for the spare unit. The hard disks are located on the rear transition module (CPRT4-A) of the CPU and shared between the active and spare unit so that each unit has access to its own and the other’s hard disk. In addition to replacement due to fault or upgrade, the HDD should be replaced every six years due to wear and tear. Six years is counted from the HDD's equipping date. RTMs delivered from the factory do not have ready-installed hard disks. If you are only replacing the RTM and the hard disk is not faulty, remove the hard disk drive and install it on the new RTM. If you have to replace a faulty hard disk with a new one, the new hard disk has to be initialized.
g
Note: OMU boots from the hard disk by default. Therefore, when replacing the hard disk, updates to the disk must be prevented to ensure that data is not lost during the time when the unit is out of use. If there are updates left pending during this time, they are buffered, and pushed to the disk later when the disk updates are enabled again. The following example shows how to replace the hard disk of an active OMU. The procedure applies also to other units which have a hard disk, except that the disk blocking is only done when replacing the OMU hardware. Before you start Check first that the fault is in the hard disk and not in the RTM or CPU. For troubleshooting instructions, see chapter Hardware troubleshooting.
DN0966621 Issue: 11-0
© 2017 Nokia
51
Replacing hardware units
w
Maintaining and Troubleshooting Hardware
NOTICE: Electrostatic discharge (ESD) may damage hardware components. To avoid ESD damage: • •
Before handling hardware units, check that the site is an ESD-protected area (EPA). If the area is not ESD-protected, create a temporary EPA. When handling hardware units, wear an ESD wrist strap or use a corresponding protection method, and do not touch the connector surfaces.
Procedure 1
Check the state of the hard disk.
ZISI:,OMU:WDU;
2
Prevent disk updates. a) Prevent file updates to the disk.
g
Note: This is done only when replacing the OMU hardware.
ZDUP:OMU; b) Prevent database file updates to the disk. With the command DBL, you can check which databases are used by the unit. For example: ZDBP:EQUIPM,0:DISK; ZDBP:ILDATA,0:DISK; c) Change the state of the HDD into BL-US. ZISC:,OMU:WDU,0:WO-ID; ZISC:,OMU:WDU,0:BL-US;
3
Change the state of the OMU unit into SE-NH.
ZUSC:OMU,0:SP; ZUSC:OMU,0:TE; ZUSC:OMU,0:SE; ZUSC:OMU,0:SE;
4
Remove the hard disk drive. a) Remove the RTM as instructed in section Replacing a rear transition module. b) Place the RTM on an ESD-protected surface so that the hard disk drive is facing down. c) Unscrew the four screws that hold the HDD to the RTM. d) Detach the HDD from the connector and remove it from the RTM. e) Remove the four metal nuts that are used to support the HDD against the RTM.
52
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
5
Replacing hardware units
Install the hard disk drive. a) Fasten the four metal nuts that are used to support the HDD against the RTM to the corners of the new HDD. b) Connect the HDD to the connector on the RTM. c) Turn the RTM over and fasten the HDD to the RTM with four screws. Figure 8
Hard disk drive on CPRT4-A Diskdrive
SASconnector
Insertedscrew DN0945272
d) Install the RTM as instructed in section Replacing a rear transition module.
6
Change the state of the OMU unit into TE-EX.
ZUSC:OMU,0:SE; ZUSC:OMU,0:TE;
t
Tip: If the hard disk is new, the state of the OMU unit will be changed into TE-EX automatically after copying the BOLERO image file to the new disk.
7
If the hard disk is a new one, initialize it. The HDD must be in the WO-ID state so that it can be initialized. To change the state, give the following command:
ZISC:,:WDU,0:WO-ID; To initialize the disk, give the following command:
ZIWI:,:WB,,,,,;
8
Change the state of the HDD into TE-ID.
ZISC:,OMU:WDU,0:TE-ID;
DN0966621 Issue: 11-0
© 2017 Nokia
53
Replacing hardware units
9
Maintaining and Troubleshooting Hardware
Check the version of the unit's IPMI software.
ZWDD:UT=OMU,UI=0; LOADING PROGRAM VERSION 13.53-0 EXECUTION STARTED 1 VALID PLUG-IN UNITS FOUND EXECUTION STARTED AT 2015-05-05 06:06:09 100% DONE, PLEASE WAIT 0 H, 0 MIN AND 0 SEC FUNCTIONAL PLUG-IN UNIT VERSION UNIT TYPE INDEX CURRENT -> AFTER UPDATE ----------- ------------- -------------------------------OMU-0 CPRT4_A-0 cprt4-a_kn_mmcf_05.52.2020 -> ---current version cprt4-a_kn_mmcf_05.52.2020 R_ABESW_1448 ---disk version
As displayed in the example above, an upgrade is not needed because the current SW version is consistent with the disk version.
10 Update the IPMI software, if needed.
g
Note: This must be done by experienced personnel who have sufficient knowledge of the system. Follow the instructions given in the command reference manual.
ZWDF:UT=OMU,UI=0,PT=CPRT4_A,PI=0;
11 Run diagnostics on the unit.
ZUDD:OMU,0:WDU,0;
12 Check the diagnostics report.
ZUDH:OMU,0:;
13 Change the working state of the HDD back into WO-ID.
ZISC:,:WDU,0:WO-ID;
14 Copy the SCMANA directory, software package directory, and BOLERO image file to the disk.
ZIWY:S:UNIT=OMU,PATH=/,DRIVE=WDU-S; ZIWY:D:UNIT=OMU,PATH=/,DRIVE=WDU-B; ZIBC:,,,,,,,,,DIR:;
54
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
15 Change the state of the hard disk into WO-BU.
ZISC:,:WDU,0:WO-BU;
16 Enable disk updates. a) Use the following command.
ZDUR:OMU;
g
Note: This is done only when replacing the OMU hardware. b) ZDBR:EQUIPM,0:DISK;
ZDBR:ILDATA,0:DISK;
17 Check that there are no alarms active.
ZAHO:OMU,0; ZAHO:WDU,0;
2.9 Replacing the HDD on CPRT5-A for VMU Purpose The CPRT5-A RTM supports two hard disk drive bays. In MSS the CPRT5-A RTM in VMU has only one HDD installed into HDD0 carrier. This HDD is for CHU unit.
DN0966621 Issue: 11-0
© 2017 Nokia
55
Replacing hardware units
Figure 9
Maintaining and Troubleshooting Hardware
The HDD0 on the CPRT5-A
CLASS1LASER PRODUCT IEC/EN60825-1
HDD1H/SLED HDD1H/SREQ
HDD1H/S HDD1 H/SREQ
HDD0H/SLED
HDD0H/S
HDD0H/SREQ
HDD0 H/SREQ
OutofServiceLED SFP0
SFP0
InServiceLED SFP1
SFP1
APP LED APP
MiniSASconnector USB SAS
HDD1 ACT
HDD1 ACT LED
HDD1
HDD0 ACT
HDD0 ACT LED HotSwapLED
HDD0
DN09172995
g
Note: There are two HDD slots and currently only HDD0 is used. In addition to replacement due to fault or upgrade, the HDD should be replaced every six years due to wear and tear. Six years is counted from the HDD's equipping date.
g
56
Note: Before removing the HDD from the RTM, make sure to plug out or power off the RTM.
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
2.9.1 Removing the HDD Before you start Identify which RTM needs to be plugged out. For example, the WDU-0 of CHU-1-0 and CHU-1-1 pair configured on VMU12 and VMU13 units. Procedure 1
Check the state of the hard disk. Step example ZISI:,CHU,1:WDU;
2
Change the state of the HDD to BL-US. Step example ZISC:,CHU,1:WDU,0:WO-ID; ZISC:,CHU,1:WDU,0:BL-US;
3
Change the state of the VMU unit to SE-NH. Step example ZUSC:VMU,12:BL; ZUSC:VMU,12:TE; ZUSC:VMU,12:SE; ZUSC:VMU,12:SE;
g
Note: After changing the VMU unit state to BL, child units in WO-EX state on that VMU will perform automatic switchover to SP-EX state. After successful switchovers, VMU state goes from BL-EX to BL-ID state. Continue state changing from BL to TE and SE only if VMU is in BL-ID to avoid unexpected child unit restarts.
4
Remove the VMU corresponding RTM from the shelf. For the instructions on removing the RTM, see Remove a rear transition module from the shelf. in section Replacing a rear transition module.
DN0966621 Issue: 11-0
© 2017 Nokia
57
Replacing hardware units
Maintaining and Troubleshooting Hardware
5
Unscrew the two retaining screws of the HDD carrier.
6
Pull the HDD carrier outward by holding both screws. Exert equal force to keep it straight.
7
Remove the HDD by unscrewing the four screws that hold the disk module to the carrier.
2.9.2 Installing the HDD Procedure 1
Install the HDD by mounting screws that hold the disk module to the carrier.
2
Align the HDD carrier to the guiding rails of the slot.
3
Insert the HDD carrier to the slot until it is firmly in place.
4
Tighten the two retaining screws of the HDD carrier. Figure 10
Tighten two screws of the HDD0 carrier
CLASS1LASER PRODUCT IEC/EN60825-1
HDD1H/S
HDD0H/S
HDD1 H/SREQ
HDD0 H/SREQ
SFP0
SFP1
SAS APP
HDD1 ACT
HDD0 ACT
DN09172983
5
Install the RTM with HDD. For the instructions on installing the RTM, see Install a rear transition module. in section Replacing a rear transition module.
58
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
g
Replacing hardware units
Note: After a while, if the HDD0 is ready, the HDD0 ACT LED turns green.
6
Change the state of VMU to TE-EX. Step example ZUSC:VMU,12:SE; ZUSC:VMU,12:TE;
g
Note: Upon command execution, the VMU unit restarts along with all its child units. After the restart, the state of the VMU unit is changed to TE-EX.
7
Change the state of VMU to WO-EX. Step example ZUSC:VMU,12:WO;
g
Note: Upon command execution, the VMU unit restarts along with all its child units. After the restart, the state of the VMU unit is changed to WO-EX. The child units of the VMU unit resume their initial state ( for example SP-EX or WO-EX).
8
Check the state of the HDD. Step example ZISI:,CHU,1:WDU,0:;
9
If the hard disk is a new one, initialize it. The HDD must be in the WO-ID state so that it can be initialized. Sub-steps a) Change the state to WO-ID. Step example ZISC:,CHU,1:WDU,0:WO-ID;
b) Initialize the disk. ZIWI:,CHU:WB,,,,,;
DN0966621 Issue: 11-0
© 2017 Nokia
59
Replacing hardware units
Maintaining and Troubleshooting Hardware
Step example ZIWI:,CHU,1:WB,F5,MSS_CHU1W0,FFF0,2,XY;
10 Check the version of the unit's IPMI software. Check whether the soft versions are consistent. If they are consistent, no upgrade is required. If they are inconsistent, an upgrade is needed. Step example WDD:UT=VMU,UI=12; LOADING PROGRAM VERSION 13.71-0 EXECUTION STARTED 1 VALID PLUG-IN UNITS FOUND EXECUTION STARTED AT 2016-12-12 09:16:54 100% DONE, PLEASE WAIT 0 H, 0 MIN AND FUNCTIONAL UNIT ----------VMU-12
PLUG-IN UNIT TYPE INDEX ------------CPRT5_A-0
0 SEC
VERSION CURRENT -> AFTER UPDATE -------------------------------cprt5-a_em_mmcf_02.01.0017 -> cprt5-a_em_mmcf_02.01.0017 RABESW_1450
COMMAND EXECUTED
Step result As displayed in the example, an upgrade is not needed because the current SW version is consistent with the disk version.
11 Update the IPMI software, if needed.
g
60
Note: Update must be performed by an experienced person who has sufficient knowledge of the system. For instructions, see command reference.
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
Sub-steps a) Check the slot of CHU. Get the master and the module number of the related VMU. Step example ZWTI:P:CHU;
b) Check all child units in the VMU. Step example ZUSI:VMU,index;
c) Change all related child units to TE-EX. Step example ZUSC:child unit,child unit index:SP; ZUSC:child unit,child unit index:TE; ZUSC:VMU,index,BL; ZUSC:VMU,index,TE; ZWDF:UT=VMU,UI=index,PT=CPRT5_A,PI=0; ZUSC:VMU,index,WO-EX;
12 Change the state of the HDD to TE-ID. Step example ZISC:,CHU,1:WDU,0:TE-ID;
13 Run the diagnostic on the unit. Step example ZUDD:CHU,1,1:WDU,0;
14 Check the diagnostic report. Step example ZUDH:CHU,1,1:;
DN0966621 Issue: 11-0
© 2017 Nokia
61
Replacing hardware units
Maintaining and Troubleshooting Hardware
15 Change the working state of the HDD back to WO-ID. Step example ZISC:,CHU,1:WDU,0:WO-ID;
16 Copy source WDU to backup WDU of CHU unit. Step example ZIWY:S:UNIT=CHU-1,PATH=/,DRIVE=WDU-S; ZIWY:D:UNIT=CHU-1,PATH=/,DRIVE=WDU-B; ZIBC:,,,,,,,,,DIR:;
17 Change the HDD state from WO-ID to WO-BU. Step example ZISC:,CHU,1:WDU,0:WO-BU;
18 Check that there are no active alarms. Step example ZAHO:CHU,1; ZAHO:WDU,0;
2.10 Replacing SFP, SFP+ and XFP transceivers Purpose To use the SFP, SFP+ or XFP connections, you need to install SFP, SFP+ and XFP transceiver modules in the corresponding sockets. All sockets are located on the front panels of the blades and RTMs.
62
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
Before you start Figure 11
Orientation of transceiver modules
Dual column socket
Single column socket
Connector sideisonright
DN70571185
w
Cableside
Connector sideisonleft
Connector sideisonleft
Latchin closedposition
NOTICE: Electrostatic discharge (ESD) may damage hardware components. To avoid ESD damage: • •
Before handling hardware units, check that the site is an ESD-protected area (EPA). If the area is not ESD-protected, create a temporary EPA. When handling hardware units, wear an ESD wrist strap or use a corresponding protection method, and do not touch the connector surfaces.
Initially, transceiver sockets may be occupied by the transceiver filler plugs, which you need to remove before installing the transceivers. If the transceivers are removed, install either replacement transceivers or filler plugs in the sockets to protect the internal components. You can install SFP, SFP+ and XFP transceivers at any time, but we recommend you install them before you install the equipment in the shelf.
DN0966621 Issue: 11-0
© 2017 Nokia
63
Replacing hardware units
Maintaining and Troubleshooting Hardware
2.10.1 Removing an SFP copper transceiver or an SFP/SFP+/XFP optical transceiver Procedure 1
If a cable is attached to the transceiver, first remove the cable by pressing the clip on the connector and pulling the connector out of the transceiver.
2
Remove the transceiver by opening the retaining clip and pulling the transceiver out by holding the clip. When removing the transceiver, note that the retaining clip is located on the right for the leftmost column and on the left for the rightmost column in case of an SFP housing assembly with dual columns of sockets.
2.10.2 Installing an SFP copper transceiver or an SFP/SFP+/XFP optical transceiver Procedure 1
Remove the filler plugs from the sockets on the front panel of the unit where you will install the transceivers. For sockets which are not in use, keep the filler plugs in place to protect the internal components.
2
Make sure that the latch on the cable socket side of the transceiver is in closed position. This ensures that the transceiver snaps into position when you insert it into the socket.
3
Install the SFP/SFP+/XFP transceiver by gently inserting into the socket until it snaps into its final position. When inserting the transceiver, note that the connector side is located on the right for the leftmost column and on the left for the rightmost column in case of an SFP housing assembly with dual columns of sockets.
4
Ensure the transceiver locking by pulling the transceiver axially.
5
For transceivers with filler plugs installed on their cable socket, keep the plugs in place until you are ready to plug cables into the transceivers. The cable plugs protect the internal components of the transceivers.
64
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
6
Replacing hardware units
If you have replaced a 1 GB SFP transceiver with a 10 GB SFP+ transceiver in an AMPP1-A blade, clear the fastpath configuration. Follow the steps below to clear the fastpath configuration: a) Connect to the blade through the serial port. b) Enter the following command:
rm /etc/fastpath/fastpath.cfg c) Restart the blade.
2.10.3 Removing and installing an SFP/SFP+/XFP filler plug Before you start
t
Tip: You may need to use a small tool in removing the filler plug due to the limited space between the sockets when equipped.
t
Tip: When removing or installing the filler plug, note that the retaining clip is located on the right for the leftmost column and on the left for the rightmost column in case of an SFP housing assembly with dual columns of sockets.
Procedure 1
If you want to remove the filler plug, gently open the retaining clip and pull the plug out by holding the clip.
2
If you want to insert the filler plug, insert the plug gently to the housing until it snaps into its final position.
2.11 Checking and replacing the air filter Purpose Inspect the air filter regularly. To prevent dust from accumulating inside the equipment, the filter element should be replaced twice a year.
DN0966621 Issue: 11-0
© 2017 Nokia
65
Replacing hardware units
Maintaining and Troubleshooting Hardware
Figure 12
Replacing the air filter
Frontview
DN70252323
Procedure 1
Pull out the air filter tray by its handle.
2
Replace the filter element.
3
Push the air filter tray back into the guide rails on both sides of the shelf until it is locked by springs.
4
Log into the active shelf manager.
5
Record the date of the air filter change. Enter the following command: clia airfilterreplaced
is the date when the air filter was replaced in the format dd.mm.yyyy. Note that this command is not used in all applications.
66
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
For more information on the airfilterreplaced command, see the shelf manager CLIA command reference. Step example # clia airfilterreplaced 13.08.2007 Pigeon Point Shelf Manager Command Line Interpreter #
6
Option Description If
you replaced the whole CHAF2-A (filter element and tray)
Then
a) Back up the shelf FRU data. Enter the following command from the active shelf manager: clia frudatar 20 254 /var/nvdata/shelf_fru_backup.bin
b) Update the shelf FRU data. Enter the following two commands: patch_fru_info 20 1 c 3 "CHAF2-A ::SCHR:<serial>" patch_fru_info 20 2 c 3 "CHAF2-A ::SCHR:<serial>"
is the hardware code and <serial> the serial number of the new filter tray. They must always be stored in two places and therefore the command is entered twice. You must read the hardware code and serial number (S/N) from the label stickers of the new filter tray. Enter the following two commands to update the shelf FRU data after replacing the CHAF2-A (label stickers shown in the picture below): patch_fru_info 20 1 c 3 "CHAF2-A :C110639.A1A:SCHR:XY071300455" patch_fru_info 20 2 c 3 "CHAF2-A :C110639.A1A:SCHR:XY071300455"
Figure 13
CHAF2-A
Air filter label stickers
C110639.A1A
CHAF2-A S/N: XY 071300455 DN0948624
During normal half-yearly maintenance, only the filter element needs to be changed and it is not necessary to update the FRU data.
DN0966621 Issue: 11-0
© 2017 Nokia
67
Replacing hardware units
Maintaining and Troubleshooting Hardware
2.12 Replacing a fuse on Passive PEM Board Purpose If the fuse on the Passive PEM Board (PPB) in the ASA16SET-A shelf set is blown, you can replace it with a new one. Figure 14
Fuses on PPB in ASA16SET-A
Before you start The fuse on the PPB has the orange color and is rated at 58 V/40 A, which is made by Littlefuse. The part number is 142.6185.5406. Use an ohm meter to measure the resistance of a new fuse. If the resistance is close or equal to zero, the new fuse is good. Make sure you have such a new fuse available. Besides, prepare a fuse puller.
f
WARNING! Hazardous energy and voltage level Make sure your hands are dry and remove any metal objects such as rings before touching the power supply equipment. Procedure 1
Log in to the active shelf manager.
2
Check if the fuse is blown. Enter the following commands to check two sensors:
# clia sensordata -v 20 “PSU n VOUT” # clia sensordata -v 20 “Feed X In m Fuse” Where X is A or B, n is 1 to 4 which corresponds to the PSU number, and m is from 1 to 4 which corresponds to the fuse number as shown in figure Fuses on PPB in ASA16SET-A. If the PSU n VOUT sensor indicates a reasonable voltage value but the Feed X In m Fuse sensor is absent, the corresponding fuse is blown. Run the commands multiple times to check whether more than one fuse is blown.
68
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
g
Replacing hardware units
Note: When checking Feed A fuses, check the PSU 1 or PSU 2 output voltage sensor and when checking Feed B fuses, check the PSU 3 or PSU 4 output voltage sensor. Enter the following commands to check the Feed A sensors: # clia sensordata -v 20 “PSU 1 VOUT” Pigeon Point Shelf Manager Command Line Interpreter 20: LUN: 1, Sensor # 200 ("PSU 1 VOUT") Type: Threshold (0x01), "Voltage" (0x02) Belongs to entity (0x0a, 0x60): FRU # 7 Status: 0xc0 All event messages enabled from this sensor Sensor scanning enabled Initial update completed Raw data: 168 (0xa8) Processed data: 53.760000 Volts Status: 0xc0 # clia sensordata -v 20 “Feed A In 1 Fuse” Pigeon Point Shelf Manager Command Line Interpreter 20: LUN: 0, Sensor # 165 ("Feed A In 1 Fuse") Type: Discrete (0x6f), "Entity Presence" (0x25) Belongs to entity (0x15, 0x60): FRU # 6 Status: 0xc0 All event messages enabled from this sensor Sensor scanning enabled Initial update completed Sensor reading: 0x01 Current State Mask 0x0001 Entity Absent
The Processed data value of PSU 1 VOUT is 53.760000 Volts, which is a reasonable value, and the Sensor reading value of Feed A In 1 Fuse is 0x01, which indicates the sensor is absent. Therefore, the fuse 1 on the Feed A is blown. 3
Turn off the breakers of the corresponding PSUs. For example, the fuse on the Feed A is blown, turn off the breakers of PSU 1 and 2.
DN0966621 Issue: 11-0
© 2017 Nokia
69
Replacing hardware units
t
Maintaining and Troubleshooting Hardware
4
Unscrew the hexagonal M4 screw on each side of the rear cable tray, lift the rear cable tray upwards and turn it out of the way.
5
Remove the rear cover by unscrewing the four Philips screws.
6
Remove the blown fuses with a fuse puller.
7
Insert new fuses.
8
Install the rear cover.
9
Re-install the hexagonal M4 screws to the rear cable tray and secure them tightly. Tip: Due to the narrow working-space, a 90-degree screwdriver could be useful for fixing the hexagonal M4 screws.
10 Turn on the breakers of the corresponding PSUs. 11 Check if the new fuses work. Enter the following command to check the sensor:
# clia sensordata -v 20 “Feed X In m Fuse” Where X is A or B, and m is from 1 to 4, that is, the number of the fuse that is replaced. If the sensor is present, the corresponding fuse works. Run the command multiple times if more than one fuse was replaced. Enter the following command to check the Feed A In 1 Fuse sensor: # clia sensordata -v 20 “Feed A In 1 Fuse” Pigeon Point Shelf Manager Command Line Interpreter 20: LUN: 0, Sensor # 165 ("Feed A In 1 Fuse") Type: Discrete (0x6f), "Entity Presence" (0x25) Belongs to entity (0x15, 0x60): FRU # 6 Status: 0xc0 All event messages enabled from this sensor Sensor scanning enabled Initial update completed Sensor reading: 0x00 Current State Mask 0x0001 Entity Present
The sensor reading value of Feed A In 1 Fuse is 0x00, which indicates the sensor is now present. Therefore, the fuse 1 on Feed A works.
70
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
12 If any replaced fuse does not work, the shelf is faulty. Replace the shelf. The existing shelf can be kept in operation till the replacement is completed. For more information about replacing a shelf, refer to the shelf replacement section.
Result The red LED on the PAM is off.
2.13 Replacing a power adapter module (APAMO-A) Purpose The power adapter module, APAMO-A, in the shelf set (ASA16SET-A) is located behind the rear cover. If you need to replace it, you need to remove the rear cover first.
Removing a power adapter module (APAMO-A) Procedure 1
Unscrew the hexagonal M4 screw on each side of the rear cable tray, lift the rear cable tray upwards and turn it out of the way.
2
Remove the rear cover by unscrewing the four Philips screws.
3
Remove the power adapter module. Figure 15
DN0966621 Issue: 11-0
Removing a power adapter module (APAMO-A)
© 2017 Nokia
71
Replacing hardware units
Maintaining and Troubleshooting Hardware
Installing a power adapter module (APAMO-A) Procedure 1
Insert a new power adapter module into the slot and slide it along the sledge till the white power adapter module connector matches the connector on the Passive PEM Board (PPB). Figure 16
t
Installing a power adapter module (APAMO-A)
2
Install the rear cover.
3
Re-install the hexagonal M4 screws to the rear cable tray and secure them tightly. Tip: Due to the narrow working-space, a 90-degree screwdriver could be useful for fixing the hexagonal M4 screws.
2.14 Replacing a power distribution unit (ADPDU-A) Purpose If the power distribution unit (PDU) is faulty, you must replace it with a new one.
72
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Figure 17
Replacing hardware units
Power distribution units (ADPDU-A) in the cabinet
Rearview
DN70258786
PDU
PDU Before you start Make sure you have a digital multimeter or voltage meter available.
f
WARNING! Hazardous energy and voltage level Before connecting or removing any power supply cables to or from the power distribution unit, make sure that all site power feeds to the power distribution unit are switched off, the circuit breakers on the front panel of the power distribution unit are in the OFF position, and the equipment is properly earthed (grounded).
f
WARNING! Hazardous energy and voltage level Make sure your hands are dry and remove any metal objects such as rings before touching the power supply equipment.
2.14.1 Removing a power distribution unit (ADPDU-A) Procedure 1
Make sure that the redundant PDU and PEM are functional. Both LEDs of the redundant PDU are lit green. The red alarm LED of the redundant PEM is off and the green OK LED is lit.
DN0966621 Issue: 11-0
© 2017 Nokia
73
Replacing hardware units
2
Maintaining and Troubleshooting Hardware
Switch off both circuit breakers on the PDU you are going to remove. Figure 18
ADPDU-A circuit breakers
ON
-48/-60VDC CircuitBreaker1
-48/-60VDC CircuitBreaker2 OFF
DN70296475
3
Switch off the battery feeds to the PDU you are going to remove.
4
Remove the plastic cable cover. a) Push the plastic cover downwards slightly, so the top of the cover detaches from the PDU b) When the top of the cover is detached, pull the cover slightly towards yourself and then up to detach it completely from the PDU.
5
Check the PDU input feeds with a digital multimeter to ensure there are no voltages in the cables.
6
Disconnect all cables from the PDU. a) b) c) d)
74
Disconnect the four power feed cables from the PDU. Disconnect the CGNDB grounding cable from the PDU. Disconnect the four PEM input feeds from the PDU. Disconnect the alarm cable(s) from the PDU.
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Figure 19
Replacing hardware units
ADPDU-A cabling
-48/-60VDC Input1
Return1
Grounding
-48/-60VDC Input2
Return2
1 Outputs 2 -48/-60VDC 3 (4x25A max.) 4
DN70387805
DN0966621 Issue: 11-0
© 2017 Nokia
75
Replacing hardware units
Maintaining and Troubleshooting Hardware
7
Remove the DC/C grounding bracket, if used.
8
Unscrew the three fixing screws attaching the PDU to the cabinet. Figure 20
Replacing a ADPDU-A
Rearview DN70217207
9
Remove the PDU from the cabinet.
2.14.2 Installing a power distribution unit (ADPDU-A) Procedure 1
Remove the plastic cable cover from the PDU. a) Push the plastic cover downwards slightly, so the top of the cover detaches from the PDU b) When the top of the cover is detached, pull the cover slightly towards yourself and then up to detach it completely from the PDU.
2
If not already installed, install the mounting ears to the PDUs. Attach the mounting ear either to the right side of one power distribution unit or to the left side on the other with the seven T10 screws that come in the package.
76
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
Be careful not to drop the small screws through the cooling grill into the PDU. Figure 21
Installing mounting ears to the ADPDU-As
x7
T10 DN70443733
3
Insert the PDU into the shelf and align the holes of its mounting ear with the cabinet mounting rail. a) From the rear of the cabinet, place the PDUs on both sides of the support structure. b) Align the mounting ears of the units with the cabinet mounting rails.
DN0966621 Issue: 11-0
© 2017 Nokia
77
Replacing hardware units
Maintaining and Troubleshooting Hardware
Figure 22
Installing a ADPDU-A
Rearview DN70217207
The mounting coordinates of the PDUs are listed below: • • •
Shelf 1: 10, 18, 26 Shelf 2: 35, 43, 51 Shelf 3: 60, 68, 76
4
Attach the PDU to the cabinet with three M6 screws.
5
Install the DC/C grounding bracket, if used. For more information on the grounding bracket used in the DC/C equipment grounding system (two-wire system), see the Installation documentation.
6
Connect the PDU grounding cable (CGNDB) to the PDU. a) b) c) d)
78
Remove the nuts from the grounding terminal with a 10 mm socket wrench. Connect the cable lug to the grounding point of the PDU. Place the lug nut(s) with an integrated star washer on top of the lug. Tighten the nut(s) with a 10 mm socket wrench, torque 5.1 Nm.
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Figure 23
Replacing hardware units
ADPDU-A grounding cable
DN70289837
7
Check the PDU input feeds with a digital multimeter to ensure there are no voltages in the cables.
8
Connect the site power supply cables to the PDU. a) Run the cables to the PDU. b) Remove the nuts from the power terminals with a 10 mm socket wrench. c) Connect the (-48/-60 VDC 1) cable with lug to terminal connector marked -48/-60 VDC Input 1, and the (Return 1) cable with lug to terminal connector marked Return 1. d) Connect the (-48/-60 VDC 2) cable with lug to terminal connector marked -48/-60 VDC Input 2, and the (Return 2) cable with lug to terminal connector marked Return 2. All four cables (two inputs and two returns) must be connected.
DN0966621 Issue: 11-0
© 2017 Nokia
79
Replacing hardware units
Maintaining and Troubleshooting Hardware
Figure 24
ADPDU-A power feed cabling
Return1 Return2 2.pullout
-48/-60VDC Input1 Grounding -48/-60VDC Input2
1.pushdown
M6 5.1Nm DN70443745
e) Attach one or two nuts per cable in the connector and tighten them securely with a 10 mm socket wrench. The nuts have integrated star-washers. Fasten the screws gently to no more than 5.1 Nm. f) Make sure that the cables are properly connected and aligned and that no bare parts exist on cable lugs that may short circuit.
9
Attach the cable cover on the PDU. a) Holding the plastic cover at an almost 45° angle, insert the lower part of the cable cover into the slot below the power terminals. b) Turn the plastic cover so that the top of it almost meets the fixing slot above the power terminals of the PDU. c) Push down slightly so you can secure the top of the cover into the slot. Do not try to force the plastic cover into position; this can break the fixing points on top and bottom of the cover.
10 Connect the four PEM input feeds to the PDU. Connect the cable pairs to the power distribution unit's output connectors 1-4.
80
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Figure 25
Replacing hardware units
ADPDU-A cabling
-48/-60VDC Input1
Return1
Grounding
-48/-60VDC Input2
Return2
1 Outputs 2 -48/-60VDC 3 (4x25A max.) 4
DN70387805
DN0966621 Issue: 11-0
© 2017 Nokia
81
Replacing hardware units
Maintaining and Troubleshooting Hardware
11 Connect the alarm cable(s) to the PDU. 12 Switch on the site power supply to the PDU. 13 Switch on the circuit breakers on the PDU. Figure 26
ADPDU-A circuit breakers
ON
-48/-60VDC CircuitBreaker1
-48/-60VDC CircuitBreaker2 OFF
DN70296475
Result Both LEDs of the PDU are lit green. The green OK LED of the PEM is lit.
2.15 Replacing a power distribution unit (ADPD2-A) Purpose If the power distribution unit (PDU) is faulty, you must replace it with a new one.
82
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Figure 27
Replacing hardware units
Power distribution units (ADPD2-A) in the cabinet
Before you start Prepare the following tools: a digital multimeter or voltage meter 8 and 10 mm spanner or a socket wrench with 8 and 10 mm sockets M4 straight lug wrench 3 mm T-type Allen key screwdriver 90-degree screwdriver size 1 and 2 Phillips screwdrivers Torx T10, Torx T30 and Torx T40 screwdrivers ESD wrist strap protective gloves safety ladder
• • • • • • • • • •
f
WARNING! Hazardous energy and voltage level Before connecting or removing any power supply cables to or from the power distribution unit, make sure that all site power feeds to the power distribution unit are switched off, the circuit breakers on the front panel of the power distribution unit are in the OFF position, and the equipment is properly earthed (grounded).
f
WARNING! Hazardous energy and voltage level Make sure your hands are dry and remove any metal objects such as rings before touching the power supply equipment.
f
CAUTION! Risk of physical injury Unfastened equipment in the cabinet can fall off if the cabinet is moved. Never leave the power distribution unit equipped in the cabinet for extended periods with the fixing screws unfastened.
2.15.1 Removing a power distribution unit (ADPD2-A) Procedure 1
Make sure that the redundant PDU and PEM are functional. The red LEDs of the redundant PDU are off. The red alarm LED of the redundant PEM is off and the green OK LED is lit.
DN0966621 Issue: 11-0
© 2017 Nokia
83
Replacing hardware units
2
Maintaining and Troubleshooting Hardware
Switch off the circuit breakers on the PDU you are going to remove. The red LEDs on the PDU are lit. Figure 28
ADPD2-A circuit breakers
Circuitbreakerx6 ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
1
2
3
4
5
6
LEDx6 Mountingholex4 DN0990951
3
Frontview
Switch off the battery feeds to the PDU you are going to remove. The red LEDs on the PDU are then off.
4
Slide the plastic cable covers horizontally to remove them on each PDU input terminal.
5
Check the PDU input cable with a digital multimeter to ensure there are no voltages in the cables.
6
Disconnect all cables from the PDU. a) b) c) d) e)
84
Disconnect the six power feed cables from the PDU. Disconnect the CGNDE grounding cable from the PDU. Unscrew the four Torx M4 screws to unfasten the PDU from the mounting holder. Push the PDU backwards a few centimeters. Disconnect all the bushing PDU output cables from the PDU by a 3 mm T-type Allen key screwdriver.
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
7
Replacing hardware units
Figure 29
ADPD2-A cabling
Figure 30
Unfastening a power distribution unit (ADPD2-A)
Remove the PDU from the cabinet.
2.15.2 Installing a power distribution unit (ADPD2-A) Procedure 1
Insert the PDU into the mounting holder from the rear side of the cabinet till the PDU mates with the mounting flanges.
2
Verify that the PDU mounting holder holes are aligned with the PDU holes.
g
DN0966621 Issue: 11-0
Note: Do not fix the PDU to the PDU mounting holder at this point, as this will make it more difficult to connect the cables between the PDUs and the PEMs.
© 2017 Nokia
85
Replacing hardware units
3
Maintaining and Troubleshooting Hardware
Make sure that the circuit breakers on the PDU are all switched off. The red LEDs of the PDU are off. Figure 31
ADPD2-A circuit breakers
Circuitbreakerx6 ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
1
2
3
4
5
6
LEDx6 Mountingholex4 DN0990951
4
Frontview
Connect the PDU grounding cable (CGNDE) to the PDU. a) Connect the angled two-hole lug of the grounding cable to the set of PDU GND studs with two M6 nuts and two washers, and then tighten the nuts. b) If the other end of the PDU grounding cable (CGNDE), the straight lug, is not connected, connect it to the cabinet grounding rail with nuts, and then tighten the nuts with an M6 (10mm) socket wrench. Figure 32
86
ADPD2-A grounding cable
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
5
Replacing hardware units
In DC/C equipment grounding system (two-wire system), insert three M5 Phillips captive screws in the PDU grounding holes marked with GND, and then tighten the screws. Figure 33
ADPD2-A optional grounding accessories
6
Check the site power supply cables with a digital multimeter to ensure there are no voltages in the cables.
7
Connect the site power supply cables to the PDU. a) Slide the plastic cable covers horizontally to remove them on each PDU input terminal. b) Connect the site return IN1+, IN2+, IN3+ cable lugs and feed IN1-, IN2-, IN3cable lugs to the PDU input terminals correspondingly marked, secure each twohole cable lug on the PDU inut terminal with two M6 nuts and washers, and fasten the nuts. The relation between the PDU inputs and the served shelf is shown in the following table: Table 10
Mapping of PDU input and shelf
PDU input
g
Shelf
IN1
Top shelf
IN2
Middle shelf
IN3
Bottom shelf
Note: If only one PDU input can be fed by the site power supply, see the installation document for details on how to chain PDU inputs. c) Make sure that the cables are properly connected and aligned and that no bare parts exist on cable lugs that may cause short-circuits. d) Place the plastic cable covers on the PDU input terminals.
DN0966621 Issue: 11-0
© 2017 Nokia
87
Replacing hardware units
8
Maintaining and Troubleshooting Hardware
Connect the power cables between PEM and PDU to the PDU. Pay attention to the PDU cable routing as shown in figure below: Figure 34
PDU input and output power cable position
a) Push the PDU backwards a few centimeters. b) Connect the bushing terminals of the cables to the PDU output terminals. Connect the cable pairs between the PEM in each shelf and the PDU according to the following table: Table 11
Power cable connection between ADPD2-A and ADPE2-A
PDU output
PEM input
OUT1+/-
Feed 1
OUT2+/-
Feed 2
OUT3+/-
Feed 1
OUT4+/-
Feed 2
OUT5+/-
Feed 1
OUT6+/-
Feed 2
Shelf Top shelf
Middle shelf
Bottom shelf
c) Use a 3 mm T-type Allen key screwdriver to fasten the hexagonal M4 screws that are placed on the top of connector to fix the cable. d) Push the PDU forwards till it mates with the flanges of the PDU mounting holder. e) Fasten the PDU to the mounting holder with four Torx M4 screws and washers.
88
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
9
Replacing hardware units
If the power cables are not connected to the PEM input feeds, connect them according to the following steps: Sub-steps a) Unscrew the hexagonal M4 screw on each side of the rear cable tray, lift the rear cable tray upwards and turn it out of the way. b) Pull out the PEM input terminal safety plastic covers. c) Unscrew the PEM input terminal hexagonal nuts with an M4 straight lug wrench. d) Connect the PDU output terminals to the PEM input terminals for each shelf using corresponding cable set and make sure the connection follows the table below. Table 12
Power cable connection between ADPD2-A and ADPE2-A
PDU output
PEM input
OUT1+/-
Feed 1
OUT2+/-
Feed 2
OUT3+/-
Feed 1
OUT4+/-
Feed 2
OUT5+/-
Feed 1
OUT6+/-
Feed 2
Shelf Top shelf
Middle shelf
Bottom shelf
e) Place the hexagonal nuts back on the PEM input terminals and fasten them with an M4 straight lug wrench.
10 Switch on the site power supply to the PDU. The red LEDs of the PDU are lit.
11 Switch on the circuit breakers on the PDU. The red LEDs of the PDU are off. The green OK LED of the PEM is lit.
DN0966621 Issue: 11-0
© 2017 Nokia
89
Replacing hardware units
Maintaining and Troubleshooting Hardware
12 Re-install the hexagonal M4 screws to the rear cable tray and secure them tightly.
t
Tip: Due to the narrow working-space, a 90-degree screwdriver could be useful for fixing the hexagonal M4 screws.
2.16 Replacing a power entry module (ADPEM-A) Purpose If the power entry module (PEM) is damaged or malfunctioning, you must replace it with a new one. If the PEM is damaged or malfunctioning due to a blown fuse and replacing the fuse does not help, you must replace the PEM with a new one. Before you start Make sure you have a digital multimeter or voltage meter available.
f
WARNING! Hazardous energy and voltage level Make sure your hands are dry and remove any metal objects such as rings before touching the power supply equipment.
2.16.1 Removing a power entry module (ADPEM-A) Procedure 1
Make sure that the redundant PEM is functional. The red alarm LED of the redundant PEM is off and the green OK LED is on.
2
Push the hot swap button on the front panel of the PEM you are going to remove. Wait for the hot swap LED to turn solid blue.
90
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
3
Replacing hardware units
Switch OFF the circuit breakers on the power distribution unit connected to the PEM you are going to remove. Figure 35
Power distribution unit (ADPDU-A) circuit breakers
ON
-48/-60VDC CircuitBreaker1
-48/-60VDC CircuitBreaker2 OFF
DN70296475
4
Remove the PEM terminal block cover. a) Lift the rear cable tray upwards and turn it out of the way. b) Unscrew the two screws on the terminal block covers with a Phillips screwdriver.
5
Make sure there is no battery voltage in the PEM input terminals. Measure the input voltages with a digital multimeter.
6
Disconnect the power cables from the PEM power terminals. Unscrew the eight connector screws with a flat screwdriver and detach the power cables from the terminals.
DN0966621 Issue: 11-0
© 2017 Nokia
91
Replacing hardware units
Maintaining and Troubleshooting Hardware
Figure 36
ADPEM-A power feed cabling (straight)
1 2 3 4
Outputs -48/-60VDC (4x25A max.)
4 3 2 1 4 3 2 1 -48/-60 VDC
RTN
DN70279286
Figure 37
92
ADPEM-A power feed cabling (angled)
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
7
Unscrew the two fixing screws on the PEM.
8
Holding both handles, pull the PEM out of the slot. Figure 38
Replacing a power entry module (ADPEM-A)
PEM
DN70244931
Cover
2.16.2 Installing a power entry module (ADPEM-A) Procedure 1
Insert the PEM into the shelf. Slide the PEM into the slot along the guide rails.
2
Tighten the two fixing screws on the PEM.
3
Make sure that the circuit breakers on the power distribution unit are OFF and that there is no battery voltage in the power distribution unit output terminals coming to the PEM input. Measure the voltages with a digital multimeter.
DN0966621 Issue: 11-0
© 2017 Nokia
93
Replacing hardware units
4
Maintaining and Troubleshooting Hardware
Connect the four power cables from the dedicated power distribution unit (PDU) to the power terminals of the PEM. Figure 39
ADPEM-A power feed cabling (straight)
1 2 3 4
Outputs -48/-60VDC (4x25A max.)
4 3 2 1 4 3 2 1 -48/-60 VDC
RTN
DN70279286
Figure 40
ADPEM-A power feed cabling (angled)
a) Observe the markings on the cables.
94
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
b) Connect the cable from the PDU output 1 to the power feed -48/-60 VDC 1 and RTN 1 on the PEM. c) Connect the cable from the PDU output 2 to the power feed -48/-60 VDC 2 and RTN 2 on the PEM. d) Connect the cable from the PDU output 3 to the power feed -48/-60 VDC 3 and RTN 3 on the PEM. e) Connect the cable from the PDU output 4 to the power feed -48/-60 VDC 4 and RTN 4 on the PEM. f) Verify the correct polarity of the -48/-60 VDC and RTN cables. g) Screw in the connector screws with a flat screwdriver. Gently tighten the screws to a torque of 1.4 Nm.
5
Install the terminal block cover on the PEM. Fasten the cover screws with a Phillips screwdriver gently to no more than 1.5 Nm.
6
Switch on the circuit breakers on the power distribution unit. Figure 41
Power distribution unit (ADPDU-A) circuit breakers
ON
-48/-60VDC CircuitBreaker1
-48/-60VDC CircuitBreaker2 OFF
DN70296475
Result All the power feeds are present and the green OK LED on the PEM front panel is lit.
DN0966621 Issue: 11-0
© 2017 Nokia
95
Replacing hardware units
Maintaining and Troubleshooting Hardware
2.16.3 Replacing a PEM (ADPEM-A) fuse Purpose If the PEM, ADPEM-A, fuse is blown, you can replace it with a new one. Before you start The ADPEM-A fuse has the green color and is rated at 80 V/30 A, which is made by Littlefuse. The part number is 166.7000.5302. Use an ohm meter to measure the resistance of a new fuse. If the resistance is close or equal to zero, the new fuse is good. Make sure you have such a new fuse available. Besides the tools used for PEM replacement, prepare a fuse puller. Procedure 1
Log in to the active shelf manager.
2
Check if the PEM fuse is blown. Enter the following commands to check two sensors related to the PEM:
# clia sensordata “PEM X In m” # clia sensordata “PEM X In m Fused” Where is the IPMB address of the IPMC, X is A or B, and m is from 1 to 4 which corresponds to the fuses (noted as Fm01) shown in the figure below. If the PEM X In m sensor is present but the PEM X In m Fused sensor is absent, the corresponding fuse is blown. Run the command multiple times to check whether more than one fuse is blown. Figure 42
ADPEM-A fuses Frontside
Fuses80V/30A
DN09120645
F201
F401
F101
F301
Topview
Example Enter the following commands to check the PEM A sensors: # clia sensordata -v 20 “PEM A In 1” Pigeon Point Shelf Manager Command Line Interpreter 20: LUN: 0, Sensor # 164 ("PEM A In 1") Type: Discrete (0x6f), "Entity Presence" (0x25) Belongs to entity (0x15, 0x60): FRU # 6 Status: 0xc0
96
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
All event messages enabled from this sensor Sensor scanning enabled Initial update completed Sensor reading: 0x00 Current State Mask 0x0001 Entity Present # clia sensordata -v 20 “PEM A In 1 Fused” Pigeon Point Shelf Manager Command Line Interpreter 20: LUN: 0, Sensor # 165 ("PEM A In 1 Fused") Type: Discrete (0x6f), "Entity Presence" (0x25) Belongs to entity (0x15, 0x60): FRU # 6 Status: 0xc0 All event messages enabled from this sensor Sensor scanning enabled Initial update completed Sensor reading: 0x01 Current State Mask 0x0001 Entity Absent
The sensor reading value of PEM A In 1 is 0x00, which indicates the sensor is present, and the sensor reading value of PEM A In 1 Fused is 0x01, which indicates the sensor is absent. Therefore, the fuse F101 is blown. 3
Remove the PEM from the shelf. a) b) c) d)
Push the hot swap button on the front panel of the PEM. Switch off the circuit breakers on the PDU connected to the PEM to be removed. Remove the PEM terminal block cover. Disconnect the cables from the PEM.
See the Removing the power entry module (ADPEM-A) section for details.
4
Remove the blown fuse with a fuse puller.
5
Insert a new fuse.
6
Install the PEM in the shelf. See the Installing the power entry module (ADPEM-A) section for details.
7
Check if the new fuse works. Enter the following command to check the sensor related to the PEM:
# clia sensordata “PEM X In m Fused”
DN0966621 Issue: 11-0
© 2017 Nokia
97
Replacing hardware units
Maintaining and Troubleshooting Hardware
Where is the IPMB address of the IPMC, X is A or B, and m is from 1 to 4. If the sensor is present, the corresponding fuse works. Example Enter the following command to check the PEM A In 1 Fused sensor: # clia sensordata -v 20 “PEM A In 1 Fused” Pigeon Point Shelf Manager Command Line Interpreter 20: LUN: 0, Sensor # 165 ("PEM A In 1 Fused") Type: Discrete (0x6f), "Entity Presence" (0x25) Belongs to entity (0x15, 0x60): FRU # 6 Status: 0xc0 All event messages enabled from this sensor Sensor scanning enabled Initial update completed Sensor reading: 0x00 Current State Mask 0x0001 Entity Present
The sensor reading value of PEM A In 1 Fused is 0x00, which indicates the sensor is now present. Therefore, the fuse F101 works. 8
If any replaced fuse does not work, the PEM or the shelf is faulty. Proceed to check the fault, and then replace either the PEM or the shelf. The existing shelf can be kept in operation till the replacement is completed. For more information about replacing a PEM or a shelf, refer to the PEM or shelf replacement section.
Result The green OK LED on the PEM front panel is lit.
2.17 Replacing a power entry module (ADPE2-A) Purpose If the power entry module (PEM) is damaged or malfunctioning, you must replace it with a new one. If the PEM is damaged or malfunctioning due to a blown fuse and replacing the fuse does not help, you must replace the PEM with a new one. Before you start Prepare the following tools: • • •
98
a digital multimeter or voltage meter M4 straight lug wrench 3 mm T-type Allen key screwdriver
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
90-degree screwdriver size 1 and 2 Phillips screwdrivers Torx T10, Torx T30 and Torx T40 screwdrivers ESD wrist strap safety ladder
• • • • •
f
Replacing hardware units
WARNING! Hazardous energy and voltage level Make sure your hands are dry and remove any metal objects such as rings before touching the power supply equipment.
2.17.1 Removing a power entry module (ADPE2-A) Procedure 1
Make sure that the redundant PEM is functional. The red alarm LED of the redundant PEM is off and the green OK LED is on.
2
Push the hot swap button for two seconds on the front panel of the PEM you are going to remove. Wait for the hot swap LED to turn solid blue. If it does not change to blue, the circuitry for hot swap control is damaged, and in such a case you can proceed to the next step.
3
Switch off the PDU circuit breakers that control the PDU output to the PEM you are going to remove. The corresponding red LEDs of the PDU are lit. Figure 43
ADPD2-A circuit breakers
Circuitbreakerx6 ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
1
2
3
4
5
6
LEDx6 Mountingholex4 DN0990951
Frontview
The following table shows the relation between the PDU circuit breakers, PDU output terminals and shelves in the cabinet.
DN0966621 Issue: 11-0
© 2017 Nokia
99
Replacing hardware units
Maintaining and Troubleshooting Hardware
Table 13
Relation between PDU circuit breakers, PDU outputs and shelves
PDU circuit breaker
g
PEM input
1
Feed 1
2
Feed 2
3
Feed 1
4
Feed 2
5
Feed 1
6
Feed 2
Shelf Top shelf
Middle shelf
Bottom shelf
Note: After the PDU circuit breakers are switched off, the PEM's red LED will be lit and green LED will be off. However, in some situations the green OK LED on the PEM is lit green even if the voltage has been disconnected in the PDU output. You can proceed to the next step.
4
Unscrew the hexagonal M4 screw on each side of the rear cable tray, lift the rear cable tray upwards and turn it out of the way.
5
Unscrew the two fixing screws on the PEM. Figure 44
6
Unscrewing the fixing screws on the PEM
Disengage the PEM. Hold both handles and withdraw the PEM out of the slot by approximately 2 cm. Ensure that all the LEDs on the PEM are turned off.
100
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Figure 45
7
Replacing hardware units
Disengaging the PEM
Re-insert the PEM into the shelf. After the re-insertion the PEM’s red LED shall be lit.
8
Pull out the PEM input terminal safety plastic covers.
9
Make sure there is no battery voltage in the PEM input terminals. Measure the input voltages with a digital multimeter.
10 Disconnect the power cables from the PEM input terminals. Unscrew the hexagonal nuts on the PEM input terminals with an M4 straight lug wrench. Figure 46
PEM power feed cabling
11 Pull the PEM completely out of the slot. 12 Place the hexagonal nuts back on the PEM input terminals and fasten them. 13 Place the PEM safety plastic cover over the PEM input terminals.
DN0966621 Issue: 11-0
© 2017 Nokia
101
Replacing hardware units
Maintaining and Troubleshooting Hardware
2.17.2 Installing a power entry module (ADPE2-A) Procedure 1
Insert the PEM into the shelf. Slide the PEM into the slot along the guide rails.
2
Tighten the two fixing screws on the PEM.
3
Make sure that the corresponding circuit breakers on the PDU are off. The following table shows the relation between the PDU circuit breakers, PDU output terminals and shelves in the cabinet. Table 14
Relation between PDU circuit breakers, PDU outputs and shelves
PDU circuit breaker
4
PEM input
1
Feed 1
2
Feed 2
3
Feed 1
4
Feed 2
5
Feed 1
6
Feed 2
Shelf Top shelf
Middle shelf
Bottom shelf
Make sure there is no battery voltage in the PDU output terminals to be connected to the PEM. Measure the voltages with a digital multimeter.
5
Remove the PEM input terminal safety plastic covers.
6
Connect the four power cables from the PDU to the PEM input terminals. a) Unscrew the PEM input terminal hexagonal nuts with an M4 straight lug wrench. b) Connect the power cables from the PDU to the PEM input terminals for each shelf. Connect the cable pairs between PEM and PDU according to the following table:
102
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Table 15
Replacing hardware units
Power cable connection between ADPD2-A and ADPE2-A
PDU output
PEM input
OUT1+/-
Feed 1
OUT2+/-
Feed 2
OUT3+/-
Feed 1
OUT4+/-
Feed 2
OUT5+/-
Feed 1
OUT6+/-
Feed 2
Shelf Top shelf
Middle shelf
Bottom shelf
c) Place the hexagonal nuts back on the PEM input terminals and fasten them with an M4 straight lug wrench.
DN0966621 Issue: 11-0
© 2017 Nokia
103
Replacing hardware units
Maintaining and Troubleshooting Hardware
7
Place the safety plastic covers on the PEM.
8
If the power cables are not connected to the PDU output terminals, connect them according to the following steps: Sub-steps a) Unscrew the four Torx M4 screws to unfasten the PDU from the mounting holder. b) Push the PDU backwards a few centimeters. c) Connect the bushing terminals of the cables to the PDU output terminals. d) Use a 3 mm T-type Allen key screwdriver to fasten the hexagonal M4 screws that are placed on the top of terminals to fix the cables. e) Push the PDU forwards till it mates with the flanges of the PDU mounting holder. f)
9
Fasten the PDU to the mounting holder with four Torx M4 screws and washers.
Switch on the corresponding circuit breakers on the PDU. All the power feeds are present and the green OK LED on the PEM front panel is lit.
10 Re-install the hexagonal M4 screws to the rear cable tray and secure them tightly.
t
Tip: Due to the narrow working-space, a 90-degree screwdriver could be useful for fixing the hexagonal M4 screws.
2.17.3 Replacing a PEM (ADPE2-A) fuse Purpose If the PEM, ADPE2-A, fuse is blown, you can replace it with a new one.
104
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
Before you start The ADPE2-A fuse has the orange color and is rated at 80 V/40 A, which is made by Littelfuse. The part number is 166.6885.5402. Use an ohm meter to measure the resistance of a new fuse. If the resistance is close or equal to zero, the new fuse is good. Make sure you have such a new fuse available. Besides the tools used for PEM replacement, prepare a fuse puller. Procedure 1
Log in to the active shelf manager.
2
Check if the PEM fuse is blown. Enter the following commands to check two sensors related to the PEM:
# clia sensordata “PEMXn Voltage” # clia sensordata “PEM X In m Fused” Where is the IPMB address of the IPMC, X is A or B, n is 1 or 2 which corresponds to the feed number, and m is from 1 to 4 which corresponds to the fuses (noted as Fm01) shown in the figure below. If the PEMXn Voltage sensor indicates a reasonable voltage value but the PEM X In m Fused sensor is absent, the corresponding fuse is blown. Run the command multiple times to check whether more than one fuse is blown. Figure 47
ADPE2-A fuses
80V/40Afusesx4
F101
DN0991035
F201
F301
F401
Rearview (coverremoved)
Example Enter the following commands to check the PEM A sensors: # clia sensordata -v 20 “PEMA1 Voltage” Pigeon Point Shelf Manager Command Line Interpreter 20: LUN: 1, Sensor # 210 ("PEMA1 Voltage") Type: Threshold (0x01), "Voltage" (0x02) Belongs to entity (0x15, 0x60): FRU # 6 Status: 0xc0 All event messages enabled from this sensor Sensor scanning enabled Initial update completed Raw data: 176 (0xb0) Processed data: 52.800000 Volts
DN0966621 Issue: 11-0
© 2017 Nokia
105
Replacing hardware units
Maintaining and Troubleshooting Hardware
Status: 0xc0 # clia sensordata -v 20 “PEM A In 1 Fused” Pigeon Point Shelf Manager Command Line Interpreter 20: LUN: 0, Sensor # 165 ("PEM A In 1 Fused") Type: Discrete (0x6f), "Entity Presence" (0x25) Belongs to entity (0x15, 0x60): FRU # 6 Status: 0xc0 All event messages enabled from this sensor Sensor scanning enabled Initial update completed Sensor reading: 0x01 Current State Mask 0x0001 Entity Absent
The Processed data value of PEMA1 Voltage is 52.800000 Volts, which is a reasonable value, and the sensor reading value of PEM A In 1 Fused is 0x01, which indicates the sensor is absent. Therefore, the fuse F101 is blown. 3
Remove the PEM from the shelf. a) Push the hot swap button on the front panel of the PEM. b) Switch off the PDU circuit breakers that controls the PDU output to the PEM to be removed. c) Disconnect the cables from the PEM. See the Removing the power entry module (ADPE2-A) section for details.
4
Unscrew the two cover screws to remove the PEM cover.
5
Remove the blown fuse with a fuse puller.
6
Insert a new fuse.
7
Place the cover and fix it with two screws.
8
Install the PEM in the shelf. See the Installing the power entry module (ADPE2-A) section for details.
9
Check if the new fuse works. Enter the following command to check the sensor related to the PEM:
# clia sensordata “PEM X In m Fused”
106
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
Where is the IPMB address of the IPMC, X is A or B, and m is from 1 to 4. If the sensor is present, the corresponding fuse works. Example Enter the following command to check the PEM A In 1 Fused sensor: # clia sensordata -v 20 “PEM A In 1 Fused” Pigeon Point Shelf Manager Command Line Interpreter 20: LUN: 0, Sensor # 165 ("PEM A In 1 Fused") Type: Discrete (0x6f), "Entity Presence" (0x25) Belongs to entity (0x15, 0x60): FRU # 6 Status: 0xc0 All event messages enabled from this sensor Sensor scanning enabled Initial update completed Sensor reading: 0x00 Current State Mask 0x0001 Entity Present
The sensor reading value of PEM A In 1 Fused is 0x00, which indicates the sensor is now present. Therefore, the fuse F101 works. 10 If any replaced fuse does not work, the PEM or the shelf is faulty. Proceed to check the fault, and then replace either the PEM or the shelf. The existing shelf can be kept in operation till the replacement is completed. For more information about replacing a PEM or a shelf, refer to the PEM or shelf replacement section. Expected outcome The green OK LED on the PEM front panel is lit.
2.18 Replacing a power supply unit (AAPSU-A) Purpose If the power supply unit (PSU), AAPSU-A, is faulty, you must replace it with a new one.
Removing a power supply unit (AAPSU-A) Procedure 1
Turn off the circuit breaker of the PSU to be removed. The PSU LEDs are off.
DN0966621 Issue: 11-0
© 2017 Nokia
107
Replacing hardware units
2
Maintaining and Troubleshooting Hardware
Push the button on the lower left corner of the PSU front panel to open the white cover a bit. Figure 48
Removing a power supply unit (AAPSU-A)
3
Open the white cover to the right so that the PSU comes out of the slot.
4
Hold the PSU and pull it out of the slot.
Installing a power supply unit (AAPSU-A) Procedure 1
Insert a new PSU into the PSU slot gentlely till the PSU cannot be pushed. The PSU is not fully inserted into the slot and about 1 cm of the PSU is out of the slot.
108
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
2
Push the button on the lower left corner of the PSU front panel to open the white cover and open it fully.
3
Push the PSU a bit further into the slot.
4
Close the white cover till the button locks it to fully insert the PSU into the slot.
5
Turn on the corresponding circuit breaker of the PSU from the rear side of the shelf. Make sure the AC OK LED and DC OK LED are lit.
2.19 Replacing a fan module Purpose In addition to replacement due to fault or upgrade, the fan module should be replaced every six years due to wear.
w
DN0966621 Issue: 11-0
NOTICE: The change time is 30 seconds maximum in order to prevent overheating of units in the shelf.
© 2017 Nokia
109
Replacing hardware units
Maintaining and Troubleshooting Hardware
Figure 49
Replacing a fan module OKLED AlarmLED HotSwapLED HotSwap PushButton
Retentionlever
1
DN70259064
Rearview
2
Before you start Ensure that you have the new spare part fan module available. Note that when the hot swap button is pressed, it is normal that all the fans (including those on the module that is subject to hot swap) start turning at full speed.
2.19.1 Removing a fan module Procedure 1
Press the hot swap button and wait for the hot swap LED to turn solid blue. After the hot swap button has been pressed, the fans start turning at full speed. Also the fans on the module that is subject to hot swap turn at full speed.
110
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
2
Push the sides of the security lock inwards (see figure Replacing a fan module, detail 1).
3
Pull out the security lock (see figure Replacing a fan module, detail 2).
4
Pull up the retention lever and pull the fan module out just a little, wait for it to stop, and then pull it out completely.
2.19.2 Installing a fan module Procedure 1
Insert the fan module completely into the shelf. The blue hot swap LED turns off and the green OK LED is lit.
Post requisites If the Major Telco Alarm LED is lit when you have replaced the fan module, you can clear the alarm by entering the clia command alarm clear through the serial port on the shelf alarm display.
2.20 Replacing a shelf in cabinet (EC208-A) Purpose If the shelf is damaged or faulty, it needs to be replaced with a new one. The replacement procedure requires shutting down the shelf and all of its units.
g
Note: • •
•
In the cabinet EC208-A, the procedure for replacing the shelf ACH16-A is the same with that for the shelf ASH16-A. You need 4 and 5 mm Allen keys for removing and installing the shelf. When installing a new shelf, you need a T10 torx screwdriver to remove the transportation support plate. If you are installing the shelf to an operating network element, connect your ESD wrist strap to the ESD grounding point in the cabinet.
Before you start The replacement procedure requires shutting down the shelf and all of its units. The following needs to be considered:
DN0966621 Issue: 11-0
© 2017 Nokia
111
Replacing hardware units
Maintaining and Troubleshooting Hardware
If there are critical 2N functional units in the shelf that do not have a redundant unit in another shelf, shutting down the shelf (for example, the first shelf) will require the entire network element to be shut down. For the other shelves, the replacement proedure will cause partial service outage, but it does not need to shut down the entire network element.
•
g
Note: The following procedure shows how you can replace the third shelf of an Open MSS as an example. The same procedure is valid only for the last shelf in use, for example, the second shelf of the two-shelf-configuration, the third shelf of the threeshelf-configuration, the fourth shelf of the four-shelf-configuration, or the fifth shelf of the five-shelf-configuration. Depending on the problem situation, the shelf managers or shelf data modules could be moved from the old shelf to be replaced to the new one.
•
g
Note: The following procedure shows how you can move the shelf managers and shelf data modules from the old shelf to the new one. Reconfigure the LAN settings so that other shelves are not connected to each other via the shelf that is being replaced. Depending on the LAN structure, this may also require cable rerouting. Make sure that there is an availble fallback copy of the current software build. Block all command calendar tasks. List all command calendar tasks: ZICL; Block the command calendar tasks: ZICB::BLOCK;
•
• •
2.20.1 Removing a shelf from the cabinet (EC208-A) Before you start
f
CAUTION! Risk of physical injury The shelf is heavy. Lifting the shelf requires at least two persons. Procedure 1
Read the FRU information, record the shelf and EMB addresses, and back up the FRU data. Sub-steps a) Connect to the active shelf manager from your workstation through the serial connection. Set the connection parameters on your workstation as follows: • • • • •
112
Baud rate: 38400 Data bits: 8 Stop bits: 1 Flow control: none No parity
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
The default user account is root and password is shmm4nsn. For more details, refer to document ATCA 16-slot DC Shelf User Guide. b) Check the shelf address and record it.
clia shelfaddress Example output: # clia shelfaddress Pigeon Point Shelf Manager Command Line Interpreter Shelf Address Info: "030001 A0103FFFFFF.." #
Further information The address of the first shelf is “010001 A0101FFFFFF..” (1A001-00). The address of the second shelf is “020001 A0102FFFFFF..” (1A002-00). The address of the third shelf is “030001 A0103FFFFFF..” (1A003-00).
c) Check the EMB addresses and record them.
clia fruinfo -x 20 254 | grep "OEM" -A 5 -m 2 Example output: # clia fruinfo -x 20 254 | grep "OEM" -A 5 -m 2 Record Type = 0xc0 OEM Defined Record Version = 2 Manufacturer ID = 0x006F2A C0 02 07 5F D8 2A 6F 00 06 00 01 01 Record Type Version = 2 Manufacturer ID C0 02 22 1B 01 2A FF FF FF 00 14 00 FF FF FF FF FF FF #
= 0xc0 OEM Defined Record = 0x006F2A 6F 00 07 00 1C 00 15 00 74 00 75 FF FF
93 00 94 FF FF FF FF FF
Take the above output as an example, the EMB addresses for the functional units in different slots of one shelf are as follows (excluding the addresses of SWUs or child units):
DN0966621 Issue: 11-0
© 2017 Nokia
113
Replacing hardware units
Maintaining and Troubleshooting Hardware
#1
#2
#3
C 00 22 21 B0 12 A6 F0 00 70 01 C0 09 30 09 4F F #4
#5
#6
#7
#10
#11
#12
#13
F FF FF F0 01 40 01 50 07 40 07 5F FF FF FF FF F #14
#15
#16
F FF FF FF FF FF FF F
d) Check that the FRU data in EEPROM1 and EEPROM2 are identical with that in the memory.
clia fruinfo -x 20 1 clia fruinfo -x 20 2 clia fruinfo -x 20 254
e) Back up the FRU data.
clia frudatar 10 0 /var/nvdata/fru_10_0.bin clia frudatar 12 0 /var/nvdata/fru_12_0.bin clia frudatar 20 254 /var/nvdata/fru_20_254.bin
g 2
Note: You can also back up the FRU data to OMU's hard disk.
Check that the LAN switch configuration has been saved to the hard disk and check which flash bank is active. Sub-steps a) Connect to the LAN switches through a telnet connection.
ZW6T:SWU,;
b) Check which flash bank (primary or secondary) is active and which flash bank will be in use after the next reboot. For example: AHUB3# show all processor cpu revision bogomips chipset Vendor
114
: : : : : :
0 e500 2.0 (pvr 8020 0020) 823.29 8541E RadiSys Corporation
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
Machine clock PVR SVR PLL setting Memory Flash Bank build ipmc fpga ipmc cpld
: : : : : : : : : : :
ATCA-2210 [0x402] (MPC8541E) 825MHz 0x80200020 0x807a0011 0x5 1024 MB 0 RELEASE3.0.60_WR20 00.16.00 02.51.00 5
Flash bank to use on next reboot Boot Flash Bank : primary AHUB3#
From the output, you can notice that: •
The primary flash bank is in use: Flash Bank
•
: 0
The primary flash bank will be in use after the next reboot: Flash bank to use on next reboot Boot Flash Bank : primary
Further information Flash Bank: 0 means that the primary flash bank is in use. Flash Bank: 1 means that the secondary flash bank is in use. c) Check the configuration.
show running-config
d) Log out the LAN switch and download the configuration file.
exit When closing the telnet connection, enter Y to the following prompt: /*** CONNECTION CLOSED ***/ DO YOU WANT TO DOWNLOAD CONFIGURATION FILE FROM LAN SWITCH ? Y
DN0966621 Issue: 11-0
© 2017 Nokia
115
Replacing hardware units
3
Maintaining and Troubleshooting Hardware
Deactivate the CHU pair. Sub-steps a) Inform the billing center the deactivation of the CHU pair. b) Set the INAC-flag for the CHU pair to deactivate it. For example:
ZUSI:OMU; ZDDE:OMU,0:"ZL:U","ZLP:U,RCB”; ZDDE:OMU,0:"ZUST:CHU,2,0:S-INAC","ZUST:CHU,2,1:S-INAC"; ZUSI:CHU,2;
c) Check that the CHU pair is not recording charging data.
ZMCJ:ALL=N,:TARGET=; For example:
ZMCJ:ALL=N,:TARGET=CHU-WO-02; Example output: MSCi
ATCA-LAB
2013-09-12
TOTAL NUMBER OF ALL RECORDS IN CHU-WO-02 NUMBER OF ORIGINAL NUMBER OF MOBILE NUMBER PORTABILITY NUMBER OF ROAMING NUMBER OF FORWARDING TOTAL NUMBER OF RESERVED CALL RECORDS
08:32:13
LEGS LEGS LEGS LEGS
IS IS IS IS IS IS
0204000 0000000 0000000 0000000 0000000 0000000
COMMAND EXECUTED
TOTAL NUMBER OF RESERVED CALL RECORDS IS 0000000 means that the CHU pair is not recording charging data.
d) Confirm that the other CHU units are still recording charging data.
ZMCJ:ALL=N,:TARGET=; ZIFO:CHU,<pair_index>:GSMCHA:;
e) Copy the charging data from memory to hard disk by switching over the CHU units.
ZUSI:CHU,<pair_index>; ZUSC:CHU,<pair_index>,<WO-EX unit index>:SP; For example:
116
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
ZUSC:CHU,2,0:SP; f)
Check that there is no open charging files.
ZIFO:CHU,<pair_index>:GSMCHA:; You can check the open, full, or transferred files, for example:
ZIFO:CHU,2:GSMCHA:,OPEN; ZIFO:CHU,2:GSMCHA:,FULL; ZIFO:CHU,2:GSMCHA:,TRANS;
g) Make sure that the charging files stored in WDU of the deactivated CHU pair have been moved to the billing center. h) Change the CHU pair from the SP-EX or WO-EX state to the SE-NH state. For example:
ZUSC:CHU,2,1:TE; ZUSC:CHU,2,1:SE; ZUSC:CHU,2,1:SE; ZUSC:CHU,2,0:TE,FCD; ZUSC:CHU,2,0:SE; ZUSC:CHU,2,0:SE;
4
t
Change the states of the GISU units and GPLU units to SE-NH. Tip: Alarm 2445 UNIT TYPE HAS NO REDUNDANCY would be triggered.
5
Deactivate the VLRU pair. If there is no VLRU pair in the shelf to be replaced, skip this step. Sub-steps a) Change the VLRU unit in the SP-EX state to SE-NH. For example:
ZUSC:VLRU,6,1:TE; ZUSC:VLRU,6,1:SE; ZUSC:VLRU,6,1:SE;
DN0966621 Issue: 11-0
© 2017 Nokia
117
Replacing hardware units
Maintaining and Troubleshooting Hardware
b) Change the VLRU unit in the WO-EX state to SE-NH. For example:
ZUSC:VLRU,6,0:TE,FCD; ZUSC:VLRU,6,0:SE; ZUSC:VLRU,6,0:SE;
w
NOTICE: The following steps c to i must be executed one by one immediately. Otherwise, it may cause serious Visitor Location Register (VLR) overload and the entire MSS outage problems.
c) Restart the spare CMM unit with the C=DSK and F=IMM parameters.
ZUSI:CMM; ZUSU:CMM,<SP-EX unit index>:C=DSK,F=IMM;
d) Wait until the spare CMM unit is restarted and check that the state is SP-EX.
ZUSI:CMM;
e) Switch over the CMM units.
ZUSI:CMM; ZUSC:CMM,<WO-EX unit index>:SP;
f)
Restart the spare CMM unit with the C=DSK and F=IMM parameters.
ZUSI:CMM; ZUSU:CMM,<SP-EX unit index>:C=DSK,F=IMM;
g) Wait until the spare CMM unit is restarted and check that the state is SP-EX.
ZUSI:CMM;
h) Switch over the CMM units.
ZUSI:CMM; ZUSC:CMM,<WO-EX unit index>:SP;
i)
Restart all the VLRU pairs in the WO-EX state at the same time immediately.
ZUSI:VLRU;
118
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
ZUSU:VLRU,<pair index>,<WO-EX unit index>:F=IMM; For example:
ZUSU:VLRU,0,0:F=IMM; ZUSU:VLRU,1,0:F=IMM; ZUSU:VLRU,2,0:F=IMM; ZUSU:VLRU,3,0:F=IMM; ZUSU:VLRU,4,0:F=IMM; ZUSU:VLRU,5,0:F=IMM; j)
Check that subscribers are coming to the VLR.
ZMVI; Example output: SUBSCRIBERS IN VLR ACTIVE 215 214 215 214 215 214 213
VLRU-0-1 VLRU-1-1 VLRU-2-0 VLRU-3-0 VLRU-4-0 VLRU-5-1 VLRU-6-0
( ( ( ( ( ( (
ACT_LIMIT 0%) 142857 0%) 142857 0%) 142857 0%) 142857 0%) 142857 0%) 142857 0%) 142857
PASSIVE 0 0 0 0 0 0 0
TOT_LIMIT 143571 143571 143571 143571 143571 143571 143571
DB USAGE% 0% 0% 0% 0% 0% 0% 0%
/*** VLRU 7 STATE INCORRECT ***/ ------------------------------------------------------------------------TOTAL 1500 ( 0%) 999999 0 1004997 0% COMMAND EXECUTION FAILED
6
Change the states of the VMU units to SE-NH. Sub-steps a) Change the state of the VMU units to BL-ID.
ZUSC:VMU,:BL; Wait until the state of the VMU units is changed to BL-ID.
ZUSI:VMU,;
b) Change the state of the VMU units from BL-ID to SE-NH.
ZUSC:VMU,:TE;
DN0966621 Issue: 11-0
© 2017 Nokia
119
Replacing hardware units
Maintaining and Troubleshooting Hardware
ZUSC:VMU,:SE; ZUSC:VMU,:SE;
7
Change the states of the IPDU units to SE-NH. If there is no IPDU unit in the shelf to be replaced, skip this step.
8
Change the states of the SHMU units to SE-NH. For example:
ZUSI:SHMU; ZUSC:SHMU,4:TE; ZUSC:SHMU,4:SE; ZUSC:SHMU,4:SE; ZUSC:SHMU,5:TE,FCD; ZUSC:SHMU,5:SE; ZUSC:SHMU,5:SE;
9
Change the state of the LAN switches in the shelf to be replaced to passive. Sub-steps a) Change the state of CNW-0 and EMB-0 to SE-NH.
ZUSC:CNW,0:TE; ZUSC:CNW,0:SE; ZUSC:CNW,0:SE; ZUSC:EMB,0:SP; ZUSC:EMB,0:TE; ZUSC:EMB,0:SE; ZUSC:EMB,0:SE;
b) Deactivate the LAN switches.
ZW6E:SWU,:P; For example:
ZW6E:SWU,4:P; ZW6E:SWU,64:P;
120
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
c) Change the state of CNW-0 and EMB-0 to WO-EX. d) Check the active alarms.
ZAHO; Check if there are active LAN switch related alarms. For example, alarms 2692 and 3292 might be triggered and can be cancelled by the following command:
ZACA:2692:SWU;
e) Repeat the above steps to CNW-1 and EMB-1.
10 Remove all the CPU blades and their RTMs from the shelf.
g
Note: Do not remove the hub blades or shelf managers. a) b) c) d) e) f)
DN0966621 Issue: 11-0
Open the hot swap handles. Wait until the hot swap LEDs turn steady blue. Disconnect all cables from the blades and RTMs. Unscrew the screws from the blades and RTMs. Mark the blades before removing that can be installed to the same slot later (due to different BIOS settings). Remove the blades and RTMs from the shelf, holding them by the handles, and place them on an ESD protected surface.
© 2017 Nokia
121
Replacing hardware units
Maintaining and Troubleshooting Hardware
11 Switch off the circuit breakers on the PDUs that are connected to the shelf that is being replaced. Figure 50
Power distribution unit (ADPDU-A) circuit breakers
ON
-48/-60VDC CircuitBreaker1
-48/-60VDC CircuitBreaker2 OFF
DN70296475
t
Tip: Alarm 3434 might be triggered.
12 Switch off the battery feeds on the PDUs that are connected to the shelf that is being replaced. 13 Remove the hub blades and shelf managers and place them on an ESD protected surface.
122
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
14 Remove the rear cable tray from the shelf. Figure 51
Removing the rear cable tray
Rearview
M4x8 M3x10
DN70673601
DN0966621 Issue: 11-0
© 2017 Nokia
123
Replacing hardware units
Maintaining and Troubleshooting Hardware
15 Remove the three fan modules. Figure 52
Removing a fan module OKLED AlarmLED HotSwapLED HotSwap PushButton
Retentionlever
1
DN70259064
Rearview
2
a) Lift the retention lever. b) Pull out the fan module. For more details, refer to Replacing a fan module.
16 Remove the two power entry modules (PEMs). a) Disconnect all the cables between the power distribution units and power entry modules. b) Unscrew the two fixing screws on the power entry module. c) Holding both handles, pull the PEM out of the slot. For more details, refer to Replacing a power entry module (ADPEM-A).
124
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
17 Disconnect all the remaining cables that are connected to the shelf. a) Disconnect the TELCO alarm cable from the shelf alarm panel. b) Disconnect the serial cable, if used, from the shelf alarm display. c) Disconnect the shelf grounding cable at the rear of the shelf.
18 Unscrew the eight M6 screws attaching the shelf to the mounting rail and the four M6 and two M5 screws attaching the shelf to the rear support rail. Figure 53
DN0966621 Issue: 11-0
Removing the shelf
© 2017 Nokia
125
Replacing hardware units
Maintaining and Troubleshooting Hardware
19 Slide the shelf out of the cabinet. 20 Remove the shelf data modules from the old shelf. Figure 54
Removing a shelf data module (SHCDM-A) Shelfdatamodule2
Shelfdatamodule1
Fixingscrew
Slot
PEM A
DN70258474
a) Remove the fixing screw at the top of the shelf data module. b) Push the shelf data module downwards to release the locking mechanism in the slot. c) Remove the shelf data module and place them on an ESD protected surface. For more details, refer to Replacing a shelf data module (SHCDM-A).
2.20.2 Installing a shelf into the cabinet (EC208-A) Procedure 1
Install the shelf data modules into the new shelf, which were removed from the old shelf. a) b) c) d) e)
Remove the PEMs. Insert the shelf data module into its slot. Push the module downwards to engage the locking mechanism in the slot. Mount the fixing screw on top of the module. Install the PEMs.
For more details, refer to Replacing a shelf data module (SHCDM-A).
126
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
2
Remove the three fan modules from the shelf.
3
Slide the shelf on the support brackets into the cabinet.
4
Attach the shelf to the cabinet mounting rail with eight M6 screws and to the rear support rail with four M6 and two M5 screws. Figure 55
DN0966621 Issue: 11-0
Installing the shelf - front view
© 2017 Nokia
127
Replacing hardware units
Maintaining and Troubleshooting Hardware
Figure 56
Installing the shelf - rear view
2pcsM5 screws
4pcsM6screws
DN0973677
g
Rearview
Note: Check that the cable storage shelf has been installed correctly so that it makes a perfect right angle to the cabinet wall. If the cable storage shelf has been installed in a slightly tilted position, it may prevent the shelf manager from being removed.
5
Install the three fan modules back into the shelf. The fan modules fall properly into place with a click.
6
At the rear of the shelf, connect the shelf grounding cable (CGNDA) between the shelf and the cabinet grounding rail. a) If not already connected, connect the grounding cable to the cabinet grounding rail. Tighten the nuts with a 10 mm socket wrench. b) Connect the grounding cable to the shelf grounding point with two M6 screws. Tighten the nuts with a 10 mm socket wrench.
7
Remove the transportation support plate covering the front of the shelf. Unscrew the screws with a T10 screwdriver.
128
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
8
Connect the cables between the power distribution units and power entry modules.
9
Install the shelf managers and hub blades. Refer to the shelf manager installation instructions from the Installing a shelf manager.
g
Note: Do not install the CPU blades than hub blades or shelf managers. Do not install any internal cables between the hub blades.
10 Switch on the battery feeds on the PDUs. 11 Power up the shelf by switching on the circuit breakers on the PDUs. 12 Check the FRU data, shelf address, and EMB addresses. The FRU data, shelf and EMB addresses were already read before removing the shelf and the result should be the same as before. Sub-steps a) Connect to the active shelf manager through the serial connection. b) Check the shelf address.
clia shelfaddress
c) Check the EMB addresses.
clia fruinfo -x 20 254 | grep "OEM" -A 5 -m 2
d) Check the FRU data.
clia fruinfo -x 20 1 clia fruinfo -x 20 2 clia fruinfo -x 20 254
DN0966621 Issue: 11-0
© 2017 Nokia
129
Replacing hardware units
Maintaining and Troubleshooting Hardware
13 Update the hardware codes and serial numbers of the new shelf, air filter tray and shelf alarm display to the FRU data. Sub-steps a) Read the hardware codes and serial numbers from the label stickers of the new shelf, air filter tray and shelf alarm display. The figure below shows the locations of the labels in ATCA 16-slot shelf ACH16SET-A, and shows examples of the label contents. Figure 57
Placement of labels in ATCA 16-slot shelf ACH16SET-A Cablesetidentification ATCA basiccableset NEcablesetstickers*
Shelfsetidentification
Networkelementidentification
ACH16SET-A (1P) FNGHW (1T)
Xxxxx
(1P) C110808.03
NE-ID:NE123456 (S)
123456789
Xxxxx
(1P) C123132.00 (S)
MadeinFinland
(1P) C123132.00
123456798
(S)
MadeinFinland
123456789
MadeinFinland
*)attachedatthesite. TheNE stickersneededaredelivered togetherwiththecableset.
Shelfposition Cabinet Shelf
1 BOT
2
3
MID
TOP
Shelftype
BOT =bottomposition MID =middleposition TOP =topposition
ATCA SYSTEM16S 21596151 1350901555 AC
Type ATCA SYSTEM Ord.No. 11596050 S/N 1360900177 AF MadeinGermany Input:-48Vdc/-60Vdc max.25A perpowerbranch (total4x4powerbranches)
CUS
Shelftypeandrating NokiaSolutionsandNetworks
ACH16-A
RATING
-48/-60VDC 4x25 A max. N16701
Frontview
Airfilteridentification(notvisiblefromoutside)
ACH16-A (1P) C1122699.0 (S)
123456789
SHALP-A (1P) C110998.A1A
MadeinFinland
(S)
XY110102310
SHCDM-A (1P) C112724.A1A (S)
XY980900998
MadeinFinland
(S)
XY892402489
SHCDM-A (S)
XY980900998
(S)
XY990000988
ASMGR-A
MadeinFinland
(S)
XY892402489
ADPEM-A (S)
XY980300345
MadeinFinland
(1P) C110581.A4A
(1P) C112695.01
MadeinFinland
(1P) C110639.A1A
ASMGR-A (1P) C110581.A4A
(1P) C112724.A1A
MadeinFinland
CHAF2-A
LUFTFILTER 2199027 1211203941
Shelfidentification
SHALD-A (1P) C110997.A1A
MadeinFinland
(S)
XY732802873
MadeinFinland
ADPEM-A (1P) C112695.01
MadeinFinland
(S)
XY980300345
MadeinFinland
DN0935988
b) Update the serial number of the new shelf to the FRU data for both FRU ID 1&2 at address 20h, for example:
patch_fru_info 20 254 c SerialNumber XY092601756 XY092601756 is the serial number in this example.
130
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
c) Update the part number (that is, hardware code) of the new shelf to the FRU data for both FRU ID 1&2 at address 20h, for example:
patch_fru_info 20 254 c PartNumber C110808.A1A C110808.A1A is the part number in this example.
d) Update the hardware code and serial number of the air filter tray to the FRU data for both FRU ID 1&2 at address 20h, for example: patch_fru_info 20 254 c 3 "CHAF2-A
:C110639.A1A:SCHR:XY990000988"
C110639.A1A is the hardware code and XY990000988 is the serial number in this example.
e) Update the hardware code and serial number of the shelf alarm display to the FRU data for both FRU ID 1&2 at address 20h, for example: patch_fru_info 20 254 c 6 "SHALD-A
:C110997.A1A:SCHR:XY732802873"
SHALD-A is the shelf alarm display type, C110997.A1A is the hardware code, and XY732802873 is the serial number in this example.
f)
Check that the hardware codes and serial numbers of the new shelf, air filter tray and shelf alarm display have been updated in the FRU data.
clia fruinfo -v 20 1 | grep -A 25 “Chassis Info Area” clia fruinfo -v 20 2 | grep -A 25 “Chassis Info Area” clia fruinfo -v 20 254 | grep -A 25 “Chassis Info Area” Example output: # clia fruinfo -v 20 1 | grep -A 25 "Chassis Info Area" Chassis Info Area: Version = 1 Chassis Type = (23) Chassis Part Number = C110808.A1A Chassis Serial Number = XY092601756 Custom Chassis Info = SCHROFF CHAF2-A :C110639.A1A:SCHR:XY990000988 SHCDM-B :C112724.A1A:SCHR:XY120502626 SHCDM-B :C112724.A1A:SCHR:XY120502637 SHALD-A :C110997.A1A:SCHR:XY732802873 0x00 0x51 AIR_FILTER_POLARITY=1 TACH_MASK=DB TOP_FAN_SHELF
Board Info Area: Version = 1
DN0966621 Issue: 11-0
© 2017 Nokia
131
Replacing hardware units
Maintaining and Troubleshooting Hardware
Language Code Mfg Date/Time Board Manufacturer Board Product Name Board Serial Number Board Part Number FRU Programmer File ID Custom Board Info
= = = = = = = =
25 Jul 26 09:00:00 2012 (8713980 minutes since 1996) SCHROFF ACH16-A
0x00 0x51
#
From the output, you can notice that: •
The part number (that is, hardware code) of the new shelf is: Chassis Part Number
•
= C110808.A1A
The serial number of the new shelf is: Chassis Serial Number
•
The hardware code and serial number of the new air filter tray are: CHAF2-A
•
= XY092601756
:C110639.A1A:SCHR:XY990000988
The hardware code and serial number of the new shelf alarm display are: SHALD-A
:C110997.A1A:SCHR:XY732802873
14 Check the base interface (BI) and fabric interface (FI) configuration from the LAN swtiches and check that the same flash bank is active as before. Sub-steps a) Connect to the LAN switches from your workstation through the serial connection. Set the connection parameters on your workstation as follows: • • • • •
Baud rate: 38400 Data bits: 8 Stop bits: 1 Flow control: none No parity
The default user account is admin. For more details, refer to document AHUB3-A and HBRT3-A User Guide.
b) Check that the same flash bank is in use as before. For example: AHUB3# show all processor cpu revision bogomips
132
: : : :
0 e500 2.0 (pvr 8020 0020) 823.29
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
chipset Vendor Machine clock PVR SVR PLL setting Memory Flash Bank build ipmc fpga ipmc cpld
Replacing hardware units
: : : : : : : : : : : : :
8541E RadiSys Corporation ATCA-2210 [0x402] (MPC8541E) 825MHz 0x80200020 0x807a0011 0x5 1024 MB 0 RELEASE3.0.60_WR20 00.16.00 02.51.00 5
Flash bank to use on next reboot Boot Flash Bank : primary AHUB3#
c) Check the configuration.
show running-config
d) Log out the LAN switch.
exit
DN0966621 Issue: 11-0
© 2017 Nokia
133
Replacing hardware units
Maintaining and Troubleshooting Hardware
15 Connect the BI and FI cables between the shelves. Sub-steps a) Connect the BI cables between the shelves. b) Check whether the LAN links are up (check the Link LED state of the BI interfaces). Figure 58
LEDs of BI interfaces BASE
Link Port
XFP 1/5
SFP 1/6
Link Port
SFP 1/7
Link Port
SFP 1/8
Link Port
SFP 1/9
Link Port
c) Check whether the EMB remains in the normal state and the related alarms.
ZUSI:EMB; ZAHO;
t
134
Tip: Alarm 3254 LAN DEVICE GENERAL FAILURE might appear.
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
d) Connect the FI cables between the shelves. e) Check whether the LAN links are up (check the Link LED state of the FI interfaces). Figure 59
LEDs of FI interfaces
Link Port
XFP 1/1
Link Port
XFP 1/2
Link Port
XFP 1/3 FABRIC
f)
Check whether the CNW remains in the normal state and the related alarms.
ZUSI:CNW; ZAHO;
t
Tip: Alarm 3254 LAN DEVICE GENERAL FAILURE might appear.
g) Connect the FI loop cable (MSSHW_107).
16 Change the states of the SHMU units to WO-EX and SP-EX. Check the states of the shelf managers according to the LEDs. Change the active unit's state to WO-EX and backup unit's state to SP-EX.
17 Check the connectivity of the shelf managers. Sub-steps a) Connect to the active shelf manager through the serial connection. b) Check the IP addresses of the eth0, eth0:0, eth1 and eth1:0 interfaces.
ifconfig Example output:
DN0966621 Issue: 11-0
© 2017 Nokia
135
Replacing hardware units
Maintaining and Troubleshooting Hardware
# ifconfig eth0 Link encap:Ethernet HWaddr 00:18:49:01:B0:BC inet addr:10.200.201.15 Bcast:10.200.201.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:67456 errors:0 dropped:0 overruns:0 frame:0 TX packets:5374 errors:1 dropped:0 overruns:0 carrier:2 collisions:0 txqueuelen:1000 RX bytes:16532665 (15.7 MiB) TX bytes:3140388 (2.9 MiB) Interrupt:27 eth0:0
Link encap:Ethernet HWaddr 00:18:49:01:B0:BC inet addr:10.200.202.13 Bcast:10.200.202.31 Mask:255.255.255.248 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 Interrupt:27
eth1
Link encap:Ethernet HWaddr 00:18:49:01:B0:BD inet addr:10.200.200.15 Bcast:10.200.200.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:115046 errors:0 dropped:0 overruns:0 frame:0 TX packets:5955 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:20007458 (19.0 MiB) TX bytes:3182510 (3.0 MiB) Interrupt:28
eth1:0
Link encap:Ethernet HWaddr 00:18:49:01:B0:BD inet addr:10.200.202.5 Bcast:10.200.202.23 Mask:255.255.255.248 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 Interrupt:28
lo
Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.255.255.0 UP LOOPBACK RUNNING MTU:16436 Metric:1 RX packets:55 errors:0 dropped:0 overruns:0 frame:0 TX packets:55 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:10074 (9.8 KiB) TX bytes:10074 (9.8 KiB)
usb0
Link encap:Ethernet HWaddr 12:F5:64:6D:2A:D7 inet addr:192.168.2.131 Bcast:192.168.2.255 Mask:255.255.255.128 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:1441655 errors:0 dropped:0 overruns:0 frame:0 TX packets:1441753 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:74790269 (71.3 MiB) TX bytes:1202028490 (1.1 GiB)
From the output, you can notice that the IP addresses of the eth0, eth0:0, eth1 and eth1:0 interfaces: • • •
136
The IP address of eth0: 10.200.201.15 The IP address of eth0:0: 10.200.202.13 The IP address of eth1: 10.200.200.15
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
•
t
Replacing hardware units
The IP address of eth1:0: 10.200.202.5
Tip: If there are no IP addresses, or the information of the eth0 or eth1 interface is missing, give the following commands: Change the link to down and up. For example: ifconfig eth0 down ifconfig eth0 up
If changing the link to down and up does not work, you can try to renew the IP addresses using the following commands: clia dhcp restart clia dhcp status
If there are still no IP addresses, configure IP addresses manually. For example: •
Execute the following commands to configure the IP addresses for SHMU-4: ifconfig eth0 10.200.200.14 netmask 255.255.255.0 ifconfig eth1 10.200.201.14 netmask 255.255.255.0
•
Execute the following commands to configure the IP addresses for SHMU-5: ifconfig eth0 10.200.201.15 netmask 255.255.255.0 ifconfig eth1 10.200.200.15 netmask 255.255.255.0
c) Check whether there are two open sessions between the SHMU and OMU units.
clia session Example output: # clia session Pigeon Point Shelf Manager Command Line Interpreter 32 sessions possible, 2 sessions currently active Session: 1, User: ID 2, Name: "openhpi"; Privilege Level: "Administrator"; Notifier: Off Channel: 1 ("LAN_802_3"); Peer IP address: 10.200.202.17, Port: 52963 Session: 2, User: ID 2, Name: "openhpi"; Privilege Level: "Administrator"; Notifier: Off Channel: 2 ("LAN_802_3"); Peer IP address: 10.200.202.25, Port: 52963
DN0966621 Issue: 11-0
© 2017 Nokia
137
Replacing hardware units
t
Maintaining and Troubleshooting Hardware
Tip: • • • •
•
There can be more than two sessions, usually as a result of switchovers. The unused sessions will be cleared after a while automatically. If there is only one session, check the EMB states. If the EMB is in the SE state, there is no active session in it. If IP addresses exist in SHMU, try to ping to both physical and logical addresses of OMU. If the ping does not work from the shelf manager to OMU, but both ends ping their own addresses, check the configuration of AHUB3-A. Check whether the OMU ports are in order and whether the port (port 2/4) to shelf managers is up. If the ping works, but there are still no sessions, try to renew IP addresses in the shelf manager using the following commands: clia dhcp restart clia dhcp status
•
If the ping works and the IP addresses are in order in the shelf manager, but there are still no sessions, try to restart the OMU unit in the WO-EX state. During the next startup, the system should initialize the connection to the shelf managers.
d) Check that there is no packet loss with ping.
clia getlanconfig 1 clia getlanconfig 2 Example output: # clia getlanconfig 1 Pigeon Point Shelf Manager Command Line Interpreter PING 10.200.202.17 (10.200.202.17): 56 data bytes 64 bytes from 10.200.202.17: seq=0 ttl=64 time=13.061 ms --- 10.200.202.17 ping statistics --1 packets transmitted, 1 packets received, 0% packet loss round-trip min/avg/max = 13.061/13.061/13.061 ms
From the output, you can notice that there is no packet loss: --- 10.200.202.17 ping statistics --1 packets transmitted, 1 packets received, 0% packet loss
e) Clear the shelf manager log.
clia sel clear
138
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
f)
Replacing hardware units
Switch over the SHMU units by changing the state of the SHMU unit in the WO-EX state to SP-EX.
ZUSC:SHMU,:SP;
g) Repeat Step a to Step e for the new active shelf manager.
18 Activate the LAN switches. Sub-steps a) Change the state of CNW-0 and EMB-0 to SE-OU.
ZUSC:CNW,0:TE; ZUSC:CNW,0:SE; ZUSC:EMB,0:SP; ZUSC:EMB,0:TE; ZUSC:EMB,0:SE;
b) Change the state of the LAN switches to WO-EX. For example:
ZUSC:SWU,4:SE; ZUSC:SWU,4:TE; ZUSC:SWU,4:WO; ZUSC:SWU,64:SE; ZUSC:SWU,64:TE; ZUSC:SWU,64:WO; ZUSI:SWU;
c) Connect to the LAN switches through serial connection and restart the SNMP daemon. blade-mgmt config service snmpd restart exit show service
Example output: AHUB3(blade-mgmt)# show service Services Status Service Enabled Status
DN0966621 Issue: 11-0
© 2017 Nokia
139
Replacing hardware units
Maintaining and Troubleshooting Hardware
------------------syslog dhcpd hpiSubagent ntpd snmpd radius-client pam-snmp snmpWatchdog cli-logging watchdog telnet tftp sshd ftpd AHUB3(blade-mgmt)#
----------enabled disabled disabled disabled enabled disabled enabled disabled enabled enabled enabled enabled disabled disabled
From the output, you can notice that the SNMP daemon is enabled: snmpd
enabled
d) Activate the LAN switches. For example:
ZW6E:SWU,4:A; ZW6E:SWU,64:A;
e) Check whether the LAN switches have IP addresses. For example:
ZYFF::SWU,4; ZYFF::SWU,64; Example output: UNIT PIU TYPE IP ADDRESS MAC ADDRESS LAN UNIT ------------------------------------------------------------------SWU - 4 AHUB3_A 10.20.0.4 CNW - 0 INTERNAL LAN CONFIGURATION STATUS: ------------------------------IP ADDRESS CONFIGURED : OK
From the output, you can notice that the LAN switch has an IP address: IP ADDRESS CONFIGURED
:
OK
If the IP address is not configured, renew it using the following commands and re-check it with the ZYFF command. linux-shell ifrenew dtl0 ifrenew dtl1
140
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
ifrenew dtl0 is used for renewing IP address for the BI LAN and ifrenew dtl1 is used for renewing IP address for the FI LAN. f)
Change the state of the LAN switches to SE-OU. For example:
ZUSC:SWU,4:TE; ZUSC:SWU,4:SE; ZUSC:SWU,64:TE; ZUSC:SWU,64:SE;
g) Change the state of CNW-0 and EMB-0 to TE-EX.
ZUSC:CNW,0:TE; ZUSC:EMB,0:TE;
h) Check whether the IP addresses of the LAN switches are configured, the trap host is configured, the configuration file is loaded, and the supervision status is reachable. For example:
ZYFF::SWU,4; ZYFF::SWU,64;
g
Note: After the LAN switch is activated (step d), it may take up to 20 minutes before the switch is reachable from the LAN management point of view. Example output:
ZYFF::SWU,4; EXECUTION STARTED, MAY TAKE SEVERAL MINUTES READING LAN SWITCH SUPERVISION DATA ... UNIT PIU TYPE IP ADDRESS MAC ADDRESS LAN UNIT ------------------------------------------------------------------SWU - 4 AHUB3_A 10.20.0.4 00:00:50:9B:E3:D9 CNW - 0 INTERNAL LAN CONFIGURATION STATUS: ------------------------------IP ADDRESS CONFIGURED : OK CONFIGURATION FILE LOADED : OK SNMP VERSION CONFIGURED : v1,v2c TRAP HOST CONFIGURED : OK L2/L3 ADMIN STATE : L2 L2/L3 OPERATION STATE : L2
DN0966621 Issue: 11-0
© 2017 Nokia
141
Replacing hardware units
Maintaining and Troubleshooting Hardware
SUPERVISION STATUS: ------------------------------SUPERVISION ENABLED : ON SUPERVISION CYCLE REF(SEC): 30 SUPERVISION STATUS : REACHABLE LAST SUPERVISION DONE : 2012-11-28
08:41:42.67
PORT OPERATIVE ADMIN INDEX STATE STATE -----------------------------0/1 : DOWN UP 0/2 : DOWN UP 0/3 : DOWN UP 0/4 : DOWN UP 0/5 : DOWN UP 0/6 : DOWN UP 0/7 : DOWN UP 0/10 : DOWN UP 0/11 : DOWN UP 0/12 : DOWN UP 0/13 : DOWN UP 0/14 : DOWN UP 0/15 : DOWN UP 0/16 : DOWN UP 1/1 : UP UP 1/2 : DOWN UP 1/3 : UP UP 2/3 : DOWN UP 3/4 : DOWN DOWN COMMAND EXECUTED
142
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
t
Replacing hardware units
Tip: If the supervision status is unreachable and SNMP is not configured: Check the SNMP configuration: linux-shell cat /etc/snmp/snmpd.conf | grep NSN
The following lines should be visible at the end of the configuration file: root@AHUB3@1-1-8:/# cat /etc/snmp/snmpd.conf | grep NSN com2sec SecNameNSN default public com2sec -Cn fi SecNameFiNSN default public-fi group GroupNSN v2c SecNameNSN group GroupFiNSN v2c SecNameFiNSN access GroupNSN "" any noauth exact all none access GroupFiNSN fi any noauth exact all none root@AHUB3@1-1-8:/#
all all
If there are no such lines, upload the configuration file to the LAN switches: For example:
ZYFM:UCF:SWU,64; Restart the SNMP daemon: blade-mgmt config service snmpd restart
Check again with the ZYFF command that the supervision status is reachable.
i)
Run diagnostics on EMB-0.
ZUDU:EMB,0; ZUDH:EMB,0; For more information, refer to UD - Diagnostics Handling.
j)
If the diagnostics is in order, change the state of EMB-0 to SP-EX.
ZUSC:EMB,0:SP;
k) Run diagnostics on CNW-0.
ZUDU:CNW,0; ZUDH:CNW,0;
l)
If the diagnostics is in order, change the state of CNW-0 to WO-EX.
ZUSC:CNW,0:WO;
DN0966621 Issue: 11-0
© 2017 Nokia
143
Replacing hardware units
Maintaining and Troubleshooting Hardware
m) Repeat the above steps to CNW-1 and EMB-1.
19 Install the rest of the blades and rear transition modules into the shelf according to your network element configuration. 20 Connect the internal cables according to your network element configuration. Refer to documents Installing ATCA Hardware and Open MSS Hardware Installation Quick Guide.
21 Connect the external cables according to your network element configuration. Refer to documents Installing ATCA Hardware and Open MSS Hardware Installation Quick Guide.
22 Activate the VLRU pair. If there was no VLRU pair in the replaced shelf, skip this step. Sub-steps a) Change the state of the VMU units which have virtualized VLRU pairs to WO-EX.
ZUSC:VMU,:SE; ZUSC:VMU,:TE; ZUSC:VMU,:WO; ZUSI:VLRU;
w
NOTICE: The following steps b to h must be executed one by one immediately. Otherwise, it may cause serious VLR overload and the entire MSS outage problems.
b) Restart the spare CMM unit with the C=DSK and F=IMM parameters.
ZUSI:CMM; ZUSU:CMM,<SP-EX unit index>:C=DSK,F=IMM;
c) Wait until the spare CMM unit is restarted and check that the state is SP-EX.
ZUSI:CMM;
144
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
d) Switch over the CMM units.
ZUSI:CMM; ZUSC:CMM,<WO-EX unit index>:SP;
e) Restart the spare CMM unit with the C=DSK and F=IMM parameters.
ZUSI:CMM; ZUSU:CMM,<SP-EX unit index>:C=DSK,F=IMM;
f)
Wait until the spare CMM unit is restarted and check that the state is SP-EX.
ZUSI:CMM;
g) Switch over the CMM units.
ZUSI:CMM; ZUSC:CMM,<WO-EX unit index>:SP;
h) Restart all the VLRU pairs in the WO-EX state at the same time immediately.
ZUSI:VLRU; ZUSU:VLRU,<pair index>,<WO-EX unit index>:F=IMM; For example:
ZUSU:VLRU,0,0:F=IMM; ZUSU:VLRU,1,0:F=IMM; ZUSU:VLRU,2,0:F=IMM; ZUSU:VLRU,3,0:F=IMM; ZUSU:VLRU,4,0:F=IMM; ZUSU:VLRU,5,0:F=IMM;
i)
Check that subscribers are coming to the VLR.
ZMVI;
DN0966621 Issue: 11-0
© 2017 Nokia
145
Replacing hardware units
Maintaining and Troubleshooting Hardware
23 Take the GISU units and GPLU units into use. Sub-steps a) Change the state of the VMU units which have virtualized GISU units to WO-EX.
ZUSC:VMU,:SE; ZUSC:VMU,:TE; ZUSC:VMU,:WO; ZUSI:VMU,;
b) If there were GPLU units, change the state to SP-EX.
ZUSC:GPLU,:SE; ZUSC:GPLU,:TE; ZUSC:GPLU,:SP; ZUSI:GPLU,;
24 Take the IPDU units into use. If there was no IPDU unit in the replaced shelf, skip this step.
25 Activate the CHU pair. Sub-steps a) Inform the billing center the activation of the CHU pair. b) Check that the CHU pair is still in the SE-NH state and the information on them is INAC.
ZUSI:CHU,<pair_index>; Example output: ZUSI:CHU,2; EXECUTION STARTED MSCi
ATCA-LAB
WORKING STATE OF UNIT PHYS CHU-2-0 0014 CHU-2-1 0015
146
UNITS STATE LOCATION SE-NH SE-NH
© 2017 Nokia
2014-08-28
08:24:21
INFO INAC INAC
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
c) Change the state of the CHU pair to WO-EX and SP-EX. For example:
ZUSC:CHU,2,0:SE; ZUSC:CHU,2,0:WO; ZUSC:CHU,2,1:SE; ZUSC:CHU,2,1:TE; ZUSC:CHU,2,1:SP;
d) Check that the hard disks are in the WO-BU state. For example:
ZISI:,CHU,2:WDU;
e) Make sure that the INAC flag is still set.
ZUSI:CHU,<pair_index>;
f)
Check the connection between the CHU pair and the billing center.
g) Clear the INAC flag in the CHU unit that is in the WO-EX state.
ZUSI:CHU,<pair_index>; ZUST:CHU,<pair_index>,<WO-EX unit index>:C-INAC; For example:
ZUST:CHU,2,0:C-INAC;
h) Check that the CHU pair is working properly. For example:
ZIFO:CHU,2:GSMCHA:; ZMCJ:ALL=N,:TARGET=CHU-WO-02;
26 Complete the shelf replacement. Sub-steps a) Unblock the command calendar tasks which were blocked before the replacement.
ZICL;
DN0966621 Issue: 11-0
© 2017 Nokia
147
Replacing hardware units
Maintaining and Troubleshooting Hardware
ZICB::UNBLOCK; b) Check the faulty links.
ZYFE:IFL;
c) Check the active alarms.
ZAHO; Check if there are active LAN switch related alarms (for example, alarm 3254) which were triggered due to the shelf replacement and have not been cancelled automatically. Cancel the alarms by the ZACA:; command.
d) Check that the network element works properly and as the same as before. Check that every unit is working in the normal state, the same signalling links are up as before, and so forth.
e) Check the clear codes.
ZTUT:CLR;
2.21 Replacing a shelf (ASA16-A) in cabinet (CAB216-A) Purpose If the shelf is damaged or faulty, it needs to be replaced with a new one. The replacement procedure requires shutting down the shelf and all of its units. Before you start The replacement procedure requires shutting down the shelf and all of its units. The following needs to be considered: •
•
If there are critical 2N functional units in the shelf that do not have a redundant unit in another shelf, shutting down the shelf will require the entire network element to be shut down. Reconfigure the LAN settings so that other shelves are not connected to each other via the shelf that is being replaced. Depending on the LAN structure, this may also require cable rerouting.
Prepare the following tools: • • •
148
a digital multimeter or voltage meter 8 and 10 mm spanner or a socket wrench with 8 and 10 mm sockets M4 straight lug wrench
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
3 mm T-type Allen key screwdriver 90-degree screwdriver size 1 and 2 Phillips screwdrivers Torx T10, Torx T30 and Torx T40 screwdrivers T20 T-type screwdriver ESD wrist strap protective gloves safety ladder
• • • • • • • •
f
Replacing hardware units
CAUTION! Risk of physical injury The shelf is heavy. Lifting the shelf requires at least two persons.
f
CAUTION! Risk of physical injury Unfastened equipment in the cabinet can fall off if the cabinet is moved. Never leave the shelf equipped in the cabinet for extended periods with the fixing screws unfastened.
w
NOTICE: Electrostatic discharge (ESD) may damage hardware components. To avoid ESD damage: • •
t
Before handling hardware units, check that the site is an ESD-protected area (EPA). If the area is not ESD-protected, create a temporary EPA. When handling hardware units, wear an ESD wrist strap or use a corresponding protection method, and do not touch the connector surfaces.
Tip: The shelf is easier to lift if you remove the fan modules and power supply units from the shelf. Re-install the fan modules and power supply units afterwards.
2.21.1 Removing a shelf (ASA16-A) from the cabinet (CAB216-A) Procedure 1
Read the FRU information and record the shelf address and the NE ID address from the shelf FRU information.
2
Change the states of all functional units so that no unit is in active state. Note that if there are critical 2N functional units in the shelf that do not have a redundant unit in another shelf, shutting down the shelf will require the entire network element to be shut down.
3
Remove all blades and rear transition modules (RTMs) from the shelf. a) b) c) d)
DN0966621 Issue: 11-0
Open the hot swap handles. Wait until the hot swap LEDs turn steady blue. Disconnect all cables from the blades and RTMs. Unscrew the screws from the blades and RTMs.
© 2017 Nokia
149
Replacing hardware units
Maintaining and Troubleshooting Hardware
e) Remove the blades and RTMs from the shelf, holding them by the handles, and place them on an ESD protected surface.
4
Switch off the site power supply.
5
Switch off the power supply unit (PSU) circuit breakers from the rear side of the shelf.
6
Disconnect all the remaining cables that are connected to the shelf. a) Unscrew the hexagonal M4 screw on each side of the rear cable tray, lift the rear cable tray upwards and turn it out of the way. b) Disconnect the AC power feed cables from the site power supply. c) Disconnect the shelf grounding cable at the rear of the shelf. d) Disconnect the TELCO alarm cable from the shelf alarm panel. e) Disconnect the serial cable, if used, from the shelf alarm display.
7
Remove the three fan modules from the shelf. a) Lift the retention lever. b) Pull out the fan module.
8
Remove the four PSUs from the shelf. a) Push the button to unlock the PSU cover. b) Open the PSU cover and use it as the extraction lever to pull out the PSU.
150
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Figure 60
DN0966621 Issue: 11-0
Replacing hardware units
Removig the PSU (AAPSU-A)
© 2017 Nokia
151
Replacing hardware units
9
Maintaining and Troubleshooting Hardware
Remove the front door to make the holes on the front cabinet profile available for the installation support frame (ISTR-A). Figure 61
152
Positioning holes for the ISTR-A installation support frame
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
10 Install the shelf installation support frame. a) Pull out the springs. Figure 62
ISTR-A installation support frame with the pin and spring
Frontview
DN0985392
b) Align the installation support frame with the cabinet positioning holes and push horizontally until the frame mates with the cabinet front profiles, that is, both the ISTR-A pins are inserted into the cabinet positioning holes and the ISTR-A front are inserted into the cabinet mid-post holes.
g
Note: When inserting the installation support frame, pay attention to its orientation. Do not turn it upside down. Figure 63
Installing ISTR-A installation support frame
c) Insert the spring into the hole of each pin to secure the installation support frame.
DN0966621 Issue: 11-0
© 2017 Nokia
153
Replacing hardware units
Maintaining and Troubleshooting Hardware
11 Unscrew the eight M6 screws attaching the shelf to the mounting rail and the four M6 and two M5 screws on the rear brackets that attach the shelf to the rear support rail.
154
Figure 64
Removing a shelf (ASA16-A) from the cabinet (CAB216-A)
Figure 65
Removing a shelf (ASA16-A) from the cabinet (CAB216-A) - rear view
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
12 Slide the shelf from the support bracket to the installation support frame till the shelf is out of the cabinet. 13 If the new shelf is not to be installed immediately, perform the following steps: a) Pull out the springs from the installation support frame holes and remove the frame. b) Install the front door. See the ATCA installation document for details.
2.21.2 Installing a shelf (ASA16-A) into the cabinet (CAB216-A) Procedure 1
Install the rear cable tray. a) Slide the cable tray on its support on the shelf. Figure 66
Installing the rear cable tray
b) Secure the tray by using one hexagonal M4 screw , and one Phillips M3 screw with a washer and bearing sleeve on each side of the cable tray.
DN0966621 Issue: 11-0
© 2017 Nokia
155
Replacing hardware units
2
Maintaining and Troubleshooting Hardware
Remove the cable tray claws using a T20 T-type screwdriver, if the cable count in your configuration is so big that the claws block the cable routes. Figure 67
Removing the cable tray claws
3
Remove the three fan modules from the shelf.
4
Remove the four PSUs from the shelf.
5
If you are installing the shelf to an operating network element, connect your ESD wrist strap to the ESD grounding point in the cabinet.
6
If the shelf installation support frame is not installed, perform the following steps: a) If the front door is not removed, remove it. b) Install the shelf installation support frame. See the Removing a shelf (ASA16-A) from the cabinet (CAB216-A) section for details.
7
t
156
Place the shelf on the mounted installation support frame, and slide the shelf on the support brackets into the cabinet. Tip: You can tilt the rear side of the shelf a bit up so it can be slided from the installation support frame to the side support brackets more smoothly.
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
8
DN0966621 Issue: 11-0
Replacing hardware units
Attach the shelf to the cabinet mounting rail with eight M6 screws and to the rear support rail with four M6 and two M5 screws on the rear brackets. Figure 68
Installing a shelf (ASA16-A) into the cabinet (CAB216-A) - front view
Figure 69
Installing a shelf (ASA16-A) into the cabinet (CAB216-A) - rear view
© 2017 Nokia
157
Replacing hardware units
g
Maintaining and Troubleshooting Hardware
Note: Check that the cable storage shelf has been installed correctly so that it makes a perfect right angle to the cabinet wall. If the cable storage shelf has been installed in a slightly tilted position, it may prevent the shelf manager from being removed.
9
Re-install the three fan modules back into the shelf. The fan modules fall properly into place with a click.
10 Re-install the four PSUs back into the shelf. 11 At the rear of the shelf, connect the shelf grounding cable (CGNDF) between the shelf and the cabinet grounding rail. a) If not already connected, connect the grounding cable to the cabinet grounding rail. Tighten the nuts with a 10 mm socket wrench. b) Connect the grounding cable to the shelf grounding point with two M6 screws. Tighten the nuts with a 10 mm socket wrench.
12 Remove the transportation support plate covering the front of the shelf. Unscrew the screws with a T10 screwdriver.
158
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
13 Pull out the springs from the installation support frame holes and remove the frame. 14 Install the front door. See the ATCA installation document for details. 15 Make sure the site power supply and the PSU circuit breakers are switched off. 16 Connect the AC power feed cables to the site power supply. 17 Switch on the site power supply. 18 Power up the shelf by switching on the PSU circuit breakers from the rear side of the shelf. 19 Connect to the active shelf manager via the serial port in the alarm display panel. 20 Enter the following commands to check whether the network element IDs of the new shelf are the same as the network element IDs of the shelf that was removed earlier. # clia networkelementid # clia networkelementid -i 2 # clia networkelementid -i 3
The network element IDs of the new shelf have been configured at the factory and they cannot be changed. If the network element IDs of the new shelf are not the same as network element IDs of the shelf that was removed earlier, contact your local company representative.
21 Configure the shelf address. Check the shelf address by entering the following command: # clia shelfaddress
The shelf address was already read in section Removing a shelf (ASA16-A) from the cabinet (CAB216-A).
22 Power down the shelf by switching off the PSU circuit breakers. The shelf is powered down so that all blades and RTMs can be installed back into the shelf according to the needed configuration, and then powered up at once.
DN0966621 Issue: 11-0
© 2017 Nokia
159
Replacing hardware units
Maintaining and Troubleshooting Hardware
23 Install blades and RTMs into the shelf according to your network element configuration. 24 Connect internal cables according to your network element configuration. You can check the cable routing and fixing instructions from the Installing ATCA Hardware document and network element specific equipping and cabling documentation.
25 Connect external cables according to your network element configuration. You can check the cable routing and fixing instructions from the Installing ATCA Hardware document and network element specific equipping and cabling documentation.
26 Power up the shelf by switching on the PSU circuit breakers. 27 Reconfigure the network element and take all the units into use. 28 Verify that the embedded software in the hardware units and the BIOS information in the CPU units are consistent with the product release, and update if necessary. See a document that describes embedded software management for details.
2.22 Replacing a shelf (ASH16-A) in cabinet (CAB216-A) Purpose If the shelf is damaged or faulty, it needs to be replaced with a new one. The replacement procedure requires shutting down the shelf and all of its units. Before you start The replacement procedure requires shutting down the shelf and all of its units. The following needs to be considered: •
•
If there are critical 2N functional units in the shelf that do not have a redundant unit in another shelf, shutting down the shelf will require the entire network element to be shut down. Reconfigure the LAN settings so that other shelves are not connected to each other via the shelf that is being replaced. Depending on the LAN structure, this may also require cable rerouting.
Prepare the following tools: • •
160
a digital multimeter or voltage meter 8 and 10 mm spanner or a socket wrench with 8 and 10 mm sockets
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
M4 straight lug wrench 3 mm T-type Allen key screwdriver 90-degree screwdriver size 1 and 2 Phillips screwdrivers Torx T10, Torx T30 and Torx T40 screwdrivers T20 T-type screwdriver ESD wrist strap protective gloves safety ladder
• • • • • • • • •
f
Replacing hardware units
CAUTION! Risk of physical injury The shelf is heavy. Lifting the shelf requires at least two persons.
f
CAUTION! Risk of physical injury Unfastened equipment in the cabinet can fall off if the cabinet is moved. Never leave the shelf equipped in the cabinet for extended periods with the fixing screws unfastened.
w
NOTICE: Electrostatic discharge (ESD) may damage hardware components. To avoid ESD damage: • •
Before handling hardware units, check that the site is an ESD-protected area (EPA). If the area is not ESD-protected, create a temporary EPA. When handling hardware units, wear an ESD wrist strap or use a corresponding protection method, and do not touch the connector surfaces.
2.22.1 Removing a shelf (ASH16-A) from the cabinet (CAB216-A) Procedure 1
Read the FRU information and record the shelf address and the NE ID address from the shelf FRU information.
2
Change the states of all functional units so that no unit is in active state. Note that if there are critical 2N functional units in the shelf that do not have a redundant unit in another shelf, shutting down the shelf will require the entire network element to be shut down.
3
Remove all blades and rear transition modules (RTMs) from the shelf. a) b) c) d) e)
DN0966621 Issue: 11-0
Open the hot swap handles. Wait until the hot swap LEDs turn steady blue. Disconnect all cables from the blades and RTMs. Unscrew the screws from the blades and RTMs. Remove the blades and RTMs from the shelf, holding them by the handles, and place them on an ESD protected surface.
© 2017 Nokia
161
Replacing hardware units
4
Maintaining and Troubleshooting Hardware
Switch off the PDU circuit breakers that control the PDU outputs connected to the shelf to be replaced. Figure 70
ADPD2-A circuit breakers
Circuitbreakerx6 ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
1
2
3
4
5
6
LEDx6 Mountingholex4 Frontview
DN0990951
The following table shows the relation between the PDU circuit breakers, PDU output terminals and shelves in the cabinet. Table 16
Relation between PDU circuit breakers, PDU outputs and shelves
PDU circuit breaker
PDU output
1
OUT1+/-
2
OUT2+/-
3
OUT3+/-
4
OUT4+/-
5
OUT5+/-
6
OUT6+/-
Shelf Top shelf
Middle shelf
Bottom shelf
The corresponding red LEDs of the PDU are lit.
5
Disconnect all the remaining cables that are connected to the shelf. a) Unscrew the hexagonal M4 screw on each side of the rear cable tray, lift the rear cable tray upwards and turn it out of the way. b) Disconnect all the cables between the PDUs and power entry modules (PEMs) from the PEM input terminals. c) Disconnect the shelf grounding cable at the rear of the shelf. d) Disconnect the TELCO alarm cable from the shelf alarm panel. e) Disconnect the serial cable, if used, from the shelf alarm display.
162
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
6
Replacing hardware units
Remove the three fan modules. a) Lift the retention lever. b) Pull out the fan module.
DN0966621 Issue: 11-0
© 2017 Nokia
163
Replacing hardware units
7
Maintaining and Troubleshooting Hardware
Remove the front door to make the holes on the front cabinet profile available for the installation support frame (ISTR-A). Figure 71
164
Positioning holes for the ISTR-A installation support frame
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
8
Replacing hardware units
Install the shelf installation support frame. a) Pull out the springs. Figure 72
ISTR-A installation support frame with the pin and spring
Frontview
DN0985392
b) Align the installation support frame with the cabinet positioning holes and push horizontally until the frame mates with the cabinet front profiles, that is, both the ISTR-A pins are inserted into the cabinet positioning holes and the ISTR-A front are inserted into the cabinet mid-post holes.
g
Note: When inserting the installation support frame, pay attention to its orientation. Do not turn it upside down. Figure 73
Installing ISTR-A installation support frame
c) Insert the spring into the hole of each pin to secure the installation support frame.
DN0966621 Issue: 11-0
© 2017 Nokia
165
Replacing hardware units
9
Maintaining and Troubleshooting Hardware
Unscrew the eight M6 screws attaching the shelf to the mounting rail and the four M6 and two M5 screws on the rear brackets that attach the shelf to the rear support rail. Figure 74
Removing a shelf (ASH16-A) from the cabinet (CAB216-A)
Figure 75
Removing a shelf (ASH16-A) from the cabinet (CAB216-A) - rear view
10 Slide the shelf from the support bracket to the installation support frame till the shelf is out of the cabinet. 11 If the new shelf is not to be installed immediately, perform the following steps: a) Pull out the springs from the installation support frame holes and remove the frame.
166
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
b) Install the front door. See the ATCA installation document for details.
2.22.2 Installing a shelf (ASH16-A) into the cabinet (CAB216-A) Procedure 1
Install the rear cable tray. a) Slide the cable tray on its support on the shelf. Figure 76
Installing the rear cable tray
b) Secure the tray by using one hexagonal M4 screw , and one Phillips M3 screw with a washer and bearing sleeve on each side of the cable tray.
t
DN0966621 Issue: 11-0
Tip: Do not fix the hexagonal M4 screws tightly at this point, as you need remove them later when you connect the cables between the PDUs and PEMs.
© 2017 Nokia
167
Replacing hardware units
2
Maintaining and Troubleshooting Hardware
Remove the cable tray claws using a T20 T-type screwdriver, if the cable count in your configuration is so big that the claws block the cable routes. Figure 77
Removing the cable tray claws
3
Remove the three fan modules from the shelf.
4
If you are installing the shelf to an operating network element, connect your ESD wrist strap to the ESD grounding point in the cabinet.
5
Make sure that the PDU circuit breakers that control the PDU outputs connected to the shelf to be installed are off. The following table shows the relation between the PDU circuit breakers, PDU output terminals and shelves in the cabinet. Table 17
Relation between PDU circuit breakers, PDU outputs and shelves
PDU circuit breaker
168
PDU output
1
OUT1+/-
2
OUT2+/-
3
OUT3+/-
4
OUT4+/-
5
OUT5+/-
6
OUT6+/-
© 2017 Nokia
Shelf Top shelf
Middle shelf
Bottom shelf
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
6
Replacing hardware units
If the shelf installation support frame is not installed, perform the following steps: a) If the front door is not removed, remove it. b) Install the shelf installation support frame. See the Removing a shelf (ASH16-A) from the cabinet (CAB216-A) section for details.
7
t
Place the shelf on the mounted installation support frame, and slide the shelf on the support brackets into the cabinet. Tip: You can tilt the rear side of the shelf a bit up so it can be slided from the installation support frame to the side support brackets more smoothly.
8
Attach the shelf to the cabinet mounting rail with eight M6 screws and to the rear support rail with four M6 and two M5 screws on the rear brackets. Figure 78
DN0966621 Issue: 11-0
Installing a shelf (ASH16-A) into the cabinet (CAB216-A) - front view
© 2017 Nokia
169
Replacing hardware units
Maintaining and Troubleshooting Hardware
Figure 79
g
Installing a shelf (ASH16-A) into the cabinet (CAB216-A) - rear view
Note: Check that the cable storage shelf has been installed correctly so that it makes a perfect right angle to the cabinet wall. If the cable storage shelf has been installed in a slightly tilted position, it may prevent the shelf manager from being removed.
9
Install the three fan modules back into the shelf. The fan modules fall properly into place with a click.
10 Install the shelf managers. You can check the shelf manager installation instructions from the section Installing a shelf manager.
11 At the rear of the shelf, connect the shelf grounding cable (CGNDF) between the shelf and the cabinet grounding rail. a) If not already connected, connect the grounding cable to the cabinet grounding rail. Tighten the nuts with a 10 mm socket wrench. b) Connect the grounding cable to the shelf grounding point with two M6 screws. Tighten the nuts with a 10 mm socket wrench.
12 Remove the transportation support plate covering the front of the shelf. Unscrew the screws with a T10 screwdriver.
170
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
13 Pull out the springs from the installation support frame holes and remove the frame. 14 Install the front door. See the ATCA installation document for details. 15 Unscrew the hexagonal M4 screw on each side of the rear cable tray, lift the rear cable tray upwards and turn it out of the way. 16 Connect the cables between the PDUs and PEMs. 17 Re-install the hexagonal M4 screws to the rear cable tray and secure them tightly.
t
Tip: Due to the narrow working-space, a 90-degree screwdriver could be useful for fixing the hexagonal M4 screws.
18 Power up the shelf by switching on the circuit breakers on the PDUs. The following table shows the relation between the PDU circuit breakers, PDU output terminals and shelves in the cabinet. Table 18
Relation between PDU circuit breakers, PDU outputs and shelves
PDU circuit breaker
DN0966621 Issue: 11-0
PDU output
1
OUT1+/-
2
OUT2+/-
3
OUT3+/-
4
OUT4+/-
5
OUT5+/-
6
OUT6+/-
© 2017 Nokia
Shelf Top shelf
Middle shelf
Bottom shelf
171
Replacing hardware units
Maintaining and Troubleshooting Hardware
19 Connect to the active shelf manager via the serial port in the alarm display panel. 20 Enter the following commands to check whether the network element IDs of the new shelf are the same as the network element IDs of the shelf that was removed earlier. # clia networkelementid # clia networkelementid -i 2 # clia networkelementid -i 3
The network element IDs of the new shelf have been configured at the factory and they cannot be changed. If the network element IDs of the new shelf are not the same as network element IDs of the shelf that was removed earlier, contact your local company representative.
21 Configure the shelf address. Check the shelf address by entering the following command: # clia shelfaddress
The shelf address was already read in section Removing a shelf from the cabinet.
22 Power down the shelf by switching off the circuit breakers on the PDUs. The shelf is powered down so that all blades and RTMs can be installed back into the shelf according to the needed configuration, and then powered up at once.
23 Install blades and RTMs into the shelf according to your network element configuration. 24 Connect internal cables according to your network element configuration. You can check the cable routing and fixing instructions from the Installing ATCA Hardware document and network element specific equipping and cabling documentation.
25 Connect external cables according to your network element configuration. You can check the cable routing and fixing instructions from the Installing ATCA Hardware document and network element specific equipping and cabling documentation.
172
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
26 Power up the shelf by switching on the circuit breakers on the PDUs. 27 Reconfigure the network element and take all the units into use. 28 Verify that the embedded software in the hardware units and the BIOS information in the CPU units are consistent with the product release, and update if necessary. See a document that describes embedded software management for details.
2.23 Replacing a shelf manager Purpose This example shows how to replace an active shelf manager. Figure 80
Replacing the shelf manager
Frontview
DN70244967
Procedure 1
Check the status of the SHMU.
ZUSI:SHMU; Example output: MSCi WORKING STATE OF UNIT PHYS SHMU-0 SHMU-1
2010-06-16 UNITS STATE WO-EX SP-EX
LOCATION
13:51:27
INFO -
TOTAL OF 2 UNITS COMMAND EXECUTED
DN0966621 Issue: 11-0
© 2017 Nokia
173
Replacing hardware units
2
Maintaining and Troubleshooting Hardware
Make a switch-over to the spare SHMU.
ZUSC:SHMU,1:WO;
3
Remove the shelf manager. See Removing a shelf manager.
4
Install the new shelf manager. See Installing a shelf manager.
5
Change the working state of the SHMU.
ZUSC:SHMU,0:TE; ZUSC:SHMU,0:SP; ZUSC:SHMU,0:WO;
6
Check the working state.
ZUSI:SHMU,0; Example output: MSCi WORKING STATE OF UNIT PHYS SHMU-0 SHMU-1
UNITS STATE WO-EX SP-EX
2010-06-16
13:51:27
LOCATION
INFO -
TOTAL OF 2 UNITS COMMAND EXECUTED
Further information The following problem may occur when the shelf manager unit is changed: After the spare (SP-EX) shelf manager has been removed, the active (WO-EX) shelf manager reboots. This may happen either because the user has issued the reboot with the CLIA reboot command or for some other reason. As a result, however, the system manager loses the RMCP connection with the active shelf manager. When the reboot is finished, the shelf manager remains in the M2 state (activation request, the blue led keeps blinking). The system manager cannot serve the activation request because it does not receive the trap which contains the request. In about ten seconds, the system manager issues a system reboot because it cannot establish the RMCP connection. What to do to resolve the problem:
174
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
Activate the shelf manager manually from the command line interface (CLIA) after the reboot (when the red led has switched off) while the blue led is blinking so that the system manager can re-create the RMCP connection. The activation command is:
#clia activate 10 0 (if the rebooted shelf manager is the left one) Or
#clia activate 12 0 (if the rebooted shelf manager is the right one) After this operation, the shelf manager functions normally again.
2.23.1 Removing a shelf manager Procedure 1
Unscrew the thumb screw on the shelf manager front panel.
2
Open the hot swap handle slightly until the blue hot swap LED starts blinking. A trigger mechanism in the handle activates the hot swap.
3
g
DN0966621 Issue: 11-0
When the hot swap LED turns solid blue, open the handle completely and pull the shelf manager out of its slot. Note: If the cable storage shelf has been installed so that it does not sit vertically in a totally direct angle, it may stop the shelf manager from coming out. In this case, try to loosen the screws that hold the cable storage shelf in place and adjust the shelf so that it sits correctly.
© 2017 Nokia
175
Replacing hardware units
Maintaining and Troubleshooting Hardware
2.23.2 Installing a shelf manager Procedure 1
Insert the shelf manager into the guides and push it completely into the shelf.
2
Close the hot swap handle.
3
Tighten the fixing screw.
4
Verify that the embedded software in the hardware units is consistent with the product release, and update it if needed. See a document that describes embedded software management for details.
Result The shelf manager boots up. In approximately a minute, the green status LED is lit, indicating that the shelf manager is fully operational. The status LED of the active shelf manager is solid green, the status LED of the backup shelf manager is blinking.
2.24 Replacing a shelf alarm display Purpose Figure 81
176
Replacing the shelf alarm display
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
2.24.1 Removing the shelf alarm display Procedure 1
Uninstall the serial cable, if connected.
2
Unscrew both fixing screws on the alarm display.
3
Holding both fixing screws, pull the alarm display out of its slot.
2.24.2 Installing the shelf alarm display Procedure 1
Insert the guides of the shelf alarm display into the slots on the horizontal board.
2
Push the shelf alarm display into the slot.
3
Tighten both fixing screws.
4
Log into the active shelf manager.
5
Back up the shelf FRU data. Enter the following command from the active shelf manager: clia frudatar 20 254 /var/nvdata/shelf_fru_backup.bin
6
Update the shelf FRU data. Enter the following two commands: patch_fru_info 20 1 c 6 "<SAD name>::SCHR:<serial>" patch_fru_info 20 2 c 6 "<SAD name>::SCHR:<serial>"
<SAD name> is the product name of the shelf alarm display, for example, SHALD-A. is the hardware code and <serial> the serial number of the new shelf alarm display. They must always be stored in two places and therefore the command is entered twice. You must read the hardware code and serial number (S/N) from the label stickers of the new shelf alarm display. Example
DN0966621 Issue: 11-0
© 2017 Nokia
177
Replacing hardware units
Maintaining and Troubleshooting Hardware
Enter the following two commands to update the shelf FRU data after replacing the shelf alarm display (label stickers shown in the picture below) patch_fru_info 20 1 c 6 "SHALD-A :C110997.A1A:SCHR:XY732802873" patch_fru_info 20 2 c 6 "SHALD-A :C110997.A1A:SCHR:XY732802873"
Figure 82 SHALD-A
Shelf alarm display label stickers C110997.A1A
SHALD-A S/N:XY 732802873
DN0948636
2.25 Replacing a shelf alarm panel Purpose Figure 83
Replacing the shelf alarm panel (SHALP-A)
Shelf Alarm Panel(SAP) Telco Alarm Connector (DB15-male)
FixingScrew DN70245109
The replacement procedure is applicable for both SHALP-A and SHALP-B.
2.25.1 Removing the shelf alarm panel Procedure
178
1
Uninstall the TELCO alarm cable, if connected.
2
Unscrew the fixing screw.
3
Pull the alarm panel out of its slot.
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
2.25.2 Installing the shelf alarm panel Procedure 1
Insert the shelf alarm panel to its slot. Take care not to damage the module as there are no guides in the slot.
2
Tighten the fixing screw at the bottom of the alarm panel.
3
Install the TELCO alarm cable, if used.
2.26 Replacing a shelf data module (SHCDM-A) Purpose The shelf data module (SHCDM-A) is located behind the power entry module. If you need to replace it, you need to remove the power entry module first. Figure 84
Replacing a shelf data module (SHCDM-A) Shelfdatamodule2
Shelfdatamodule1
Fixingscrew
Slot
PEM A
DN70258474
Before you start The replacement procedure requires shutting down the shelf and all of its units. If there are critical 2N functional units in the shelf that do not have a redundant unit in another shelf, shutting down the shelf will require the entire network element to be shut down. Prepare the following tools: • • •
DN0966621 Issue: 11-0
screwdrivers ESD wrist strap safety ladder
© 2017 Nokia
179
Replacing hardware units
w
Maintaining and Troubleshooting Hardware
NOTICE: The shelf data module is very sensitive to rough treatment. Handle the shelf data module with care during all installation phases.
2.26.1 Removing a shelf data module (SHCDM-A) Procedure 1
Connect to the active shelf manager from the workstation through the serial connection. Set the connection parameters on the workstation as follows: • • • • •
Baud rate: 38400 Data bits: 8 Stop bits: 1 Flow control: none No parity
The default user account is root and password is shmm4nsn. For more details, refer to the document ATCA 16-slot DC Shelf User Guide.
2
Verify that the current FRU data is correct in the shelf manager memory. Enter the following command: clia fruinfo 20 254 | grep -c "Error"
The command output indicates the number of errors. Step example # clia fruinfo 20 254 | grep -c "Error" 0 #
g
Note: The number of errors should be 0 to have a error-free backup in the next step.
3
Back up the FRU data. Enter the following command: clia frudatar 20 254 /var/nvdata/old_shelf_fru.bin
4
Power off the shelf. Switch off the circuit breakers on the power distribution units (PDUs) that are connected to the shelf.
180
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
5
Replacing hardware units
Remove the two power entry modules (PEMs). Sub-steps a) Lift the rear cable tray upwards and turn it out of the way. b) Unscrew the two fixing screws on the PEM. c) Holding both handles, pull the PEM out of the slot.
6
Remove the shelf data module(s) from the shelf. If the shelf data module 1 is faulty, remove both shelf data modules and make sure they do not get mixed. The existing shelf data module 2 will be installed in the right slot from the rear view. If the shelf data module 2 is faulty, remove it only. Sub-steps a) Remove the fixing screw at the top of the shelf data module with a magnetic screwdriver. b) Push the shelf data module downwards to release the locking mechanism in the slot. c) Remove the shelf data module and place them on an ESD protected surface. Figure 85
Replacing a shelf data module (SHCDM-A) Shelfdatamodule2
Shelfdatamodule1
Fixingscrew
Slot
PEM A
DN70258474
DN0966621 Issue: 11-0
© 2017 Nokia
181
Replacing hardware units
Maintaining and Troubleshooting Hardware
2.26.2 Installing a shelf data module (SHCDM-A) Procedure 1
Insert the shelf data module(s). If the shelf data module 1 is faulty, insert the new module into the module 2 slot (the left slot from the rear view) and the original shelf data module 2 into the module 1 slot (the right slot from the rear view). If the shelf data module 2 is faulty, insert the new data module into the module 2 slot (the left slot from the rear view). Sub-steps a) Insert the new shelf data module into its slot. b) Push the module downwards to engage the locking mechanism in the slot. c) Mount the fixing screw on top of the module with a magnetic screwdriver.
2
Install the PEMs. Sub-steps a) Slide the PEM into the slot along the guide rails. b) Tighten the two fixing screws on the PEM. c) Rotate the rear cable tray downwards.
3
Power on the shelf. Switch on the circuit breakers on the PDUs.
4
Connect to the active shelf manager.
5
Verify that the current FRU data is correct. Enter the following command and the output should be 0. clia fruinfo 20 254 | grep -c "Error"
If error exists, restore the original FRU data with the following command: clia frudataw 20 254 /var/nvdata/old_shelf_fru.bin
182
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
6
Replacing hardware units
Update the serial number of the shelf data module to the shelf FRU data. Enter the following two command: patch_fru_info 20 254 c "SHCDM-A ::SCHR:<serial>"
can be 4 or 5. Use 4 for shelf data module 1 (the right one from the rear view) and 5 for shelf data module 2 (the left one from the rear view). is the hardware code and <serial> is the serial number of the shelf data module. Read the hardware code and serial number (S/N) from the label stickers of the shelf data module. Figure 86
Shelf data module (SHCDM-A) label stickers
Step example For the shelf data module 1: # patch_fru_info 20 254 c 4 "SHCDM-A
g
:C111000.A1A:SCHR:XY980900998"
Note: If the shelf data module 1 is faulty and the original shelf data module 2 is installed to the module 1 slot (the right slot from rear view), <serial> is the serial number of the original shelf data module 2. For the shelf data module 2: # patch_fru_info 20 254 c 5 "SHCDM-A
7
:C111000.A1A:SCHR:XY980900999"
Check that the serial number of the installed shelf data module is updated in the FRU data. Enter the following commands: clia fruinfo -v 20 254 | grep -A 13 "Chassis Info" clia fruinfo -v 20 1 | grep -A 13 "Chassis Info" clia fruinfo -v 20 2 | grep -A 13 "Chassis Info"
Step example # clia fruinfo -v 20 1 | grep -A 13 "Chassis Info" Chassis Info Area: Version = 1 Chassis Type = (23) Chassis Part Number = C112691.01 Chassis Serial Number = XY120503692 Custom Chassis Info = SCHROFF CHAF2-A :C110639.A1A:SCHR:XY120500115 SHCDM-A :C111000.A1A:SCHR:XY980900998 // module 1 information SHCDM-A :C111000.A1A:SCHR:XY980900999 // module 2 information
DN0966621 Issue: 11-0
© 2017 Nokia
183
Replacing hardware units
Maintaining and Troubleshooting Hardware
SHALD-B :C112649.A1A:SCHR:XY120601047 0x00 0x51 AIR_FILTER_POLARITY=1 TACH_MASK=DB TOP_FAN_SHELF
8
Verify that the current FRU data is correct. Enter the following command and the output should be 0. clia fruinfo 20 254 | grep -c "Error"
9
Check the hot swap states of the installed FRUs. Enter the following command and verify that all the installed FRUs are listed and the hot swap state is M4 (Active). clia fru
Step example 10: FRU # 0 Entity: (0xf0, 0x60) Hot Swap State: M4 (Active), Previous: M3 (Activation In Process), Last State Change Cause: Normal State Change (0x0) Device ID String: "ShMM-500"
10 Restore the Network Element ID Enter the following command: clia networkelementid <previous network element ID>
Step example # clia networkelementid Pigeon Point Shelf Manager Command Line Interpreter Error: Network Element ID 1 is differ in Shelf FRU 1 (ÿÿÿÿÿÿÿÿÿÿÿ) and Shelf FRU 2 (NE225705). # # clia networkelementid NE225705
184
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
2.27 Replacing a shelf data module (SHCDM-B) in shelf set (ASH16SET-A) Purpose The shelf data module, SHCDM-B, in the shelf set (ASH16SET-A) is located behind the power entry module (PEM), ADPE2-A. If you need to replace it, you need to remove the PEM first. Before you start The replacement procedure requires shutting down the shelf and all of its units. If there are critical 2N functional units in the shelf that do not have a redundant unit in another shelf, shutting down the shelf will require the entire network element to be shut down. Prepare the following tools: screwdrivers ESD wrist strap safety ladder
• • •
g
Note: The shelf data module is very sensitive to rough treatment. Handle the shelf data module with care during all installation phases.
g
Table 19
Compatibility of SHCDM-B and ASH16-A SHCDM-B
ASH16-A C112648.A1A C112648.A1B
C112724.A1A C112648.B1A Compatible revision
C112724.A1B C112648.B1B C112648.B1C C112724.B1B or later
C112648.C1C or later
2.27.1 Removing a shelf data module (SHCDM-B) in shelf set (ASH16SET-A) Procedure 1
Connect to the active shelf manager from the workstation through the serial connection. Set the connection parameters on the workstation as follows: •
DN0966621 Issue: 11-0
Baud rate: 38400
© 2017 Nokia
185
Replacing hardware units
Maintaining and Troubleshooting Hardware
• • • •
Data bits: 8 Stop bits: 1 Flow control: none No parity
The default user account is root and password is shmm4nsn. For more details, refer to the document ATCA 16-slot DC Shelf User Guide. 2
Verify that the current FRU data is correct in the shelf manager memory. Enter the following command: clia fruinfo 20 254 | grep -c "Error"
The command output indicates the number of errors. Step example # clia fruinfo 20 254 | grep -c "Error" 0 #
g
Note: The number of errors should be 0 to have a error-free backup in the next step.
3
Back up the FRU data. Enter the following command: clia frudatar 20 254 /var/nvdata/old_shelf_fru.bin
4
Power off the shelf. Switch off the power distribution unit (PDU) circuit breakers that control the PDU outputs to the power entry modules (PEMs) in the shelf. Figure 87
ADPD2-A circuit breakers
Circuitbreakerx6 ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
1
2
3
4
5
6
LEDx6 Mountingholex4 DN0990951
Frontview
The following table shows the relation between the PDU circuit breakers and shelves in the cabinet.
186
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Table 20
Replacing hardware units
Relation between PDU circuit breakers and shelves PDU circuit breaker
5
Shelf
1 and 2
Top shelf
3 and 4
Middle shelf
5 and 6
Bottom shelf
Remove the two PEMs. Sub-steps a) Unscrew the hexagonal M4 screw on each side of the rear cable tray, lift the rear cable tray upwards and turn it out of the way. b) Unscrew the two fixing screws on the PEM. Figure 88
Unscrewing the fixing screws on the PEM
c) Holding both handles, pull the PEM out of the slot.
6
Remove the shelf data module(s) from the shelf. If the shelf data module 1 is faulty, remove both shelf data modules and make sure they do not get mixed. The existing shelf data module 2 will be installed in the right slot from the rear view. If the shelf data module 2 is faulty, remove it only.
DN0966621 Issue: 11-0
Option
Description
SHCDM-B version is C112724.A1A or C112724.A1B (old version)
Follow the substpes:
© 2017 Nokia
187
Replacing hardware units
Maintaining and Troubleshooting Hardware
Option
Description a) Unscrew the fixing screw and remove the bracket enclosing the shelf data module with a magnetic screwdriver. b) Push the shelf data module downwards to release the locking mechanism in the slot. c) Remove the shelf data module and place them on an ESD protected surface.
SHCDM-B version is C112724.B1B or later (new version)
Figure 89
Follow the substpes: a) Press the clippers to open status. b) Remove the shelf data module outwards and place them on an ESD potected surface. c) Press the clippers to lock status.
Replacing a shelf data module (SHCDM-B) in shelf set (ASH16SET-A) for old version Shelfdatamodule2
Fixingscrew
Shelfdatamodule1
Bracket
PEM A
DN09106032
188
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Figure 90
Replacing hardware units
Replacing a shelf data module (SHCDM-B) in shelf set (ASH16SET-A) for new version Shelfdatamodule2
Shelfdatamodule1
ID ID
Clippers
PEM A DN09234703
2.27.2 Installing a shelf data module (SHCDM-B) in shelf set (ASH16SET-A) Procedure 1
Insert the shelf data module(s). If the shelf data module 1 is faulty, insert the new module into the module 2 slot (the left slot from the rear view) and the original shelf data module 2 into the module 1 slot (the right slot from the rear view). If the shelf data module 2 is faulty, insert the new data module into the module 2 slot (the left slot from the rear view). Option
Description
SHCDM-B version is C112724.A1A or Follow the substeps: C112724.A1B (old version) a) Insert the new shelf data module into its slot. b) Push the module downwards to engage the locking mechanism in the slot.
DN0966621 Issue: 11-0
© 2017 Nokia
189
Replacing hardware units
Maintaining and Troubleshooting Hardware
Option
Description c) Mount the bracket and tighten the fixing screw with a magnetic screwdriver.
SHCDM-B version is C112724.B1B or Follow the substeps: later (new version) a) Press the clippers to open status. b) Insert the new shelf data module into its slot. c) Press the clippers to lock status.
2
Install the PEMs. Sub-steps a) Slide the PEM into the slot along the guide rails. b) Tighten the two fixing screws on the PEM. c) Re-install the hexagonal M4 screws to the rear cable tray and secure them tightly.
t 3
Tip: Due to the narrow working-space, a 90-degree screwdriver could be useful for fixing the hexagonal M4 screws.
Power on the shelf. Switch on the corresponding circuit breakers on the PDUs.
4
Connect to the active shelf manager.
5
Verify that the current FRU data is correct. Enter the following command and the output should be 0. clia fruinfo 20 254 | grep -c "Error"
If error exists, restore the original FRU data with the following command: clia frudataw 20 254 /var/nvdata/old_shelf_fru.bin
190
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
6
Replacing hardware units
Update the serial number of the shelf data module to the shelf FRU data. Enter the following commands: patch_fru_info 20 254 c "SHCDM-B ::SCHR:<serial>"
can be 4 or 5. Use 4 for shelf data module 1 (the right one from the rear view) and 5 for shelf data module 2 (the left one from the rear view). is the hardware code and <serial> is the serial number of the shelf data module. Read the hardware code and serial number (S/N) from the label stickers of the shelf data module. Figure 91
Shelf data module (SHCDM-B) label stickers SHCDM-BS/N:XY 850800309
SHCDM-BC112724.A1A DN0990309
Step example For the shelf data module 1: # patch_fru_info 20 254 c 4 "SHCDM-B
g
:C112724.A1A:SCHR:XY850800308"
Note: If the shelf data module 1 is faulty and the original shelf data module 2 is installed to the module 1 slot (the right slot from rear view), <serial> is the serial number of the original shelf data module 2. For the shelf data module 2: # patch_fru_info 20 254 c 5 "SHCDM-B
7
:C112724.A1A:SCHR:XY850800309"
Check that the serial number of the installed shelf data module is updated in the FRU data. Enter the following commands: clia fruinfo -v 20 254 | grep -A 13 "Chassis Info" clia fruinfo -v 20 1 | grep -A 13 "Chassis Info" clia fruinfo -v 20 2 | grep -A 13 "Chassis Info"
Step example # clia fruinfo -v 20 1 | grep -A 13 "Chassis Info" Chassis Info Area: Version = 1 Chassis Type = (23) Chassis Part Number = C112691.01 Chassis Serial Number = XY120503692 Custom Chassis Info = SCHROFF CHAF2-A :C110639.A1A:SCHR:XY120500115 SHCDM-B :C112724.A1A:SCHR:XY850800308 // module 1 information SHCDM-B :C112724.A1A:SCHR:XY850800309 // module 2 information SHALD-B :C112649.A1A:SCHR:XY120601047
DN0966621 Issue: 11-0
© 2017 Nokia
191
Replacing hardware units
Maintaining and Troubleshooting Hardware
0x00 0x51 AIR_FILTER_POLARITY=1 TACH_MASK=DB TOP_FAN_SHELF
8
Verify that the current FRU data is correct. Enter the following command and the output should be 0. clia fruinfo 20 254 | grep -c "Error"
9
Check the hot swap states of the installed FRUs. Enter the following command and verify that all the installed FRUs are listed and the hot swap state is M4 (Active). clia fru
Step example 10: FRU # 0 Entity: (0xf0, 0x60) Hot Swap State: M4 (Active), Previous: M3 (Activation In Process), Last State Change Cause: Normal State Change (0x0) Device ID String: "ShMM-500"
10 Restore the Network Element ID Enter the following command: clia networkelementid <previous network element ID>
Step example # clia networkelementid Pigeon Point Shelf Manager Command Line Interpreter Error: Network Element ID 1 is differ in Shelf FRU 1 (ÿÿÿÿÿÿÿÿÿÿÿ) and Shelf FRU 2 (NE225705). # # clia networkelementid NE225705
192
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
2.28 Replacing a shelf data module (SHCDM-B) in shelf set (ASH16SET-B) Purpose The shelf data module, SHCDM-B, in the shelf set (ASH16SET-B) is located behind the power entry module (PEM), ADPEM-A. If you need to replace it, you need to remove the PEM first. Before you start The replacement procedure requires shutting down the shelf and all of its units. If there are critical 2N functional units in the shelf that do not have a redundant unit in another shelf, shutting down the shelf will require the entire network element to be shut down. Prepare the following tools: screwdrivers ESD wrist strap safety ladder
• • •
g
Note: The shelf data module is very sensitive to rough treatment. Handle the shelf data module with care during all installation phases.
g
Table 21
Compatibility of SHCDM-B and ASH16-A SHCDM-B
ASH16-A C112648.A1A C112648.A1B
C112724.A1A C112648.B1A Compatible revision
C112724.A1B C112648.B1B C112648.B1C C112724.B1B or later
C112648.C1C or later
2.28.1 Removing a shelf data module (SHCDM-B) in shelf set (ASH16SET-B) Procedure 1
Connect to the active shelf manager from the workstation through the serial connection. Set the connection parameters on the workstation as follows: •
DN0966621 Issue: 11-0
Baud rate: 38400
© 2017 Nokia
193
Replacing hardware units
Maintaining and Troubleshooting Hardware
• • • •
Data bits: 8 Stop bits: 1 Flow control: none No parity
The default user account is root and password is shmm4nsn. For more details, refer to the document ATCA 16-slot DC Shelf User Guide. 2
Verify that the current FRU data is correct in the shelf manager memory. Enter the following command: clia fruinfo 20 254 | grep -c "Error"
The command output indicates the number of errors. Step example # clia fruinfo 20 254 | grep -c "Error" 0 #
g
Note: The number of errors should be 0 to have a error-free backup in the next step.
3
Back up the FRU data. Enter the following command: clia frudatar 20 254 /var/nvdata/old_shelf_fru.bin
4
Power off the shelf. Switch off the circuit breakers on the power distribution units (PDUs) that are connected to the shelf.
194
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
5
Replacing hardware units
Remove the two power entry modules (PEMs). Sub-steps a) Lift the rear cable tray upwards and turn it out of the way. b) Unscrew the two fixing screws on the PEM. c) Holding both handles, pull the PEM out of the slot.
6
Remove the shelf data module(s) from the shelf. If the shelf data module 1 is faulty, remove both shelf data modules and make sure they do not get mixed. The existing shelf data module 2 will be installed in the right slot from the rear view. If the shelf data module 2 is faulty, remove it only.
DN0966621 Issue: 11-0
Option
Description
SHCDM-B version is C112724.A1A or C112724.A1B (old version)
Follow the substpes:
SHCDM-B version is C112724.B1B or later (new version)
Follow the substpes:
© 2017 Nokia
a) Unscrew the fixing screw and remove the bracket enclosing the shelf data module with a magnetic screwdriver. b) Push the shelf data module downwards to release the locking mechanism in the slot. c) Remove the shelf data module and place them on an ESD protected surface.
a) Press the clippers to open status. b) Remove the shelf data module outwards and place them on an ESD potected surface. c) Press the clippers to lock status.
195
Replacing hardware units
Maintaining and Troubleshooting Hardware
Figure 92
Replacing a shelf data module (SHCDM-B) in shelf set (ASH16SET-B) for old version
Shelfdatamodule2
Fixingscrew
Shelfdatamodule1
Bracket
PEM A
DN0990293
Figure 93
Replacing a shelf data module (SHCDM-B) in shelf set (ASH16SET-B) for new version
Shelfdatamodule2
Shelfdatamodule1
ID ID
Clippers
DN09234715
196
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
2.28.2 Installing a shelf data module (SHCDM-B) in shelf set (ASH16SET-B) Procedure 1
Insert the shelf data module(s). If the shelf data module 1 is faulty, insert the new module into the module 2 slot (the left slot from the rear view) and the original shelf data module 2 into the module 1 slot (the right slot from the rear view). If the shelf data module 2 is faulty, insert the new data module into the module 2 slot (the left slot from the rear view). Option
Description
SHCDM-B version is C112724.A1A or Follow the substeps: C112724.A1B (old version) a) Insert the new shelf data module into its slot. b) Push the module downwards to engage the locking mechanism in the slot. c) Mount the bracket and tighten the fixing screw with a magnetic screwdriver. SHCDM-B version is C112724.B1B or Follow the substeps: later (new version) a) Press the clippers to open status. b) Insert the new shelf data module into its slot. c) Press the clippers to lock status.
2
Install the PEMs. Sub-steps a) Slide the PEM into the slot along the guide rails. b) Tighten the two fixing screws on the PEM. c) Rotate the rear cable tray downwards.
3
Power on the shelf. Switch on the circuit breakers on the PDUs.
DN0966621 Issue: 11-0
© 2017 Nokia
197
Replacing hardware units
Maintaining and Troubleshooting Hardware
4
Connect to the active shelf manager.
5
Verify that the current FRU data is correct. Enter the following command and the output should be 0. clia fruinfo 20 254 | grep -c "Error"
If error exists, restore the original FRU data with the following command: clia frudataw 20 254 /var/nvdata/old_shelf_fru.bin
6
Update the serial number of the shelf data module to the shelf FRU data. Enter the following commands: patch_fru_info 20 254 c "SHCDM-B ::SCHR:<serial>"
can be 4 or 5. Use 4 for shelf data module 1 (the right one from the rear view) and 5 for shelf data module 2 (the left one from the rear view). is the hardware code and <serial> is the serial number of the shelf data module. Read the hardware code and serial number (S/N) from the label stickers of the shelf data module. Figure 94
Shelf data module (SHCDM-B) label stickers SHCDM-BS/N:XY 850800309
SHCDM-BC112724.A1A DN0990309
Step example For the shelf data module 1: # patch_fru_info 20 254 c 4 "SHCDM-B
g
:C112724.A1A:SCHR:XY850800308"
Note: If the shelf data module 1 is faulty and the original shelf data module 2 is installed to the module 1 slot (the right slot from rear view), <serial> is the serial number of the original shelf data module 2. For the shelf data module 2: # patch_fru_info 20 254 c 5 "SHCDM-B
7
:C112724.A1A:SCHR:XY850800309"
Check that the serial number of the installed shelf data module is updated in the FRU data. Enter the following commands: clia fruinfo -v 20 254 | grep -A 13 "Chassis Info" clia fruinfo -v 20 1 | grep -A 13 "Chassis Info" clia fruinfo -v 20 2 | grep -A 13 "Chassis Info"
198
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
Step example # clia fruinfo -v 20 1 | grep -A 13 "Chassis Info" Chassis Info Area: Version = 1 Chassis Type = (23) Chassis Part Number = C112691.01 Chassis Serial Number = XY120503692 Custom Chassis Info = SCHROFF CHAF2-A :C110639.A1A:SCHR:XY120500115 SHCDM-B :C112724.A1A:SCHR:XY850800308 // module 1 information SHCDM-B :C112724.A1A:SCHR:XY850800309 // module 2 information SHALD-B :C112649.A1A:SCHR:XY120601047 0x00 0x51 AIR_FILTER_POLARITY=1 TACH_MASK=DB TOP_FAN_SHELF
8
Verify that the current FRU data is correct. Enter the following command and the output should be 0. clia fruinfo 20 254 | grep -c "Error"
9
Check the hot swap states of the installed FRUs. Enter the following command and verify that all the installed FRUs are listed and the hot swap state is M4 (Active). clia fru
Step example 10: FRU # 0 Entity: (0xf0, 0x60) Hot Swap State: M4 (Active), Previous: M3 (Activation In Process), Last State Change Cause: Normal State Change (0x0) Device ID String: "ShMM-500"
10 Restore the Network Element ID Enter the following command: clia networkelementid <previous network element ID>
Step example # clia networkelementid Pigeon Point Shelf Manager Command Line Interpreter
DN0966621 Issue: 11-0
© 2017 Nokia
199
Replacing hardware units
Maintaining and Troubleshooting Hardware
Error: Network Element ID 1 is differ in Shelf FRU 1 (ÿÿÿÿÿÿÿÿÿÿÿ) and Shelf FRU 2 (NE225705). # # clia networkelementid NE225705
2.29 Replacing a cable tray with fiber optic cable tray Purpose The cable tray can be replaced with the fiber optic cable tray, which provides guiding elements for the fiber optic cables.
2.29.1 Removing the cable tray Procedure 1
Remove both fixing screws.
2
Disengage the cable tray by pushing it upwards.
Example Figure 95
Removing the cable tray
2
1
DN0959664
200
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
2.29.2 Installing the fiber optic cable tray Procedure 1
Engage the cable tray for fibre optic cables.
2
Insert and tighten the fixing screws.
Example Figure 96
Installing the fiber optic cable tray
1
2
DN0959676
DN0966621 Issue: 11-0
© 2017 Nokia
201
SEL interpretation
Maintaining and Troubleshooting Hardware
3 SEL interpretation 3.1 Overview The purpose of this chapter is to show how to analyze and understand events generated by sensors which are stored in the System Event Log (SEL). Typical situations in which the SEL needs to be consulted are as followed: • • •
Unexpected shutdown or reboot Front plate LEDs showing abnormality Any unusual behavior
In many cases, analyzing the SEL allows to determine the root cause of the events and provide essential guidance in determining either preventive or corrective action.
3.2 Getting SEL information SEL information are stored in both shelf manager and FRUs. Use different commands to get SEL information in shelf manager or a specific FRU.
Get SEL information from shelf manager Procedure 1
Connect to shelf manager from network management client. Enter the following command: ssh root@<shelf manager ipaddress>
2
Choose a command to perform on need. If
Then
Get all generic SEL information of whole shelf
clia sel
Get all detailed SEL information of whole shelf
clia sel -v
Get all generic SEL information of a specific address
clia sel
Example: clia sel 9e
Get all detailed SEL information of a specific address
202
© 2017 Nokia
clia sel -v
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
SEL interpretation
If
Then
Get all generic SEL information of a specific slot
clia sel board
Example: clia sel board 1
Get all detailed SEL information of a specific slot
clia sel -v board
For more information on ipmb address and physical slot number, refer to corresponding shelf user guide.
Get SEL information from an FRU Procedure 1
Connect to the FRU from network management client. Enter the following command: ssh root@
2
Choose a command to perform on need. If
Then
Get all generic SEL information of the ipmitool sel list FRU Get all detailed SEL information of the ipmitool sel list -v FRU
3.3 Analyzing SEL information SEL information should be consulted whenever an unusual situation is reported. Analyze SEL information using ipmitool The ipmitool sel list command shows Sensor Type and Number and reports in a human readable format the Event Data. In some cases, ipmitool is not able to analyze the Event Data and print Event Data 1, 2 and 3. For detailed information about Event Data, refer to the sensor list in corresponding shelf or FRU user guide.
DN0966621 Issue: 11-0
© 2017 Nokia
203
SEL interpretation
Maintaining and Troubleshooting Hardware
The output can be, for example, the following: 23c | 01/20/2014 | 16:20:07 | System Firmware Progress #0x27 | Asserted | Option ROM initialization
Explanation: Sequence: 23c Event Date: 01/20/2014 Event Time: 16:20:07 Sensor Type and Number: System Firmware Progress #0x27 Event/Reading Type Code: Asserted Event Data: Option ROM initialization Analyze SEL information using clia It is recommended to use clia sel command to analyze SEL data since it provides more details on sensors. The output can be, for example, the following: 0x0001: Event: at Jan 22 02:00:14 1970; from:(0xa0,0,0); sensor:(0x02,3); event:0x1(asserted): "Lower Critical", Threshold: 0x78, Reading: 0x2a
Explanation: Sequence: 0x0001 Event Date and Time: Jan 22 02:00:14 1970 Slot IPMB address, Channel number, LUN: 0xa0, 0, 0 Sensor Type Code, Sensor ID: 0x02, 3 Event/Reading Type Code: 0x1 (asserted) Event Data: "Lower Critical", Threshold: 0x78, Reading: 0x2a
SEL Event Example: Standard Sensor Information of the standard sensors can be found from either IPMI specification version 2.0 or PICMG specification version 3.0. 0x004D: Event: at Jan 3 04:56:11 2010; from:(0x92,0,0); sensor:(0x0f,39); event:0x6f(asserted): 0xC0 0x08 0xFF
Procedure 1
Check the slot IPMB address to know from which shelf manager or FRU the event is generated. 0x92 refers to slot 4.
204
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
2
SEL interpretation
Check the event/reading type code. 0x6f (asserted) refers to sensor specific and offsets are specified in table Sensor Type Codes. For information about the event/reading type code range and category, see table Event/Reading Type Code Ranges in IPMI specification version 2.0.
3
Check the sensor type code. 0x0f refers to system firmware progress. For information about the sensor type code, see table Sensor Type Codes in IPMI specification version 2.0.
4
Check the event data byte 1. The higher 4 bits is to decide whether event data byte 2 and 3 have meanings, and the lower 4 bits refers to offset. The higher 4 bits of 0xC0 are 1100, and the lower 4 bits are 0000. • • •
[7:6] = 11b, meaning "sensor-specific event extension code in byte 2", so need to check event data byte 2. [5:4] = 00b, meaning "unspecified byte 3", that is, event data byte 3 has no meaning. [3:0] = 00h, meaning "system firmware error"
For information about event data byte 1, 2 and 3, see table Sensor Type Codes in IPMI specification version 2.0. 5
Check the event data byte 2 when it has meanings. 0x08 refers to removable boot media not found.
6
Check the event data byte 3 when it has meanings. No need in this exmaple.
SEL Event Example: OEM Sensor Information of the OEM sensors and extended information of the standard sensors can be found from shelf or FRU user guides. 0x00EA: Event: at Jan 7 02:24:45 2010; from:(0x96,0,0); sensor:(0xda,47); event:0x6f(asserted): 0xA0 0x01 0x00
Procedure 1
Check the slot IPMB address to know from which shelf manager or FRU the event is generated. 0x96 refers to slot 3.
DN0966621 Issue: 11-0
© 2017 Nokia
205
SEL interpretation
Maintaining and Troubleshooting Hardware
2
Check the event/reading type code. 0x6f (asserted) refers to sensor specific and offsets are specified in table Sensor Type Codes.
3
Check the sensor type code. 0xda refers to OEM reserved. Then, find sensor number 47 in corresponding FRU user guide, AC5 Reset Source.
4
Check the event data byte 1. The higher 4 bits of0xA0 are 1010, and the lower 4 bits are 0000. • • •
5
[7:6] = 10b, meaning "OEM code in byte 2", so need to check event data byte 2 in corresponding FRU user guide. [5:4] = 10b, meaning "OEM code in byte 3", so need to check event data byte 3 in corresponding FRU user guide. [3:0] = 00h, no meaning for OEM sonsors.
Check the event data byte 2. 0x01 refers to reserved.
6
Check the event data byte 3. 0x00 refers to IPMC watchdog timeout.
206
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
The information in this document applies solely to the hardware/software product (“Product”) specified herein, and only as specified herein. Reference to “Nokia” later in this document shall mean the respective company within Nokia Group of Companies with whom you have entered into the Agreement (as defined below). This document is intended for use by Nokia's customers (“You”) only, and it may not be used except for the purposes defined in the agreement between You and Nokia (“Agreement”) under which this document is distributed. No part of this document may be used, copied, reproduced, modified or transmitted in any form or means without the prior written permission of Nokia. If You have not entered into an Agreement applicable to the Product, or if that Agreement has expired or has been terminated, You may not use this document in any manner and You are obliged to return it to Nokia and destroy or delete any copies thereof. The document has been prepared to be used by professional and properly trained personnel, and You assume full responsibility when using it. Nokia welcomes your comments as part of the process of continuous development and improvement of the documentation. This document and its contents are provided as a convenience to You. Any information or statements concerning the suitability, capacity, fitness for purpose or performance of the Product are given solely on an “as is” and “as available” basis in this document, and Nokia reserves the right to change any such information and statements without notice. Nokia has made all reasonable efforts to ensure that the content of this document is adequate and free of material errors and omissions, and Nokia will correct errors that You identify in this document. Nokia's total liability for any errors in the document is strictly limited to the correction of such error(s). Nokia does not warrant that the use of the software in the Product will be uninterrupted or error-free. NO WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO ANY WARRANTY OF AVAILABILITY, ACCURACY, RELIABILITY, TITLE, NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE, IS MADE IN RELATION TO THE CONTENT OF THIS DOCUMENT. IN NO EVENT WILL NOKIA BE LIABLE FOR ANY DAMAGES, INCLUDING BUT NOT LIMITED TO SPECIAL, DIRECT, INDIRECT, INCIDENTAL OR CONSEQUENTIAL OR ANY LOSSES, SUCH AS BUT NOT LIMITED TO LOSS OF PROFIT, REVENUE, BUSINESS INTERRUPTION, BUSINESS OPPORTUNITY OR DATA THAT MAY ARISE FROM THE USE OF THIS DOCUMENT OR THE INFORMATION IN IT, EVEN IN THE CASE OF ERRORS IN OR OMISSIONS FROM THIS DOCUMENT OR ITS CONTENT. This document is Nokia proprietary and confidential information, which may not be distributed or disclosed to any third parties without the prior written consent of Nokia. Nokia is a registered trademark of Nokia Corporation. Other product names mentioned in this document may be trademarks of their respective owners. Copyright © 2017 Nokia. All rights reserved.
f
Important Notice on Product Safety This product may present safety risks due to laser, electricity, heat, and other sources of danger. Only trained and qualified personnel may install, operate, maintain or otherwise handle this product and only after having carefully read the safety information applicable to this product. The safety information is provided in the Safety Information section in the “Legal, Safety and Environmental Information” part of this document or documentation set.
Nokia is continually striving to reduce the adverse environmental effects of its products and services. We would like to encourage you as our customers and users to join us in working towards a cleaner, safer environment. Please recycle product packaging and follow the recommendations for power use and proper disposal of our products and their components. If you should have questions regarding our Environmental Policy or any of the environmental services we offer, please contact us at Nokia for any additional information.
2
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Table of Contents This document has 206 pages
Summary of changes .................................................................. 10
1 1.1 1.1.1 1.1.2 1.1.2.1 1.1.2.2 1.1.3 1.1.3.1 1.1.3.2 1.1.3.3
Hardware troubleshooting............................................................ 11 Problem with a blade, RTM or AMC............................................. 11 General hardware problems......................................................... 11 Power problems........................................................................... 12 The site / cabinet/ shelf has a power failure.................................13 There is a power failure in the blade............................................ 13 Software related problems........................................................... 13 The blade does not boot up......................................................... 13 The blade fails to boot up with newly upgraded software............ 13 The embedded software in the hardware units is not consistent with the product release............................................................... 13 The BIOS information in a CPU unit is not consistent with the product release............................................................................ 14 The login banner shows that the blade is in debug mode............14 There are problems with the computer unit start-up.................... 14 LED signals and what they mean.................................................14 Power good LED is not lit / is blinking.......................................... 14 Out-of-service LED is lit / is blinking.............................................15 Hot swap LED remains lit after the hot swap latch has been closed...........................................................................................16 Hot swap LED keeps blinking after the hot swap latch has been closed...........................................................................................16 Connectivity problems..................................................................16 Blade does not answer to ping.....................................................16 BIOS/U-boot POST is not displayed on the console....................17 Communication cannot be established between the Ethernet nodes........................................................................................... 17 Problem with SFP, SFP+ or XFP transceiver............................... 18 Problem with shelf manager.........................................................18 Description .................................................................................. 18 Symptoms ................................................................................... 19 Recovery procedures .................................................................. 19 The embedded software in the hardware units are not consistent with the product release............................................................... 19 The health LED/power good LED is not lit green or the out of service LED is lit...........................................................................19 The hot swap LED is not lit when the hot swap latch has been pulled or remains lit when the latch has been closed...................20
1.1.3.4 1.1.3.5 1.1.3.6 1.1.4 1.1.4.1 1.1.4.2 1.1.4.3 1.1.4.4 1.1.5 1.1.5.1 1.1.5.2 1.1.5.3 1.2 1.3 1.3.1 1.3.2 1.3.3 1.3.3.1 1.3.3.2 1.3.3.3
2 2.1 2.1.1
Replacing hardware units.............................................................21 Replacing a blade........................................................................ 21 Removing a blade from the shelf................................................. 22
DN0966621 Issue: 11-0
© 2017 Nokia
3
Maintaining and Troubleshooting Hardware
2.1.2 2.2 2.3 2.4 2.5 2.5.1 2.5.2 2.6 2.6.1 2.6.2 2.7 2.8 2.9 2.9.1 2.9.2 2.10 2.10.1 2.10.2 2.10.3 2.11 2.12 2.13 2.14 2.14.1 2.14.2 2.15 2.15.1 2.15.2 2.16 2.16.1 2.16.2 2.16.3 2.17 2.17.1 2.17.2 2.17.3 2.18 2.19 2.19.1 2.19.2 2.20 2.20.1 2.20.2
4
Installing a blade.......................................................................... 23 Replacing a CPU blade (ACPI4-A or ACPI4-B)........................... 25 Replacing a CPU blade (ACPI5-A) ............................................. 29 Replacing a hub blade (AHUB3-A or AHUB3-B)..........................34 Replacing memory modules on the ACPI4-A or ACPI4-B blade...... 38 Removing a memory module....................................................... 39 Installing a memory module......................................................... 39 Replacing memory modules on the ACPI5-A blade.....................40 Removing a memory module....................................................... 41 Installing a memory module......................................................... 45 Replacing a rear transition module.............................................. 47 Replacing the hard disk drive on CPRT4-A..................................51 Replacing the HDD on CPRT5-A for VMU................................... 55 Removing the HDD...................................................................... 57 Installing the HDD........................................................................ 58 Replacing SFP, SFP+ and XFP transceivers............................... 62 Removing an SFP copper transceiver or an SFP/SFP+/XFP optical transceiver........................................................................ 64 Installing an SFP copper transceiver or an SFP/SFP+/XFP optical transceiver....................................................................................64 Removing and installing an SFP/SFP+/XFP filler plug.................65 Checking and replacing the air filter.............................................65 Replacing a fuse on Passive PEM Board.................................... 68 Replacing a power adapter module (APAMO-A)..........................71 Replacing a power distribution unit (ADPDU-A)...........................72 Removing a power distribution unit (ADPDU-A).......................... 73 Installing a power distribution unit (ADPDU-A)............................ 76 Replacing a power distribution unit (ADPD2-A)........................... 82 Removing a power distribution unit (ADPD2-A)........................... 83 Installing a power distribution unit (ADPD2-A)............................. 85 Replacing a power entry module (ADPEM-A)..............................90 Removing a power entry module (ADPEM-A)..............................90 Installing a power entry module (ADPEM-A)................................93 Replacing a PEM (ADPEM-A) fuse..............................................96 Replacing a power entry module (ADPE2-A)...............................98 Removing a power entry module (ADPE2-A)...............................99 Installing a power entry module (ADPE2-A)...............................102 Replacing a PEM (ADPE2-A) fuse.............................................104 Replacing a power supply unit (AAPSU-A)................................ 107 Replacing a fan module............................................................. 109 Removing a fan module..............................................................110 Installing a fan module................................................................111 Replacing a shelf in cabinet (EC208-A)......................................111 Removing a shelf from the cabinet (EC208-A)........................... 112 Installing a shelf into the cabinet (EC208-A).............................. 126
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
2.21 2.21.1 2.21.2 2.22 2.22.1 2.22.2 2.23 2.23.1 2.23.2 2.24 2.24.1 2.24.2 2.25 2.25.1 2.25.2 2.26 2.26.1 2.26.2 2.27
2.29 2.29.1 2.29.2
Replacing a shelf (ASA16-A) in cabinet (CAB216-A).................148 Removing a shelf (ASA16-A) from the cabinet (CAB216-A)...... 149 Installing a shelf (ASA16-A) into the cabinet (CAB216-A)......... 155 Replacing a shelf (ASH16-A) in cabinet (CAB216-A)................ 160 Removing a shelf (ASH16-A) from the cabinet (CAB216-A)......161 Installing a shelf (ASH16-A) into the cabinet (CAB216-A)......... 167 Replacing a shelf manager........................................................ 173 Removing a shelf manager........................................................ 175 Installing a shelf manager.......................................................... 176 Replacing a shelf alarm display................................................. 176 Removing the shelf alarm display.............................................. 177 Installing the shelf alarm display................................................ 177 Replacing a shelf alarm panel....................................................178 Removing the shelf alarm panel.................................................178 Installing the shelf alarm panel...................................................179 Replacing a shelf data module (SHCDM-A)...............................179 Removing a shelf data module (SHCDM-A).............................. 180 Installing a shelf data module (SHCDM-A)................................ 182 Replacing a shelf data module (SHCDM-B) in shelf set (ASH16SET-A)........................................................................... 185 Removing a shelf data module (SHCDM-B) in shelf set (ASH16SET-A)........................................................................... 185 Installing a shelf data module (SHCDM-B) in shelf set (ASH16SET-A)........................................................................... 189 Replacing a shelf data module (SHCDM-B) in shelf set (ASH16SET-B)........................................................................... 193 Removing a shelf data module (SHCDM-B) in shelf set (ASH16SET-B)........................................................................... 193 Installing a shelf data module (SHCDM-B) in shelf set (ASH16SET-B)........................................................................... 197 Replacing a cable tray with fiber optic cable tray....................... 200 Removing the cable tray............................................................ 200 Installing the fiber optic cable tray..............................................201
3 3.1 3.2 3.3
SEL interpretation...................................................................... 202 Overview.................................................................................... 202 Getting SEL information............................................................. 202 Analyzing SEL information......................................................... 203
2.27.1 2.27.2 2.28 2.28.1 2.28.2
DN0966621 Issue: 11-0
© 2017 Nokia
5
Maintaining and Troubleshooting Hardware
List of Figures
6
Figure 1
Removing a blade...............................................................................22
Figure 2
Installing a blade.................................................................................24
Figure 3
Memory modules on ACPI4-A............................................................ 40
Figure 4
The Hot Swap LED on the ACPI5-A...................................................44
Figure 5
Removing and installing a memory module on ACPI5-A....................45
Figure 6
Removing the RTM.............................................................................49
Figure 7
Installing the RTM...............................................................................50
Figure 8
Hard disk drive on CPRT4-A.............................................................. 53
Figure 9
The HDD0 on the CPRT5-A............................................................... 56
Figure 10
Tighten two screws of the HDD0 carrier............................................. 58
Figure 11
Orientation of transceiver modules.....................................................63
Figure 12
Replacing the air filter.........................................................................66
Figure 13
Air filter label stickers..........................................................................67
Figure 14
Fuses on PPB in ASA16SET-A.......................................................... 68
Figure 15
Removing a power adapter module (APAMO-A)................................ 71
Figure 16
Installing a power adapter module (APAMO-A).................................. 72
Figure 17
Power distribution units (ADPDU-A) in the cabinet............................ 73
Figure 18
ADPDU-A circuit breakers.................................................................. 74
Figure 19
ADPDU-A cabling............................................................................... 75
Figure 20
Replacing a ADPDU-A....................................................................... 76
Figure 21
Installing mounting ears to the ADPDU-As.........................................77
Figure 22
Installing a ADPDU-A......................................................................... 78
Figure 23
ADPDU-A grounding cable.................................................................79
Figure 24
ADPDU-A power feed cabling............................................................ 80
Figure 25
ADPDU-A cabling............................................................................... 81
Figure 26
ADPDU-A circuit breakers.................................................................. 82
Figure 27
Power distribution units (ADPD2-A) in the cabinet............................. 83
Figure 28
ADPD2-A circuit breakers...................................................................84
Figure 29
ADPD2-A cabling................................................................................85
Figure 30
Unfastening a power distribution unit (ADPD2-A).............................. 85
Figure 31
ADPD2-A circuit breakers...................................................................86
Figure 32
ADPD2-A grounding cable................................................................. 86
Figure 33
ADPD2-A optional grounding accessories......................................... 87
Figure 34
PDU input and output power cable position....................................... 88
Figure 35
Power distribution unit (ADPDU-A) circuit breakers........................... 91
Figure 36
ADPEM-A power feed cabling (straight).............................................92
Figure 37
ADPEM-A power feed cabling (angled)..............................................92
Figure 38
Replacing a power entry module (ADPEM-A).................................... 93
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Figure 39
ADPEM-A power feed cabling (straight).............................................94
Figure 40
ADPEM-A power feed cabling (angled)..............................................94
Figure 41
Power distribution unit (ADPDU-A) circuit breakers........................... 95
Figure 42
ADPEM-A fuses..................................................................................96
Figure 43
ADPD2-A circuit breakers...................................................................99
Figure 44
Unscrewing the fixing screws on the PEM....................................... 100
Figure 45
Disengaging the PEM.......................................................................101
Figure 46
PEM power feed cabling...................................................................101
Figure 47
ADPE2-A fuses.................................................................................105
Figure 48
Removing a power supply unit (AAPSU-A)...................................... 108
Figure 49
Replacing a fan module.................................................................... 110
Figure 50
Power distribution unit (ADPDU-A) circuit breakers......................... 122
Figure 51
Removing the rear cable tray........................................................... 123
Figure 52
Removing a fan module....................................................................124
Figure 53
Removing the shelf...........................................................................125
Figure 54
Removing a shelf data module (SHCDM-A).....................................126
Figure 55
Installing the shelf - front view.......................................................... 127
Figure 56
Installing the shelf - rear view........................................................... 128
Figure 57
Placement of labels in ATCA 16-slot shelf ACH16SET-A.................130
Figure 58
LEDs of BI interfaces........................................................................134
Figure 59
LEDs of FI interfaces........................................................................ 135
Figure 60
Removig the PSU (AAPSU-A)..........................................................151
Figure 61
Positioning holes for the ISTR-A installation support frame............. 152
Figure 62
ISTR-A installation support frame with the pin and spring................153
Figure 63
Installing ISTR-A installation support frame..................................... 153
Figure 64
Removing a shelf (ASA16-A) from the cabinet (CAB216-A)............ 154
Figure 65
Removing a shelf (ASA16-A) from the cabinet (CAB216-A) - rear view. 154
Figure 66
Installing the rear cable tray............................................................. 155
Figure 67
Removing the cable tray claws.........................................................156
Figure 68
Installing a shelf (ASA16-A) into the cabinet (CAB216-A) - front view... 157
Figure 69
Installing a shelf (ASA16-A) into the cabinet (CAB216-A) - rear view.... 157
Figure 70
ADPD2-A circuit breakers.................................................................162
Figure 71
Positioning holes for the ISTR-A installation support frame............. 164
Figure 72
ISTR-A installation support frame with the pin and spring................165
Figure 73
Installing ISTR-A installation support frame..................................... 165
Figure 74
Removing a shelf (ASH16-A) from the cabinet (CAB216-A)............ 166
Figure 75
Removing a shelf (ASH16-A) from the cabinet (CAB216-A) - rear view ..........................................................................................................166
DN0966621 Issue: 11-0
© 2017 Nokia
7
Maintaining and Troubleshooting Hardware
8
Figure 76
Installing the rear cable tray............................................................. 167
Figure 77
Removing the cable tray claws.........................................................168
Figure 78
Installing a shelf (ASH16-A) into the cabinet (CAB216-A) - front view... 169
Figure 79
Installing a shelf (ASH16-A) into the cabinet (CAB216-A) - rear view.... 170
Figure 80
Replacing the shelf manager............................................................173
Figure 81
Replacing the shelf alarm display ....................................................176
Figure 82
Shelf alarm display label stickers..................................................... 178
Figure 83
Replacing the shelf alarm panel (SHALP-A).................................... 178
Figure 84
Replacing a shelf data module (SHCDM-A)..................................... 179
Figure 85
Replacing a shelf data module (SHCDM-A)..................................... 181
Figure 86
Shelf data module (SHCDM-A) label stickers...................................183
Figure 87
ADPD2-A circuit breakers.................................................................186
Figure 88
Unscrewing the fixing screws on the PEM....................................... 187
Figure 89
Replacing a shelf data module (SHCDM-B) in shelf set (ASH16SET-A) for old version................................................................................... 188
Figure 90
Replacing a shelf data module (SHCDM-B) in shelf set (ASH16SET-A) for new version................................................................................. 189
Figure 91
Shelf data module (SHCDM-B) label stickers...................................191
Figure 92
Replacing a shelf data module (SHCDM-B) in shelf set (ASH16SET-B) for old version................................................................................... 196
Figure 93
Replacing a shelf data module (SHCDM-B) in shelf set (ASH16SET-B) for new version................................................................................. 196
Figure 94
Shelf data module (SHCDM-B) label stickers...................................198
Figure 95
Removing the cable tray...................................................................200
Figure 96
Installing the fiber optic cable tray.................................................... 201
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
List of Tables Table 1
steps for changing unit state to SE-NH.............................................. 30
Table 2
steps for changing unit state to TE .................................................... 32
Table 3
steps for changing unit state to WO-EX ............................................ 34
Table 4
ID of faulty memory module................................................................38
Table 5
Approved ACPI5-A DIMM memory module types.............................. 41
Table 6
Recommended memory configurations..............................................41
Table 7
Steps for changing the related unit state into SE-NH......................... 42
Table 8
Steps for changing the related unit state into TE................................46
Table 9
Steps for changing the related unit state into WO-EX........................ 46
Table 10
Mapping of PDU input and shelf.........................................................87
Table 11
Power cable connection between ADPD2-A and ADPE2-A...............88
Table 12
Power cable connection between ADPD2-A and ADPE2-A...............89
Table 13
Relation between PDU circuit breakers, PDU outputs and shelves. 100
Table 14
Relation between PDU circuit breakers, PDU outputs and shelves. 102
Table 15
Power cable connection between ADPD2-A and ADPE2-A.............103
Table 16
Relation between PDU circuit breakers, PDU outputs and shelves. 162
Table 17
Relation between PDU circuit breakers, PDU outputs and shelves. 168
Table 18
Relation between PDU circuit breakers, PDU outputs and shelves. 171
Table 19
Compatibility of SHCDM-B and ASH16-A........................................ 185
Table 20
Relation between PDU circuit breakers and shelves........................187
Table 21
Compatibility of SHCDM-B and ASH16-A........................................ 193
DN0966621 Issue: 11-0
© 2017 Nokia
9
Summary of changes
Maintaining and Troubleshooting Hardware
Summary of changes Changes between document issues are cumulative. Therefore, the latest document issue contains all changes made to previous issues. Changes made between issues 11-0 and 10-3 The following topics have been updated: • • • • •
Replacing a CPU blade (ACPI5-A) Replacing a hub blade (AHUB3-A or AHUB3-B) Replacing a rear transition module Replacing the hard disk drive on CPRT4-A Replacing the HDD on CPRT5-A for VMU
Changes made between issues 10-3 and 10-2 The following sections have been updated: • • • •
Blade does not answer to ping Replacing a hub blade (AHUB3-A or AHUB3-B) Replacing a PEM (ADPE2- A) fuse Replacing a shelf data module (SHCDM-B) in shelf set (ASH16SET-A)
Changes made between issues 10-2 and 10-1 Section Replacing a hub blade (AHUB3-A or AHUB3-B) has been updated.
10
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Hardware troubleshooting
1 Hardware troubleshooting 1.1 Problem with a blade, RTM or AMC This section describes the most common problem situations with ATCA Field Replaceable Units (FRUs).
1.1.1 General hardware problems Description This section describes the most common problem situations with ATCA Field Replaceable Units (FRUs). Possible causes for the problem are: • • • • • • • •
The FRU is not properly seated. The FRU has been installed in an incorrect slot. One of the cables is not properly connected. There is a hardware fault in the blade. The blade malfunctions. The blade overheats. CPU BIOS output does not include the expected data. Incorrect memory configuration.
Recovery procedures The FRU is not properly seated The blade, RTM or AMC does not fit into its slot correctly. 1. Uninstall the FRU. 2. Re-install the FRU according to installation manual. 3. If the FRU cannot be installed correctly, replace the FRU. The FRU has been installed in an incorrect slot The blade, RTM or AMC is not installed in the slot designated to it in the configuration. 1. Uninstall the FRU. 2. Install FRU in the correct slot, as shown in User Guide. One of the cables is not properly connected One of the cables is either connected to the wrong unit or is incorrectly plugged in. 1. Remove the cable. 2. Install the cable as shown in the network element’s Quick Guide. There is a hardware fault in the blade For example one of the rear connectors has been damaged.
DN0966621 Issue: 11-0
© 2017 Nokia
11
Hardware troubleshooting
Maintaining and Troubleshooting Hardware
1. Replace the FRU. The blade malfunctions The blade does not function. 1. Check the system event log (SEL) through the shelf manager. Use the clia sel [-v]
g
Note: If the blade needs to be sent to the HWS for repair, remove the memory modules before the sending. In this case, retain the original configurations of the memory modules and make sure they do not get mixed.
1.1.2 Power problems
12
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
1.1.2.1
Hardware troubleshooting
The site / cabinet/ shelf has a power failure If there is no operating current for the network element, verify the following: • • •
1.1.2.2
Verify that the shelf is receiving power from the site power supply. Verify power cables leading from the PDUs to the PEMs. If the steps above do not restore operating power to the shelf, replace the shelf.
There is a power failure in the blade If there is no operating current for the blade, verify the following: • •
Verify that other components in the shelf are powered. If not, see The shelf has a power failure above. If the steps above do not restore power to the blade, replace the blade.
1.1.3 Software related problems 1.1.3.1
The blade does not boot up If U-Boot is functioning but Linux does not boot up, try the following: 1. 2. 3. 4.
1.1.3.2
Verify that the blade hardware is not damaged. Verify if there are network problems. Disable the BMC watchdog to diagnose the bootup. Restore Linux software from U-Boot.
The blade fails to boot up with newly upgraded software The blade’s embedded software may be corrupted. •
1.1.3.3
Re-load the software through U-Boot or from the secondary flash.
The embedded software in the hardware units is not consistent with the product release First required actions before troubleshooting any software related problem: • •
Verify that the embedded software has correct versions in the hardware units according to the product release. Update the embedded software to the required versions if necessary.
For details, see the separate embedded software checking and updating instructions.
DN0966621 Issue: 11-0
© 2017 Nokia
13
Hardware troubleshooting
1.1.3.4
Maintaining and Troubleshooting Hardware
The BIOS information in a CPU unit is not consistent with the product release First required actions before troubleshooting any BIOS related problem: • •
1.1.3.5
The login banner shows that the blade is in debug mode •
1.1.3.6
Verify that the BIOS information in the CPU unit conforms to the product release. Update the BIOS if necessary, either from the Flash tool or USB Flash device.
Restore valid shelf FRU information.
There are problems with the computer unit start-up 1. Check the states of the SHMUs in the shelf where the failing computer unit is. If the states are not WO and SP, analyze and change the states. 2. Check if alarm 3481 SHMU COMMUNICATION FAILURE is on. If yes, analyze and correct. 3. Check the slot (and shelf) number of the ACPI4-A/ACPI4-B blade in the failing computer unit. 4. Change the functional state of the failing computer to SE-NH. 5. Delete the ACPI4-A/ACPI4-B blade from the failing computer unit. 6. Create the ACPI4-A/ACPI4-B blade to the failing computer unit using the correct slot and shelf numbers. 7. Change the failing computer unit to normal operational state. Results •
The boot printouts show correct unit address, for example 0005:
•
UNIT ADDRESS SET FROM IPMI: 0005 The boot loading is done correctly and the unit is started to normal operational state.
1.1.4 LED signals and what they mean See the blade user guide for descriptions of LEDs and their functions for the specific blade type.
1.1.4.1
Power good LED is not lit / is blinking 1. Check that other components in the shelf are powered. If not, check power cabling, the PEMs and PDUs. 2. Make sure that the blade is inserted correctly. 3. Make sure that the blade and the memory modules are properly seated: a) Remove the blade. b) Remove and re-install the memory modules. c) Re-install the blade to the shelf.
14
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Hardware troubleshooting
d) Make sure the hot swap latch is pushed in all the way. 4. Make sure that the connector pins have not been damaged. If the pins show no sign of damage, try the following: a) Insert the blade into a different slot to see if the power good LED lights up. b) Insert a different blade to the original slot to see if its power good LED lights up. 5. Check that the blade is not in the hot-swap state. The power good LED is off when the blade is in this state. 6. Check that the blade’s power indicator debug LEDs are on. If the debug LEDs are not on when there is power to the shelf, replace the blade.
1.1.4.2
Out-of-service LED is lit / is blinking One of the voltages may have exceeded a threshold or there may be a fault in the DC converter. 1. Log in to the shelf manager. 2. Check the SEL of the shelf. Use the clia sel command 3. Check the board-specific event log for voltage alarms. Use the clia sel
t
Tip: For the documentation of sensor alarms, see the alarm reference manuals or the blade-specific user guides. The shelf manager may have a power failure. 1. One of the voltages may have exceeded a threshold or there may be a fault in the DC converter. a) Log in to the shelf manager. b) Check the SEL of the shelf. Use the clia sel command. c) Check the FRU-specific event log for voltage alarms. Use the clia sel
DN0966621 Issue: 11-0
© 2017 Nokia
15
Hardware troubleshooting
1.1.4.3
Maintaining and Troubleshooting Hardware
Hot swap LED remains lit after the hot swap latch has been closed 1. Re-open the latch slightly and close it again. 2. If the hot swap LED still remains lit, check the FRU status. Use the clia board <slot number of hub> command.
1.1.4.4
Hot swap LED keeps blinking after the hot swap latch has been closed The FRU information of the blade may be incorrect. 1. Log in to the shelf manager. 2. Check the FRU data. Give command clia fruinfo
1.1.5 Connectivity problems 1.1.5.1
Blade does not answer to ping If the blade does not answer to ping, verify the following: 1. Check the link LED state. If the link LED is off, check that the network cable has been connected correctly and is properly attached. 2. Check that the IP address of the CPU blade is correct. a) Connect to the blade through the serial port. b) Give command ifconfig eth0. c) Try to ping the unit's own IP address using command ping
g
Note: dtl0 is the management interface for the EMB SWU and dtl1 is for the CNW SWU. 1). Renew the dtl1 IP address. ifdown dtl1 ifup dtl1
16
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Hardware troubleshooting
2). Show the dtl1 IP address configuration. ifconfig dtl1
If the dtl1 IP address is lost and the renew command is not effective, you have to configure it manually. 3). Configure the dtl1 IP address manually. ifconfig dtl1
4). Check that the dtl1 interface has a correct IP address. ifconfig dtl1
c) If you are using a AHUB3-B, enter the following commands:
g
Note: The default interface in BI is the management interface for the EMB SWU and mgmt2 in LMP is for the CNW SWU. 1). Renew the IP address. SWITCH(enable)# en bi SWITCH(enable-bi)# ip address dhcp renew
2). Check that the dhcpd service is up. Switch from the AHUB main menu to Enable-BI mode. SWITCH(enable-bi)# en bi SWITCH(enable-bi)# show dhcp client
3). Restart dhcpd in Enable-BI mode. SWITCH(enable-bi)# configure terminal SWITCH(enable-bi)# dhcp client enable
d) Try to ping the unit's own IP address using command ping
1.1.5.2
BIOS/U-boot POST is not displayed on the console CPU, HUB and packet processing blades support console redirection. If the BIOS or U-boot POST is not displayed on the console, check the following: 1. Verify that the terminal settings are correct. 2. Verify that the cables to the console are of the correct type. 3. Verify that the cables to the console are correctly plugged in.
1.1.5.3
Communication cannot be established between the Ethernet nodes Verify the following: 1. 2. 3. 4. 5. 6. 7.
DN0966621 Issue: 11-0
Connect to the blade through the serial or the Ethernet maintenance ports. Check the state of the ports. Verify that an IP address has been assigned to the node. Verify that an appropriate subnet mask is assigned to the node. Verify that the node is within a reachable VLAN. Verify that routing instructions do not prevent the communication. Check the SEL to verify that the node’s Ethernet backplane has been activated.
© 2017 Nokia
17
Hardware troubleshooting
Maintaining and Troubleshooting Hardware
1.2 Problem with SFP, SFP+ or XFP transceiver Description If an Ethernet connection is not working properly, there may be a fault in the SFP, SFP+ or XFP transceiver. Symptoms • •
Statistics reports show that data packets are lost or there is a high count of one type of data packet and the count climbs rapidly. One of the LEDs indicates that there may be an Ethernet link/port failure.
Recovery procedures 1. Check that the transceiver and optical cable are properly connected and the cable is not crimped. 2. Check the LEDs that indicate the status of the blade/AMC module to which the transceiver is attached. • • •
The power good LED is on. The hot-swap LED is off. The out-of-service LED is off.
If the LEDs show that the blade/AMC may be faulty, see the blade/AMC-specific troubleshooting instructions given in this document. 3. Check the status of the Ethernet ports and links. a) For correct LED behaviour, see the blade-specific user guides. b) For user interface commands, see the command reference manuals. 4. Check the transceiver information. 5. If the port and link status was correct, replace the transceiver at the other end of the link. 6. If the link is not recovered, replace the cable connecting the transceivers. 7. If the link still does not work, replace the transceiver at this end of the link.
1.3 Problem with shelf manager 1.3.1 Description A shelf manager is not functioning properly. Possible causes for the problem are: • • • • •
18
The embedded software in the hardware units is not consistent with the product release. The shelf manager is not properly seated in the shelf manager slot. One of the voltages is too high/low. One of the temperatures is too high. The DC converter is malfunctioning.
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
• • •
Hardware troubleshooting
The IP address of the shelf manager is incorrect. The shelf manager firmware is corrupted. There is a hardware fault in the shelf manager.
1.3.2 Symptoms The following symptoms may indicate a problem in the shelf manager: • •
g
The health LED/power good LED is not lit green or the out of service LED is lit. The hot swap LED is not lit when the hot swap latch has been opened or remains lit when the latch has been closed. Note: The ATCA hardware platform occasionally exhibits a certain IPMI O&M event asserted that is visible in System Event Log. The event is Voltage out of limit, generated from sensor I2C_PWR_A of shelf manager A (ASMGR-A, the left one in the shelf). The asserted event is followed immediately by the corresponding deasserted event.
1.3.3 Recovery procedures Note that in the case of 2N-redundant configuration, the same recovery procedures apply for both single unit failure, and the simultaneous malfunction of both redundant units.
1.3.3.1
The embedded software in the hardware units are not consistent with the product release First required actions before troubleshooting any software related problem: • •
Verify that the embedded software has correct versions in the hardware units according to the product release. Update the embedded software to the required versions if necessary.
For instruction, see embedded software checking and updating instructions.
1.3.3.2
The health LED/power good LED is not lit green or the out of service LED is lit 1. Make sure the shelf manager is seated properly. a) Remove the shelf manager as instructed in section Removing a shelf manager. b) Re-install the shelf manager as instructed in section Installing a shelf manager. 2. If the problem persists, replace the shelf manager with another one to make sure the shelf manager is functioning properly.
DN0966621 Issue: 11-0
© 2017 Nokia
19
Hardware troubleshooting
1.3.3.3
Maintaining and Troubleshooting Hardware
The hot swap LED is not lit when the hot swap latch has been pulled or remains lit when the latch has been closed 1. If the Hot Swap LED is not lit when you have pulled on the hot swap handle, try pulling the handle out again a little more firmly. 2. If the LED remains lit after you have inserted a shelf manager, try pulling the handle and pushing it back in. 3. The shelf manager firmware may be corrupted and you may need to upgrade the firmware.
20
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
2 Replacing hardware units 2.1 Replacing a blade Purpose If a blade is faulty, or it needs to be upgraded or serviced, you need to remove the blade from the shelf and install a new blade in its place.
t
Tip: When sending a faulty blade to Hardware Services (HWS) for a replacement or repair, remember to remove the memory modules, hard disk drive, AMC modules or SFP/SFP+/XFP transceivers, if any of these have been integrated in the blade.
w
NOTICE: For ACAR1-B, there must be AMC modules or fillers fitted in at least the two centermost AMC slots before it is removed. This ensures a smooth removal not scratching the gasket of a blade in adjacent slot. Before you start First make sure the fault is in the blade and not in the slot or in the shelf. Bring the new blade in its inner package close to the shelf, and place it on an ESDprotected surface.
w
NOTICE: Electrostatic discharge (ESD) may damage hardware components. To avoid ESD damage: • •
Before handling hardware units, check that the site is an ESD-protected area (EPA). If the area is not ESD-protected, create a temporary EPA. When handling hardware units, wear an ESD wrist strap or use a corresponding protection method, and do not touch the connector surfaces.
When removing a blade from the shelf permanently or for a longer period of time, you must install a filler blade in its place. This is to ensure adequate cooling airflow and proper EMC shield in the shelf.
t
DN0966621 Issue: 11-0
Tip: When removing or installing a blade, it is not necessary to remove the AMCs equipped on the blade or the corresponding RTM. But before removing a blade or RTM with AMCs residing on it, the AMCs must be shut down and all the cables connected to the AMCs must be disconnected first.
© 2017 Nokia
21
Replacing hardware units
Maintaining and Troubleshooting Hardware
2.1.1 Removing a blade from the shelf Procedure 1
Unscrew the two retaining screws at the top and bottom of the blade's front panel.
2
Gently open the lower ejector latch (hot swap handle) so that the blue hot swap LED starts blinking.
g
Note: Do not open the latch all the way yet. Opening the latch notifies the hardware management system that you are going to remove the blade and tells it to finish all processes. The hot swap LED starts blinking.
3
Wait until the hot swap LED turns into a steady blue. This may take a few seconds.
4
Disconnect the cables, if any, from the blade.
5
Open both ejector latches.
6
Unseat the blade.
7
Gently slide the blade out of the slot and place it on an ESD-protected surface. Figure 1
22
Removing a blade
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
8
Replacing hardware units
If you are not going to replace the blade with a new one immediately, install a filler blade in the empty slot. This is to ensure adequate cooling and proper EMC shield in the shelf.
9
Remove the memory modules, hard disk drive, AMC modules and SFP/SFP+/XFP transceivers, if any of these have been installed in the blade.
2.1.2 Installing a blade Before you start For the new AHUB3-B and AHUB4-A blades to be installed, make sure that the fourth jumper on the DIP switch is set to ON. For more information on the jumper settings, see the corresponding hub blade user guides. Procedure 1
If the memory module is missing, then install it and verify that the memory module configuration meets the network element requirements. For more information, please refer to Replacing memory modules chapter of the relevant blade.
DN0966621 Issue: 11-0
© 2017 Nokia
23
Replacing hardware units
Maintaining and Troubleshooting Hardware
2
Determine the slot in which to install the blade.
3
Check that the EMC gasket is correctly in place and that its contacts are clean.
4
Open both ejector latches by turning them outwards.
5
Hold the blade from the ejector latches and slide it into the shelf along the guide rails. Figure 2
g
Installing a blade
Note: Carefully support the blade or RTM during installation. Do not pull or push the blade from the ejector latches.
6
When the ejector latches reach the latch rail on the shelf, close both latches at the same time by turning the latches inwards toward the center of the front panel.
7
Wait until the blue hot swap LED turns off and the power LED turns solid green.
8
Tighten the retaining screws at the top and bottom of the front panel.
9
Connect the cables, if any, to the blade.
10 Verify that the embedded software in the hardware units and the BIOS information in the CPU units are consistent with the product release, and
24
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
update if necessary. See a document that describes embedded software management for details. Post requisites
g
Note: If you are replacing an AMPP1-A blade, follow the steps below to clear the fastpath configuration: 1. Connect to the blade through the serial port. 2. Enter the following command: rm/etc/fastpath/fastpath.cfg 3. Restart the blade.
2.2 Replacing a CPU blade (ACPI4-A or ACPI4-B) Purpose The following example shows how to replace an ACPI4-A or ACPI4-B blade with one of the same type in the active OMU.
g
Note: When replacing the ACPI4-A or ACPI4-B of an OMU, all updates to the unit’s hard disk must be prevented to ensure that no data is lost during the time when the unit is out of use. If there are updates left pending during this time, they are buffered, and pushed to the disk when the disk updates are enabled again. With other units, the disk updates are not blocked. ACPI4-A and ACPI4-B is used also for IPDU in those configurations where the IP director unit is included. In a failure situation, there is an automatic switchover from the active to the standby unit. During the short time when the standby unit is being activated, there may be a momentary traffic breakdown, and some data packets may be lost, but otherwise the traffic handling continues normally. After replacing a CPU blade, the BIOS settings of the new blade should be checked. For instructions on how to check BIOS settings of CPU blades, see Commissioning document. Before you start Check first that the fault is in the blade and not in the slot or in the shelf. For instructions, see chapter Hardware troubleshooting. Bring the new blade in its inner package close to the shelf, and place it on an ESDprotected surface. When removing a blade from the shelf permanently or for a longer period of time, you must install a filler blade in its place. This is to ensure adequate cooling airflow and proper EMC shield in the shelf.
DN0966621 Issue: 11-0
© 2017 Nokia
25
Replacing hardware units
w
Maintaining and Troubleshooting Hardware
NOTICE: Electrostatic discharge (ESD) may damage hardware components. To avoid ESD damage: • •
Before handling hardware units, check that the site is an ESD-protected area (EPA). If the area is not ESD-protected, create a temporary EPA. When handling hardware units, wear an ESD wrist strap or use a corresponding protection method, and do not touch the connector surfaces.
Procedure 1
Disable disk updates. a) Copy the data files from OMU to the disks.
g
Note: This is done only when replacing the OMU hardware.
ZDFC:OMU,0; b) Copy the databases from memory to the disks. With command DBL, you can check which databases are used by the unit.
ZDBC:EQUIPM,0:; ZDBC:ILDATA,0:; ... ... c) Prevent file updates to the disk. ZDUP:OMU:; d) Prevent database file updates to the disk. ZDBP:EQUIPM,0:DISK; ZDBP:ILDATA,0:DISK; e) Change the state of the HDD into BL-US. ZISC:,OMU:WDU,0:WO-ID; ZISC:,OMU:WDU,0:BL-US;
2
Change the state of the unit into SE-NH.
ZUSC:OMU,0:SP; ZUSC:OMU,0:TE; ZUSC:OMU,0:SE; ZUSC:OMU,0:SE;
3
Remove a blade from the shelf. See Removing a blade from the shelf.
4
Install a blade. See Installing a blade.
26
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
5
Replacing hardware units
Check the BIOS settings of the new blade. For details, see Commissioning document.
6
Change the working state of the unit into TE-EX.
ZUSC:OMU,0:SE; ZUSC:OMU,0:TE;
7
g
Check the HPM.1 version of the blade. Note: Check whether the soft versions are consistent. If they are consistant, no upgrade is required. If they are inconsistent, an upgrade is needed.
ZWDN:UT=OMU,UI=0; LOADING PROGRAM VERSION 13.53-0 EXECUTION STARTED 1 VALID PLUG-IN UNITS FOUND EXECUTION STARTED AT 2015-05-05 05:30:47 50% DONE, PLEASE WAIT 0 H, 14 MIN AND 49 SEC 100% DONE, PLEASE WAIT 0 H, 0 MIN AND 0 SEC FUNCTIONAL PLUG-IN UNIT VERSION UNIT TYPE INDEX CURRENT -> AFTER UPDATE ----------- ------------- -------------------------------OMU-0 ACPI4_B-0 acpi4-b_kn_ipmc_05.52.6094 -> ---current version acpi4-b_kn_ipmc_05.52.6094 R_ABESW_1436 disk version acpi4-b_kn_ipmc_05.52.6094 -> backup version acpi4-b_kn_ipmc_05.52.6094 R_ABESW_1436 disk version acpi4-b_kn_bios_04.02.0000 -> acpi4-b_kn_bios_04.02.0000 R_ABESW_1436 acpi4-b_kn_bios_04.02.0000 -> acpi4-b_kn_bios_04.02.0000 R_ABESW_1436 acpi4-b_kn_fpga_05.02.0000 -> acpi4-b_kn_fpga_05.02.0000 R_ABESW_1436
-------
COMMAND EXECUTED
As displayed in the example above, an upgrade is not needed. Because the current SW version is consistent with the disk version.
DN0966621 Issue: 11-0
© 2017 Nokia
27
Replacing hardware units
8
g
Maintaining and Troubleshooting Hardware
Update the HPM.1 version, if needed. Note: This must be done by experienced personnel who have sufficient knowledge of the system. Follow the instructions given in the command reference manual. This command updates the IPMI, FPGA and BIOS.
ZWDO:UT=OMU,UI=0,PT=ACPI4_A,PI=0;
9
g
Check the version of the FRU data package. Note:
ZWDP:UT=OMU,UI=0;
10 Replace the FRU package, if needed.
g
Note: Check whether the soft versions are consistent. If they are consistant, no upgrade is required. If they are inconsistent, an upgrade is needed. This must be done by experienced personnel who have sufficient knowledge of the system. Follow the instructions given in the command reference manual. Example:
ZWDQ:UT=OMU,UI=0,PT=ACPI4_A,PI=0; LOADING PROGRAM VERSION 13.53-0 EXECUTION STARTED 1 VALID PLUG-IN UNITS FOUND EXECUTION STARTED AT 2015-05-05 05:38:42 33% DONE, PLEASE WAIT 0 H, 14 MIN AND 57 SEC 66% DONE, PLEASE WAIT 0 H, 14 MIN AND 55 SEC 100% DONE, PLEASE WAIT 0 H, 0 MIN AND 0 SEC FUNCTIONAL PLUG-IN UNIT VERSION UNIT TYPE INDEX CURRENT -> AFTER UPDATE ----------- ------------- -------------------------------OMU-0 ACPI4_B-0 acpi4-b_kn_frud_03.10.0000 -> ---current version acpi4-b_kn_frud_03.12.0000 RABESW3_1429 --disk version COMMAND EXECUTED
EMBEDDED SOFTWARE HANDLING COMMAND <WD_>
As displayed in the example above, an upgrade is needed. Because the current SW version is inconsistent with the disk version.
28
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
11 Run diagnostics on the unit.
ZUDU:OMU,0;
12 Check the diagnostics report.
ZUDH:OMU,0;
13 Change the working state of the WDU. If the diagnostics report shows that the unit is healthy, change the state of the HDD into WO-BU.
ZISC:,OMU:WDU,0:WO-ID; ZISC:,OMU:WDU,0:WO-BU;
14 Enable disk updates. a) Enable file updates to the disk.
g
Note: This is done only when replacing the OMU hardware.
ZDUR:OMU; b) Enable database file updates to the disk.
ZDBR:EQUIPM,0:DISK; ZDBR:ILDATA,0:DISK; ... ...
15 Change the working state of the OMU.
ZUSC:OMU,0:SP; ZUSC:OMU,0:WO;
16 Check that there are no alarms active.
ZAHO:OMU;
2.3 Replacing a CPU blade (ACPI5-A) Purpose The following example shows how to replace an ACPI5-A blade with one of the same type in the active CHU.
DN0966621 Issue: 11-0
© 2017 Nokia
29
Replacing hardware units
g
Maintaining and Troubleshooting Hardware
Note: For other units, the disk updates are not blocked. ACPI5-A is also used for IPDU in those configurations where the IP director unit is included. In case of failure, there is an automatic switchover from the active unit to the standby unit. During the short time when the standby unit is being activated, there may be a momentary traffic breakdown, and some data packets might be lost, otherwise the traffic handling continues normally. After replacing a CPU blade, the BIOS settings of the new blade must be checked. For instructions on how to check BIOS settings of CPU blades, see Commissioning document. Before you start Check if there is a fault in the blade, see Commissioning document. Place the new blade on an ESD-protected surface in its inner package close to the shelf. When removing a blade from the shelf permanently or for a longer period of time, you must install a filler blade in its place to ensure an adequate cooling airflow and a proper EMC shield in the shelf.
w
NOTICE: Electrostatic discharge (ESD) might damage hardware components. To avoid ESD damage: • •
Before handling hardware units, check that the site is an ESD-protected area (EPA). If the area is not ESD-protected, create a temporary EPA. When handling hardware units, wear an ESD wrist strap or use a corresponding protection method, and do not touch the connector surfaces.
Procedure 1
Change HDD state to BL-US if corresponding CPRT5-A is installed with HDD.
ZISC:,CHU:WDU,0:WO-ID; ZISC:,CHU:WDU,0:BL-US;
2
Change the unit state to SE-NH. Table 1
steps for changing unit state to SE-NH Unit Type
Native unit (IPDU for example)
Steps •
g
Note: When the IPDU is in WO-EX state, execute the following steps. If it is in SP-EX state, ignore the first step and execute the other steps.
ZUSC:IPDU,0:SP;
30
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Table 1
Replacing hardware units
steps for changing unit state to SE-NH (Cont.) Unit Type
Steps • • •
virtualized (into several child units) VMU (CHU for example)
ZUSC:IPDU,0:TE; ZUSC:IPDU,0:SE; ZUSC:IPDU,0:SE;
a) Check the slot of the CHU. Get the master and the module number of the related VMU.
ZWTI:P:CHU; b) Check all child units in the VMU.
ZUSI:VMU,index; c) Change all related child units to SENH. •
• • •
g
Note: When the child unit is in WO-EX state, execute the following steps. If it is in SP-EX state, ignore the first step and execute the other steps.
ZUSC:child index:SP; ZUSC:child index:TE; ZUSC:child index:SE; ZUSC:child index:SE;
unit,child unit unit,child unit unit,child unit unit,child unit
d) Change the VMU to SE-NH. • • • •
3
ZUSC:VMU,index:BL; ZUSC:VMU,index:TE; ZUSC:VMU,index:SE; ZUSC:VMU,index:SE;
Remove a blade from the shelf. See Removing a blade from the shelf.
4
Install a blade. See Installing a blade.
DN0966621 Issue: 11-0
© 2017 Nokia
31
Replacing hardware units
5
Maintaining and Troubleshooting Hardware
Check the BIOS settings of the new blade. For instructions, see Commissioning document.
6
Change the working state of the unit to TE-EX. Table 2
steps for changing unit state to TE Unit type
Steps
Native unit (IPDU for example)
ZUSC:IPDU,0:SE; ZUSC:IPDU,0:TE;
• •
virtualized (into several child units) VMU (CHU for example)
ZUSC:VMU,index:SE; ZUSC:VMU,index:TE;
• •
g 7
g
Note: The state of the child unit is changed automatically.
Check the HPM.1 version of the blade. Note: Check whether the soft versions are consistent. If they are consistent, no upgrade is required. If they are inconsistent, an upgrade is needed.
ZD8I:D8I:UT=VMU,UI=index::ALL; D8I:UT=VMU,UI=12::ALL; LOADING PROGRAM VERSION 1.22-0 EXECUTION STARTED
MSCi
MSS06
UNIT -----------VMU-12
2016-12-13
PIU TYPE -------ACPI5_A
ESW -----IPMC BIOS FPGA
STATUS -----OK OK OK
09:48:17
ACTIVE -----------02.02.0004 01.05.0009 10.00.0000
BACKUP -----------02.02.0004 01.05.0009 10.00.0000
[ALL] TOTAL 1 UNIT(S) FOUND, 1 SUCCESS, 0 FAILED DISK VERSIONS: ACPI5_A
IPMC BIOS FPGA
02.02.0004 01.05.0009 10.00.0000
COMMAND EXECUTED
32
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
As displayed in the example, an upgrade is needed because the current IPMC versions (active and backup) are inconsistent with the disk IPMC version. And the BIOS version is also different. 8
g
Update the HPM.1 version if needed. Note: Update must be performed by an experienced person who has sufficient knowledge of the system. For instructions, see command reference. a) Update the HPM.1 version.
ZD8U:UT=VMU,UI=index,PT=ACPI5_A; b) Check the embedded software uploading status until uploading is complete.
ZD8S:FUL; c) Check the embedded software that has not been activated yet (optional).
ZD8I:UT=VMU,UI=index::UNACT:; d) Activate the new embedded software in the backup flash bank after the uploading has finished.
ZD8A:UT=VMU,UI=index,ST=NON-WO,:; For more information on HPM.1, see Updating Embedded Software document.
9
g
Check the version of the FRU data package. Note: Check whether the soft versions are consistent. If they are consistent, no upgrade is required. If they are inconsistent, an upgrade is needed.
ZWDP:UT=VMU,UI=index; EXECUTION STARTED 1 VALID PLUG-IN UNITS FOUND EXECUTION STARTED AT 2015-05-04 15:01:22 100% DONE, PLEASE WAIT 0 H, 0 MIN AND 0 SEC FUNCTIONAL PLUG-IN UNIT VERSION UNIT TYPE INDEX CURRENT -> AFTER UPDATE ----------- ------------- -------------------------------VMU-8 ACPI5_A-1 acpi5-a_em_frud_02.01.0027 -> ---current version acpi5-a_em_frud_02.01.0027 RABESW_1431 ---disk version
As displayed in the example, an upgrade is not needed because the current version is consistent with the disk version.
10 Replace the FRU package if needed.
g
DN0966621 Issue: 11-0
Note: Update must be performed by an experienced person who has sufficient knowledge of the system. For instructions, see command reference.
© 2017 Nokia
33
Replacing hardware units
Maintaining and Troubleshooting Hardware
Example:
ZWDQ:UT=VMU,UI=index,PT=ACPI5_A,PI=0; 11 Run the diagnostic on the unit.
ZUDU:VMU,index;
12 Check the diagnostic report.
ZUDH:VMU,index;
13 Change the working state of the WDU if corresponding CPRT5-A is installed with HDD. If the diagnostic report shows that the unit is healthy, change the state of the HDD to WO-BU.
ZISC:,CHU:WDU,0:WO-ID; ZISC:,CHU:WDU,0:WO-BU;
14 Change the unit state to WO-EX . Table 3
steps for changing unit state to WO-EX Unit type
Steps
Native unit (IPDU for example)
ZUSC:IPDU,0:SP;
virtualized (into several child units) VMU (CHU for example)
ZUSC:VMU,index:WO;
g
Note: The state of the child unit is changed automatically.
15 Check that there are no active alarms.
ZAHO:VMU,index;
2.4 Replacing a hub blade (AHUB3-A or AHUB3-B) Purpose The following example shows how to replace a hub blade in the active EMB (basic interface) or CNW (fabric interface).
34
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
The hub blade includes a configuration file of the CNW and of the EMB. When the blade is replaced with one of the same type, the configuration file can be stored to the OMU disk file before it is removed. From the OMU disk, the file is loaded back to the new switch after the old blade has been replaced. If the blade is replaced with a different type (for example, a newer blade variant), the configuration file of the old blade cannot be used. In this case, the default configuration is loaded to the new blade from the software build after the blade has been replaced. Before you start Check first the fault is in the blade and not in the slot or in the shelf. For instructions, see chapter Hardware troubleshooting. Bring the new blade in its inner package close to the shelf, and place it on an ESDprotected surface.
g
Note: Electrostatic discharge (ESD) may damage hardware components. To avoid ESD damage: Before handling hardware units, check that the site is an ESD-protected area (EPA). If the area is not ESD-protected, create a temporary EPA. When handling hardware units, wear an ESD wrist strap or use a corresponding protection method, and do not touch the connector surfaces.
• •
Procedure 1
Download the configuration file from the switch. Load the configuration file of the switch to the OMU disk.
ZYFM:DCF:SWU,0;
2
Change the state of the units into SE-NH. •
•
3
The EMB:
ZUSC:EMB,0:SP; ZUSC:EMB,0:TE; ZUSC:EMB,0:SE; ZUSC:EMB,0:SE; The CNW: ZUSC:CNW,0:TE; ZUSC:CNW,0:SE; ZUSC:CNW,0:SE;
Check bond0 switchover if needed. In function units, if interfaces EL0 and EL1 are configured to bond0, use the following command to check bond0 switchover. EL0 and ELI should have been switched over after the CNW state change in step 2. ZQRI;
DN0966621 Issue: 11-0
© 2017 Nokia
35
Replacing hardware units
Maintaining and Troubleshooting Hardware
From the printouts, you can see that the Ethernet interface assigned with an IP address is the active interface. If the switchover fails, use the following commands to manually switch over the interfaces for bond0: ZQRW:GISU,14::BOND0; ZQRW:GISU,14::EL0;
In this example, EL1 interface is now the active interface. 4
Remove a blade from the shelf. See Removing a blade from the shelf.
5
Install a blade. See Installing a blade.
6
Change the state of the switch into SE-OU;
ZUSC:EMB,0:SE; ZUSC:CNW,0:SE;
7
Change the state of the switch into TE-EX.
ZUSC:EMB,0:TE; ZUSC:CNW,0:TE;
8
Check the connection between the OMU and the HUB.
ZW6T:SWU,0;
g
Note: If the connection is broken, see section Blade does not answer to ping.
9
Check the eSW versions. Sub-steps a) Check the FRU version.
ZWDP:UT=SWU,UI=0;
36
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
b) Check the IPMI version and the UCSW version. •
Use one D8 command to check the IPMI and the UCSW versions at the same time. ZD8I:UT=SWU,UI=0:ALL:ALL;
•
If ZD8I does not support SWU, use the following commands to check the IPMI and the UCSW versions seperately. 1. Check the IPMI version. ZWDD:UT=SWU,UI=0,;
2. Check the UCSW version. ZUSC:SWU,0:SE; ZYFM:ISW:SWU,0;
g
Note: For the UCSW version used in the network element, see the Release Note. An upgrade of eSW is needed when one of the following conditions is met: • • •
The FRU version in the new switch is inconsistent with the disk version. The IPMI version in the new switch is inconsistent with the disk version. The UCSW software in the new switch is older than the one in the network element.
See section Updating embedded software of an AHUB3-A/B blade of the Updating Embedded Software document for upgrade instructions.
10 Upload configuration file to LAN switch.
g
Note: This step is only required when the configuration file is not uploaded in any previous steps.
ZYFM:UCF:SWU,0; ZYFM:UCF:SWU,60;
11 Reconfigure the time zone settings. See section Opening the first MML session via Telnet of the Commissioning document.
12 Run diagnostics on the unit.
g
DN0966621 Issue: 11-0
Note: Change the units to TE state with the ZUSC command before running diagnostics if needed.
© 2017 Nokia
37
Replacing hardware units
Maintaining and Troubleshooting Hardware
ZUDU:EMB,0; Or
ZUDU:CNW,0; 13 Check the diagnostics report.
ZUDH:EMB,0; And
ZUDH:CNW,0;
14 Change the working state of the unit. If the diagnostic report shows that the unit is healthy, change its state into WO-EX. The EMB:
•
ZUSC:EMB,0:SP; ZUSC:EMB,0:WO; The CNW: ZUSC:CNW,0:WO;
•
15 Check that the switch supervision is functioning.
ZYFF;
2.5 Replacing memory modules on the ACPI4-A or ACPI4-B blade You may need to change the memory configuration of the ACPI4-A or ACPI4-B blade or replace a faulty memory module. For a description of supported memory configurations, see the section Memory modules in the blade-specific user guide. Before you start The value in data byte 3 of IPMI sensor #70 "Memory/PICMG Front Board" indicates the ID of the faulty memory module. The following table can be used to identify its location on the ACPI4 blade. Table 4
ID of faulty memory module
Description
38
Value in data 3
Socket naming
Channel 0, DIMM 0
1
J14
Channel 0, DIMM 1
2
J13
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Table 4
Replacing hardware units
ID of faulty memory module (Cont.)
Description
Value in data 3
Socket naming
Channel 1, DIMM 0
3
J16
Channel 1, DIMM 1
4
J15
Channel 2, DIMM 0
5
J18
Channel 2, DIMM 1
6
J17
In the ACPI4-A blade, memory slots J14, J16 and J18 can be used. In the ACPI4-B blade, all memory slots (J13, J14, J15, J16, J17 and J18) can be used.
2.5.1 Removing a memory module Procedure 1
Remove the blade from the shelf. For instructions, see Replacing a blade.
2
Place the blade on an anti-static surface so that you are facing the front plate connectors.
3
Remove the cover plate which protects the memory modules.
4
5
To release the memory module, push the retaining clips on each side of the socket sideways.
Pull out the memory module from the socket.
2.5.2 Installing a memory module Procedure 1
DN0966621 Issue: 11-0
Insert the new memory module into the socket.
© 2017 Nokia
39
Replacing hardware units
Maintaining and Troubleshooting Hardware
Align the notches on the module with the socket’s key inserts. 2
g
Push down the memory module gently but firmly until it is properly seated and the retaining clips lock on each side. Note: Memory modules must be correctly installed in their sockets, for the blade to function properly.
3
Install the cover plate that protects the memory modules and fasten it with screws. Figure 3
Memory modules on ACPI4-A
J13 J14 J15 J16 J17 J18
Channel Channel Channel 0 1 2 DN0945381
2.6 Replacing memory modules on the ACPI5-A blade Purpose You might need to change the memory configurations on the ACPI5-A blade or replace a faulty memory module. For a description of supported memory configurations, see the section about memory modules in the ACPI5-A and CPRT5-A user guide. ACPI5-A memory modules
40
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
The ACPI5-A has eight 240 pin, straight-up sockets for DIMM memory modules and can be equipped with up to 128GB DDR3 SDRAM. The table below shows the DIMM memory modules that are approved for ACPI5-A. Table 5
Approved ACPI5-A DIMM memory module types
Type
Size
MRB3L04
4 GB
MRB3L08
8 GB
MRB3L16
16 GB
Memory configuration rules The following memory configurations are recommended for ACPI5-A. In addition, other memory configurations are also possible. Table 6
Recommended memory configurations
Total memory
Configuration
Populated DIMM slots
32 GB
8 x 4 GB
All
64 GB
8 x 8 GB
All
128 GB
8 x 16GB
All
g
Note: The memory slots are illustrated in the figure 4. All DIMM memory slots must always be installed in the ACPI5-A. To avoid thermal and compatibility issues, only Nokia approved memory modules must be used. Other memory configurations are possible from technical perspective, but any asymmetric configurations (not all slots installed or mixing different size of DIMMs) would slower the performance. Thus other configurations are not accepted. The combined use of 4/8/16G DIMMs in one ACPI5-A blade is not allowed.
2.6.1 Removing a memory module Procedure
g
1
DN0966621 Issue: 11-0
Note: Perform this operation only when replacing the CPU blade that related CPRT5-A is installed with HDD. Take the CHU unit as an example.
© 2017 Nokia
41
Replacing hardware units
Maintaining and Troubleshooting Hardware
Change the state of the HDD into BL-US.
ZISC:,CHU:WDU,0:WO-ID; ZISC:,CHU:WDU,0:BL-US; 2
Change the state of the unit into SE-NH. Table 7
Steps for changing the related unit state into SE-NH Unit Type
Steps
Native unit (IPDU for example)
•
• • •
virtualized (into several child units) VMU (CHU for example)
g
Note: When the IPDU is WO-EX state, execute the following steps. If it is SPEX state, ignore the first step and execute the other steps.
ZUSC:IPDU,0:SP; ZUSC:IPDU,0:TE; ZUSC:IPDU,0:SE; ZUSC:IPDU,0:SE;
a) Check the slot of the CHU. Get the master and the module number of the related VMU.
ZWTI:P:CHU; b) Check all child units in the related VMU.
ZUSI:VMU,index; c) Change all child units into SE-NH. •
• • •
g
Note: When the child unit is WOEX state, execute the following steps. If it is SP-EX state, ignore the first step and execute the other steps.
ZUSC:child index:SP; ZUSC:child index:TE; ZUSC:child index:SE; ZUSC:child index:SE;
unit,child unit unit,child unit unit,child unit unit,child unit
d) Change the VMU to SE-NH. • •
42
© 2017 Nokia
ZUSC:VMU,index:BL; ZUSC:VMU,index:TE;
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Table 7
Replacing hardware units
Steps for changing the related unit state into SE-NH (Cont.) Unit Type
Steps • •
3
ZUSC:VMU,index:SE; ZUSC:VMU,index:SE;
Hot swap the blade and remove it from the shelf. a) Unscrew the two retaining screws from the top and bottom of the front panel. b) Gently open the ejector latches (hot swap handle), and the blue hot swap LED starts blinking. c) Wait until the hot swap LED turns into steady blue. d) Remove the blade from the shelf.
DN0966621 Issue: 11-0
© 2017 Nokia
43
Replacing hardware units
Maintaining and Troubleshooting Hardware
Figure 4
The Hot Swap LED on the ACPI5-A Reset Reset
SER
SER
OutofServiceLED InServiceLED SFP0
SFP0 SFP1
APP
APP LED SFP1
U1/U2/U3LEDs 2xUSB U1 U2 U3
HotSwapLED
DN09105793
For instructions, see Replacing a blade.
44
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
4
Place the blade on an anti-static surface so that you are facing the front plate connectors.
5
To release the memory module, push the retaining clips on each side of the socket sideways. The memory module is automatically lifted up.
6
Pull out the memory module from the socket.
2.6.2 Installing a memory module Procedure 1
Insert the new memory module into the socket. Align the notches on the module with the socket’s key inserts.
2
g
Push down the memory module gently but firmly until it is properly seated and the retaining clips lock on each side automatically. Note: Memory modules must be correctly installed in their sockets, for the blade to function properly. Figure 5
Removing and installing a memory module on ACPI5-A
DN09105887
3
Put the blade into the shelf properly. a) Put the blade into the shelf and close the ejector latches. b) Wait until the blue hot swap LED is on, then blinking and finally off.
DN0966621 Issue: 11-0
© 2017 Nokia
45
Replacing hardware units
Maintaining and Troubleshooting Hardware
c) Tighten the screws.
4
Change the working state of the unit into TE-EX. Table 8
Steps for changing the related unit state into TE Unit type
Native unit (IPDU for example)
Steps • •
virtualized (into several child units) VMU (CHU for example)
• •
ZUSC:IPDU,0:SE; ZUSC:IPDU,0:TE; ZUSC:VMU,index:SE; ZUSC:VMU,index:TE;
g 5
Note: The state of the child unit is changed automatically.
Run the diagnostic on the unit.
ZUDU:VMU,index;
6
Check the diagnostic report.
ZUDH:VMU,index;
g
7 Note: Perform this operation only when replacing the CPU blade that related CPRT5-A is installed with HDD. Take the CHU unit as an example. Change the working state of the WDU. If the diagnostic report shows that the unit is healthy, change the state of the HDD into WO-BU.
ZISC:,CHU:WDU,0:WO-ID; ZISC:,CHU:WDU,0:WO-BU;
8
Change the unit into WO-EX state. Table 9
Steps for changing the related unit state into WO-EX Steps
Unit type Native unit (IPDU for example)
46
© 2017 Nokia
ZUSC:IPDU,0:SP;
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Table 9
Replacing hardware units
Steps for changing the related unit state into WO-EX (Cont.) Steps
Unit type virtualized (into several child units) VMU (CHU for example)
9
ZUSC:VMU,index:WO;
g
Note: The state of the child unit is changed automatically.
Check that there are no active alarms.
ZAHO:CHU; ZAHO:VMU,index;
2.7 Replacing a rear transition module Purpose If a rear transition module (RTM) is faulty, or it needs to be upgraded or serviced, you need to remove it from the shelf and install a new RTM in its place.
t
Tip: When sending a faulty RTM to Hardware Services (HWS) for a replacement or repair, remember to remove the hard disk drive or SFP/SFP+/XFP transceivers, if any of these have been integrated in the RTM. Before you start Before replacing a faulty RTM, make sure that the corresponding blade is functioning properly and that the fault is in the RTM and not in the slot or the shelf. For troubleshooting instructions, refer to section Problem with a blade, RTM or AMC.
w
NOTICE: Electrostatic discharge (ESD) may damage hardware components. To avoid ESD damage: • •
Before handling hardware units, check that the site is an ESD-protected area (EPA). If the area is not ESD-protected, create a temporary EPA. When handling hardware units, wear an ESD wrist strap or use a corresponding protection method, and do not touch the connector surfaces.
If applicable, bring the new RTM in its inner package close to the shelf to an ESDprotected surface. When permanently removing an RTM from the slot, install an RTM filler in its place.
DN0966621 Issue: 11-0
© 2017 Nokia
47
Replacing hardware units
Maintaining and Troubleshooting Hardware
Procedure 1
Change the state of the unit into SE-NH. When replacing the CPRT4-A RTM for an OMU unit, change the state of the OMU unit, for example:
ZUSC:OMU,0:SP; ZUSC:OMU,0:TE; ZUSC:OMU,0:SE; ZUSC:OMU,0:SE; When replacing the CPRT4-B RTM for an IPDU unit, change the state of the IPDU unit, for example:
ZUSC:IPDU,0:SP; ZUSC:IPDU,0:TE; ZUSC:IPDU,0:SE; ZUSC:IPDU,0:SE; When replacing the HBRT3-A RTM for an SWU unit, change the state of the SWU unit, for example:
ZUSC:SWU,0:TE; ZUSC:SWU,0:SE; ZUSC:SWU,0:SE; When replacing the CPRT5-A RTM for a VMU unit, change the state of the VMU unit, for example:
ZUSC:VMU,0:BL; ZUSC:VMU,0:TE; ZUSC:VMU,0:SE; ZUSC:VMU,0:SE;
g
Note: After changing the VMU unit state, the state of all child units on this VMU is changed to SE-NH.
2
Remove a rear transition module from the shelf. a) Unscrew the two retaining screws from the top and bottom of the front panel. b) Gently open the lower ejector latch (hot swap handle) so that the blue hot swap LED starts blinking. Do not open the latch all the way yet. Opening the latch notifies the hardware management system that you are going to remove the blade and tells it to finish all processes. The hot swap LED starts blinking. c) Wait until the hot swap LED turns into a steady blue. This may take a few seconds. d) Disconnect the cables, if any, from the RTM. e) Open both ejector latches.
48
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
f)
Unseat the RTM by turning both ejector latches gently toward the center of the RTM front panel. g) Gently slide the RTM out of the slot and place it on an ESD-protected surface. Figure 6
Removing the RTM
1 2
Alternative A
3
AlternativeB 1. Pushin 1.Lift 2. Pullout
2. Pullout
DN0960584
h) If you are not going to replace the RTM with a new one immediately, install an RTM filler in the empty slot. This is to ensure adequate cooling and proper EMC shield in the shelf.
3
Install a rear transition module. a) Determine the slot in which to install the RTM. Make sure that the corresponding blade is functioning properly and that you are installing the RTM to the correct slot in reference to the blade. Check the switch settings, if there are any. b) Check that the EMC gasket is correctly in place and that its contacts are clean. c) Open both ejector latches by turning them outwards, into a horizontal position. d) Insert the RTM into the shelf.
DN0966621 Issue: 11-0
© 2017 Nokia
49
Replacing hardware units
Maintaining and Troubleshooting Hardware
Figure 7
Installing the RTM
1
2
DN0960518
Carefully support the RTM during installation. Do not pull or push the RTM from the ejector latches. e) When the ejector latches reach the latch rail on the shelf, close both latches at the same time by turning them inwards toward the center of the RTM front panel. f) Wait until the blue hot swap LED turns off and the power LED turns solid green. g) Connect the cables, if any, to the RTM. h) Verify that the embedded software in the hardware units is consistent with the product release, and update it if needed. See a document that describes embedded software management for details.
4
Change the state of the unit into TE-EX. After replacing the CPRT4-A RTM for an OMU unit, change the state of the OMU unit, for example:
ZUSC:OMU,0:SE; ZUSC:OMU,0:TE; After replacing the CPRT4-B RTM for an IPDU unit, change the state of the IPDU unit, for example:
ZUSC:IPDU,0:SE; ZUSC:IPDU,0:TE; After replacing the HBRT3-A RTM for an SWU unit, change the state of the SWU unit, for example:
ZUSC:SWU,0:SE; ZUSC:SWU,0:TE; After replacing the CPRT5-A RTM for a VMU unit, change the state of the VMU unit, for example:
ZUSC:VMU,0:SE; ZUSC:VMU,0:TE;
50
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
g
Replacing hardware units
Note: Upon command execution, the VMU unit restarts along with all its child units. After the restart, the state of the VMU unit is changed to TE-EX.
5
Change the state of VMU into WO-EX.
ZUSC:VMU,0:WO;
g
Note: Upon command execution, the VMU unit restarts along with all its child units. After the restart, the state of the VMU unit is changed to WO-EX. The child units of the VMU unit, however, resume their initial state ( for example SP-EX or WO-EX).
2.8 Replacing the hard disk drive on CPRT4-A Purpose Units that store or process large amounts of data can be equipped with a hard disk. OMU always has one hard disk for the active unit and one for the spare unit. The hard disks are located on the rear transition module (CPRT4-A) of the CPU and shared between the active and spare unit so that each unit has access to its own and the other’s hard disk. In addition to replacement due to fault or upgrade, the HDD should be replaced every six years due to wear and tear. Six years is counted from the HDD's equipping date. RTMs delivered from the factory do not have ready-installed hard disks. If you are only replacing the RTM and the hard disk is not faulty, remove the hard disk drive and install it on the new RTM. If you have to replace a faulty hard disk with a new one, the new hard disk has to be initialized.
g
Note: OMU boots from the hard disk by default. Therefore, when replacing the hard disk, updates to the disk must be prevented to ensure that data is not lost during the time when the unit is out of use. If there are updates left pending during this time, they are buffered, and pushed to the disk later when the disk updates are enabled again. The following example shows how to replace the hard disk of an active OMU. The procedure applies also to other units which have a hard disk, except that the disk blocking is only done when replacing the OMU hardware. Before you start Check first that the fault is in the hard disk and not in the RTM or CPU. For troubleshooting instructions, see chapter Hardware troubleshooting.
DN0966621 Issue: 11-0
© 2017 Nokia
51
Replacing hardware units
w
Maintaining and Troubleshooting Hardware
NOTICE: Electrostatic discharge (ESD) may damage hardware components. To avoid ESD damage: • •
Before handling hardware units, check that the site is an ESD-protected area (EPA). If the area is not ESD-protected, create a temporary EPA. When handling hardware units, wear an ESD wrist strap or use a corresponding protection method, and do not touch the connector surfaces.
Procedure 1
Check the state of the hard disk.
ZISI:,OMU:WDU;
2
Prevent disk updates. a) Prevent file updates to the disk.
g
Note: This is done only when replacing the OMU hardware.
ZDUP:OMU; b) Prevent database file updates to the disk. With the command DBL, you can check which databases are used by the unit. For example: ZDBP:EQUIPM,0:DISK; ZDBP:ILDATA,0:DISK; c) Change the state of the HDD into BL-US. ZISC:,OMU:WDU,0:WO-ID; ZISC:,OMU:WDU,0:BL-US;
3
Change the state of the OMU unit into SE-NH.
ZUSC:OMU,0:SP; ZUSC:OMU,0:TE; ZUSC:OMU,0:SE; ZUSC:OMU,0:SE;
4
Remove the hard disk drive. a) Remove the RTM as instructed in section Replacing a rear transition module. b) Place the RTM on an ESD-protected surface so that the hard disk drive is facing down. c) Unscrew the four screws that hold the HDD to the RTM. d) Detach the HDD from the connector and remove it from the RTM. e) Remove the four metal nuts that are used to support the HDD against the RTM.
52
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
5
Replacing hardware units
Install the hard disk drive. a) Fasten the four metal nuts that are used to support the HDD against the RTM to the corners of the new HDD. b) Connect the HDD to the connector on the RTM. c) Turn the RTM over and fasten the HDD to the RTM with four screws. Figure 8
Hard disk drive on CPRT4-A Diskdrive
SASconnector
Insertedscrew DN0945272
d) Install the RTM as instructed in section Replacing a rear transition module.
6
Change the state of the OMU unit into TE-EX.
ZUSC:OMU,0:SE; ZUSC:OMU,0:TE;
t
Tip: If the hard disk is new, the state of the OMU unit will be changed into TE-EX automatically after copying the BOLERO image file to the new disk.
7
If the hard disk is a new one, initialize it. The HDD must be in the WO-ID state so that it can be initialized. To change the state, give the following command:
ZISC:,:WDU,0:WO-ID; To initialize the disk, give the following command:
ZIWI:,:WB,
8
Change the state of the HDD into TE-ID.
ZISC:,OMU:WDU,0:TE-ID;
DN0966621 Issue: 11-0
© 2017 Nokia
53
Replacing hardware units
9
Maintaining and Troubleshooting Hardware
Check the version of the unit's IPMI software.
ZWDD:UT=OMU,UI=0; LOADING PROGRAM VERSION 13.53-0 EXECUTION STARTED 1 VALID PLUG-IN UNITS FOUND EXECUTION STARTED AT 2015-05-05 06:06:09 100% DONE, PLEASE WAIT 0 H, 0 MIN AND 0 SEC FUNCTIONAL PLUG-IN UNIT VERSION UNIT TYPE INDEX CURRENT -> AFTER UPDATE ----------- ------------- -------------------------------OMU-0 CPRT4_A-0 cprt4-a_kn_mmcf_05.52.2020 -> ---current version cprt4-a_kn_mmcf_05.52.2020 R_ABESW_1448 ---disk version
As displayed in the example above, an upgrade is not needed because the current SW version is consistent with the disk version.
10 Update the IPMI software, if needed.
g
Note: This must be done by experienced personnel who have sufficient knowledge of the system. Follow the instructions given in the command reference manual.
ZWDF:UT=OMU,UI=0,PT=CPRT4_A,PI=0;
11 Run diagnostics on the unit.
ZUDD:OMU,0:WDU,0;
12 Check the diagnostics report.
ZUDH:OMU,0:;
13 Change the working state of the HDD back into WO-ID.
ZISC:,:WDU,0:WO-ID;
14 Copy the SCMANA directory, software package directory, and BOLERO image file to the disk.
ZIWY:S:UNIT=OMU,PATH=/,DRIVE=WDU-S; ZIWY:D:UNIT=OMU,PATH=/,DRIVE=WDU-B; ZIBC:,,,,,,,,,DIR:;
54
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
15 Change the state of the hard disk into WO-BU.
ZISC:,:WDU,0:WO-BU;
16 Enable disk updates. a) Use the following command.
ZDUR:OMU;
g
Note: This is done only when replacing the OMU hardware. b) ZDBR:EQUIPM,0:DISK;
ZDBR:ILDATA,0:DISK;
17 Check that there are no alarms active.
ZAHO:OMU,0; ZAHO:WDU,0;
2.9 Replacing the HDD on CPRT5-A for VMU Purpose The CPRT5-A RTM supports two hard disk drive bays. In MSS the CPRT5-A RTM in VMU has only one HDD installed into HDD0 carrier. This HDD is for CHU unit.
DN0966621 Issue: 11-0
© 2017 Nokia
55
Replacing hardware units
Figure 9
Maintaining and Troubleshooting Hardware
The HDD0 on the CPRT5-A
CLASS1LASER PRODUCT IEC/EN60825-1
HDD1H/SLED HDD1H/SREQ
HDD1H/S HDD1 H/SREQ
HDD0H/SLED
HDD0H/S
HDD0H/SREQ
HDD0 H/SREQ
OutofServiceLED SFP0
SFP0
InServiceLED SFP1
SFP1
APP LED APP
MiniSASconnector USB SAS
HDD1 ACT
HDD1 ACT LED
HDD1
HDD0 ACT
HDD0 ACT LED HotSwapLED
HDD0
DN09172995
g
Note: There are two HDD slots and currently only HDD0 is used. In addition to replacement due to fault or upgrade, the HDD should be replaced every six years due to wear and tear. Six years is counted from the HDD's equipping date.
g
56
Note: Before removing the HDD from the RTM, make sure to plug out or power off the RTM.
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
2.9.1 Removing the HDD Before you start Identify which RTM needs to be plugged out. For example, the WDU-0 of CHU-1-0 and CHU-1-1 pair configured on VMU12 and VMU13 units. Procedure 1
Check the state of the hard disk. Step example ZISI:,CHU,1:WDU;
2
Change the state of the HDD to BL-US. Step example ZISC:,CHU,1:WDU,0:WO-ID; ZISC:,CHU,1:WDU,0:BL-US;
3
Change the state of the VMU unit to SE-NH. Step example ZUSC:VMU,12:BL; ZUSC:VMU,12:TE; ZUSC:VMU,12:SE; ZUSC:VMU,12:SE;
g
Note: After changing the VMU unit state to BL, child units in WO-EX state on that VMU will perform automatic switchover to SP-EX state. After successful switchovers, VMU state goes from BL-EX to BL-ID state. Continue state changing from BL to TE and SE only if VMU is in BL-ID to avoid unexpected child unit restarts.
4
Remove the VMU corresponding RTM from the shelf. For the instructions on removing the RTM, see Remove a rear transition module from the shelf. in section Replacing a rear transition module.
DN0966621 Issue: 11-0
© 2017 Nokia
57
Replacing hardware units
Maintaining and Troubleshooting Hardware
5
Unscrew the two retaining screws of the HDD carrier.
6
Pull the HDD carrier outward by holding both screws. Exert equal force to keep it straight.
7
Remove the HDD by unscrewing the four screws that hold the disk module to the carrier.
2.9.2 Installing the HDD Procedure 1
Install the HDD by mounting screws that hold the disk module to the carrier.
2
Align the HDD carrier to the guiding rails of the slot.
3
Insert the HDD carrier to the slot until it is firmly in place.
4
Tighten the two retaining screws of the HDD carrier. Figure 10
Tighten two screws of the HDD0 carrier
CLASS1LASER PRODUCT IEC/EN60825-1
HDD1H/S
HDD0H/S
HDD1 H/SREQ
HDD0 H/SREQ
SFP0
SFP1
SAS APP
HDD1 ACT
HDD0 ACT
DN09172983
5
Install the RTM with HDD. For the instructions on installing the RTM, see Install a rear transition module. in section Replacing a rear transition module.
58
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
g
Replacing hardware units
Note: After a while, if the HDD0 is ready, the HDD0 ACT LED turns green.
6
Change the state of VMU to TE-EX. Step example ZUSC:VMU,12:SE; ZUSC:VMU,12:TE;
g
Note: Upon command execution, the VMU unit restarts along with all its child units. After the restart, the state of the VMU unit is changed to TE-EX.
7
Change the state of VMU to WO-EX. Step example ZUSC:VMU,12:WO;
g
Note: Upon command execution, the VMU unit restarts along with all its child units. After the restart, the state of the VMU unit is changed to WO-EX. The child units of the VMU unit resume their initial state ( for example SP-EX or WO-EX).
8
Check the state of the HDD. Step example ZISI:,CHU,1:WDU,0:;
9
If the hard disk is a new one, initialize it. The HDD must be in the WO-ID state so that it can be initialized. Sub-steps a) Change the state to WO-ID. Step example ZISC:,CHU,1:WDU,0:WO-ID;
b) Initialize the disk. ZIWI:,CHU:WB,
DN0966621 Issue: 11-0
© 2017 Nokia
59
Replacing hardware units
Maintaining and Troubleshooting Hardware
Step example ZIWI:,CHU,1:WB,F5,MSS_CHU1W0,FFF0,2,XY;
10 Check the version of the unit's IPMI software. Check whether the soft versions are consistent. If they are consistent, no upgrade is required. If they are inconsistent, an upgrade is needed. Step example WDD:UT=VMU,UI=12; LOADING PROGRAM VERSION 13.71-0 EXECUTION STARTED 1 VALID PLUG-IN UNITS FOUND EXECUTION STARTED AT 2016-12-12 09:16:54 100% DONE, PLEASE WAIT 0 H, 0 MIN AND FUNCTIONAL UNIT ----------VMU-12
PLUG-IN UNIT TYPE INDEX ------------CPRT5_A-0
0 SEC
VERSION CURRENT -> AFTER UPDATE -------------------------------cprt5-a_em_mmcf_02.01.0017 -> cprt5-a_em_mmcf_02.01.0017 RABESW_1450
COMMAND EXECUTED
Step result As displayed in the example, an upgrade is not needed because the current SW version is consistent with the disk version.
11 Update the IPMI software, if needed.
g
60
Note: Update must be performed by an experienced person who has sufficient knowledge of the system. For instructions, see command reference.
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
Sub-steps a) Check the slot of CHU. Get the master and the module number of the related VMU. Step example ZWTI:P:CHU;
b) Check all child units in the VMU. Step example ZUSI:VMU,index;
c) Change all related child units to TE-EX. Step example ZUSC:child unit,child unit index:SP; ZUSC:child unit,child unit index:TE; ZUSC:VMU,index,BL; ZUSC:VMU,index,TE; ZWDF:UT=VMU,UI=index,PT=CPRT5_A,PI=0; ZUSC:VMU,index,WO-EX;
12 Change the state of the HDD to TE-ID. Step example ZISC:,CHU,1:WDU,0:TE-ID;
13 Run the diagnostic on the unit. Step example ZUDD:CHU,1,1:WDU,0;
14 Check the diagnostic report. Step example ZUDH:CHU,1,1:;
DN0966621 Issue: 11-0
© 2017 Nokia
61
Replacing hardware units
Maintaining and Troubleshooting Hardware
15 Change the working state of the HDD back to WO-ID. Step example ZISC:,CHU,1:WDU,0:WO-ID;
16 Copy source WDU to backup WDU of CHU unit. Step example ZIWY:S:UNIT=CHU-1,PATH=/,DRIVE=WDU-S; ZIWY:D:UNIT=CHU-1,PATH=/,DRIVE=WDU-B; ZIBC:,,,,,,,,,DIR:;
17 Change the HDD state from WO-ID to WO-BU. Step example ZISC:,CHU,1:WDU,0:WO-BU;
18 Check that there are no active alarms. Step example ZAHO:CHU,1; ZAHO:WDU,0;
2.10 Replacing SFP, SFP+ and XFP transceivers Purpose To use the SFP, SFP+ or XFP connections, you need to install SFP, SFP+ and XFP transceiver modules in the corresponding sockets. All sockets are located on the front panels of the blades and RTMs.
62
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
Before you start Figure 11
Orientation of transceiver modules
Dual column socket
Single column socket
Connector sideisonright
DN70571185
w
Cableside
Connector sideisonleft
Connector sideisonleft
Latchin closedposition
NOTICE: Electrostatic discharge (ESD) may damage hardware components. To avoid ESD damage: • •
Before handling hardware units, check that the site is an ESD-protected area (EPA). If the area is not ESD-protected, create a temporary EPA. When handling hardware units, wear an ESD wrist strap or use a corresponding protection method, and do not touch the connector surfaces.
Initially, transceiver sockets may be occupied by the transceiver filler plugs, which you need to remove before installing the transceivers. If the transceivers are removed, install either replacement transceivers or filler plugs in the sockets to protect the internal components. You can install SFP, SFP+ and XFP transceivers at any time, but we recommend you install them before you install the equipment in the shelf.
DN0966621 Issue: 11-0
© 2017 Nokia
63
Replacing hardware units
Maintaining and Troubleshooting Hardware
2.10.1 Removing an SFP copper transceiver or an SFP/SFP+/XFP optical transceiver Procedure 1
If a cable is attached to the transceiver, first remove the cable by pressing the clip on the connector and pulling the connector out of the transceiver.
2
Remove the transceiver by opening the retaining clip and pulling the transceiver out by holding the clip. When removing the transceiver, note that the retaining clip is located on the right for the leftmost column and on the left for the rightmost column in case of an SFP housing assembly with dual columns of sockets.
2.10.2 Installing an SFP copper transceiver or an SFP/SFP+/XFP optical transceiver Procedure 1
Remove the filler plugs from the sockets on the front panel of the unit where you will install the transceivers. For sockets which are not in use, keep the filler plugs in place to protect the internal components.
2
Make sure that the latch on the cable socket side of the transceiver is in closed position. This ensures that the transceiver snaps into position when you insert it into the socket.
3
Install the SFP/SFP+/XFP transceiver by gently inserting into the socket until it snaps into its final position. When inserting the transceiver, note that the connector side is located on the right for the leftmost column and on the left for the rightmost column in case of an SFP housing assembly with dual columns of sockets.
4
Ensure the transceiver locking by pulling the transceiver axially.
5
For transceivers with filler plugs installed on their cable socket, keep the plugs in place until you are ready to plug cables into the transceivers. The cable plugs protect the internal components of the transceivers.
64
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
6
Replacing hardware units
If you have replaced a 1 GB SFP transceiver with a 10 GB SFP+ transceiver in an AMPP1-A blade, clear the fastpath configuration. Follow the steps below to clear the fastpath configuration: a) Connect to the blade through the serial port. b) Enter the following command:
rm /etc/fastpath/fastpath.cfg c) Restart the blade.
2.10.3 Removing and installing an SFP/SFP+/XFP filler plug Before you start
t
Tip: You may need to use a small tool in removing the filler plug due to the limited space between the sockets when equipped.
t
Tip: When removing or installing the filler plug, note that the retaining clip is located on the right for the leftmost column and on the left for the rightmost column in case of an SFP housing assembly with dual columns of sockets.
Procedure 1
If you want to remove the filler plug, gently open the retaining clip and pull the plug out by holding the clip.
2
If you want to insert the filler plug, insert the plug gently to the housing until it snaps into its final position.
2.11 Checking and replacing the air filter Purpose Inspect the air filter regularly. To prevent dust from accumulating inside the equipment, the filter element should be replaced twice a year.
DN0966621 Issue: 11-0
© 2017 Nokia
65
Replacing hardware units
Maintaining and Troubleshooting Hardware
Figure 12
Replacing the air filter
Frontview
DN70252323
Procedure 1
Pull out the air filter tray by its handle.
2
Replace the filter element.
3
Push the air filter tray back into the guide rails on both sides of the shelf until it is locked by springs.
4
Log into the active shelf manager.
5
Record the date of the air filter change. Enter the following command: clia airfilterreplaced
66
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
For more information on the airfilterreplaced command, see the shelf manager CLIA command reference. Step example # clia airfilterreplaced 13.08.2007 Pigeon Point Shelf Manager Command Line Interpreter #
6
Option Description If
you replaced the whole CHAF2-A (filter element and tray)
Then
a) Back up the shelf FRU data. Enter the following command from the active shelf manager: clia frudatar 20 254 /var/nvdata/shelf_fru_backup.bin
b) Update the shelf FRU data. Enter the following two commands: patch_fru_info 20 1 c 3 "CHAF2-A :
Figure 13
CHAF2-A
Air filter label stickers
C110639.A1A
CHAF2-A S/N: XY 071300455 DN0948624
During normal half-yearly maintenance, only the filter element needs to be changed and it is not necessary to update the FRU data.
DN0966621 Issue: 11-0
© 2017 Nokia
67
Replacing hardware units
Maintaining and Troubleshooting Hardware
2.12 Replacing a fuse on Passive PEM Board Purpose If the fuse on the Passive PEM Board (PPB) in the ASA16SET-A shelf set is blown, you can replace it with a new one. Figure 14
Fuses on PPB in ASA16SET-A
Before you start The fuse on the PPB has the orange color and is rated at 58 V/40 A, which is made by Littlefuse. The part number is 142.6185.5406. Use an ohm meter to measure the resistance of a new fuse. If the resistance is close or equal to zero, the new fuse is good. Make sure you have such a new fuse available. Besides, prepare a fuse puller.
f
WARNING! Hazardous energy and voltage level Make sure your hands are dry and remove any metal objects such as rings before touching the power supply equipment. Procedure 1
Log in to the active shelf manager.
2
Check if the fuse is blown. Enter the following commands to check two sensors:
# clia sensordata -v 20 “PSU n VOUT” # clia sensordata -v 20 “Feed X In m Fuse” Where X is A or B, n is 1 to 4 which corresponds to the PSU number, and m is from 1 to 4 which corresponds to the fuse number as shown in figure Fuses on PPB in ASA16SET-A. If the PSU n VOUT sensor indicates a reasonable voltage value but the Feed X In m Fuse sensor is absent, the corresponding fuse is blown. Run the commands multiple times to check whether more than one fuse is blown.
68
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
g
Replacing hardware units
Note: When checking Feed A fuses, check the PSU 1 or PSU 2 output voltage sensor and when checking Feed B fuses, check the PSU 3 or PSU 4 output voltage sensor. Enter the following commands to check the Feed A sensors: # clia sensordata -v 20 “PSU 1 VOUT” Pigeon Point Shelf Manager Command Line Interpreter 20: LUN: 1, Sensor # 200 ("PSU 1 VOUT") Type: Threshold (0x01), "Voltage" (0x02) Belongs to entity (0x0a, 0x60): FRU # 7 Status: 0xc0 All event messages enabled from this sensor Sensor scanning enabled Initial update completed Raw data: 168 (0xa8) Processed data: 53.760000 Volts Status: 0xc0 # clia sensordata -v 20 “Feed A In 1 Fuse” Pigeon Point Shelf Manager Command Line Interpreter 20: LUN: 0, Sensor # 165 ("Feed A In 1 Fuse") Type: Discrete (0x6f), "Entity Presence" (0x25) Belongs to entity (0x15, 0x60): FRU # 6 Status: 0xc0 All event messages enabled from this sensor Sensor scanning enabled Initial update completed Sensor reading: 0x01 Current State Mask 0x0001 Entity Absent
The Processed data value of PSU 1 VOUT is 53.760000 Volts, which is a reasonable value, and the Sensor reading value of Feed A In 1 Fuse is 0x01, which indicates the sensor is absent. Therefore, the fuse 1 on the Feed A is blown. 3
Turn off the breakers of the corresponding PSUs. For example, the fuse on the Feed A is blown, turn off the breakers of PSU 1 and 2.
DN0966621 Issue: 11-0
© 2017 Nokia
69
Replacing hardware units
t
Maintaining and Troubleshooting Hardware
4
Unscrew the hexagonal M4 screw on each side of the rear cable tray, lift the rear cable tray upwards and turn it out of the way.
5
Remove the rear cover by unscrewing the four Philips screws.
6
Remove the blown fuses with a fuse puller.
7
Insert new fuses.
8
Install the rear cover.
9
Re-install the hexagonal M4 screws to the rear cable tray and secure them tightly. Tip: Due to the narrow working-space, a 90-degree screwdriver could be useful for fixing the hexagonal M4 screws.
10 Turn on the breakers of the corresponding PSUs. 11 Check if the new fuses work. Enter the following command to check the sensor:
# clia sensordata -v 20 “Feed X In m Fuse” Where X is A or B, and m is from 1 to 4, that is, the number of the fuse that is replaced. If the sensor is present, the corresponding fuse works. Run the command multiple times if more than one fuse was replaced. Enter the following command to check the Feed A In 1 Fuse sensor: # clia sensordata -v 20 “Feed A In 1 Fuse” Pigeon Point Shelf Manager Command Line Interpreter 20: LUN: 0, Sensor # 165 ("Feed A In 1 Fuse") Type: Discrete (0x6f), "Entity Presence" (0x25) Belongs to entity (0x15, 0x60): FRU # 6 Status: 0xc0 All event messages enabled from this sensor Sensor scanning enabled Initial update completed Sensor reading: 0x00 Current State Mask 0x0001 Entity Present
The sensor reading value of Feed A In 1 Fuse is 0x00, which indicates the sensor is now present. Therefore, the fuse 1 on Feed A works.
70
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
12 If any replaced fuse does not work, the shelf is faulty. Replace the shelf. The existing shelf can be kept in operation till the replacement is completed. For more information about replacing a shelf, refer to the shelf replacement section.
Result The red LED on the PAM is off.
2.13 Replacing a power adapter module (APAMO-A) Purpose The power adapter module, APAMO-A, in the shelf set (ASA16SET-A) is located behind the rear cover. If you need to replace it, you need to remove the rear cover first.
Removing a power adapter module (APAMO-A) Procedure 1
Unscrew the hexagonal M4 screw on each side of the rear cable tray, lift the rear cable tray upwards and turn it out of the way.
2
Remove the rear cover by unscrewing the four Philips screws.
3
Remove the power adapter module. Figure 15
DN0966621 Issue: 11-0
Removing a power adapter module (APAMO-A)
© 2017 Nokia
71
Replacing hardware units
Maintaining and Troubleshooting Hardware
Installing a power adapter module (APAMO-A) Procedure 1
Insert a new power adapter module into the slot and slide it along the sledge till the white power adapter module connector matches the connector on the Passive PEM Board (PPB). Figure 16
t
Installing a power adapter module (APAMO-A)
2
Install the rear cover.
3
Re-install the hexagonal M4 screws to the rear cable tray and secure them tightly. Tip: Due to the narrow working-space, a 90-degree screwdriver could be useful for fixing the hexagonal M4 screws.
2.14 Replacing a power distribution unit (ADPDU-A) Purpose If the power distribution unit (PDU) is faulty, you must replace it with a new one.
72
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Figure 17
Replacing hardware units
Power distribution units (ADPDU-A) in the cabinet
Rearview
DN70258786
PDU
PDU Before you start Make sure you have a digital multimeter or voltage meter available.
f
WARNING! Hazardous energy and voltage level Before connecting or removing any power supply cables to or from the power distribution unit, make sure that all site power feeds to the power distribution unit are switched off, the circuit breakers on the front panel of the power distribution unit are in the OFF position, and the equipment is properly earthed (grounded).
f
WARNING! Hazardous energy and voltage level Make sure your hands are dry and remove any metal objects such as rings before touching the power supply equipment.
2.14.1 Removing a power distribution unit (ADPDU-A) Procedure 1
Make sure that the redundant PDU and PEM are functional. Both LEDs of the redundant PDU are lit green. The red alarm LED of the redundant PEM is off and the green OK LED is lit.
DN0966621 Issue: 11-0
© 2017 Nokia
73
Replacing hardware units
2
Maintaining and Troubleshooting Hardware
Switch off both circuit breakers on the PDU you are going to remove. Figure 18
ADPDU-A circuit breakers
ON
-48/-60VDC CircuitBreaker1
-48/-60VDC CircuitBreaker2 OFF
DN70296475
3
Switch off the battery feeds to the PDU you are going to remove.
4
Remove the plastic cable cover. a) Push the plastic cover downwards slightly, so the top of the cover detaches from the PDU b) When the top of the cover is detached, pull the cover slightly towards yourself and then up to detach it completely from the PDU.
5
Check the PDU input feeds with a digital multimeter to ensure there are no voltages in the cables.
6
Disconnect all cables from the PDU. a) b) c) d)
74
Disconnect the four power feed cables from the PDU. Disconnect the CGNDB grounding cable from the PDU. Disconnect the four PEM input feeds from the PDU. Disconnect the alarm cable(s) from the PDU.
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Figure 19
Replacing hardware units
ADPDU-A cabling
-48/-60VDC Input1
Return1
Grounding
-48/-60VDC Input2
Return2
1 Outputs 2 -48/-60VDC 3 (4x25A max.) 4
DN70387805
DN0966621 Issue: 11-0
© 2017 Nokia
75
Replacing hardware units
Maintaining and Troubleshooting Hardware
7
Remove the DC/C grounding bracket, if used.
8
Unscrew the three fixing screws attaching the PDU to the cabinet. Figure 20
Replacing a ADPDU-A
Rearview DN70217207
9
Remove the PDU from the cabinet.
2.14.2 Installing a power distribution unit (ADPDU-A) Procedure 1
Remove the plastic cable cover from the PDU. a) Push the plastic cover downwards slightly, so the top of the cover detaches from the PDU b) When the top of the cover is detached, pull the cover slightly towards yourself and then up to detach it completely from the PDU.
2
If not already installed, install the mounting ears to the PDUs. Attach the mounting ear either to the right side of one power distribution unit or to the left side on the other with the seven T10 screws that come in the package.
76
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
Be careful not to drop the small screws through the cooling grill into the PDU. Figure 21
Installing mounting ears to the ADPDU-As
x7
T10 DN70443733
3
Insert the PDU into the shelf and align the holes of its mounting ear with the cabinet mounting rail. a) From the rear of the cabinet, place the PDUs on both sides of the support structure. b) Align the mounting ears of the units with the cabinet mounting rails.
DN0966621 Issue: 11-0
© 2017 Nokia
77
Replacing hardware units
Maintaining and Troubleshooting Hardware
Figure 22
Installing a ADPDU-A
Rearview DN70217207
The mounting coordinates of the PDUs are listed below: • • •
Shelf 1: 10, 18, 26 Shelf 2: 35, 43, 51 Shelf 3: 60, 68, 76
4
Attach the PDU to the cabinet with three M6 screws.
5
Install the DC/C grounding bracket, if used. For more information on the grounding bracket used in the DC/C equipment grounding system (two-wire system), see the Installation documentation.
6
Connect the PDU grounding cable (CGNDB) to the PDU. a) b) c) d)
78
Remove the nuts from the grounding terminal with a 10 mm socket wrench. Connect the cable lug to the grounding point of the PDU. Place the lug nut(s) with an integrated star washer on top of the lug. Tighten the nut(s) with a 10 mm socket wrench, torque 5.1 Nm.
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Figure 23
Replacing hardware units
ADPDU-A grounding cable
DN70289837
7
Check the PDU input feeds with a digital multimeter to ensure there are no voltages in the cables.
8
Connect the site power supply cables to the PDU. a) Run the cables to the PDU. b) Remove the nuts from the power terminals with a 10 mm socket wrench. c) Connect the (-48/-60 VDC 1) cable with lug to terminal connector marked -48/-60 VDC Input 1, and the (Return 1) cable with lug to terminal connector marked Return 1. d) Connect the (-48/-60 VDC 2) cable with lug to terminal connector marked -48/-60 VDC Input 2, and the (Return 2) cable with lug to terminal connector marked Return 2. All four cables (two inputs and two returns) must be connected.
DN0966621 Issue: 11-0
© 2017 Nokia
79
Replacing hardware units
Maintaining and Troubleshooting Hardware
Figure 24
ADPDU-A power feed cabling
Return1 Return2 2.pullout
-48/-60VDC Input1 Grounding -48/-60VDC Input2
1.pushdown
M6 5.1Nm DN70443745
e) Attach one or two nuts per cable in the connector and tighten them securely with a 10 mm socket wrench. The nuts have integrated star-washers. Fasten the screws gently to no more than 5.1 Nm. f) Make sure that the cables are properly connected and aligned and that no bare parts exist on cable lugs that may short circuit.
9
Attach the cable cover on the PDU. a) Holding the plastic cover at an almost 45° angle, insert the lower part of the cable cover into the slot below the power terminals. b) Turn the plastic cover so that the top of it almost meets the fixing slot above the power terminals of the PDU. c) Push down slightly so you can secure the top of the cover into the slot. Do not try to force the plastic cover into position; this can break the fixing points on top and bottom of the cover.
10 Connect the four PEM input feeds to the PDU. Connect the cable pairs to the power distribution unit's output connectors 1-4.
80
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Figure 25
Replacing hardware units
ADPDU-A cabling
-48/-60VDC Input1
Return1
Grounding
-48/-60VDC Input2
Return2
1 Outputs 2 -48/-60VDC 3 (4x25A max.) 4
DN70387805
DN0966621 Issue: 11-0
© 2017 Nokia
81
Replacing hardware units
Maintaining and Troubleshooting Hardware
11 Connect the alarm cable(s) to the PDU. 12 Switch on the site power supply to the PDU. 13 Switch on the circuit breakers on the PDU. Figure 26
ADPDU-A circuit breakers
ON
-48/-60VDC CircuitBreaker1
-48/-60VDC CircuitBreaker2 OFF
DN70296475
Result Both LEDs of the PDU are lit green. The green OK LED of the PEM is lit.
2.15 Replacing a power distribution unit (ADPD2-A) Purpose If the power distribution unit (PDU) is faulty, you must replace it with a new one.
82
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Figure 27
Replacing hardware units
Power distribution units (ADPD2-A) in the cabinet
Before you start Prepare the following tools: a digital multimeter or voltage meter 8 and 10 mm spanner or a socket wrench with 8 and 10 mm sockets M4 straight lug wrench 3 mm T-type Allen key screwdriver 90-degree screwdriver size 1 and 2 Phillips screwdrivers Torx T10, Torx T30 and Torx T40 screwdrivers ESD wrist strap protective gloves safety ladder
• • • • • • • • • •
f
WARNING! Hazardous energy and voltage level Before connecting or removing any power supply cables to or from the power distribution unit, make sure that all site power feeds to the power distribution unit are switched off, the circuit breakers on the front panel of the power distribution unit are in the OFF position, and the equipment is properly earthed (grounded).
f
WARNING! Hazardous energy and voltage level Make sure your hands are dry and remove any metal objects such as rings before touching the power supply equipment.
f
CAUTION! Risk of physical injury Unfastened equipment in the cabinet can fall off if the cabinet is moved. Never leave the power distribution unit equipped in the cabinet for extended periods with the fixing screws unfastened.
2.15.1 Removing a power distribution unit (ADPD2-A) Procedure 1
Make sure that the redundant PDU and PEM are functional. The red LEDs of the redundant PDU are off. The red alarm LED of the redundant PEM is off and the green OK LED is lit.
DN0966621 Issue: 11-0
© 2017 Nokia
83
Replacing hardware units
2
Maintaining and Troubleshooting Hardware
Switch off the circuit breakers on the PDU you are going to remove. The red LEDs on the PDU are lit. Figure 28
ADPD2-A circuit breakers
Circuitbreakerx6 ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
1
2
3
4
5
6
LEDx6 Mountingholex4 DN0990951
3
Frontview
Switch off the battery feeds to the PDU you are going to remove. The red LEDs on the PDU are then off.
4
Slide the plastic cable covers horizontally to remove them on each PDU input terminal.
5
Check the PDU input cable with a digital multimeter to ensure there are no voltages in the cables.
6
Disconnect all cables from the PDU. a) b) c) d) e)
84
Disconnect the six power feed cables from the PDU. Disconnect the CGNDE grounding cable from the PDU. Unscrew the four Torx M4 screws to unfasten the PDU from the mounting holder. Push the PDU backwards a few centimeters. Disconnect all the bushing PDU output cables from the PDU by a 3 mm T-type Allen key screwdriver.
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
7
Replacing hardware units
Figure 29
ADPD2-A cabling
Figure 30
Unfastening a power distribution unit (ADPD2-A)
Remove the PDU from the cabinet.
2.15.2 Installing a power distribution unit (ADPD2-A) Procedure 1
Insert the PDU into the mounting holder from the rear side of the cabinet till the PDU mates with the mounting flanges.
2
Verify that the PDU mounting holder holes are aligned with the PDU holes.
g
DN0966621 Issue: 11-0
Note: Do not fix the PDU to the PDU mounting holder at this point, as this will make it more difficult to connect the cables between the PDUs and the PEMs.
© 2017 Nokia
85
Replacing hardware units
3
Maintaining and Troubleshooting Hardware
Make sure that the circuit breakers on the PDU are all switched off. The red LEDs of the PDU are off. Figure 31
ADPD2-A circuit breakers
Circuitbreakerx6 ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
1
2
3
4
5
6
LEDx6 Mountingholex4 DN0990951
4
Frontview
Connect the PDU grounding cable (CGNDE) to the PDU. a) Connect the angled two-hole lug of the grounding cable to the set of PDU GND studs with two M6 nuts and two washers, and then tighten the nuts. b) If the other end of the PDU grounding cable (CGNDE), the straight lug, is not connected, connect it to the cabinet grounding rail with nuts, and then tighten the nuts with an M6 (10mm) socket wrench. Figure 32
86
ADPD2-A grounding cable
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
5
Replacing hardware units
In DC/C equipment grounding system (two-wire system), insert three M5 Phillips captive screws in the PDU grounding holes marked with GND, and then tighten the screws. Figure 33
ADPD2-A optional grounding accessories
6
Check the site power supply cables with a digital multimeter to ensure there are no voltages in the cables.
7
Connect the site power supply cables to the PDU. a) Slide the plastic cable covers horizontally to remove them on each PDU input terminal. b) Connect the site return IN1+, IN2+, IN3+ cable lugs and feed IN1-, IN2-, IN3cable lugs to the PDU input terminals correspondingly marked, secure each twohole cable lug on the PDU inut terminal with two M6 nuts and washers, and fasten the nuts. The relation between the PDU inputs and the served shelf is shown in the following table: Table 10
Mapping of PDU input and shelf
PDU input
g
Shelf
IN1
Top shelf
IN2
Middle shelf
IN3
Bottom shelf
Note: If only one PDU input can be fed by the site power supply, see the installation document for details on how to chain PDU inputs. c) Make sure that the cables are properly connected and aligned and that no bare parts exist on cable lugs that may cause short-circuits. d) Place the plastic cable covers on the PDU input terminals.
DN0966621 Issue: 11-0
© 2017 Nokia
87
Replacing hardware units
8
Maintaining and Troubleshooting Hardware
Connect the power cables between PEM and PDU to the PDU. Pay attention to the PDU cable routing as shown in figure below: Figure 34
PDU input and output power cable position
a) Push the PDU backwards a few centimeters. b) Connect the bushing terminals of the cables to the PDU output terminals. Connect the cable pairs between the PEM in each shelf and the PDU according to the following table: Table 11
Power cable connection between ADPD2-A and ADPE2-A
PDU output
PEM input
OUT1+/-
Feed 1
OUT2+/-
Feed 2
OUT3+/-
Feed 1
OUT4+/-
Feed 2
OUT5+/-
Feed 1
OUT6+/-
Feed 2
Shelf Top shelf
Middle shelf
Bottom shelf
c) Use a 3 mm T-type Allen key screwdriver to fasten the hexagonal M4 screws that are placed on the top of connector to fix the cable. d) Push the PDU forwards till it mates with the flanges of the PDU mounting holder. e) Fasten the PDU to the mounting holder with four Torx M4 screws and washers.
88
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
9
Replacing hardware units
If the power cables are not connected to the PEM input feeds, connect them according to the following steps: Sub-steps a) Unscrew the hexagonal M4 screw on each side of the rear cable tray, lift the rear cable tray upwards and turn it out of the way. b) Pull out the PEM input terminal safety plastic covers. c) Unscrew the PEM input terminal hexagonal nuts with an M4 straight lug wrench. d) Connect the PDU output terminals to the PEM input terminals for each shelf using corresponding cable set and make sure the connection follows the table below. Table 12
Power cable connection between ADPD2-A and ADPE2-A
PDU output
PEM input
OUT1+/-
Feed 1
OUT2+/-
Feed 2
OUT3+/-
Feed 1
OUT4+/-
Feed 2
OUT5+/-
Feed 1
OUT6+/-
Feed 2
Shelf Top shelf
Middle shelf
Bottom shelf
e) Place the hexagonal nuts back on the PEM input terminals and fasten them with an M4 straight lug wrench.
10 Switch on the site power supply to the PDU. The red LEDs of the PDU are lit.
11 Switch on the circuit breakers on the PDU. The red LEDs of the PDU are off. The green OK LED of the PEM is lit.
DN0966621 Issue: 11-0
© 2017 Nokia
89
Replacing hardware units
Maintaining and Troubleshooting Hardware
12 Re-install the hexagonal M4 screws to the rear cable tray and secure them tightly.
t
Tip: Due to the narrow working-space, a 90-degree screwdriver could be useful for fixing the hexagonal M4 screws.
2.16 Replacing a power entry module (ADPEM-A) Purpose If the power entry module (PEM) is damaged or malfunctioning, you must replace it with a new one. If the PEM is damaged or malfunctioning due to a blown fuse and replacing the fuse does not help, you must replace the PEM with a new one. Before you start Make sure you have a digital multimeter or voltage meter available.
f
WARNING! Hazardous energy and voltage level Make sure your hands are dry and remove any metal objects such as rings before touching the power supply equipment.
2.16.1 Removing a power entry module (ADPEM-A) Procedure 1
Make sure that the redundant PEM is functional. The red alarm LED of the redundant PEM is off and the green OK LED is on.
2
Push the hot swap button on the front panel of the PEM you are going to remove. Wait for the hot swap LED to turn solid blue.
90
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
3
Replacing hardware units
Switch OFF the circuit breakers on the power distribution unit connected to the PEM you are going to remove. Figure 35
Power distribution unit (ADPDU-A) circuit breakers
ON
-48/-60VDC CircuitBreaker1
-48/-60VDC CircuitBreaker2 OFF
DN70296475
4
Remove the PEM terminal block cover. a) Lift the rear cable tray upwards and turn it out of the way. b) Unscrew the two screws on the terminal block covers with a Phillips screwdriver.
5
Make sure there is no battery voltage in the PEM input terminals. Measure the input voltages with a digital multimeter.
6
Disconnect the power cables from the PEM power terminals. Unscrew the eight connector screws with a flat screwdriver and detach the power cables from the terminals.
DN0966621 Issue: 11-0
© 2017 Nokia
91
Replacing hardware units
Maintaining and Troubleshooting Hardware
Figure 36
ADPEM-A power feed cabling (straight)
1 2 3 4
Outputs -48/-60VDC (4x25A max.)
4 3 2 1 4 3 2 1 -48/-60 VDC
RTN
DN70279286
Figure 37
92
ADPEM-A power feed cabling (angled)
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
7
Unscrew the two fixing screws on the PEM.
8
Holding both handles, pull the PEM out of the slot. Figure 38
Replacing a power entry module (ADPEM-A)
PEM
DN70244931
Cover
2.16.2 Installing a power entry module (ADPEM-A) Procedure 1
Insert the PEM into the shelf. Slide the PEM into the slot along the guide rails.
2
Tighten the two fixing screws on the PEM.
3
Make sure that the circuit breakers on the power distribution unit are OFF and that there is no battery voltage in the power distribution unit output terminals coming to the PEM input. Measure the voltages with a digital multimeter.
DN0966621 Issue: 11-0
© 2017 Nokia
93
Replacing hardware units
4
Maintaining and Troubleshooting Hardware
Connect the four power cables from the dedicated power distribution unit (PDU) to the power terminals of the PEM. Figure 39
ADPEM-A power feed cabling (straight)
1 2 3 4
Outputs -48/-60VDC (4x25A max.)
4 3 2 1 4 3 2 1 -48/-60 VDC
RTN
DN70279286
Figure 40
ADPEM-A power feed cabling (angled)
a) Observe the markings on the cables.
94
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
b) Connect the cable from the PDU output 1 to the power feed -48/-60 VDC 1 and RTN 1 on the PEM. c) Connect the cable from the PDU output 2 to the power feed -48/-60 VDC 2 and RTN 2 on the PEM. d) Connect the cable from the PDU output 3 to the power feed -48/-60 VDC 3 and RTN 3 on the PEM. e) Connect the cable from the PDU output 4 to the power feed -48/-60 VDC 4 and RTN 4 on the PEM. f) Verify the correct polarity of the -48/-60 VDC and RTN cables. g) Screw in the connector screws with a flat screwdriver. Gently tighten the screws to a torque of 1.4 Nm.
5
Install the terminal block cover on the PEM. Fasten the cover screws with a Phillips screwdriver gently to no more than 1.5 Nm.
6
Switch on the circuit breakers on the power distribution unit. Figure 41
Power distribution unit (ADPDU-A) circuit breakers
ON
-48/-60VDC CircuitBreaker1
-48/-60VDC CircuitBreaker2 OFF
DN70296475
Result All the power feeds are present and the green OK LED on the PEM front panel is lit.
DN0966621 Issue: 11-0
© 2017 Nokia
95
Replacing hardware units
Maintaining and Troubleshooting Hardware
2.16.3 Replacing a PEM (ADPEM-A) fuse Purpose If the PEM, ADPEM-A, fuse is blown, you can replace it with a new one. Before you start The ADPEM-A fuse has the green color and is rated at 80 V/30 A, which is made by Littlefuse. The part number is 166.7000.5302. Use an ohm meter to measure the resistance of a new fuse. If the resistance is close or equal to zero, the new fuse is good. Make sure you have such a new fuse available. Besides the tools used for PEM replacement, prepare a fuse puller. Procedure 1
Log in to the active shelf manager.
2
Check if the PEM fuse is blown. Enter the following commands to check two sensors related to the PEM:
# clia sensordata
ADPEM-A fuses Frontside
Fuses80V/30A
DN09120645
F201
F401
F101
F301
Topview
Example Enter the following commands to check the PEM A sensors: # clia sensordata -v 20 “PEM A In 1” Pigeon Point Shelf Manager Command Line Interpreter 20: LUN: 0, Sensor # 164 ("PEM A In 1") Type: Discrete (0x6f), "Entity Presence" (0x25) Belongs to entity (0x15, 0x60): FRU # 6 Status: 0xc0
96
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
All event messages enabled from this sensor Sensor scanning enabled Initial update completed Sensor reading: 0x00 Current State Mask 0x0001 Entity Present # clia sensordata -v 20 “PEM A In 1 Fused” Pigeon Point Shelf Manager Command Line Interpreter 20: LUN: 0, Sensor # 165 ("PEM A In 1 Fused") Type: Discrete (0x6f), "Entity Presence" (0x25) Belongs to entity (0x15, 0x60): FRU # 6 Status: 0xc0 All event messages enabled from this sensor Sensor scanning enabled Initial update completed Sensor reading: 0x01 Current State Mask 0x0001 Entity Absent
The sensor reading value of PEM A In 1 is 0x00, which indicates the sensor is present, and the sensor reading value of PEM A In 1 Fused is 0x01, which indicates the sensor is absent. Therefore, the fuse F101 is blown. 3
Remove the PEM from the shelf. a) b) c) d)
Push the hot swap button on the front panel of the PEM. Switch off the circuit breakers on the PDU connected to the PEM to be removed. Remove the PEM terminal block cover. Disconnect the cables from the PEM.
See the Removing the power entry module (ADPEM-A) section for details.
4
Remove the blown fuse with a fuse puller.
5
Insert a new fuse.
6
Install the PEM in the shelf. See the Installing the power entry module (ADPEM-A) section for details.
7
Check if the new fuse works. Enter the following command to check the sensor related to the PEM:
# clia sensordata
DN0966621 Issue: 11-0
© 2017 Nokia
97
Replacing hardware units
Maintaining and Troubleshooting Hardware
Where
The sensor reading value of PEM A In 1 Fused is 0x00, which indicates the sensor is now present. Therefore, the fuse F101 works. 8
If any replaced fuse does not work, the PEM or the shelf is faulty. Proceed to check the fault, and then replace either the PEM or the shelf. The existing shelf can be kept in operation till the replacement is completed. For more information about replacing a PEM or a shelf, refer to the PEM or shelf replacement section.
Result The green OK LED on the PEM front panel is lit.
2.17 Replacing a power entry module (ADPE2-A) Purpose If the power entry module (PEM) is damaged or malfunctioning, you must replace it with a new one. If the PEM is damaged or malfunctioning due to a blown fuse and replacing the fuse does not help, you must replace the PEM with a new one. Before you start Prepare the following tools: • • •
98
a digital multimeter or voltage meter M4 straight lug wrench 3 mm T-type Allen key screwdriver
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
90-degree screwdriver size 1 and 2 Phillips screwdrivers Torx T10, Torx T30 and Torx T40 screwdrivers ESD wrist strap safety ladder
• • • • •
f
Replacing hardware units
WARNING! Hazardous energy and voltage level Make sure your hands are dry and remove any metal objects such as rings before touching the power supply equipment.
2.17.1 Removing a power entry module (ADPE2-A) Procedure 1
Make sure that the redundant PEM is functional. The red alarm LED of the redundant PEM is off and the green OK LED is on.
2
Push the hot swap button for two seconds on the front panel of the PEM you are going to remove. Wait for the hot swap LED to turn solid blue. If it does not change to blue, the circuitry for hot swap control is damaged, and in such a case you can proceed to the next step.
3
Switch off the PDU circuit breakers that control the PDU output to the PEM you are going to remove. The corresponding red LEDs of the PDU are lit. Figure 43
ADPD2-A circuit breakers
Circuitbreakerx6 ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
1
2
3
4
5
6
LEDx6 Mountingholex4 DN0990951
Frontview
The following table shows the relation between the PDU circuit breakers, PDU output terminals and shelves in the cabinet.
DN0966621 Issue: 11-0
© 2017 Nokia
99
Replacing hardware units
Maintaining and Troubleshooting Hardware
Table 13
Relation between PDU circuit breakers, PDU outputs and shelves
PDU circuit breaker
g
PEM input
1
Feed 1
2
Feed 2
3
Feed 1
4
Feed 2
5
Feed 1
6
Feed 2
Shelf Top shelf
Middle shelf
Bottom shelf
Note: After the PDU circuit breakers are switched off, the PEM's red LED will be lit and green LED will be off. However, in some situations the green OK LED on the PEM is lit green even if the voltage has been disconnected in the PDU output. You can proceed to the next step.
4
Unscrew the hexagonal M4 screw on each side of the rear cable tray, lift the rear cable tray upwards and turn it out of the way.
5
Unscrew the two fixing screws on the PEM. Figure 44
6
Unscrewing the fixing screws on the PEM
Disengage the PEM. Hold both handles and withdraw the PEM out of the slot by approximately 2 cm. Ensure that all the LEDs on the PEM are turned off.
100
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Figure 45
7
Replacing hardware units
Disengaging the PEM
Re-insert the PEM into the shelf. After the re-insertion the PEM’s red LED shall be lit.
8
Pull out the PEM input terminal safety plastic covers.
9
Make sure there is no battery voltage in the PEM input terminals. Measure the input voltages with a digital multimeter.
10 Disconnect the power cables from the PEM input terminals. Unscrew the hexagonal nuts on the PEM input terminals with an M4 straight lug wrench. Figure 46
PEM power feed cabling
11 Pull the PEM completely out of the slot. 12 Place the hexagonal nuts back on the PEM input terminals and fasten them. 13 Place the PEM safety plastic cover over the PEM input terminals.
DN0966621 Issue: 11-0
© 2017 Nokia
101
Replacing hardware units
Maintaining and Troubleshooting Hardware
2.17.2 Installing a power entry module (ADPE2-A) Procedure 1
Insert the PEM into the shelf. Slide the PEM into the slot along the guide rails.
2
Tighten the two fixing screws on the PEM.
3
Make sure that the corresponding circuit breakers on the PDU are off. The following table shows the relation between the PDU circuit breakers, PDU output terminals and shelves in the cabinet. Table 14
Relation between PDU circuit breakers, PDU outputs and shelves
PDU circuit breaker
4
PEM input
1
Feed 1
2
Feed 2
3
Feed 1
4
Feed 2
5
Feed 1
6
Feed 2
Shelf Top shelf
Middle shelf
Bottom shelf
Make sure there is no battery voltage in the PDU output terminals to be connected to the PEM. Measure the voltages with a digital multimeter.
5
Remove the PEM input terminal safety plastic covers.
6
Connect the four power cables from the PDU to the PEM input terminals. a) Unscrew the PEM input terminal hexagonal nuts with an M4 straight lug wrench. b) Connect the power cables from the PDU to the PEM input terminals for each shelf. Connect the cable pairs between PEM and PDU according to the following table:
102
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Table 15
Replacing hardware units
Power cable connection between ADPD2-A and ADPE2-A
PDU output
PEM input
OUT1+/-
Feed 1
OUT2+/-
Feed 2
OUT3+/-
Feed 1
OUT4+/-
Feed 2
OUT5+/-
Feed 1
OUT6+/-
Feed 2
Shelf Top shelf
Middle shelf
Bottom shelf
c) Place the hexagonal nuts back on the PEM input terminals and fasten them with an M4 straight lug wrench.
DN0966621 Issue: 11-0
© 2017 Nokia
103
Replacing hardware units
Maintaining and Troubleshooting Hardware
7
Place the safety plastic covers on the PEM.
8
If the power cables are not connected to the PDU output terminals, connect them according to the following steps: Sub-steps a) Unscrew the four Torx M4 screws to unfasten the PDU from the mounting holder. b) Push the PDU backwards a few centimeters. c) Connect the bushing terminals of the cables to the PDU output terminals. d) Use a 3 mm T-type Allen key screwdriver to fasten the hexagonal M4 screws that are placed on the top of terminals to fix the cables. e) Push the PDU forwards till it mates with the flanges of the PDU mounting holder. f)
9
Fasten the PDU to the mounting holder with four Torx M4 screws and washers.
Switch on the corresponding circuit breakers on the PDU. All the power feeds are present and the green OK LED on the PEM front panel is lit.
10 Re-install the hexagonal M4 screws to the rear cable tray and secure them tightly.
t
Tip: Due to the narrow working-space, a 90-degree screwdriver could be useful for fixing the hexagonal M4 screws.
2.17.3 Replacing a PEM (ADPE2-A) fuse Purpose If the PEM, ADPE2-A, fuse is blown, you can replace it with a new one.
104
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
Before you start The ADPE2-A fuse has the orange color and is rated at 80 V/40 A, which is made by Littelfuse. The part number is 166.6885.5402. Use an ohm meter to measure the resistance of a new fuse. If the resistance is close or equal to zero, the new fuse is good. Make sure you have such a new fuse available. Besides the tools used for PEM replacement, prepare a fuse puller. Procedure 1
Log in to the active shelf manager.
2
Check if the PEM fuse is blown. Enter the following commands to check two sensors related to the PEM:
# clia sensordata
ADPE2-A fuses
80V/40Afusesx4
F101
DN0991035
F201
F301
F401
Rearview (coverremoved)
Example Enter the following commands to check the PEM A sensors: # clia sensordata -v 20 “PEMA1 Voltage” Pigeon Point Shelf Manager Command Line Interpreter 20: LUN: 1, Sensor # 210 ("PEMA1 Voltage") Type: Threshold (0x01), "Voltage" (0x02) Belongs to entity (0x15, 0x60): FRU # 6 Status: 0xc0 All event messages enabled from this sensor Sensor scanning enabled Initial update completed Raw data: 176 (0xb0) Processed data: 52.800000 Volts
DN0966621 Issue: 11-0
© 2017 Nokia
105
Replacing hardware units
Maintaining and Troubleshooting Hardware
Status: 0xc0 # clia sensordata -v 20 “PEM A In 1 Fused” Pigeon Point Shelf Manager Command Line Interpreter 20: LUN: 0, Sensor # 165 ("PEM A In 1 Fused") Type: Discrete (0x6f), "Entity Presence" (0x25) Belongs to entity (0x15, 0x60): FRU # 6 Status: 0xc0 All event messages enabled from this sensor Sensor scanning enabled Initial update completed Sensor reading: 0x01 Current State Mask 0x0001 Entity Absent
The Processed data value of PEMA1 Voltage is 52.800000 Volts, which is a reasonable value, and the sensor reading value of PEM A In 1 Fused is 0x01, which indicates the sensor is absent. Therefore, the fuse F101 is blown. 3
Remove the PEM from the shelf. a) Push the hot swap button on the front panel of the PEM. b) Switch off the PDU circuit breakers that controls the PDU output to the PEM to be removed. c) Disconnect the cables from the PEM. See the Removing the power entry module (ADPE2-A) section for details.
4
Unscrew the two cover screws to remove the PEM cover.
5
Remove the blown fuse with a fuse puller.
6
Insert a new fuse.
7
Place the cover and fix it with two screws.
8
Install the PEM in the shelf. See the Installing the power entry module (ADPE2-A) section for details.
9
Check if the new fuse works. Enter the following command to check the sensor related to the PEM:
# clia sensordata
106
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
Where
The sensor reading value of PEM A In 1 Fused is 0x00, which indicates the sensor is now present. Therefore, the fuse F101 works. 10 If any replaced fuse does not work, the PEM or the shelf is faulty. Proceed to check the fault, and then replace either the PEM or the shelf. The existing shelf can be kept in operation till the replacement is completed. For more information about replacing a PEM or a shelf, refer to the PEM or shelf replacement section. Expected outcome The green OK LED on the PEM front panel is lit.
2.18 Replacing a power supply unit (AAPSU-A) Purpose If the power supply unit (PSU), AAPSU-A, is faulty, you must replace it with a new one.
Removing a power supply unit (AAPSU-A) Procedure 1
Turn off the circuit breaker of the PSU to be removed. The PSU LEDs are off.
DN0966621 Issue: 11-0
© 2017 Nokia
107
Replacing hardware units
2
Maintaining and Troubleshooting Hardware
Push the button on the lower left corner of the PSU front panel to open the white cover a bit. Figure 48
Removing a power supply unit (AAPSU-A)
3
Open the white cover to the right so that the PSU comes out of the slot.
4
Hold the PSU and pull it out of the slot.
Installing a power supply unit (AAPSU-A) Procedure 1
Insert a new PSU into the PSU slot gentlely till the PSU cannot be pushed. The PSU is not fully inserted into the slot and about 1 cm of the PSU is out of the slot.
108
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
2
Push the button on the lower left corner of the PSU front panel to open the white cover and open it fully.
3
Push the PSU a bit further into the slot.
4
Close the white cover till the button locks it to fully insert the PSU into the slot.
5
Turn on the corresponding circuit breaker of the PSU from the rear side of the shelf. Make sure the AC OK LED and DC OK LED are lit.
2.19 Replacing a fan module Purpose In addition to replacement due to fault or upgrade, the fan module should be replaced every six years due to wear.
w
DN0966621 Issue: 11-0
NOTICE: The change time is 30 seconds maximum in order to prevent overheating of units in the shelf.
© 2017 Nokia
109
Replacing hardware units
Maintaining and Troubleshooting Hardware
Figure 49
Replacing a fan module OKLED AlarmLED HotSwapLED HotSwap PushButton
Retentionlever
1
DN70259064
Rearview
2
Before you start Ensure that you have the new spare part fan module available. Note that when the hot swap button is pressed, it is normal that all the fans (including those on the module that is subject to hot swap) start turning at full speed.
2.19.1 Removing a fan module Procedure 1
Press the hot swap button and wait for the hot swap LED to turn solid blue. After the hot swap button has been pressed, the fans start turning at full speed. Also the fans on the module that is subject to hot swap turn at full speed.
110
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
2
Push the sides of the security lock inwards (see figure Replacing a fan module, detail 1).
3
Pull out the security lock (see figure Replacing a fan module, detail 2).
4
Pull up the retention lever and pull the fan module out just a little, wait for it to stop, and then pull it out completely.
2.19.2 Installing a fan module Procedure 1
Insert the fan module completely into the shelf. The blue hot swap LED turns off and the green OK LED is lit.
Post requisites If the Major Telco Alarm LED is lit when you have replaced the fan module, you can clear the alarm by entering the clia command alarm clear through the serial port on the shelf alarm display.
2.20 Replacing a shelf in cabinet (EC208-A) Purpose If the shelf is damaged or faulty, it needs to be replaced with a new one. The replacement procedure requires shutting down the shelf and all of its units.
g
Note: • •
•
In the cabinet EC208-A, the procedure for replacing the shelf ACH16-A is the same with that for the shelf ASH16-A. You need 4 and 5 mm Allen keys for removing and installing the shelf. When installing a new shelf, you need a T10 torx screwdriver to remove the transportation support plate. If you are installing the shelf to an operating network element, connect your ESD wrist strap to the ESD grounding point in the cabinet.
Before you start The replacement procedure requires shutting down the shelf and all of its units. The following needs to be considered:
DN0966621 Issue: 11-0
© 2017 Nokia
111
Replacing hardware units
Maintaining and Troubleshooting Hardware
If there are critical 2N functional units in the shelf that do not have a redundant unit in another shelf, shutting down the shelf (for example, the first shelf) will require the entire network element to be shut down. For the other shelves, the replacement proedure will cause partial service outage, but it does not need to shut down the entire network element.
•
g
Note: The following procedure shows how you can replace the third shelf of an Open MSS as an example. The same procedure is valid only for the last shelf in use, for example, the second shelf of the two-shelf-configuration, the third shelf of the threeshelf-configuration, the fourth shelf of the four-shelf-configuration, or the fifth shelf of the five-shelf-configuration. Depending on the problem situation, the shelf managers or shelf data modules could be moved from the old shelf to be replaced to the new one.
•
g
Note: The following procedure shows how you can move the shelf managers and shelf data modules from the old shelf to the new one. Reconfigure the LAN settings so that other shelves are not connected to each other via the shelf that is being replaced. Depending on the LAN structure, this may also require cable rerouting. Make sure that there is an availble fallback copy of the current software build. Block all command calendar tasks. List all command calendar tasks: ZICL; Block the command calendar tasks: ZICB:
•
• •
2.20.1 Removing a shelf from the cabinet (EC208-A) Before you start
f
CAUTION! Risk of physical injury The shelf is heavy. Lifting the shelf requires at least two persons. Procedure 1
Read the FRU information, record the shelf and EMB addresses, and back up the FRU data. Sub-steps a) Connect to the active shelf manager from your workstation through the serial connection. Set the connection parameters on your workstation as follows: • • • • •
112
Baud rate: 38400 Data bits: 8 Stop bits: 1 Flow control: none No parity
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
The default user account is root and password is shmm4nsn. For more details, refer to document ATCA 16-slot DC Shelf User Guide. b) Check the shelf address and record it.
clia shelfaddress Example output: # clia shelfaddress Pigeon Point Shelf Manager Command Line Interpreter Shelf Address Info: "030001 A0103FFFFFF.." #
Further information The address of the first shelf is “010001 A0101FFFFFF..” (1A001-00). The address of the second shelf is “020001 A0102FFFFFF..” (1A002-00). The address of the third shelf is “030001 A0103FFFFFF..” (1A003-00).
c) Check the EMB addresses and record them.
clia fruinfo -x 20 254 | grep "OEM" -A 5 -m 2 Example output: # clia fruinfo -x 20 254 | grep "OEM" -A 5 -m 2 Record Type = 0xc0 OEM Defined Record Version = 2 Manufacturer ID = 0x006F2A C0 02 07 5F D8 2A 6F 00 06 00 01 01 Record Type Version = 2 Manufacturer ID C0 02 22 1B 01 2A FF FF FF 00 14 00 FF FF FF FF FF FF #
= 0xc0 OEM Defined Record = 0x006F2A 6F 00 07 00 1C 00 15 00 74 00 75 FF FF
93 00 94 FF FF FF FF FF
Take the above output as an example, the EMB addresses for the functional units in different slots of one shelf are as follows (excluding the addresses of SWUs or child units):
DN0966621 Issue: 11-0
© 2017 Nokia
113
Replacing hardware units
Maintaining and Troubleshooting Hardware
#1
#2
#3
C 00 22 21 B0 12 A6 F0 00 70 01 C0 09 30 09 4F F #4
#5
#6
#7
#10
#11
#12
#13
F FF FF F0 01 40 01 50 07 40 07 5F FF FF FF FF F #14
#15
#16
F FF FF FF FF FF FF F
d) Check that the FRU data in EEPROM1 and EEPROM2 are identical with that in the memory.
clia fruinfo -x 20 1 clia fruinfo -x 20 2 clia fruinfo -x 20 254
e) Back up the FRU data.
clia frudatar 10 0 /var/nvdata/fru_10_0.bin clia frudatar 12 0 /var/nvdata/fru_12_0.bin clia frudatar 20 254 /var/nvdata/fru_20_254.bin
g 2
Note: You can also back up the FRU data to OMU's hard disk.
Check that the LAN switch configuration has been saved to the hard disk and check which flash bank is active. Sub-steps a) Connect to the LAN switches through a telnet connection.
ZW6T:SWU,
b) Check which flash bank (primary or secondary) is active and which flash bank will be in use after the next reboot. For example: AHUB3# show all processor cpu revision bogomips chipset Vendor
114
: : : : : :
0 e500 2.0 (pvr 8020 0020) 823.29 8541E RadiSys Corporation
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
Machine clock PVR SVR PLL setting Memory Flash Bank build ipmc fpga ipmc cpld
: : : : : : : : : : :
ATCA-2210 [0x402] (MPC8541E) 825MHz 0x80200020 0x807a0011 0x5 1024 MB 0 RELEASE3.0.60_WR20 00.16.00 02.51.00 5
Flash bank to use on next reboot Boot Flash Bank : primary AHUB3#
From the output, you can notice that: •
The primary flash bank is in use: Flash Bank
•
: 0
The primary flash bank will be in use after the next reboot: Flash bank to use on next reboot Boot Flash Bank : primary
Further information Flash Bank: 0 means that the primary flash bank is in use. Flash Bank: 1 means that the secondary flash bank is in use. c) Check the configuration.
show running-config
d) Log out the LAN switch and download the configuration file.
exit When closing the telnet connection, enter Y to the following prompt: /*** CONNECTION CLOSED ***/ DO YOU WANT TO DOWNLOAD CONFIGURATION FILE FROM LAN SWITCH ? Y
DN0966621 Issue: 11-0
© 2017 Nokia
115
Replacing hardware units
3
Maintaining and Troubleshooting Hardware
Deactivate the CHU pair. Sub-steps a) Inform the billing center the deactivation of the CHU pair. b) Set the INAC-flag for the CHU pair to deactivate it. For example:
ZUSI:OMU; ZDDE:OMU,0:"ZL:U","ZLP:U,RCB”; ZDDE:OMU,0:"ZUST:CHU,2,0:S-INAC","ZUST:CHU,2,1:S-INAC"; ZUSI:CHU,2;
c) Check that the CHU pair is not recording charging data.
ZMCJ:ALL=N,:TARGET=
ZMCJ:ALL=N,:TARGET=CHU-WO-02; Example output: MSCi
ATCA-LAB
2013-09-12
TOTAL NUMBER OF ALL RECORDS IN CHU-WO-02 NUMBER OF ORIGINAL NUMBER OF MOBILE NUMBER PORTABILITY NUMBER OF ROAMING NUMBER OF FORWARDING TOTAL NUMBER OF RESERVED CALL RECORDS
08:32:13
LEGS LEGS LEGS LEGS
IS IS IS IS IS IS
0204000 0000000 0000000 0000000 0000000 0000000
COMMAND EXECUTED
TOTAL NUMBER OF RESERVED CALL RECORDS IS 0000000 means that the CHU pair is not recording charging data.
d) Confirm that the other CHU units are still recording charging data.
ZMCJ:ALL=N,:TARGET=
e) Copy the charging data from memory to hard disk by switching over the CHU units.
ZUSI:CHU,<pair_index>; ZUSC:CHU,<pair_index>,<WO-EX unit index>:SP; For example:
116
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
ZUSC:CHU,2,0:SP; f)
Check that there is no open charging files.
ZIFO:CHU,<pair_index>:GSMCHA:; You can check the open, full, or transferred files, for example:
ZIFO:CHU,2:GSMCHA:,OPEN; ZIFO:CHU,2:GSMCHA:,FULL; ZIFO:CHU,2:GSMCHA:,TRANS;
g) Make sure that the charging files stored in WDU of the deactivated CHU pair have been moved to the billing center. h) Change the CHU pair from the SP-EX or WO-EX state to the SE-NH state. For example:
ZUSC:CHU,2,1:TE; ZUSC:CHU,2,1:SE; ZUSC:CHU,2,1:SE; ZUSC:CHU,2,0:TE,FCD; ZUSC:CHU,2,0:SE; ZUSC:CHU,2,0:SE;
4
t
Change the states of the GISU units and GPLU units to SE-NH. Tip: Alarm 2445 UNIT TYPE HAS NO REDUNDANCY would be triggered.
5
Deactivate the VLRU pair. If there is no VLRU pair in the shelf to be replaced, skip this step. Sub-steps a) Change the VLRU unit in the SP-EX state to SE-NH. For example:
ZUSC:VLRU,6,1:TE; ZUSC:VLRU,6,1:SE; ZUSC:VLRU,6,1:SE;
DN0966621 Issue: 11-0
© 2017 Nokia
117
Replacing hardware units
Maintaining and Troubleshooting Hardware
b) Change the VLRU unit in the WO-EX state to SE-NH. For example:
ZUSC:VLRU,6,0:TE,FCD; ZUSC:VLRU,6,0:SE; ZUSC:VLRU,6,0:SE;
w
NOTICE: The following steps c to i must be executed one by one immediately. Otherwise, it may cause serious Visitor Location Register (VLR) overload and the entire MSS outage problems.
c) Restart the spare CMM unit with the C=DSK and F=IMM parameters.
ZUSI:CMM; ZUSU:CMM,<SP-EX unit index>:C=DSK,F=IMM;
d) Wait until the spare CMM unit is restarted and check that the state is SP-EX.
ZUSI:CMM;
e) Switch over the CMM units.
ZUSI:CMM; ZUSC:CMM,<WO-EX unit index>:SP;
f)
Restart the spare CMM unit with the C=DSK and F=IMM parameters.
ZUSI:CMM; ZUSU:CMM,<SP-EX unit index>:C=DSK,F=IMM;
g) Wait until the spare CMM unit is restarted and check that the state is SP-EX.
ZUSI:CMM;
h) Switch over the CMM units.
ZUSI:CMM; ZUSC:CMM,<WO-EX unit index>:SP;
i)
Restart all the VLRU pairs in the WO-EX state at the same time immediately.
ZUSI:VLRU;
118
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
ZUSU:VLRU,<pair index>,<WO-EX unit index>:F=IMM; For example:
ZUSU:VLRU,0,0:F=IMM; ZUSU:VLRU,1,0:F=IMM; ZUSU:VLRU,2,0:F=IMM; ZUSU:VLRU,3,0:F=IMM; ZUSU:VLRU,4,0:F=IMM; ZUSU:VLRU,5,0:F=IMM; j)
Check that subscribers are coming to the VLR.
ZMVI; Example output: SUBSCRIBERS IN VLR ACTIVE 215 214 215 214 215 214 213
VLRU-0-1 VLRU-1-1 VLRU-2-0 VLRU-3-0 VLRU-4-0 VLRU-5-1 VLRU-6-0
( ( ( ( ( ( (
ACT_LIMIT 0%) 142857 0%) 142857 0%) 142857 0%) 142857 0%) 142857 0%) 142857 0%) 142857
PASSIVE 0 0 0 0 0 0 0
TOT_LIMIT 143571 143571 143571 143571 143571 143571 143571
DB USAGE% 0% 0% 0% 0% 0% 0% 0%
/*** VLRU 7 STATE INCORRECT ***/ ------------------------------------------------------------------------TOTAL 1500 ( 0%) 999999 0 1004997 0% COMMAND EXECUTION FAILED
6
Change the states of the VMU units to SE-NH. Sub-steps a) Change the state of the VMU units to BL-ID.
ZUSC:VMU,
ZUSI:VMU,
b) Change the state of the VMU units from BL-ID to SE-NH.
ZUSC:VMU,
DN0966621 Issue: 11-0
© 2017 Nokia
119
Replacing hardware units
Maintaining and Troubleshooting Hardware
ZUSC:VMU,
7
Change the states of the IPDU units to SE-NH. If there is no IPDU unit in the shelf to be replaced, skip this step.
8
Change the states of the SHMU units to SE-NH. For example:
ZUSI:SHMU; ZUSC:SHMU,4:TE; ZUSC:SHMU,4:SE; ZUSC:SHMU,4:SE; ZUSC:SHMU,5:TE,FCD; ZUSC:SHMU,5:SE; ZUSC:SHMU,5:SE;
9
Change the state of the LAN switches in the shelf to be replaced to passive. Sub-steps a) Change the state of CNW-0 and EMB-0 to SE-NH.
ZUSC:CNW,0:TE; ZUSC:CNW,0:SE; ZUSC:CNW,0:SE; ZUSC:EMB,0:SP; ZUSC:EMB,0:TE; ZUSC:EMB,0:SE; ZUSC:EMB,0:SE;
b) Deactivate the LAN switches.
ZW6E:SWU,
ZW6E:SWU,4:P; ZW6E:SWU,64:P;
120
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
c) Change the state of CNW-0 and EMB-0 to WO-EX. d) Check the active alarms.
ZAHO; Check if there are active LAN switch related alarms. For example, alarms 2692 and 3292 might be triggered and can be cancelled by the following command:
ZACA:2692:SWU;
e) Repeat the above steps to CNW-1 and EMB-1.
10 Remove all the CPU blades and their RTMs from the shelf.
g
Note: Do not remove the hub blades or shelf managers. a) b) c) d) e) f)
DN0966621 Issue: 11-0
Open the hot swap handles. Wait until the hot swap LEDs turn steady blue. Disconnect all cables from the blades and RTMs. Unscrew the screws from the blades and RTMs. Mark the blades before removing that can be installed to the same slot later (due to different BIOS settings). Remove the blades and RTMs from the shelf, holding them by the handles, and place them on an ESD protected surface.
© 2017 Nokia
121
Replacing hardware units
Maintaining and Troubleshooting Hardware
11 Switch off the circuit breakers on the PDUs that are connected to the shelf that is being replaced. Figure 50
Power distribution unit (ADPDU-A) circuit breakers
ON
-48/-60VDC CircuitBreaker1
-48/-60VDC CircuitBreaker2 OFF
DN70296475
t
Tip: Alarm 3434 might be triggered.
12 Switch off the battery feeds on the PDUs that are connected to the shelf that is being replaced. 13 Remove the hub blades and shelf managers and place them on an ESD protected surface.
122
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
14 Remove the rear cable tray from the shelf. Figure 51
Removing the rear cable tray
Rearview
M4x8 M3x10
DN70673601
DN0966621 Issue: 11-0
© 2017 Nokia
123
Replacing hardware units
Maintaining and Troubleshooting Hardware
15 Remove the three fan modules. Figure 52
Removing a fan module OKLED AlarmLED HotSwapLED HotSwap PushButton
Retentionlever
1
DN70259064
Rearview
2
a) Lift the retention lever. b) Pull out the fan module. For more details, refer to Replacing a fan module.
16 Remove the two power entry modules (PEMs). a) Disconnect all the cables between the power distribution units and power entry modules. b) Unscrew the two fixing screws on the power entry module. c) Holding both handles, pull the PEM out of the slot. For more details, refer to Replacing a power entry module (ADPEM-A).
124
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
17 Disconnect all the remaining cables that are connected to the shelf. a) Disconnect the TELCO alarm cable from the shelf alarm panel. b) Disconnect the serial cable, if used, from the shelf alarm display. c) Disconnect the shelf grounding cable at the rear of the shelf.
18 Unscrew the eight M6 screws attaching the shelf to the mounting rail and the four M6 and two M5 screws attaching the shelf to the rear support rail. Figure 53
DN0966621 Issue: 11-0
Removing the shelf
© 2017 Nokia
125
Replacing hardware units
Maintaining and Troubleshooting Hardware
19 Slide the shelf out of the cabinet. 20 Remove the shelf data modules from the old shelf. Figure 54
Removing a shelf data module (SHCDM-A) Shelfdatamodule2
Shelfdatamodule1
Fixingscrew
Slot
PEM A
DN70258474
a) Remove the fixing screw at the top of the shelf data module. b) Push the shelf data module downwards to release the locking mechanism in the slot. c) Remove the shelf data module and place them on an ESD protected surface. For more details, refer to Replacing a shelf data module (SHCDM-A).
2.20.2 Installing a shelf into the cabinet (EC208-A) Procedure 1
Install the shelf data modules into the new shelf, which were removed from the old shelf. a) b) c) d) e)
Remove the PEMs. Insert the shelf data module into its slot. Push the module downwards to engage the locking mechanism in the slot. Mount the fixing screw on top of the module. Install the PEMs.
For more details, refer to Replacing a shelf data module (SHCDM-A).
126
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
2
Remove the three fan modules from the shelf.
3
Slide the shelf on the support brackets into the cabinet.
4
Attach the shelf to the cabinet mounting rail with eight M6 screws and to the rear support rail with four M6 and two M5 screws. Figure 55
DN0966621 Issue: 11-0
Installing the shelf - front view
© 2017 Nokia
127
Replacing hardware units
Maintaining and Troubleshooting Hardware
Figure 56
Installing the shelf - rear view
2pcsM5 screws
4pcsM6screws
DN0973677
g
Rearview
Note: Check that the cable storage shelf has been installed correctly so that it makes a perfect right angle to the cabinet wall. If the cable storage shelf has been installed in a slightly tilted position, it may prevent the shelf manager from being removed.
5
Install the three fan modules back into the shelf. The fan modules fall properly into place with a click.
6
At the rear of the shelf, connect the shelf grounding cable (CGNDA) between the shelf and the cabinet grounding rail. a) If not already connected, connect the grounding cable to the cabinet grounding rail. Tighten the nuts with a 10 mm socket wrench. b) Connect the grounding cable to the shelf grounding point with two M6 screws. Tighten the nuts with a 10 mm socket wrench.
7
Remove the transportation support plate covering the front of the shelf. Unscrew the screws with a T10 screwdriver.
128
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
8
Connect the cables between the power distribution units and power entry modules.
9
Install the shelf managers and hub blades. Refer to the shelf manager installation instructions from the Installing a shelf manager.
g
Note: Do not install the CPU blades than hub blades or shelf managers. Do not install any internal cables between the hub blades.
10 Switch on the battery feeds on the PDUs. 11 Power up the shelf by switching on the circuit breakers on the PDUs. 12 Check the FRU data, shelf address, and EMB addresses. The FRU data, shelf and EMB addresses were already read before removing the shelf and the result should be the same as before. Sub-steps a) Connect to the active shelf manager through the serial connection. b) Check the shelf address.
clia shelfaddress
c) Check the EMB addresses.
clia fruinfo -x 20 254 | grep "OEM" -A 5 -m 2
d) Check the FRU data.
clia fruinfo -x 20 1 clia fruinfo -x 20 2 clia fruinfo -x 20 254
DN0966621 Issue: 11-0
© 2017 Nokia
129
Replacing hardware units
Maintaining and Troubleshooting Hardware
13 Update the hardware codes and serial numbers of the new shelf, air filter tray and shelf alarm display to the FRU data. Sub-steps a) Read the hardware codes and serial numbers from the label stickers of the new shelf, air filter tray and shelf alarm display. The figure below shows the locations of the labels in ATCA 16-slot shelf ACH16SET-A, and shows examples of the label contents. Figure 57
Placement of labels in ATCA 16-slot shelf ACH16SET-A Cablesetidentification ATCA basiccableset NEcablesetstickers*
Shelfsetidentification
Networkelementidentification
ACH16SET-A (1P) FNGHW (1T)
Xxxxx
(1P) C110808.03
NE-ID:NE123456 (S)
123456789
Xxxxx
(1P) C123132.00 (S)
MadeinFinland
(1P) C123132.00
123456798
(S)
MadeinFinland
123456789
MadeinFinland
*)attachedatthesite. TheNE stickersneededaredelivered togetherwiththecableset.
Shelfposition Cabinet Shelf
1 BOT
2
3
MID
TOP
Shelftype
BOT =bottomposition MID =middleposition TOP =topposition
ATCA SYSTEM16S 21596151 1350901555 AC
Type ATCA SYSTEM Ord.No. 11596050 S/N 1360900177 AF MadeinGermany Input:-48Vdc/-60Vdc max.25A perpowerbranch (total4x4powerbranches)
CUS
Shelftypeandrating NokiaSolutionsandNetworks
ACH16-A
RATING
-48/-60VDC 4x25 A max. N16701
Frontview
Airfilteridentification(notvisiblefromoutside)
ACH16-A (1P) C1122699.0 (S)
123456789
SHALP-A (1P) C110998.A1A
MadeinFinland
(S)
XY110102310
SHCDM-A (1P) C112724.A1A (S)
XY980900998
MadeinFinland
(S)
XY892402489
SHCDM-A (S)
XY980900998
(S)
XY990000988
ASMGR-A
MadeinFinland
(S)
XY892402489
ADPEM-A (S)
XY980300345
MadeinFinland
(1P) C110581.A4A
(1P) C112695.01
MadeinFinland
(1P) C110639.A1A
ASMGR-A (1P) C110581.A4A
(1P) C112724.A1A
MadeinFinland
CHAF2-A
LUFTFILTER 2199027 1211203941
Shelfidentification
SHALD-A (1P) C110997.A1A
MadeinFinland
(S)
XY732802873
MadeinFinland
ADPEM-A (1P) C112695.01
MadeinFinland
(S)
XY980300345
MadeinFinland
DN0935988
b) Update the serial number of the new shelf to the FRU data for both FRU ID 1&2 at address 20h, for example:
patch_fru_info 20 254 c SerialNumber XY092601756 XY092601756 is the serial number in this example.
130
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
c) Update the part number (that is, hardware code) of the new shelf to the FRU data for both FRU ID 1&2 at address 20h, for example:
patch_fru_info 20 254 c PartNumber C110808.A1A C110808.A1A is the part number in this example.
d) Update the hardware code and serial number of the air filter tray to the FRU data for both FRU ID 1&2 at address 20h, for example: patch_fru_info 20 254 c 3 "CHAF2-A
:C110639.A1A:SCHR:XY990000988"
C110639.A1A is the hardware code and XY990000988 is the serial number in this example.
e) Update the hardware code and serial number of the shelf alarm display to the FRU data for both FRU ID 1&2 at address 20h, for example: patch_fru_info 20 254 c 6 "SHALD-A
:C110997.A1A:SCHR:XY732802873"
SHALD-A is the shelf alarm display type, C110997.A1A is the hardware code, and XY732802873 is the serial number in this example.
f)
Check that the hardware codes and serial numbers of the new shelf, air filter tray and shelf alarm display have been updated in the FRU data.
clia fruinfo -v 20 1 | grep -A 25 “Chassis Info Area” clia fruinfo -v 20 2 | grep -A 25 “Chassis Info Area” clia fruinfo -v 20 254 | grep -A 25 “Chassis Info Area” Example output: # clia fruinfo -v 20 1 | grep -A 25 "Chassis Info Area" Chassis Info Area: Version = 1 Chassis Type = (23) Chassis Part Number = C110808.A1A Chassis Serial Number = XY092601756 Custom Chassis Info = SCHROFF CHAF2-A :C110639.A1A:SCHR:XY990000988 SHCDM-B :C112724.A1A:SCHR:XY120502626 SHCDM-B :C112724.A1A:SCHR:XY120502637 SHALD-A :C110997.A1A:SCHR:XY732802873 0x00 0x51 AIR_FILTER_POLARITY=1 TACH_MASK=DB TOP_FAN_SHELF
Board Info Area: Version = 1
DN0966621 Issue: 11-0
© 2017 Nokia
131
Replacing hardware units
Maintaining and Troubleshooting Hardware
Language Code Mfg Date/Time Board Manufacturer Board Product Name Board Serial Number Board Part Number FRU Programmer File ID Custom Board Info
= = = = = = = =
25 Jul 26 09:00:00 2012 (8713980 minutes since 1996) SCHROFF ACH16-A
0x00 0x51
#
From the output, you can notice that: •
The part number (that is, hardware code) of the new shelf is: Chassis Part Number
•
= C110808.A1A
The serial number of the new shelf is: Chassis Serial Number
•
The hardware code and serial number of the new air filter tray are: CHAF2-A
•
= XY092601756
:C110639.A1A:SCHR:XY990000988
The hardware code and serial number of the new shelf alarm display are: SHALD-A
:C110997.A1A:SCHR:XY732802873
14 Check the base interface (BI) and fabric interface (FI) configuration from the LAN swtiches and check that the same flash bank is active as before. Sub-steps a) Connect to the LAN switches from your workstation through the serial connection. Set the connection parameters on your workstation as follows: • • • • •
Baud rate: 38400 Data bits: 8 Stop bits: 1 Flow control: none No parity
The default user account is admin. For more details, refer to document AHUB3-A and HBRT3-A User Guide.
b) Check that the same flash bank is in use as before. For example: AHUB3# show all processor cpu revision bogomips
132
: : : :
0 e500 2.0 (pvr 8020 0020) 823.29
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
chipset Vendor Machine clock PVR SVR PLL setting Memory Flash Bank build ipmc fpga ipmc cpld
Replacing hardware units
: : : : : : : : : : : : :
8541E RadiSys Corporation ATCA-2210 [0x402] (MPC8541E) 825MHz 0x80200020 0x807a0011 0x5 1024 MB 0 RELEASE3.0.60_WR20 00.16.00 02.51.00 5
Flash bank to use on next reboot Boot Flash Bank : primary AHUB3#
c) Check the configuration.
show running-config
d) Log out the LAN switch.
exit
DN0966621 Issue: 11-0
© 2017 Nokia
133
Replacing hardware units
Maintaining and Troubleshooting Hardware
15 Connect the BI and FI cables between the shelves. Sub-steps a) Connect the BI cables between the shelves. b) Check whether the LAN links are up (check the Link LED state of the BI interfaces). Figure 58
LEDs of BI interfaces BASE
Link Port
XFP 1/5
SFP 1/6
Link Port
SFP 1/7
Link Port
SFP 1/8
Link Port
SFP 1/9
Link Port
c) Check whether the EMB remains in the normal state and the related alarms.
ZUSI:EMB; ZAHO;
t
134
Tip: Alarm 3254 LAN DEVICE GENERAL FAILURE might appear.
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
d) Connect the FI cables between the shelves. e) Check whether the LAN links are up (check the Link LED state of the FI interfaces). Figure 59
LEDs of FI interfaces
Link Port
XFP 1/1
Link Port
XFP 1/2
Link Port
XFP 1/3 FABRIC
f)
Check whether the CNW remains in the normal state and the related alarms.
ZUSI:CNW; ZAHO;
t
Tip: Alarm 3254 LAN DEVICE GENERAL FAILURE might appear.
g) Connect the FI loop cable (MSSHW_107).
16 Change the states of the SHMU units to WO-EX and SP-EX. Check the states of the shelf managers according to the LEDs. Change the active unit's state to WO-EX and backup unit's state to SP-EX.
17 Check the connectivity of the shelf managers. Sub-steps a) Connect to the active shelf manager through the serial connection. b) Check the IP addresses of the eth0, eth0:0, eth1 and eth1:0 interfaces.
ifconfig Example output:
DN0966621 Issue: 11-0
© 2017 Nokia
135
Replacing hardware units
Maintaining and Troubleshooting Hardware
# ifconfig eth0 Link encap:Ethernet HWaddr 00:18:49:01:B0:BC inet addr:10.200.201.15 Bcast:10.200.201.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:67456 errors:0 dropped:0 overruns:0 frame:0 TX packets:5374 errors:1 dropped:0 overruns:0 carrier:2 collisions:0 txqueuelen:1000 RX bytes:16532665 (15.7 MiB) TX bytes:3140388 (2.9 MiB) Interrupt:27 eth0:0
Link encap:Ethernet HWaddr 00:18:49:01:B0:BC inet addr:10.200.202.13 Bcast:10.200.202.31 Mask:255.255.255.248 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 Interrupt:27
eth1
Link encap:Ethernet HWaddr 00:18:49:01:B0:BD inet addr:10.200.200.15 Bcast:10.200.200.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:115046 errors:0 dropped:0 overruns:0 frame:0 TX packets:5955 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:20007458 (19.0 MiB) TX bytes:3182510 (3.0 MiB) Interrupt:28
eth1:0
Link encap:Ethernet HWaddr 00:18:49:01:B0:BD inet addr:10.200.202.5 Bcast:10.200.202.23 Mask:255.255.255.248 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 Interrupt:28
lo
Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.255.255.0 UP LOOPBACK RUNNING MTU:16436 Metric:1 RX packets:55 errors:0 dropped:0 overruns:0 frame:0 TX packets:55 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:10074 (9.8 KiB) TX bytes:10074 (9.8 KiB)
usb0
Link encap:Ethernet HWaddr 12:F5:64:6D:2A:D7 inet addr:192.168.2.131 Bcast:192.168.2.255 Mask:255.255.255.128 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:1441655 errors:0 dropped:0 overruns:0 frame:0 TX packets:1441753 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:74790269 (71.3 MiB) TX bytes:1202028490 (1.1 GiB)
From the output, you can notice that the IP addresses of the eth0, eth0:0, eth1 and eth1:0 interfaces: • • •
136
The IP address of eth0: 10.200.201.15 The IP address of eth0:0: 10.200.202.13 The IP address of eth1: 10.200.200.15
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
•
t
Replacing hardware units
The IP address of eth1:0: 10.200.202.5
Tip: If there are no IP addresses, or the information of the eth0 or eth1 interface is missing, give the following commands: Change the link to down and up. For example: ifconfig eth0 down ifconfig eth0 up
If changing the link to down and up does not work, you can try to renew the IP addresses using the following commands: clia dhcp restart clia dhcp status
If there are still no IP addresses, configure IP addresses manually. For example: •
Execute the following commands to configure the IP addresses for SHMU-4: ifconfig eth0 10.200.200.14 netmask 255.255.255.0 ifconfig eth1 10.200.201.14 netmask 255.255.255.0
•
Execute the following commands to configure the IP addresses for SHMU-5: ifconfig eth0 10.200.201.15 netmask 255.255.255.0 ifconfig eth1 10.200.200.15 netmask 255.255.255.0
c) Check whether there are two open sessions between the SHMU and OMU units.
clia session Example output: # clia session Pigeon Point Shelf Manager Command Line Interpreter 32 sessions possible, 2 sessions currently active Session: 1, User: ID 2, Name: "openhpi"; Privilege Level: "Administrator"; Notifier: Off Channel: 1 ("LAN_802_3"); Peer IP address: 10.200.202.17, Port: 52963 Session: 2, User: ID 2, Name: "openhpi"; Privilege Level: "Administrator"; Notifier: Off Channel: 2 ("LAN_802_3"); Peer IP address: 10.200.202.25, Port: 52963
DN0966621 Issue: 11-0
© 2017 Nokia
137
Replacing hardware units
t
Maintaining and Troubleshooting Hardware
Tip: • • • •
•
There can be more than two sessions, usually as a result of switchovers. The unused sessions will be cleared after a while automatically. If there is only one session, check the EMB states. If the EMB is in the SE state, there is no active session in it. If IP addresses exist in SHMU, try to ping to both physical and logical addresses of OMU. If the ping does not work from the shelf manager to OMU, but both ends ping their own addresses, check the configuration of AHUB3-A. Check whether the OMU ports are in order and whether the port (port 2/4) to shelf managers is up. If the ping works, but there are still no sessions, try to renew IP addresses in the shelf manager using the following commands: clia dhcp restart clia dhcp status
•
If the ping works and the IP addresses are in order in the shelf manager, but there are still no sessions, try to restart the OMU unit in the WO-EX state. During the next startup, the system should initialize the connection to the shelf managers.
d) Check that there is no packet loss with ping.
clia getlanconfig 1 clia getlanconfig 2 Example output: # clia getlanconfig 1 Pigeon Point Shelf Manager Command Line Interpreter PING 10.200.202.17 (10.200.202.17): 56 data bytes 64 bytes from 10.200.202.17: seq=0 ttl=64 time=13.061 ms --- 10.200.202.17 ping statistics --1 packets transmitted, 1 packets received, 0% packet loss round-trip min/avg/max = 13.061/13.061/13.061 ms
From the output, you can notice that there is no packet loss: --- 10.200.202.17 ping statistics --1 packets transmitted, 1 packets received, 0% packet loss
e) Clear the shelf manager log.
clia sel clear
138
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
f)
Replacing hardware units
Switch over the SHMU units by changing the state of the SHMU unit in the WO-EX state to SP-EX.
ZUSC:SHMU,
g) Repeat Step a to Step e for the new active shelf manager.
18 Activate the LAN switches. Sub-steps a) Change the state of CNW-0 and EMB-0 to SE-OU.
ZUSC:CNW,0:TE; ZUSC:CNW,0:SE; ZUSC:EMB,0:SP; ZUSC:EMB,0:TE; ZUSC:EMB,0:SE;
b) Change the state of the LAN switches to WO-EX. For example:
ZUSC:SWU,4:SE; ZUSC:SWU,4:TE; ZUSC:SWU,4:WO; ZUSC:SWU,64:SE; ZUSC:SWU,64:TE; ZUSC:SWU,64:WO; ZUSI:SWU;
c) Connect to the LAN switches through serial connection and restart the SNMP daemon. blade-mgmt config service snmpd restart exit show service
Example output: AHUB3(blade-mgmt)# show service Services Status Service Enabled Status
DN0966621 Issue: 11-0
© 2017 Nokia
139
Replacing hardware units
Maintaining and Troubleshooting Hardware
------------------syslog dhcpd hpiSubagent ntpd snmpd radius-client pam-snmp snmpWatchdog cli-logging watchdog telnet tftp sshd ftpd AHUB3(blade-mgmt)#
----------enabled disabled disabled disabled enabled disabled enabled disabled enabled enabled enabled enabled disabled disabled
From the output, you can notice that the SNMP daemon is enabled: snmpd
enabled
d) Activate the LAN switches. For example:
ZW6E:SWU,4:A; ZW6E:SWU,64:A;
e) Check whether the LAN switches have IP addresses. For example:
ZYFF::SWU,4; ZYFF::SWU,64; Example output: UNIT PIU TYPE IP ADDRESS MAC ADDRESS LAN UNIT ------------------------------------------------------------------SWU - 4 AHUB3_A 10.20.0.4 CNW - 0 INTERNAL LAN CONFIGURATION STATUS: ------------------------------IP ADDRESS CONFIGURED : OK
From the output, you can notice that the LAN switch has an IP address: IP ADDRESS CONFIGURED
:
OK
If the IP address is not configured, renew it using the following commands and re-check it with the ZYFF command. linux-shell ifrenew dtl0 ifrenew dtl1
140
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
ifrenew dtl0 is used for renewing IP address for the BI LAN and ifrenew dtl1 is used for renewing IP address for the FI LAN. f)
Change the state of the LAN switches to SE-OU. For example:
ZUSC:SWU,4:TE; ZUSC:SWU,4:SE; ZUSC:SWU,64:TE; ZUSC:SWU,64:SE;
g) Change the state of CNW-0 and EMB-0 to TE-EX.
ZUSC:CNW,0:TE; ZUSC:EMB,0:TE;
h) Check whether the IP addresses of the LAN switches are configured, the trap host is configured, the configuration file is loaded, and the supervision status is reachable. For example:
ZYFF::SWU,4; ZYFF::SWU,64;
g
Note: After the LAN switch is activated (step d), it may take up to 20 minutes before the switch is reachable from the LAN management point of view. Example output:
ZYFF::SWU,4; EXECUTION STARTED, MAY TAKE SEVERAL MINUTES READING LAN SWITCH SUPERVISION DATA ... UNIT PIU TYPE IP ADDRESS MAC ADDRESS LAN UNIT ------------------------------------------------------------------SWU - 4 AHUB3_A 10.20.0.4 00:00:50:9B:E3:D9 CNW - 0 INTERNAL LAN CONFIGURATION STATUS: ------------------------------IP ADDRESS CONFIGURED : OK CONFIGURATION FILE LOADED : OK SNMP VERSION CONFIGURED : v1,v2c TRAP HOST CONFIGURED : OK L2/L3 ADMIN STATE : L2 L2/L3 OPERATION STATE : L2
DN0966621 Issue: 11-0
© 2017 Nokia
141
Replacing hardware units
Maintaining and Troubleshooting Hardware
SUPERVISION STATUS: ------------------------------SUPERVISION ENABLED : ON SUPERVISION CYCLE REF(SEC): 30 SUPERVISION STATUS : REACHABLE LAST SUPERVISION DONE : 2012-11-28
08:41:42.67
PORT OPERATIVE ADMIN INDEX STATE STATE -----------------------------0/1 : DOWN UP 0/2 : DOWN UP 0/3 : DOWN UP 0/4 : DOWN UP 0/5 : DOWN UP 0/6 : DOWN UP 0/7 : DOWN UP 0/10 : DOWN UP 0/11 : DOWN UP 0/12 : DOWN UP 0/13 : DOWN UP 0/14 : DOWN UP 0/15 : DOWN UP 0/16 : DOWN UP 1/1 : UP UP 1/2 : DOWN UP 1/3 : UP UP 2/3 : DOWN UP 3/4 : DOWN DOWN COMMAND EXECUTED
142
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
t
Replacing hardware units
Tip: If the supervision status is unreachable and SNMP is not configured: Check the SNMP configuration: linux-shell cat /etc/snmp/snmpd.conf | grep NSN
The following lines should be visible at the end of the configuration file: root@AHUB3@1-1-8:/# cat /etc/snmp/snmpd.conf | grep NSN com2sec SecNameNSN default public com2sec -Cn fi SecNameFiNSN default public-fi group GroupNSN v2c SecNameNSN group GroupFiNSN v2c SecNameFiNSN access GroupNSN "" any noauth exact all none access GroupFiNSN fi any noauth exact all none root@AHUB3@1-1-8:/#
all all
If there are no such lines, upload the configuration file to the LAN switches: For example:
ZYFM:UCF:SWU,64; Restart the SNMP daemon: blade-mgmt config service snmpd restart
Check again with the ZYFF command that the supervision status is reachable.
i)
Run diagnostics on EMB-0.
ZUDU:EMB,0; ZUDH:EMB,0; For more information, refer to UD - Diagnostics Handling.
j)
If the diagnostics is in order, change the state of EMB-0 to SP-EX.
ZUSC:EMB,0:SP;
k) Run diagnostics on CNW-0.
ZUDU:CNW,0; ZUDH:CNW,0;
l)
If the diagnostics is in order, change the state of CNW-0 to WO-EX.
ZUSC:CNW,0:WO;
DN0966621 Issue: 11-0
© 2017 Nokia
143
Replacing hardware units
Maintaining and Troubleshooting Hardware
m) Repeat the above steps to CNW-1 and EMB-1.
19 Install the rest of the blades and rear transition modules into the shelf according to your network element configuration. 20 Connect the internal cables according to your network element configuration. Refer to documents Installing ATCA Hardware and Open MSS Hardware Installation Quick Guide.
21 Connect the external cables according to your network element configuration. Refer to documents Installing ATCA Hardware and Open MSS Hardware Installation Quick Guide.
22 Activate the VLRU pair. If there was no VLRU pair in the replaced shelf, skip this step. Sub-steps a) Change the state of the VMU units which have virtualized VLRU pairs to WO-EX.
ZUSC:VMU,
w
NOTICE: The following steps b to h must be executed one by one immediately. Otherwise, it may cause serious VLR overload and the entire MSS outage problems.
b) Restart the spare CMM unit with the C=DSK and F=IMM parameters.
ZUSI:CMM; ZUSU:CMM,<SP-EX unit index>:C=DSK,F=IMM;
c) Wait until the spare CMM unit is restarted and check that the state is SP-EX.
ZUSI:CMM;
144
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
d) Switch over the CMM units.
ZUSI:CMM; ZUSC:CMM,<WO-EX unit index>:SP;
e) Restart the spare CMM unit with the C=DSK and F=IMM parameters.
ZUSI:CMM; ZUSU:CMM,<SP-EX unit index>:C=DSK,F=IMM;
f)
Wait until the spare CMM unit is restarted and check that the state is SP-EX.
ZUSI:CMM;
g) Switch over the CMM units.
ZUSI:CMM; ZUSC:CMM,<WO-EX unit index>:SP;
h) Restart all the VLRU pairs in the WO-EX state at the same time immediately.
ZUSI:VLRU; ZUSU:VLRU,<pair index>,<WO-EX unit index>:F=IMM; For example:
ZUSU:VLRU,0,0:F=IMM; ZUSU:VLRU,1,0:F=IMM; ZUSU:VLRU,2,0:F=IMM; ZUSU:VLRU,3,0:F=IMM; ZUSU:VLRU,4,0:F=IMM; ZUSU:VLRU,5,0:F=IMM;
i)
Check that subscribers are coming to the VLR.
ZMVI;
DN0966621 Issue: 11-0
© 2017 Nokia
145
Replacing hardware units
Maintaining and Troubleshooting Hardware
23 Take the GISU units and GPLU units into use. Sub-steps a) Change the state of the VMU units which have virtualized GISU units to WO-EX.
ZUSC:VMU,
b) If there were GPLU units, change the state to SP-EX.
ZUSC:GPLU,
24 Take the IPDU units into use. If there was no IPDU unit in the replaced shelf, skip this step.
25 Activate the CHU pair. Sub-steps a) Inform the billing center the activation of the CHU pair. b) Check that the CHU pair is still in the SE-NH state and the information on them is INAC.
ZUSI:CHU,<pair_index>; Example output: ZUSI:CHU,2; EXECUTION STARTED MSCi
ATCA-LAB
WORKING STATE OF UNIT PHYS CHU-2-0 0014 CHU-2-1 0015
146
UNITS STATE LOCATION SE-NH SE-NH
© 2017 Nokia
2014-08-28
08:24:21
INFO INAC INAC
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
c) Change the state of the CHU pair to WO-EX and SP-EX. For example:
ZUSC:CHU,2,0:SE; ZUSC:CHU,2,0:WO; ZUSC:CHU,2,1:SE; ZUSC:CHU,2,1:TE; ZUSC:CHU,2,1:SP;
d) Check that the hard disks are in the WO-BU state. For example:
ZISI:,CHU,2:WDU;
e) Make sure that the INAC flag is still set.
ZUSI:CHU,<pair_index>;
f)
Check the connection between the CHU pair and the billing center.
g) Clear the INAC flag in the CHU unit that is in the WO-EX state.
ZUSI:CHU,<pair_index>; ZUST:CHU,<pair_index>,<WO-EX unit index>:C-INAC; For example:
ZUST:CHU,2,0:C-INAC;
h) Check that the CHU pair is working properly. For example:
ZIFO:CHU,2:GSMCHA:; ZMCJ:ALL=N,:TARGET=CHU-WO-02;
26 Complete the shelf replacement. Sub-steps a) Unblock the command calendar tasks which were blocked before the replacement.
ZICL;
DN0966621 Issue: 11-0
© 2017 Nokia
147
Replacing hardware units
Maintaining and Troubleshooting Hardware
ZICB:
ZYFE:IFL;
c) Check the active alarms.
ZAHO; Check if there are active LAN switch related alarms (for example, alarm 3254) which were triggered due to the shelf replacement and have not been cancelled automatically. Cancel the alarms by the ZACA:
d) Check that the network element works properly and as the same as before. Check that every unit is working in the normal state, the same signalling links are up as before, and so forth.
e) Check the clear codes.
ZTUT:CLR;
2.21 Replacing a shelf (ASA16-A) in cabinet (CAB216-A) Purpose If the shelf is damaged or faulty, it needs to be replaced with a new one. The replacement procedure requires shutting down the shelf and all of its units. Before you start The replacement procedure requires shutting down the shelf and all of its units. The following needs to be considered: •
•
If there are critical 2N functional units in the shelf that do not have a redundant unit in another shelf, shutting down the shelf will require the entire network element to be shut down. Reconfigure the LAN settings so that other shelves are not connected to each other via the shelf that is being replaced. Depending on the LAN structure, this may also require cable rerouting.
Prepare the following tools: • • •
148
a digital multimeter or voltage meter 8 and 10 mm spanner or a socket wrench with 8 and 10 mm sockets M4 straight lug wrench
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
3 mm T-type Allen key screwdriver 90-degree screwdriver size 1 and 2 Phillips screwdrivers Torx T10, Torx T30 and Torx T40 screwdrivers T20 T-type screwdriver ESD wrist strap protective gloves safety ladder
• • • • • • • •
f
Replacing hardware units
CAUTION! Risk of physical injury The shelf is heavy. Lifting the shelf requires at least two persons.
f
CAUTION! Risk of physical injury Unfastened equipment in the cabinet can fall off if the cabinet is moved. Never leave the shelf equipped in the cabinet for extended periods with the fixing screws unfastened.
w
NOTICE: Electrostatic discharge (ESD) may damage hardware components. To avoid ESD damage: • •
t
Before handling hardware units, check that the site is an ESD-protected area (EPA). If the area is not ESD-protected, create a temporary EPA. When handling hardware units, wear an ESD wrist strap or use a corresponding protection method, and do not touch the connector surfaces.
Tip: The shelf is easier to lift if you remove the fan modules and power supply units from the shelf. Re-install the fan modules and power supply units afterwards.
2.21.1 Removing a shelf (ASA16-A) from the cabinet (CAB216-A) Procedure 1
Read the FRU information and record the shelf address and the NE ID address from the shelf FRU information.
2
Change the states of all functional units so that no unit is in active state. Note that if there are critical 2N functional units in the shelf that do not have a redundant unit in another shelf, shutting down the shelf will require the entire network element to be shut down.
3
Remove all blades and rear transition modules (RTMs) from the shelf. a) b) c) d)
DN0966621 Issue: 11-0
Open the hot swap handles. Wait until the hot swap LEDs turn steady blue. Disconnect all cables from the blades and RTMs. Unscrew the screws from the blades and RTMs.
© 2017 Nokia
149
Replacing hardware units
Maintaining and Troubleshooting Hardware
e) Remove the blades and RTMs from the shelf, holding them by the handles, and place them on an ESD protected surface.
4
Switch off the site power supply.
5
Switch off the power supply unit (PSU) circuit breakers from the rear side of the shelf.
6
Disconnect all the remaining cables that are connected to the shelf. a) Unscrew the hexagonal M4 screw on each side of the rear cable tray, lift the rear cable tray upwards and turn it out of the way. b) Disconnect the AC power feed cables from the site power supply. c) Disconnect the shelf grounding cable at the rear of the shelf. d) Disconnect the TELCO alarm cable from the shelf alarm panel. e) Disconnect the serial cable, if used, from the shelf alarm display.
7
Remove the three fan modules from the shelf. a) Lift the retention lever. b) Pull out the fan module.
8
Remove the four PSUs from the shelf. a) Push the button to unlock the PSU cover. b) Open the PSU cover and use it as the extraction lever to pull out the PSU.
150
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Figure 60
DN0966621 Issue: 11-0
Replacing hardware units
Removig the PSU (AAPSU-A)
© 2017 Nokia
151
Replacing hardware units
9
Maintaining and Troubleshooting Hardware
Remove the front door to make the holes on the front cabinet profile available for the installation support frame (ISTR-A). Figure 61
152
Positioning holes for the ISTR-A installation support frame
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
10 Install the shelf installation support frame. a) Pull out the springs. Figure 62
ISTR-A installation support frame with the pin and spring
Frontview
DN0985392
b) Align the installation support frame with the cabinet positioning holes and push horizontally until the frame mates with the cabinet front profiles, that is, both the ISTR-A pins are inserted into the cabinet positioning holes and the ISTR-A front are inserted into the cabinet mid-post holes.
g
Note: When inserting the installation support frame, pay attention to its orientation. Do not turn it upside down. Figure 63
Installing ISTR-A installation support frame
c) Insert the spring into the hole of each pin to secure the installation support frame.
DN0966621 Issue: 11-0
© 2017 Nokia
153
Replacing hardware units
Maintaining and Troubleshooting Hardware
11 Unscrew the eight M6 screws attaching the shelf to the mounting rail and the four M6 and two M5 screws on the rear brackets that attach the shelf to the rear support rail.
154
Figure 64
Removing a shelf (ASA16-A) from the cabinet (CAB216-A)
Figure 65
Removing a shelf (ASA16-A) from the cabinet (CAB216-A) - rear view
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
12 Slide the shelf from the support bracket to the installation support frame till the shelf is out of the cabinet. 13 If the new shelf is not to be installed immediately, perform the following steps: a) Pull out the springs from the installation support frame holes and remove the frame. b) Install the front door. See the ATCA installation document for details.
2.21.2 Installing a shelf (ASA16-A) into the cabinet (CAB216-A) Procedure 1
Install the rear cable tray. a) Slide the cable tray on its support on the shelf. Figure 66
Installing the rear cable tray
b) Secure the tray by using one hexagonal M4 screw , and one Phillips M3 screw with a washer and bearing sleeve on each side of the cable tray.
DN0966621 Issue: 11-0
© 2017 Nokia
155
Replacing hardware units
2
Maintaining and Troubleshooting Hardware
Remove the cable tray claws using a T20 T-type screwdriver, if the cable count in your configuration is so big that the claws block the cable routes. Figure 67
Removing the cable tray claws
3
Remove the three fan modules from the shelf.
4
Remove the four PSUs from the shelf.
5
If you are installing the shelf to an operating network element, connect your ESD wrist strap to the ESD grounding point in the cabinet.
6
If the shelf installation support frame is not installed, perform the following steps: a) If the front door is not removed, remove it. b) Install the shelf installation support frame. See the Removing a shelf (ASA16-A) from the cabinet (CAB216-A) section for details.
7
t
156
Place the shelf on the mounted installation support frame, and slide the shelf on the support brackets into the cabinet. Tip: You can tilt the rear side of the shelf a bit up so it can be slided from the installation support frame to the side support brackets more smoothly.
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
8
DN0966621 Issue: 11-0
Replacing hardware units
Attach the shelf to the cabinet mounting rail with eight M6 screws and to the rear support rail with four M6 and two M5 screws on the rear brackets. Figure 68
Installing a shelf (ASA16-A) into the cabinet (CAB216-A) - front view
Figure 69
Installing a shelf (ASA16-A) into the cabinet (CAB216-A) - rear view
© 2017 Nokia
157
Replacing hardware units
g
Maintaining and Troubleshooting Hardware
Note: Check that the cable storage shelf has been installed correctly so that it makes a perfect right angle to the cabinet wall. If the cable storage shelf has been installed in a slightly tilted position, it may prevent the shelf manager from being removed.
9
Re-install the three fan modules back into the shelf. The fan modules fall properly into place with a click.
10 Re-install the four PSUs back into the shelf. 11 At the rear of the shelf, connect the shelf grounding cable (CGNDF) between the shelf and the cabinet grounding rail. a) If not already connected, connect the grounding cable to the cabinet grounding rail. Tighten the nuts with a 10 mm socket wrench. b) Connect the grounding cable to the shelf grounding point with two M6 screws. Tighten the nuts with a 10 mm socket wrench.
12 Remove the transportation support plate covering the front of the shelf. Unscrew the screws with a T10 screwdriver.
158
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
13 Pull out the springs from the installation support frame holes and remove the frame. 14 Install the front door. See the ATCA installation document for details. 15 Make sure the site power supply and the PSU circuit breakers are switched off. 16 Connect the AC power feed cables to the site power supply. 17 Switch on the site power supply. 18 Power up the shelf by switching on the PSU circuit breakers from the rear side of the shelf. 19 Connect to the active shelf manager via the serial port in the alarm display panel. 20 Enter the following commands to check whether the network element IDs of the new shelf are the same as the network element IDs of the shelf that was removed earlier. # clia networkelementid # clia networkelementid -i 2 # clia networkelementid -i 3
The network element IDs of the new shelf have been configured at the factory and they cannot be changed. If the network element IDs of the new shelf are not the same as network element IDs of the shelf that was removed earlier, contact your local company representative.
21 Configure the shelf address. Check the shelf address by entering the following command: # clia shelfaddress
The shelf address was already read in section Removing a shelf (ASA16-A) from the cabinet (CAB216-A).
22 Power down the shelf by switching off the PSU circuit breakers. The shelf is powered down so that all blades and RTMs can be installed back into the shelf according to the needed configuration, and then powered up at once.
DN0966621 Issue: 11-0
© 2017 Nokia
159
Replacing hardware units
Maintaining and Troubleshooting Hardware
23 Install blades and RTMs into the shelf according to your network element configuration. 24 Connect internal cables according to your network element configuration. You can check the cable routing and fixing instructions from the Installing ATCA Hardware document and network element specific equipping and cabling documentation.
25 Connect external cables according to your network element configuration. You can check the cable routing and fixing instructions from the Installing ATCA Hardware document and network element specific equipping and cabling documentation.
26 Power up the shelf by switching on the PSU circuit breakers. 27 Reconfigure the network element and take all the units into use. 28 Verify that the embedded software in the hardware units and the BIOS information in the CPU units are consistent with the product release, and update if necessary. See a document that describes embedded software management for details.
2.22 Replacing a shelf (ASH16-A) in cabinet (CAB216-A) Purpose If the shelf is damaged or faulty, it needs to be replaced with a new one. The replacement procedure requires shutting down the shelf and all of its units. Before you start The replacement procedure requires shutting down the shelf and all of its units. The following needs to be considered: •
•
If there are critical 2N functional units in the shelf that do not have a redundant unit in another shelf, shutting down the shelf will require the entire network element to be shut down. Reconfigure the LAN settings so that other shelves are not connected to each other via the shelf that is being replaced. Depending on the LAN structure, this may also require cable rerouting.
Prepare the following tools: • •
160
a digital multimeter or voltage meter 8 and 10 mm spanner or a socket wrench with 8 and 10 mm sockets
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
M4 straight lug wrench 3 mm T-type Allen key screwdriver 90-degree screwdriver size 1 and 2 Phillips screwdrivers Torx T10, Torx T30 and Torx T40 screwdrivers T20 T-type screwdriver ESD wrist strap protective gloves safety ladder
• • • • • • • • •
f
Replacing hardware units
CAUTION! Risk of physical injury The shelf is heavy. Lifting the shelf requires at least two persons.
f
CAUTION! Risk of physical injury Unfastened equipment in the cabinet can fall off if the cabinet is moved. Never leave the shelf equipped in the cabinet for extended periods with the fixing screws unfastened.
w
NOTICE: Electrostatic discharge (ESD) may damage hardware components. To avoid ESD damage: • •
Before handling hardware units, check that the site is an ESD-protected area (EPA). If the area is not ESD-protected, create a temporary EPA. When handling hardware units, wear an ESD wrist strap or use a corresponding protection method, and do not touch the connector surfaces.
2.22.1 Removing a shelf (ASH16-A) from the cabinet (CAB216-A) Procedure 1
Read the FRU information and record the shelf address and the NE ID address from the shelf FRU information.
2
Change the states of all functional units so that no unit is in active state. Note that if there are critical 2N functional units in the shelf that do not have a redundant unit in another shelf, shutting down the shelf will require the entire network element to be shut down.
3
Remove all blades and rear transition modules (RTMs) from the shelf. a) b) c) d) e)
DN0966621 Issue: 11-0
Open the hot swap handles. Wait until the hot swap LEDs turn steady blue. Disconnect all cables from the blades and RTMs. Unscrew the screws from the blades and RTMs. Remove the blades and RTMs from the shelf, holding them by the handles, and place them on an ESD protected surface.
© 2017 Nokia
161
Replacing hardware units
4
Maintaining and Troubleshooting Hardware
Switch off the PDU circuit breakers that control the PDU outputs connected to the shelf to be replaced. Figure 70
ADPD2-A circuit breakers
Circuitbreakerx6 ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
1
2
3
4
5
6
LEDx6 Mountingholex4 Frontview
DN0990951
The following table shows the relation between the PDU circuit breakers, PDU output terminals and shelves in the cabinet. Table 16
Relation between PDU circuit breakers, PDU outputs and shelves
PDU circuit breaker
PDU output
1
OUT1+/-
2
OUT2+/-
3
OUT3+/-
4
OUT4+/-
5
OUT5+/-
6
OUT6+/-
Shelf Top shelf
Middle shelf
Bottom shelf
The corresponding red LEDs of the PDU are lit.
5
Disconnect all the remaining cables that are connected to the shelf. a) Unscrew the hexagonal M4 screw on each side of the rear cable tray, lift the rear cable tray upwards and turn it out of the way. b) Disconnect all the cables between the PDUs and power entry modules (PEMs) from the PEM input terminals. c) Disconnect the shelf grounding cable at the rear of the shelf. d) Disconnect the TELCO alarm cable from the shelf alarm panel. e) Disconnect the serial cable, if used, from the shelf alarm display.
162
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
6
Replacing hardware units
Remove the three fan modules. a) Lift the retention lever. b) Pull out the fan module.
DN0966621 Issue: 11-0
© 2017 Nokia
163
Replacing hardware units
7
Maintaining and Troubleshooting Hardware
Remove the front door to make the holes on the front cabinet profile available for the installation support frame (ISTR-A). Figure 71
164
Positioning holes for the ISTR-A installation support frame
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
8
Replacing hardware units
Install the shelf installation support frame. a) Pull out the springs. Figure 72
ISTR-A installation support frame with the pin and spring
Frontview
DN0985392
b) Align the installation support frame with the cabinet positioning holes and push horizontally until the frame mates with the cabinet front profiles, that is, both the ISTR-A pins are inserted into the cabinet positioning holes and the ISTR-A front are inserted into the cabinet mid-post holes.
g
Note: When inserting the installation support frame, pay attention to its orientation. Do not turn it upside down. Figure 73
Installing ISTR-A installation support frame
c) Insert the spring into the hole of each pin to secure the installation support frame.
DN0966621 Issue: 11-0
© 2017 Nokia
165
Replacing hardware units
9
Maintaining and Troubleshooting Hardware
Unscrew the eight M6 screws attaching the shelf to the mounting rail and the four M6 and two M5 screws on the rear brackets that attach the shelf to the rear support rail. Figure 74
Removing a shelf (ASH16-A) from the cabinet (CAB216-A)
Figure 75
Removing a shelf (ASH16-A) from the cabinet (CAB216-A) - rear view
10 Slide the shelf from the support bracket to the installation support frame till the shelf is out of the cabinet. 11 If the new shelf is not to be installed immediately, perform the following steps: a) Pull out the springs from the installation support frame holes and remove the frame.
166
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
b) Install the front door. See the ATCA installation document for details.
2.22.2 Installing a shelf (ASH16-A) into the cabinet (CAB216-A) Procedure 1
Install the rear cable tray. a) Slide the cable tray on its support on the shelf. Figure 76
Installing the rear cable tray
b) Secure the tray by using one hexagonal M4 screw , and one Phillips M3 screw with a washer and bearing sleeve on each side of the cable tray.
t
DN0966621 Issue: 11-0
Tip: Do not fix the hexagonal M4 screws tightly at this point, as you need remove them later when you connect the cables between the PDUs and PEMs.
© 2017 Nokia
167
Replacing hardware units
2
Maintaining and Troubleshooting Hardware
Remove the cable tray claws using a T20 T-type screwdriver, if the cable count in your configuration is so big that the claws block the cable routes. Figure 77
Removing the cable tray claws
3
Remove the three fan modules from the shelf.
4
If you are installing the shelf to an operating network element, connect your ESD wrist strap to the ESD grounding point in the cabinet.
5
Make sure that the PDU circuit breakers that control the PDU outputs connected to the shelf to be installed are off. The following table shows the relation between the PDU circuit breakers, PDU output terminals and shelves in the cabinet. Table 17
Relation between PDU circuit breakers, PDU outputs and shelves
PDU circuit breaker
168
PDU output
1
OUT1+/-
2
OUT2+/-
3
OUT3+/-
4
OUT4+/-
5
OUT5+/-
6
OUT6+/-
© 2017 Nokia
Shelf Top shelf
Middle shelf
Bottom shelf
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
6
Replacing hardware units
If the shelf installation support frame is not installed, perform the following steps: a) If the front door is not removed, remove it. b) Install the shelf installation support frame. See the Removing a shelf (ASH16-A) from the cabinet (CAB216-A) section for details.
7
t
Place the shelf on the mounted installation support frame, and slide the shelf on the support brackets into the cabinet. Tip: You can tilt the rear side of the shelf a bit up so it can be slided from the installation support frame to the side support brackets more smoothly.
8
Attach the shelf to the cabinet mounting rail with eight M6 screws and to the rear support rail with four M6 and two M5 screws on the rear brackets. Figure 78
DN0966621 Issue: 11-0
Installing a shelf (ASH16-A) into the cabinet (CAB216-A) - front view
© 2017 Nokia
169
Replacing hardware units
Maintaining and Troubleshooting Hardware
Figure 79
g
Installing a shelf (ASH16-A) into the cabinet (CAB216-A) - rear view
Note: Check that the cable storage shelf has been installed correctly so that it makes a perfect right angle to the cabinet wall. If the cable storage shelf has been installed in a slightly tilted position, it may prevent the shelf manager from being removed.
9
Install the three fan modules back into the shelf. The fan modules fall properly into place with a click.
10 Install the shelf managers. You can check the shelf manager installation instructions from the section Installing a shelf manager.
11 At the rear of the shelf, connect the shelf grounding cable (CGNDF) between the shelf and the cabinet grounding rail. a) If not already connected, connect the grounding cable to the cabinet grounding rail. Tighten the nuts with a 10 mm socket wrench. b) Connect the grounding cable to the shelf grounding point with two M6 screws. Tighten the nuts with a 10 mm socket wrench.
12 Remove the transportation support plate covering the front of the shelf. Unscrew the screws with a T10 screwdriver.
170
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
13 Pull out the springs from the installation support frame holes and remove the frame. 14 Install the front door. See the ATCA installation document for details. 15 Unscrew the hexagonal M4 screw on each side of the rear cable tray, lift the rear cable tray upwards and turn it out of the way. 16 Connect the cables between the PDUs and PEMs. 17 Re-install the hexagonal M4 screws to the rear cable tray and secure them tightly.
t
Tip: Due to the narrow working-space, a 90-degree screwdriver could be useful for fixing the hexagonal M4 screws.
18 Power up the shelf by switching on the circuit breakers on the PDUs. The following table shows the relation between the PDU circuit breakers, PDU output terminals and shelves in the cabinet. Table 18
Relation between PDU circuit breakers, PDU outputs and shelves
PDU circuit breaker
DN0966621 Issue: 11-0
PDU output
1
OUT1+/-
2
OUT2+/-
3
OUT3+/-
4
OUT4+/-
5
OUT5+/-
6
OUT6+/-
© 2017 Nokia
Shelf Top shelf
Middle shelf
Bottom shelf
171
Replacing hardware units
Maintaining and Troubleshooting Hardware
19 Connect to the active shelf manager via the serial port in the alarm display panel. 20 Enter the following commands to check whether the network element IDs of the new shelf are the same as the network element IDs of the shelf that was removed earlier. # clia networkelementid # clia networkelementid -i 2 # clia networkelementid -i 3
The network element IDs of the new shelf have been configured at the factory and they cannot be changed. If the network element IDs of the new shelf are not the same as network element IDs of the shelf that was removed earlier, contact your local company representative.
21 Configure the shelf address. Check the shelf address by entering the following command: # clia shelfaddress
The shelf address was already read in section Removing a shelf from the cabinet.
22 Power down the shelf by switching off the circuit breakers on the PDUs. The shelf is powered down so that all blades and RTMs can be installed back into the shelf according to the needed configuration, and then powered up at once.
23 Install blades and RTMs into the shelf according to your network element configuration. 24 Connect internal cables according to your network element configuration. You can check the cable routing and fixing instructions from the Installing ATCA Hardware document and network element specific equipping and cabling documentation.
25 Connect external cables according to your network element configuration. You can check the cable routing and fixing instructions from the Installing ATCA Hardware document and network element specific equipping and cabling documentation.
172
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
26 Power up the shelf by switching on the circuit breakers on the PDUs. 27 Reconfigure the network element and take all the units into use. 28 Verify that the embedded software in the hardware units and the BIOS information in the CPU units are consistent with the product release, and update if necessary. See a document that describes embedded software management for details.
2.23 Replacing a shelf manager Purpose This example shows how to replace an active shelf manager. Figure 80
Replacing the shelf manager
Frontview
DN70244967
Procedure 1
Check the status of the SHMU.
ZUSI:SHMU; Example output: MSCi WORKING STATE OF UNIT PHYS SHMU-0 SHMU-1
2010-06-16 UNITS STATE WO-EX SP-EX
LOCATION
13:51:27
INFO -
TOTAL OF 2 UNITS COMMAND EXECUTED
DN0966621 Issue: 11-0
© 2017 Nokia
173
Replacing hardware units
2
Maintaining and Troubleshooting Hardware
Make a switch-over to the spare SHMU.
ZUSC:SHMU,1:WO;
3
Remove the shelf manager. See Removing a shelf manager.
4
Install the new shelf manager. See Installing a shelf manager.
5
Change the working state of the SHMU.
ZUSC:SHMU,0:TE; ZUSC:SHMU,0:SP; ZUSC:SHMU,0:WO;
6
Check the working state.
ZUSI:SHMU,0; Example output: MSCi WORKING STATE OF UNIT PHYS SHMU-0 SHMU-1
UNITS STATE WO-EX SP-EX
2010-06-16
13:51:27
LOCATION
INFO -
TOTAL OF 2 UNITS COMMAND EXECUTED
Further information The following problem may occur when the shelf manager unit is changed: After the spare (SP-EX) shelf manager has been removed, the active (WO-EX) shelf manager reboots. This may happen either because the user has issued the reboot with the CLIA reboot command or for some other reason. As a result, however, the system manager loses the RMCP connection with the active shelf manager. When the reboot is finished, the shelf manager remains in the M2 state (activation request, the blue led keeps blinking). The system manager cannot serve the activation request because it does not receive the trap which contains the request. In about ten seconds, the system manager issues a system reboot because it cannot establish the RMCP connection. What to do to resolve the problem:
174
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
Activate the shelf manager manually from the command line interface (CLIA) after the reboot (when the red led has switched off) while the blue led is blinking so that the system manager can re-create the RMCP connection. The activation command is:
#clia activate 10 0 (if the rebooted shelf manager is the left one) Or
#clia activate 12 0 (if the rebooted shelf manager is the right one) After this operation, the shelf manager functions normally again.
2.23.1 Removing a shelf manager Procedure 1
Unscrew the thumb screw on the shelf manager front panel.
2
Open the hot swap handle slightly until the blue hot swap LED starts blinking. A trigger mechanism in the handle activates the hot swap.
3
g
DN0966621 Issue: 11-0
When the hot swap LED turns solid blue, open the handle completely and pull the shelf manager out of its slot. Note: If the cable storage shelf has been installed so that it does not sit vertically in a totally direct angle, it may stop the shelf manager from coming out. In this case, try to loosen the screws that hold the cable storage shelf in place and adjust the shelf so that it sits correctly.
© 2017 Nokia
175
Replacing hardware units
Maintaining and Troubleshooting Hardware
2.23.2 Installing a shelf manager Procedure 1
Insert the shelf manager into the guides and push it completely into the shelf.
2
Close the hot swap handle.
3
Tighten the fixing screw.
4
Verify that the embedded software in the hardware units is consistent with the product release, and update it if needed. See a document that describes embedded software management for details.
Result The shelf manager boots up. In approximately a minute, the green status LED is lit, indicating that the shelf manager is fully operational. The status LED of the active shelf manager is solid green, the status LED of the backup shelf manager is blinking.
2.24 Replacing a shelf alarm display Purpose Figure 81
176
Replacing the shelf alarm display
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
2.24.1 Removing the shelf alarm display Procedure 1
Uninstall the serial cable, if connected.
2
Unscrew both fixing screws on the alarm display.
3
Holding both fixing screws, pull the alarm display out of its slot.
2.24.2 Installing the shelf alarm display Procedure 1
Insert the guides of the shelf alarm display into the slots on the horizontal board.
2
Push the shelf alarm display into the slot.
3
Tighten both fixing screws.
4
Log into the active shelf manager.
5
Back up the shelf FRU data. Enter the following command from the active shelf manager: clia frudatar 20 254 /var/nvdata/shelf_fru_backup.bin
6
Update the shelf FRU data. Enter the following two commands: patch_fru_info 20 1 c 6 "<SAD name>:
<SAD name> is the product name of the shelf alarm display, for example, SHALD-A.
DN0966621 Issue: 11-0
© 2017 Nokia
177
Replacing hardware units
Maintaining and Troubleshooting Hardware
Enter the following two commands to update the shelf FRU data after replacing the shelf alarm display (label stickers shown in the picture below) patch_fru_info 20 1 c 6 "SHALD-A :C110997.A1A:SCHR:XY732802873" patch_fru_info 20 2 c 6 "SHALD-A :C110997.A1A:SCHR:XY732802873"
Figure 82 SHALD-A
Shelf alarm display label stickers C110997.A1A
SHALD-A S/N:XY 732802873
DN0948636
2.25 Replacing a shelf alarm panel Purpose Figure 83
Replacing the shelf alarm panel (SHALP-A)
Shelf Alarm Panel(SAP) Telco Alarm Connector (DB15-male)
FixingScrew DN70245109
The replacement procedure is applicable for both SHALP-A and SHALP-B.
2.25.1 Removing the shelf alarm panel Procedure
178
1
Uninstall the TELCO alarm cable, if connected.
2
Unscrew the fixing screw.
3
Pull the alarm panel out of its slot.
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
2.25.2 Installing the shelf alarm panel Procedure 1
Insert the shelf alarm panel to its slot. Take care not to damage the module as there are no guides in the slot.
2
Tighten the fixing screw at the bottom of the alarm panel.
3
Install the TELCO alarm cable, if used.
2.26 Replacing a shelf data module (SHCDM-A) Purpose The shelf data module (SHCDM-A) is located behind the power entry module. If you need to replace it, you need to remove the power entry module first. Figure 84
Replacing a shelf data module (SHCDM-A) Shelfdatamodule2
Shelfdatamodule1
Fixingscrew
Slot
PEM A
DN70258474
Before you start The replacement procedure requires shutting down the shelf and all of its units. If there are critical 2N functional units in the shelf that do not have a redundant unit in another shelf, shutting down the shelf will require the entire network element to be shut down. Prepare the following tools: • • •
DN0966621 Issue: 11-0
screwdrivers ESD wrist strap safety ladder
© 2017 Nokia
179
Replacing hardware units
w
Maintaining and Troubleshooting Hardware
NOTICE: The shelf data module is very sensitive to rough treatment. Handle the shelf data module with care during all installation phases.
2.26.1 Removing a shelf data module (SHCDM-A) Procedure 1
Connect to the active shelf manager from the workstation through the serial connection. Set the connection parameters on the workstation as follows: • • • • •
Baud rate: 38400 Data bits: 8 Stop bits: 1 Flow control: none No parity
The default user account is root and password is shmm4nsn. For more details, refer to the document ATCA 16-slot DC Shelf User Guide.
2
Verify that the current FRU data is correct in the shelf manager memory. Enter the following command: clia fruinfo 20 254 | grep -c "Error"
The command output indicates the number of errors. Step example # clia fruinfo 20 254 | grep -c "Error" 0 #
g
Note: The number of errors should be 0 to have a error-free backup in the next step.
3
Back up the FRU data. Enter the following command: clia frudatar 20 254 /var/nvdata/old_shelf_fru.bin
4
Power off the shelf. Switch off the circuit breakers on the power distribution units (PDUs) that are connected to the shelf.
180
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
5
Replacing hardware units
Remove the two power entry modules (PEMs). Sub-steps a) Lift the rear cable tray upwards and turn it out of the way. b) Unscrew the two fixing screws on the PEM. c) Holding both handles, pull the PEM out of the slot.
6
Remove the shelf data module(s) from the shelf. If the shelf data module 1 is faulty, remove both shelf data modules and make sure they do not get mixed. The existing shelf data module 2 will be installed in the right slot from the rear view. If the shelf data module 2 is faulty, remove it only. Sub-steps a) Remove the fixing screw at the top of the shelf data module with a magnetic screwdriver. b) Push the shelf data module downwards to release the locking mechanism in the slot. c) Remove the shelf data module and place them on an ESD protected surface. Figure 85
Replacing a shelf data module (SHCDM-A) Shelfdatamodule2
Shelfdatamodule1
Fixingscrew
Slot
PEM A
DN70258474
DN0966621 Issue: 11-0
© 2017 Nokia
181
Replacing hardware units
Maintaining and Troubleshooting Hardware
2.26.2 Installing a shelf data module (SHCDM-A) Procedure 1
Insert the shelf data module(s). If the shelf data module 1 is faulty, insert the new module into the module 2 slot (the left slot from the rear view) and the original shelf data module 2 into the module 1 slot (the right slot from the rear view). If the shelf data module 2 is faulty, insert the new data module into the module 2 slot (the left slot from the rear view). Sub-steps a) Insert the new shelf data module into its slot. b) Push the module downwards to engage the locking mechanism in the slot. c) Mount the fixing screw on top of the module with a magnetic screwdriver.
2
Install the PEMs. Sub-steps a) Slide the PEM into the slot along the guide rails. b) Tighten the two fixing screws on the PEM. c) Rotate the rear cable tray downwards.
3
Power on the shelf. Switch on the circuit breakers on the PDUs.
4
Connect to the active shelf manager.
5
Verify that the current FRU data is correct. Enter the following command and the output should be 0. clia fruinfo 20 254 | grep -c "Error"
If error exists, restore the original FRU data with the following command: clia frudataw 20 254 /var/nvdata/old_shelf_fru.bin
182
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
6
Replacing hardware units
Update the serial number of the shelf data module to the shelf FRU data. Enter the following two command: patch_fru_info 20 254 c
Shelf data module (SHCDM-A) label stickers
Step example For the shelf data module 1: # patch_fru_info 20 254 c 4 "SHCDM-A
g
:C111000.A1A:SCHR:XY980900998"
Note: If the shelf data module 1 is faulty and the original shelf data module 2 is installed to the module 1 slot (the right slot from rear view), <serial> is the serial number of the original shelf data module 2. For the shelf data module 2: # patch_fru_info 20 254 c 5 "SHCDM-A
7
:C111000.A1A:SCHR:XY980900999"
Check that the serial number of the installed shelf data module is updated in the FRU data. Enter the following commands: clia fruinfo -v 20 254 | grep -A 13 "Chassis Info" clia fruinfo -v 20 1 | grep -A 13 "Chassis Info" clia fruinfo -v 20 2 | grep -A 13 "Chassis Info"
Step example # clia fruinfo -v 20 1 | grep -A 13 "Chassis Info" Chassis Info Area: Version = 1 Chassis Type = (23) Chassis Part Number = C112691.01 Chassis Serial Number = XY120503692 Custom Chassis Info = SCHROFF CHAF2-A :C110639.A1A:SCHR:XY120500115 SHCDM-A :C111000.A1A:SCHR:XY980900998 // module 1 information SHCDM-A :C111000.A1A:SCHR:XY980900999 // module 2 information
DN0966621 Issue: 11-0
© 2017 Nokia
183
Replacing hardware units
Maintaining and Troubleshooting Hardware
SHALD-B :C112649.A1A:SCHR:XY120601047 0x00 0x51 AIR_FILTER_POLARITY=1 TACH_MASK=DB TOP_FAN_SHELF
8
Verify that the current FRU data is correct. Enter the following command and the output should be 0. clia fruinfo 20 254 | grep -c "Error"
9
Check the hot swap states of the installed FRUs. Enter the following command and verify that all the installed FRUs are listed and the hot swap state is M4 (Active). clia fru
Step example 10: FRU # 0 Entity: (0xf0, 0x60) Hot Swap State: M4 (Active), Previous: M3 (Activation In Process), Last State Change Cause: Normal State Change (0x0) Device ID String: "ShMM-500"
10 Restore the Network Element ID Enter the following command: clia networkelementid <previous network element ID>
Step example # clia networkelementid Pigeon Point Shelf Manager Command Line Interpreter Error: Network Element ID 1 is differ in Shelf FRU 1 (ÿÿÿÿÿÿÿÿÿÿÿ) and Shelf FRU 2 (NE225705). # # clia networkelementid NE225705
184
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
2.27 Replacing a shelf data module (SHCDM-B) in shelf set (ASH16SET-A) Purpose The shelf data module, SHCDM-B, in the shelf set (ASH16SET-A) is located behind the power entry module (PEM), ADPE2-A. If you need to replace it, you need to remove the PEM first. Before you start The replacement procedure requires shutting down the shelf and all of its units. If there are critical 2N functional units in the shelf that do not have a redundant unit in another shelf, shutting down the shelf will require the entire network element to be shut down. Prepare the following tools: screwdrivers ESD wrist strap safety ladder
• • •
g
Note: The shelf data module is very sensitive to rough treatment. Handle the shelf data module with care during all installation phases.
g
Table 19
Compatibility of SHCDM-B and ASH16-A SHCDM-B
ASH16-A C112648.A1A C112648.A1B
C112724.A1A C112648.B1A Compatible revision
C112724.A1B C112648.B1B C112648.B1C C112724.B1B or later
C112648.C1C or later
2.27.1 Removing a shelf data module (SHCDM-B) in shelf set (ASH16SET-A) Procedure 1
Connect to the active shelf manager from the workstation through the serial connection. Set the connection parameters on the workstation as follows: •
DN0966621 Issue: 11-0
Baud rate: 38400
© 2017 Nokia
185
Replacing hardware units
Maintaining and Troubleshooting Hardware
• • • •
Data bits: 8 Stop bits: 1 Flow control: none No parity
The default user account is root and password is shmm4nsn. For more details, refer to the document ATCA 16-slot DC Shelf User Guide. 2
Verify that the current FRU data is correct in the shelf manager memory. Enter the following command: clia fruinfo 20 254 | grep -c "Error"
The command output indicates the number of errors. Step example # clia fruinfo 20 254 | grep -c "Error" 0 #
g
Note: The number of errors should be 0 to have a error-free backup in the next step.
3
Back up the FRU data. Enter the following command: clia frudatar 20 254 /var/nvdata/old_shelf_fru.bin
4
Power off the shelf. Switch off the power distribution unit (PDU) circuit breakers that control the PDU outputs to the power entry modules (PEMs) in the shelf. Figure 87
ADPD2-A circuit breakers
Circuitbreakerx6 ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
ON 1 0 OFF
1
2
3
4
5
6
LEDx6 Mountingholex4 DN0990951
Frontview
The following table shows the relation between the PDU circuit breakers and shelves in the cabinet.
186
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Table 20
Replacing hardware units
Relation between PDU circuit breakers and shelves PDU circuit breaker
5
Shelf
1 and 2
Top shelf
3 and 4
Middle shelf
5 and 6
Bottom shelf
Remove the two PEMs. Sub-steps a) Unscrew the hexagonal M4 screw on each side of the rear cable tray, lift the rear cable tray upwards and turn it out of the way. b) Unscrew the two fixing screws on the PEM. Figure 88
Unscrewing the fixing screws on the PEM
c) Holding both handles, pull the PEM out of the slot.
6
Remove the shelf data module(s) from the shelf. If the shelf data module 1 is faulty, remove both shelf data modules and make sure they do not get mixed. The existing shelf data module 2 will be installed in the right slot from the rear view. If the shelf data module 2 is faulty, remove it only.
DN0966621 Issue: 11-0
Option
Description
SHCDM-B version is C112724.A1A or C112724.A1B (old version)
Follow the substpes:
© 2017 Nokia
187
Replacing hardware units
Maintaining and Troubleshooting Hardware
Option
Description a) Unscrew the fixing screw and remove the bracket enclosing the shelf data module with a magnetic screwdriver. b) Push the shelf data module downwards to release the locking mechanism in the slot. c) Remove the shelf data module and place them on an ESD protected surface.
SHCDM-B version is C112724.B1B or later (new version)
Figure 89
Follow the substpes: a) Press the clippers to open status. b) Remove the shelf data module outwards and place them on an ESD potected surface. c) Press the clippers to lock status.
Replacing a shelf data module (SHCDM-B) in shelf set (ASH16SET-A) for old version Shelfdatamodule2
Fixingscrew
Shelfdatamodule1
Bracket
PEM A
DN09106032
188
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Figure 90
Replacing hardware units
Replacing a shelf data module (SHCDM-B) in shelf set (ASH16SET-A) for new version Shelfdatamodule2
Shelfdatamodule1
ID ID
Clippers
PEM A DN09234703
2.27.2 Installing a shelf data module (SHCDM-B) in shelf set (ASH16SET-A) Procedure 1
Insert the shelf data module(s). If the shelf data module 1 is faulty, insert the new module into the module 2 slot (the left slot from the rear view) and the original shelf data module 2 into the module 1 slot (the right slot from the rear view). If the shelf data module 2 is faulty, insert the new data module into the module 2 slot (the left slot from the rear view). Option
Description
SHCDM-B version is C112724.A1A or Follow the substeps: C112724.A1B (old version) a) Insert the new shelf data module into its slot. b) Push the module downwards to engage the locking mechanism in the slot.
DN0966621 Issue: 11-0
© 2017 Nokia
189
Replacing hardware units
Maintaining and Troubleshooting Hardware
Option
Description c) Mount the bracket and tighten the fixing screw with a magnetic screwdriver.
SHCDM-B version is C112724.B1B or Follow the substeps: later (new version) a) Press the clippers to open status. b) Insert the new shelf data module into its slot. c) Press the clippers to lock status.
2
Install the PEMs. Sub-steps a) Slide the PEM into the slot along the guide rails. b) Tighten the two fixing screws on the PEM. c) Re-install the hexagonal M4 screws to the rear cable tray and secure them tightly.
t 3
Tip: Due to the narrow working-space, a 90-degree screwdriver could be useful for fixing the hexagonal M4 screws.
Power on the shelf. Switch on the corresponding circuit breakers on the PDUs.
4
Connect to the active shelf manager.
5
Verify that the current FRU data is correct. Enter the following command and the output should be 0. clia fruinfo 20 254 | grep -c "Error"
If error exists, restore the original FRU data with the following command: clia frudataw 20 254 /var/nvdata/old_shelf_fru.bin
190
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
6
Replacing hardware units
Update the serial number of the shelf data module to the shelf FRU data. Enter the following commands: patch_fru_info 20 254 c
Shelf data module (SHCDM-B) label stickers SHCDM-BS/N:XY 850800309
SHCDM-BC112724.A1A DN0990309
Step example For the shelf data module 1: # patch_fru_info 20 254 c 4 "SHCDM-B
g
:C112724.A1A:SCHR:XY850800308"
Note: If the shelf data module 1 is faulty and the original shelf data module 2 is installed to the module 1 slot (the right slot from rear view), <serial> is the serial number of the original shelf data module 2. For the shelf data module 2: # patch_fru_info 20 254 c 5 "SHCDM-B
7
:C112724.A1A:SCHR:XY850800309"
Check that the serial number of the installed shelf data module is updated in the FRU data. Enter the following commands: clia fruinfo -v 20 254 | grep -A 13 "Chassis Info" clia fruinfo -v 20 1 | grep -A 13 "Chassis Info" clia fruinfo -v 20 2 | grep -A 13 "Chassis Info"
Step example # clia fruinfo -v 20 1 | grep -A 13 "Chassis Info" Chassis Info Area: Version = 1 Chassis Type = (23) Chassis Part Number = C112691.01 Chassis Serial Number = XY120503692 Custom Chassis Info = SCHROFF CHAF2-A :C110639.A1A:SCHR:XY120500115 SHCDM-B :C112724.A1A:SCHR:XY850800308 // module 1 information SHCDM-B :C112724.A1A:SCHR:XY850800309 // module 2 information SHALD-B :C112649.A1A:SCHR:XY120601047
DN0966621 Issue: 11-0
© 2017 Nokia
191
Replacing hardware units
Maintaining and Troubleshooting Hardware
0x00 0x51 AIR_FILTER_POLARITY=1 TACH_MASK=DB TOP_FAN_SHELF
8
Verify that the current FRU data is correct. Enter the following command and the output should be 0. clia fruinfo 20 254 | grep -c "Error"
9
Check the hot swap states of the installed FRUs. Enter the following command and verify that all the installed FRUs are listed and the hot swap state is M4 (Active). clia fru
Step example 10: FRU # 0 Entity: (0xf0, 0x60) Hot Swap State: M4 (Active), Previous: M3 (Activation In Process), Last State Change Cause: Normal State Change (0x0) Device ID String: "ShMM-500"
10 Restore the Network Element ID Enter the following command: clia networkelementid <previous network element ID>
Step example # clia networkelementid Pigeon Point Shelf Manager Command Line Interpreter Error: Network Element ID 1 is differ in Shelf FRU 1 (ÿÿÿÿÿÿÿÿÿÿÿ) and Shelf FRU 2 (NE225705). # # clia networkelementid NE225705
192
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
2.28 Replacing a shelf data module (SHCDM-B) in shelf set (ASH16SET-B) Purpose The shelf data module, SHCDM-B, in the shelf set (ASH16SET-B) is located behind the power entry module (PEM), ADPEM-A. If you need to replace it, you need to remove the PEM first. Before you start The replacement procedure requires shutting down the shelf and all of its units. If there are critical 2N functional units in the shelf that do not have a redundant unit in another shelf, shutting down the shelf will require the entire network element to be shut down. Prepare the following tools: screwdrivers ESD wrist strap safety ladder
• • •
g
Note: The shelf data module is very sensitive to rough treatment. Handle the shelf data module with care during all installation phases.
g
Table 21
Compatibility of SHCDM-B and ASH16-A SHCDM-B
ASH16-A C112648.A1A C112648.A1B
C112724.A1A C112648.B1A Compatible revision
C112724.A1B C112648.B1B C112648.B1C C112724.B1B or later
C112648.C1C or later
2.28.1 Removing a shelf data module (SHCDM-B) in shelf set (ASH16SET-B) Procedure 1
Connect to the active shelf manager from the workstation through the serial connection. Set the connection parameters on the workstation as follows: •
DN0966621 Issue: 11-0
Baud rate: 38400
© 2017 Nokia
193
Replacing hardware units
Maintaining and Troubleshooting Hardware
• • • •
Data bits: 8 Stop bits: 1 Flow control: none No parity
The default user account is root and password is shmm4nsn. For more details, refer to the document ATCA 16-slot DC Shelf User Guide. 2
Verify that the current FRU data is correct in the shelf manager memory. Enter the following command: clia fruinfo 20 254 | grep -c "Error"
The command output indicates the number of errors. Step example # clia fruinfo 20 254 | grep -c "Error" 0 #
g
Note: The number of errors should be 0 to have a error-free backup in the next step.
3
Back up the FRU data. Enter the following command: clia frudatar 20 254 /var/nvdata/old_shelf_fru.bin
4
Power off the shelf. Switch off the circuit breakers on the power distribution units (PDUs) that are connected to the shelf.
194
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
5
Replacing hardware units
Remove the two power entry modules (PEMs). Sub-steps a) Lift the rear cable tray upwards and turn it out of the way. b) Unscrew the two fixing screws on the PEM. c) Holding both handles, pull the PEM out of the slot.
6
Remove the shelf data module(s) from the shelf. If the shelf data module 1 is faulty, remove both shelf data modules and make sure they do not get mixed. The existing shelf data module 2 will be installed in the right slot from the rear view. If the shelf data module 2 is faulty, remove it only.
DN0966621 Issue: 11-0
Option
Description
SHCDM-B version is C112724.A1A or C112724.A1B (old version)
Follow the substpes:
SHCDM-B version is C112724.B1B or later (new version)
Follow the substpes:
© 2017 Nokia
a) Unscrew the fixing screw and remove the bracket enclosing the shelf data module with a magnetic screwdriver. b) Push the shelf data module downwards to release the locking mechanism in the slot. c) Remove the shelf data module and place them on an ESD protected surface.
a) Press the clippers to open status. b) Remove the shelf data module outwards and place them on an ESD potected surface. c) Press the clippers to lock status.
195
Replacing hardware units
Maintaining and Troubleshooting Hardware
Figure 92
Replacing a shelf data module (SHCDM-B) in shelf set (ASH16SET-B) for old version
Shelfdatamodule2
Fixingscrew
Shelfdatamodule1
Bracket
PEM A
DN0990293
Figure 93
Replacing a shelf data module (SHCDM-B) in shelf set (ASH16SET-B) for new version
Shelfdatamodule2
Shelfdatamodule1
ID ID
Clippers
DN09234715
196
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
2.28.2 Installing a shelf data module (SHCDM-B) in shelf set (ASH16SET-B) Procedure 1
Insert the shelf data module(s). If the shelf data module 1 is faulty, insert the new module into the module 2 slot (the left slot from the rear view) and the original shelf data module 2 into the module 1 slot (the right slot from the rear view). If the shelf data module 2 is faulty, insert the new data module into the module 2 slot (the left slot from the rear view). Option
Description
SHCDM-B version is C112724.A1A or Follow the substeps: C112724.A1B (old version) a) Insert the new shelf data module into its slot. b) Push the module downwards to engage the locking mechanism in the slot. c) Mount the bracket and tighten the fixing screw with a magnetic screwdriver. SHCDM-B version is C112724.B1B or Follow the substeps: later (new version) a) Press the clippers to open status. b) Insert the new shelf data module into its slot. c) Press the clippers to lock status.
2
Install the PEMs. Sub-steps a) Slide the PEM into the slot along the guide rails. b) Tighten the two fixing screws on the PEM. c) Rotate the rear cable tray downwards.
3
Power on the shelf. Switch on the circuit breakers on the PDUs.
DN0966621 Issue: 11-0
© 2017 Nokia
197
Replacing hardware units
Maintaining and Troubleshooting Hardware
4
Connect to the active shelf manager.
5
Verify that the current FRU data is correct. Enter the following command and the output should be 0. clia fruinfo 20 254 | grep -c "Error"
If error exists, restore the original FRU data with the following command: clia frudataw 20 254 /var/nvdata/old_shelf_fru.bin
6
Update the serial number of the shelf data module to the shelf FRU data. Enter the following commands: patch_fru_info 20 254 c
Shelf data module (SHCDM-B) label stickers SHCDM-BS/N:XY 850800309
SHCDM-BC112724.A1A DN0990309
Step example For the shelf data module 1: # patch_fru_info 20 254 c 4 "SHCDM-B
g
:C112724.A1A:SCHR:XY850800308"
Note: If the shelf data module 1 is faulty and the original shelf data module 2 is installed to the module 1 slot (the right slot from rear view), <serial> is the serial number of the original shelf data module 2. For the shelf data module 2: # patch_fru_info 20 254 c 5 "SHCDM-B
7
:C112724.A1A:SCHR:XY850800309"
Check that the serial number of the installed shelf data module is updated in the FRU data. Enter the following commands: clia fruinfo -v 20 254 | grep -A 13 "Chassis Info" clia fruinfo -v 20 1 | grep -A 13 "Chassis Info" clia fruinfo -v 20 2 | grep -A 13 "Chassis Info"
198
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
Step example # clia fruinfo -v 20 1 | grep -A 13 "Chassis Info" Chassis Info Area: Version = 1 Chassis Type = (23) Chassis Part Number = C112691.01 Chassis Serial Number = XY120503692 Custom Chassis Info = SCHROFF CHAF2-A :C110639.A1A:SCHR:XY120500115 SHCDM-B :C112724.A1A:SCHR:XY850800308 // module 1 information SHCDM-B :C112724.A1A:SCHR:XY850800309 // module 2 information SHALD-B :C112649.A1A:SCHR:XY120601047 0x00 0x51 AIR_FILTER_POLARITY=1 TACH_MASK=DB TOP_FAN_SHELF
8
Verify that the current FRU data is correct. Enter the following command and the output should be 0. clia fruinfo 20 254 | grep -c "Error"
9
Check the hot swap states of the installed FRUs. Enter the following command and verify that all the installed FRUs are listed and the hot swap state is M4 (Active). clia fru
Step example 10: FRU # 0 Entity: (0xf0, 0x60) Hot Swap State: M4 (Active), Previous: M3 (Activation In Process), Last State Change Cause: Normal State Change (0x0) Device ID String: "ShMM-500"
10 Restore the Network Element ID Enter the following command: clia networkelementid <previous network element ID>
Step example # clia networkelementid Pigeon Point Shelf Manager Command Line Interpreter
DN0966621 Issue: 11-0
© 2017 Nokia
199
Replacing hardware units
Maintaining and Troubleshooting Hardware
Error: Network Element ID 1 is differ in Shelf FRU 1 (ÿÿÿÿÿÿÿÿÿÿÿ) and Shelf FRU 2 (NE225705). # # clia networkelementid NE225705
2.29 Replacing a cable tray with fiber optic cable tray Purpose The cable tray can be replaced with the fiber optic cable tray, which provides guiding elements for the fiber optic cables.
2.29.1 Removing the cable tray Procedure 1
Remove both fixing screws.
2
Disengage the cable tray by pushing it upwards.
Example Figure 95
Removing the cable tray
2
1
DN0959664
200
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
Replacing hardware units
2.29.2 Installing the fiber optic cable tray Procedure 1
Engage the cable tray for fibre optic cables.
2
Insert and tighten the fixing screws.
Example Figure 96
Installing the fiber optic cable tray
1
2
DN0959676
DN0966621 Issue: 11-0
© 2017 Nokia
201
SEL interpretation
Maintaining and Troubleshooting Hardware
3 SEL interpretation 3.1 Overview The purpose of this chapter is to show how to analyze and understand events generated by sensors which are stored in the System Event Log (SEL). Typical situations in which the SEL needs to be consulted are as followed: • • •
Unexpected shutdown or reboot Front plate LEDs showing abnormality Any unusual behavior
In many cases, analyzing the SEL allows to determine the root cause of the events and provide essential guidance in determining either preventive or corrective action.
3.2 Getting SEL information SEL information are stored in both shelf manager and FRUs. Use different commands to get SEL information in shelf manager or a specific FRU.
Get SEL information from shelf manager Procedure 1
Connect to shelf manager from network management client. Enter the following command: ssh root@<shelf manager ipaddress>
2
Choose a command to perform on need. If
Then
Get all generic SEL information of whole shelf
clia sel
Get all detailed SEL information of whole shelf
clia sel -v
Get all generic SEL information of a specific address
clia sel
Example: clia sel 9e
Get all detailed SEL information of a specific address
202
© 2017 Nokia
clia sel -v
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
SEL interpretation
If
Then
Get all generic SEL information of a specific slot
clia sel board
Example: clia sel board 1
Get all detailed SEL information of a specific slot
clia sel -v board
For more information on ipmb address and physical slot number, refer to corresponding shelf user guide.
Get SEL information from an FRU Procedure 1
Connect to the FRU from network management client. Enter the following command: ssh root@
2
Choose a command to perform on need. If
Then
Get all generic SEL information of the ipmitool sel list FRU Get all detailed SEL information of the ipmitool sel list -v FRU
3.3 Analyzing SEL information SEL information should be consulted whenever an unusual situation is reported. Analyze SEL information using ipmitool The ipmitool sel list command shows Sensor Type and Number and reports in a human readable format the Event Data. In some cases, ipmitool is not able to analyze the Event Data and print Event Data 1, 2 and 3. For detailed information about Event Data, refer to the sensor list in corresponding shelf or FRU user guide.
DN0966621 Issue: 11-0
© 2017 Nokia
203
SEL interpretation
Maintaining and Troubleshooting Hardware
The output can be, for example, the following: 23c | 01/20/2014 | 16:20:07 | System Firmware Progress #0x27 | Asserted | Option ROM initialization
Explanation: Sequence: 23c Event Date: 01/20/2014 Event Time: 16:20:07 Sensor Type and Number: System Firmware Progress #0x27 Event/Reading Type Code: Asserted Event Data: Option ROM initialization Analyze SEL information using clia It is recommended to use clia sel command to analyze SEL data since it provides more details on sensors. The output can be, for example, the following: 0x0001: Event: at Jan 22 02:00:14 1970; from:(0xa0,0,0); sensor:(0x02,3); event:0x1(asserted): "Lower Critical", Threshold: 0x78, Reading: 0x2a
Explanation: Sequence: 0x0001 Event Date and Time: Jan 22 02:00:14 1970 Slot IPMB address, Channel number, LUN: 0xa0, 0, 0 Sensor Type Code, Sensor ID: 0x02, 3 Event/Reading Type Code: 0x1 (asserted) Event Data: "Lower Critical", Threshold: 0x78, Reading: 0x2a
SEL Event Example: Standard Sensor Information of the standard sensors can be found from either IPMI specification version 2.0 or PICMG specification version 3.0. 0x004D: Event: at Jan 3 04:56:11 2010; from:(0x92,0,0); sensor:(0x0f,39); event:0x6f(asserted): 0xC0 0x08 0xFF
Procedure 1
Check the slot IPMB address to know from which shelf manager or FRU the event is generated. 0x92 refers to slot 4.
204
© 2017 Nokia
DN0966621 Issue: 11-0
Maintaining and Troubleshooting Hardware
2
SEL interpretation
Check the event/reading type code. 0x6f (asserted) refers to sensor specific and offsets are specified in table Sensor Type Codes. For information about the event/reading type code range and category, see table Event/Reading Type Code Ranges in IPMI specification version 2.0.
3
Check the sensor type code. 0x0f refers to system firmware progress. For information about the sensor type code, see table Sensor Type Codes in IPMI specification version 2.0.
4
Check the event data byte 1. The higher 4 bits is to decide whether event data byte 2 and 3 have meanings, and the lower 4 bits refers to offset. The higher 4 bits of 0xC0 are 1100, and the lower 4 bits are 0000. • • •
[7:6] = 11b, meaning "sensor-specific event extension code in byte 2", so need to check event data byte 2. [5:4] = 00b, meaning "unspecified byte 3", that is, event data byte 3 has no meaning. [3:0] = 00h, meaning "system firmware error"
For information about event data byte 1, 2 and 3, see table Sensor Type Codes in IPMI specification version 2.0. 5
Check the event data byte 2 when it has meanings. 0x08 refers to removable boot media not found.
6
Check the event data byte 3 when it has meanings. No need in this exmaple.
SEL Event Example: OEM Sensor Information of the OEM sensors and extended information of the standard sensors can be found from shelf or FRU user guides. 0x00EA: Event: at Jan 7 02:24:45 2010; from:(0x96,0,0); sensor:(0xda,47); event:0x6f(asserted): 0xA0 0x01 0x00
Procedure 1
Check the slot IPMB address to know from which shelf manager or FRU the event is generated. 0x96 refers to slot 3.
DN0966621 Issue: 11-0
© 2017 Nokia
205
SEL interpretation
Maintaining and Troubleshooting Hardware
2
Check the event/reading type code. 0x6f (asserted) refers to sensor specific and offsets are specified in table Sensor Type Codes.
3
Check the sensor type code. 0xda refers to OEM reserved. Then, find sensor number 47 in corresponding FRU user guide, AC5 Reset Source.
4
Check the event data byte 1. The higher 4 bits of0xA0 are 1010, and the lower 4 bits are 0000. • • •
5
[7:6] = 10b, meaning "OEM code in byte 2", so need to check event data byte 2 in corresponding FRU user guide. [5:4] = 10b, meaning "OEM code in byte 3", so need to check event data byte 3 in corresponding FRU user guide. [3:0] = 00h, no meaning for OEM sonsors.
Check the event data byte 2. 0x01 refers to reserved.
6
Check the event data byte 3. 0x00 refers to IPMC watchdog timeout.
206
© 2017 Nokia
DN0966621 Issue: 11-0
Related Documents
Maintaining And Troubleshooting Hw - Mss15.pdf
April 2020 2
15 Maintaining & Troubleshooting Windows
May 2020 0
Building And Maintaining Relationships.docx
November 2019 22
Troubleshooting
December 2019 34
Hw
April 2020 36
Hw
November 2019 53More Documents from ""
Ned - Flexi Ns - Mme Hardware Description.pdf
April 2020 1
04_02_cn31534en30gla0_flexins3.0 Mme Integration.pdf
April 2020 7
I_o System Administration - Mss15.pdf
April 2020 2
Omgw_hardware Description.pdf
April 2020 22
