Introduction 3g Network Kpis

06.April 2006

Introduction to UMTS Radio KPI 3G network planning introduce www.huawei www.huawei.com .com Huawei Northwest Africa Region RNP Solution Manage: William.chen [email protected] HUAWEI TECHNOLOGIES CO., LTD.

PDF created with pdfFactory Pro trial version www.pdffactory.com

Agenda n

UMTS Radio KPI overview

n

3G Network Optimization

n

Case Study of KPI Optimization

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 2

3G KPIs Principle: S.M.A.R.T Specific

Measurable

Attainable Relevant Time-bound

the KPI has clear and complete definition and formula, include check point and procedure.

KPIs are measurable by given condition, measurement equipment and procedure.

all the KPIs should be reachable, it is refer to the commercial network. the KPI can show the subscriber experience the KPI target should be on the base of time-bound

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 3

3G KPIs : Specific Complete KPI definition include the formula combine with the check point or procedure. The example: RRC Connection Successful Rate n formula RRCS_SRService =

RRCConnectionSuccessservice ×100% RRCConnectionAttempt service

n Check point The number of “RRC Connection Attempt” is A1 or A2? A2 represent the effective number of “RRC Connection Attempt”.

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 4

3G KPIs : Measurable – Drive Test n Field Test -> Drive Test Evaluate the overall network performance, usually on the network pre-launch phase and initial stage of commercial launch. Test platform Multiple test model UEs can perform different tests.

Data analysis Probe & Assistant is used for analyzing test data

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 5

Driver test route is based on cluster, it is involved about 20 sites in one cluster usually.

3G KPIs : Measurable – Stationary test System KPI is suggested to be test by stationary:

n Field Test ->stationary Test Evaluate the system / equipment performance.

n Throughput KPI n Delay KPI n Quality KPI

Core Network

Stationary test condition is fixed, and usually used in indoor test scenario.

NodeB

RNC NodeB

System performance nEquipment ability nTransmission nNetwork construct n….

Radio Network performance nRadio network planning nSpecial environment condition

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 6

Radio Network KPI test is suggested to be test by drive test n Call drop rate n Handover successful rate

3G KPIs : Measurable – Statistic test n Statistic Test Nastar server

Monitoring & analysis center Recommended for security

Essential Optimization team

OM system

Pre-Condition for Statistic Test Subscriber care center

Local networks

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

There must be enough statistic sample, that Terminal: ordinary PC or laptop, no distance mean network traffic should be reach high limitation level.

Any corresponding dept.

Page 7

Huawei KPI test platform comprehensive analysis of the performance, configuration, alarm GENEX Nastar 3G

iManagerTM M2000

obtaining test data op para tim me iza tion ter fil au es to de matic l ive sharing of ry Node B analysis results RNC

v GENEX Probe

GENEX Assistant 3G

v AGILENT

Node B

v QUALCOMM v HUAWEI RNC

HLR/AC

multiple test data Node B

RNS

wireless test data

GENEX Probe WCDMA

R NC te d a ta s t

MSC/SSP/ VLR Node B

RNC

GMSC/SSP CN

GENEX UNet

Node B Node B

network pre-planning/planning

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 8

RNS

PSTN PLMN ISDN

3G KPIs: Relevant Examples of User Experience (QoE) completion of a download file

End-to-end response is fast

The voice and video is Clare

Voice, Video Phone, MMS, WAP, Email, FTP, HTTP… Service Performance

Radio Network KPI AMR12.2, CS64k,PS64k/128k/384k, HSDPA/HSUPA Accessibility

Retainability

Integrity

Mobility

Utilization

Statistic / Measurement data HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 9

Availability

Huawei 3G KPIs Architecture 3G KPIs

Accessability

Retainability

• Call Setup Success Rate (Voice/VP)

• Call Drop Rate (Voice/VP)

• PDP Context Activation Success Rate

• PDP Context Drop Rate

Service Integrity

• PS Throughput

PDF created with pdfFactory Pro trial version www.pdffactory.com

• SHO Success Rate • Hard Handover Success Rate

• SMS/MMS Success Rate

HUAWEI TECHNOLOGIES CO., LTD.

Mobility

• Inter-RAT Handover Success Rate

Page 10

Delay/Latency

Availability

• Call Setup Delay (Voice/VP)

• Worst Cell Rate

• PDP Context Activation Time • RTT

3G KPIs: It is not only a value 3G KPI is not only a value, but a system, for example of CDR (Call Drop Rate) Network Planning

Network Construct

optimization

Root cause drop-call

Coverage

Hand over

59.45%

Transmission

10.02%

Pilot pollution

7.29%

Neighbor cell 2G Transport problem Interference Scramble congestionresource 4.56%

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

0.68%

Page 11

0.68%

3%

2.28%

Others

11.94%

Call drop cause

3G KPIs: Attainable 3G KPI is output of combination with investment include technology, HR, cost, competition strategy etc. Cost

Huawei KPI comply principle: n Huawei will be responsibility for every complied KPI;

Reasonable n Cooperate with Mobilis to work out a Competitive KPIKPI; target n Use the experience from other commercial network; Competition

Attainable

Common target for Mobilis and Huawei

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 12

Technical

3G KPIs: Time-bound nMature Network nOngoing Optimization

100 100 90 90 80 80 70 70 60 60 50 4050 3040 2030 1020 010 0

0 0 3 3 6 6 9 9 12 12 15 15 18 18 21 21 24 24 27 27 30 30 33 33 36 36 39 39 42 42 45 45 48 48

ü Drive Test KPIs ü Stationary test KPIs ü Network Statistics

Number of Sites Number of Sites

ü Network Statistics ü Benchmark test

nCommercial Launch Nastar

Probe & Assistant Probe & Assistant

n Pre-Launch KPI Acceptance

Ea lif c h K ed P ur I h at a s io n

Probe & Assistant

ü Drive Test KPIs ü Stationary test KPIs

nNetwork construct

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 13

ü Site verification

Recommend test methodology Pre-launch Acceptance

On-going Optimization

RRC connection success rate

Drive Test

-

Call setup success rate

Drive Test

Statistic Test

PDP activation success rate

Drive Test

Statistic Test

CS Call drop rate

Drive Test

Statistic Test

PS Call drop rate

Drive Test

Statistic Test

CS Call complete rate

-

Statistic Test

PS Call Complete rate

-

Statistic Test

HSPA Call drop rate

Stationary

Stationary

R99 PS Throughput

Stationary

Stationary

HSPA Throughput

Stationary

Stationary

Soft handover success rate

Drive Test

Statistic Test

Inter-RAT handover success

Drive Test

Statistic Test

Test Methodology

rate

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 14

Contents • UMTS Radio KPI overview • 3G Radio Network Optimization • Case Study of KPI Optimization

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 15

Optimization throughout Life Cycle Subs. Number

• RF adjustment

Drop call

• Para. adjustment

Congestion

• Maintenance and upgrade

Poor quality

• Contingency planning

Access failure ……

• Network expansion

Pr ob an lem dr a es nal y olu s tio is n

Pre-launch optimization

Single site verification

• …….

Customized and differentiated services Billing strategies

Investment RF plan review

Construction phase Troubleshooting

DT & CQT

Commercia l launch

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

KPI analysis

Complaints

Booming phase Optimizing Page 16

Return

Mature phase Balancing

Time

Network Optimization Phases Optimization preparation

RF optimization

Service test and parameter optimization

New site integrated

Routine drive test and stats. analysis

Single site verification

N

80％ sites in the cluster ready?

N

Y

Acceptance criteria satisfied?

Y Acceptance

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 17

RF Optimization Target n To optimize coverage n To minimize pilot pollution n To optimize cell dominance n To optimize neighbor cell list n To resolve RF-related drop calls

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 18

RF Parameters Optimization n Engineering parameters adjustment To adjust antenna down tilt To adjust antenna azimuth To adjust antenna location To adjust antenna height To replace antenna To replace site To add new cell

n Radio part parameters adjustment To optimize neighbor cell list

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 19

Pilot Pollution Minimization Pilot pollution definition: Pilot pollution will result in: (1) low signal quality (2) decreased system capacity (3) Call drops easier

n SHO candidates (A) n Active set size (B) n If A>B, pilot pollution exists -60

RSCP (dBm)

-65

Margin

-70 -75

-62

-64

-80

-66

-68

Ways to optimize: (1) Antenna adjustment (e.g. azimuth or down tilt) (2) Pilot power optimization

-69

-85

-81

-90 SC1

SC2

Active Set

SC3

SC4

SC5

Pilot Pollution

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

SC6 Not Pilot Pollution Page 20

Pilot Pollution: Example

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 21

RF-related Drop Calls Appearance

Problems n Poor coverage

Poor RSCP & Ec/Io

n High interference

Poor Ec/Io or RTWP

n Poor UL coverage

UE max Tx power

n Poor dominance

many SHO events

n Pilot pollution

many cells present

n Missing neighbors

Fast change of RF conditions usually causes drop calls, e.g. turning a corner.

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 22

Para. Optimization Target n To reduce access failures n To reduce drop calls

Para. optimization is an important step after RF optimization

n To enhance service quality

Service quality and network resources utilization will be improved after para. optimization

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 23

Parameters to be Optimized n CCCH power allocation para. n RL maximum power para.

Seldom adjusted

n Cell re-selection para. n Intra-freq. handover para.

An effective way to reduce drop calls

n Inter-RAT handover para. n Power control para. n Access power para.

The influence caused by the cell parameters adjustment should be analyzed carefully.

n Other related para.

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 24

Intra-freq. Re-selection Para. Optimize Treselection, Qhysts and Sintrasearch so as to have minimum ping-pong and minimum camped onto wrong cell

Qhyst2

CPICH_Ec/Io

The black dotted line is the serving cells.

CPICH_Ec/Io

Qhyst2 Qhyst2 Qhyst2 Qhyst2

The black dotted line is the serving cells.

UE doesn’t camp onto the best cells.

Sintrasearch

Qqualmin

UE doesn’t camp onto the best cells.

Qqualmin Treselection

Treselection

Treselection

Treselection Treselection

Treselection, Qhyst2, Sintrasearch = 0

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Treselection

Treselection, Qhyst2, Sintrasearch != 0

Page 25

Time

Contents • UMTS Radio KPI overview • 3G Radio Network Optimization • Case Study of KPI Optimization

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 26

Case study from commercial projects

• Example of Accessibility KPI analysis • Example of Call Drop KPI issue & solution • Example of Throughput KPI issue analysis

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 27

Example of accessibility KPIs issue

Trouble-shooting of RRC setup and RAB assignment problems: • STEP1: Identify the counter with the highest number

Breakdown of CS RAB failure (Counters) VS.RAB.FailEstCS.I UB.Band

• STEP2: Identify the Top 10 cells with the same problem

VS.RAB.FailEstabCS. Other.Cell

Breakdown of CS RRC failure (Counters) VS.RRC.Rej.R

VS.RRC.Rej.Cod

Definition of Counters L.Fail e.Cong l VS.RAB.FailEstPs.IUB.Band: The number of RABs unsuccessfully established in a cell due to IUB resource congestion causes. • VS.RAB.FailEstabCS.Other.Cell: Pre-admission control module reports a resource congestion.

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

VS.RAB.FailEstPS. RIPFail

Page 28

VS.RRC.Rej.UL.C

RRC.FailConnEstab.

E.Cong

NoReply

• VS.RRC.Rej.UL.CE.Cong: RRC setup failure due to lack of UL CE resources

Analysis The “worst” sites (cells) that have been found to have both IUB and CE congestion issues: n0109TO (cell id 578/579/580) n0111TO (3882/3883/3884) n0070TO (18641/18642/18643) UL CE Occupation Rate

NodeB Name 2007-02-19

2007-02-20

2007-02-21

2007-02-22

0070TO

120.83%

132.29%

132.29%

171.88%

0109TO

142.71%

175.00%

175.00%

180.21%

0111TO

158.33%

132.29%

132.29%

148.96%

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 29

Suggested solution A comparative analysis shows that, if excluding the problematic sites, the KPI would improve substantially, say, AMR RAB assignment success rate from 97.79% to 98.09%:

RRC Connection Setup Success Rate (CS)(>98%) AMR RAB Assignment Success Rate(>98%) Video Call RAB Assignment Success Rate(>98%) PS64 RAB Assignment Success Rate(>97%) PS128 RAB Assignment Success Rate(>97%) PS384 RAB Assignment Success Rate(>97%)

KPIs (including IUB

KPIs (without IUB

Congestion sites)

Congestion sites)

99.17%(313992/316615)

99.35%(256449/258126)

97.79%(294499/301169)

98.09%(241127/245815)

Suggested action plan: • CE/IUB expansion

98.31%(3314/3371)

98.67%(2891/2930)

84.93%(2462/2899)

83.10%(1981/2384)

98.48%(16674/16932)

98.80%(13638/13803)

97.53%(58114/59584)

97.81%(48854/49946)

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 30

• Perform regular neighbour list check to further tune the performance

Case study from commercial projects

• Example of Accessibility KPI analysis • Example of Call Drop KPI issue & solution • Example of Throughput KPI issue analysis

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 31

Example of Call drop rate issues Drop Call Rate Voice(3G) Drop Call Rate Video(3G) Drop Call Rate (2G)

AMR12.2 Call Drop Rate 3.5%

Voice call drop rate changes over a threemonth optimization period

3.0% 2.5% 2.0% 1.5% 1.0% 0.5%

Zone1 Solving Voice call drop rate problems in Top 3 zones

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

2006-03-19

2006-03-17

2006-03-15

2006-03-13

2006-03-11

2006-03-09

2006-03-07

2006-03-05

2006-03-03

2006-03-01

2006-02-27

2006-02-25

2006-02-23

2006-02-21

2006-02-19

2006-02-17

2006-02-15

2006-02-13

2006-02-11

2006-02-09

2006-02-07

2006-02-05

2006-02-03

2006-02-01

2006-01-30

2006-01-28

2006-01-26

2006-01-24

2006-01-22

2006-01-20

2006-01-18

2006-01-16

0.0%

Zone2 Zone3

Page 32

What measures were taken to solve the call drop problems? Zone

Action time

Call drop rate reduction

Optimization measures

Zone 1

Feb. 14-17

1.57%->1.27%

Zone 2

Feb. 23-25

1.38%->1.21%

Zone 3

Mar.2-6

1.34%->1.10%

ü Scrambling code planning adjustment ü System/handover parameter tuning ü Neighbour list optimization ü RF optimization, etc.

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 33

Case study from commercial projects

• Example of Accessibility KPI analysis • Example of Call Drop KPI issue & solution • Example of Throughput issue analysis

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 34

Example of throughput KPI issues

45 Huawei sites provide coverage for DT route (Madrid South East)

Group

Service

FTP application throughput

I/B PS UL:384 DL:384

Minimum application throughput DL

HSDPA

Target

Valid calls

Successful

KPI

UL > 300 kbps DL > 361 kbps

118 (UL) 87 (DL)

118 (UL) 87 (DL)

319 (UL) 293 (DL)

> 384 Kbit/s

87

87

280

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 35

Analysis: coverage problems RNC 123

RNC 122

Areas that lack dominant pilot Drive test route involves 3 Huawei RNCs and 1 Nortel RNC RNC 121

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 36

The impact of missing neighbours • DL R99 throughput has been impacted by the interference generated by missing neighbors, mostly concerning the new sites that had been recently put on air • Areas with low throughput corresponds to bad Ec/Io figures and HHO to 2G Low throughput

UE handover to GSM

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

Page 37

Other causes In addition to coverage and missing neighbour causes, the HSDPA minimum throughput problem is due to: • •

DT route crosses the IUR area where HSDPA calls are reconfigured to DCH (H2D) UE moves from a non-hotspot to a hotspot site in HSDPA connected mode

RNC 122 RNC 123

RNC 122

RNC 123

RNC 121

HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com

RNC 121

Page 38

06.April 2006

Thank You www.huawei.com www.huawei .com

HUAWEI TECHNOLOGIES CO., LTD.

PDF created with pdfFactory Pro trial version www.pdffactory.com