LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
No. Checked
1 (52)
Program Sea Hawk 2018
Date
Cluster Name 2018_P5_EJ_4G_140 Reference
Rev
CLUSTER ACCEPTANCE CERTIFICATE (CAC) LTE PROJECT Area
East Java
City
Bangkalan
Cluster Name
2018_P4_EJ_4G_222
Abstract This document is to provide report for XL Axiata on Cluster Acceptance Cluster based for commercial LTE launch. Approval or reject using . logic SOM { SOM and HS , if SOM OK -> END ]
PT. HUAWEI TECH INVESTMENT
SOM PT. XL AXIATA Tbk.
${Level2}
Name: Achmad Fausi
Name:
Date: 05 December 2018
Date:
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
No. Checked
2 (52)
Program Sea Hawk 2018
Date
Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
TABLE OF CONTENTS 1
INTRODUCTION
5
1.1 Introduction
5
1.2 General Site Information
5
1.2.1 New Site Database
5
1.2.2 Neighbors First Tier
6
1.2.3 Punch List Database
6
1.3 Drive Test Methodology “Stationary Assessment”
7
1.4 FTP Server Information
7
1.5 Drive Test tool and Detail
7
2
8
MAP INFORMATION
2.1 Map Information
8
2.2 Drive test route, cluster border and coverage prediction
8
3
10
Performance Result
3.1 NMS KPI LTE Error! Bookmark not defined. 3.1.1 Availability Error! Bookmark not defined. 3.1.2 Accessibility Error! Bookmark not defined. 3.1.3 Retainability Error! Bookmark not defined. 3.1.4 Integrity Error! Bookmark not defined. 3.1.5 TX_RANK (Info Only)
10
3.1.6 Mobility
12
3.1.7 Utilization
12
3.1.8 CSFB
12
3.1.9 Traffic and Capacity
12
3.2 Drive Test KPI
17
3.2.1 Retainability
17
3.2.2 Accessibility
17
3.2.3 CSFB
17
3.2.4 Integrity Error! Bookmark not defined. 3.2.5 Mobility
18
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
No. Checked
3 (52)
Program Sea Hawk 2018
Date
Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
3.2.6 RSRP IDLE Drive Test
19
3.2.7 SINR-DL Dedicated Drive Test
20
3.2.8 PCI Plot
22
3.2.9 CQI
22
3.2.10 RSRQ
23
3.2.11 PS DL Throughput
24
3.2.12 PS UL Throughput
25
3.2.13 Transmission Modes Plot
26
3.2.14 Channel Bandwidth Plot
27
3.2.15 Event Failed
27
3.2.16 Sleeping Cell Identification
27
3.2.17 External Interference Identification
28
3.2.18 Cell Overshooting
28
3.2.19 Bad Spot analysis and Improvement
29
3.2.20 Physical Tuning Summary
30
3.2.21 Parameter Tuning Summary
33
4
NMS KPI RAN LTE TREND
34
5
KPI 2G & 3G
38
5.1 List of 2G, 3G & LTE sites inside LTE Polygon
38
5.2 NMS 2G
39
5.3 NMS 3G
39
5.4 MRR 3G
39
6
FEATURE
42
7
Issues, Recommendation and Exclusion
45
7.1 KPI RAN LTE Error! Bookmark not defined. 7.2 DT KPI LTE Error! Bookmark not defined. 7.2.1 Ping Latency 32bit
45
7.2.2 Ping latency 1000bit
46
7.3 KPI 2G & 3G
46
8
46
Conclusion
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
No. Checked
4 (52)
Program Sea Hawk 2018
Date
Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
Table of Figure Figure 1: Cluster Map Information ......................................................................................................................... 8 Figure 2: Drive Test Route ....................................................................................................................................... 8 Figure 3: Coverage Prediction using Planning Tools & DT Route ............................................................................ 9 Figure 6: RSRP IDLE Drive Test Result ................................................................................................................... 19 Figure 7: RSRP CDF Distribution ............................................................................................................................ 20 Figure 8: SINR-DL Dedicated Drive Test Result ..................................................................................................... 20 Figure 9: CDF Plot on SINR-DL Drive Test .............................................................................................................. 21 Figure 15 PCI Plot .................................................................................................................................................. 22 Figure 17 CQI Distribution Result .......................................................................................................................... 22 Figure 16 RSRQ Drive Test Result .......................................................................................................................... 23 Figure 18 PS DL Throughput Drive Test Result ...................................................................................................... 24 Figure 19 PS UL Throughput Drive Test Result ...................................................................................................... 25 Figure 21: Channel Bandwidth Plot ...................................................................................................................... 27
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
No. Checked
5 (52)
Program Sea Hawk 2018
Date
1
INTRODUCTION
1.1
Introduction
Cluster Name 2018_P5_EJ_4G_140 Reference
Rev
Provisional Acceptance shall be conducted after all the sites on air within cluster. If there are some issues that halt the RFS e.g. due to delayed community case, tower strengthening, etc, PAC can be conducted when at least 85% of sites are on air within a cluster. In the case of mushroom site where there is only 1 new site only with existing neighbor sites SSO is conducted for PAC.
This document presents the result of Cluster Drive test and Network Performance KPI based on active measurement and OSS data collection for 2018_P4_EJ_4G_222 The drive-test KPIs are evaluated by drive-test coverage and statistic according to the predefined drive-test route that is mutually agreed by both parties. The results of the measurements are then compared with the passing criteria agreed upon by XL and HUAWEI.
1.2
General Site Information General Site Information
Cluster Name
2018_P4_EJ_4G_222
Area
Bangkalan
Total number of cluster sites
3 Site
Total number of planned sites
1 Site
Total number of On-Air Macro sites:
3 Site
Total number of Pico Site
0 Site
Total number of pending On-Air Macro Sites
0 Site
Total number of pending On-Air Pico Sites
0 Site
1.2.1
New Site Database
eNB ID
LTE Site Name
CellID
Longitude
Latitude
TAC
PCI
Status
OA Date
544723
LTE_LERPAK_BANGKALAN
4
112.9338056
-7.024497222
55441
444
Integrated
17-May-18
544723
LTE_LERPAK_BANGKALAN
5
112.9338056
-7.024497222
55441
445
Integrated
17-May-18
544723
LTE_LERPAK_BANGKALAN
6
112.9338056
-7.024497222
55441
446
Integrated
17-May-18
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
1.2.2
No. Checked
6 (52)
Program Sea Hawk 2018
Date
Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
Neighbors First Tier
eNB ID
LTE Site Name
CellID
Longitude
Latitude
TAC
PCI
Fix Stats
543403
LTE_SELATAN_GEGER
4
112.93018
-7.0076
55441
234
existing on air
543403
LTE_SELATAN_GEGER
5
112.93018
-7.0076
55441
235
existing on air
543403
LTE_SELATAN_GEGER
6
112.93018
-7.0076
55441
236
existing on air
544301
LTE_REP_BATUKOCENG
4
112.9194722
-7.042361111
55441
201
existing on air
544301
LTE_REP_BATUKOCENG
5
112.9194722
-7.042361111
55441
202
existing on air
544301
LTE_REP_BATUKOCENG
6
112.9194722
-7.042361111
55441
203
existing on air
1.2.3
Punch List Database
There is no punch list at this Cluster.
Drive Test Methodology “Mobility Assessment” Drive test shall be performed under below circumstances:
Cluster is barred / reserved to ensure only single user camp in the cluster using USIM class 11 HotRod Prioritas profile to be used
LTE No.
Round 1
Round 2
Mobile UE
Method
RAT
BAND
KPI Measured
Remark 1 laptop, separated round between UL & DL Test to guarantee single user
Handset1
Idle
Lock LTE
LTE
1800
RSRP, RSRQ, PCI Plot
HUAWEI E392 (Modem)
Dedicated, continues download
Lock LTE
LTE
1800
PDCP DL THP, SINR
HUAWEI E392 (Modem)
Dedicated, continues Upload
Lock LTE
LTE
1800
PDCP UL THP
Handset 1
Dedicated, continues download
Automatic (Unlocked)
WCDMA / LTE
1800/ 2100
IRAT HO on edge 4G coverage
1 laptop, separated round between UL & DL Test to guarantee single user
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
1.3
No. Checked
7 (52)
Program Sea Hawk 2018
Date
Cluster Name 2018_P5_EJ_4G_140 Reference
Rev
Drive Test Methodology “Stationary Assessment”
Stationary KPI’s will be tested based on the agreed-on methodology with XL team. Cell Edge Performance for Link Budget Verification will be tested on the spot where the RSRP reaches between -115dBm to -120dBm at the edge of a cluster. LTE No.
Static
Static
1.4
Mobile UE
Method
Handset1
Handset 1
Static
Static
Lock LTE
Lock LTE
LTE
LTE
KPI Measured
Remark
1800
Target > 1 Mbps
Speedtest (OOKLA & Open Signal) is required at badspot area (-<115 dBm) which is detected from MR or DT with maximum 3 spots with GnetTrack
1800
HotRod Priority Speed (higher QoS) is higher than Super HotRod (lower QoS)
Downlink QoS Test, best Condition Spot. Continues download > 2 Min
BAND
FTP Server Information FTP Server information
1.5
RAT
IP Address IP:103.52.146.236
Drive Test tool and Detail DT Tools
Samsung Galaxy S5 GENEX Probe v3.16
Date of DT DT Team
01 Desember 2018 Achmad Afandi
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
No. Checked
2
MAP INFORMATION
2.1
Map Information
8 (52)
Program Sea Hawk 2018
Date
Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
Figure 1: Cluster Map Information
2.2
Drive test route, cluster border and coverage prediction
Figure 2: Drive Test Route
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
No. Checked
9 (52)
Program Sea Hawk 2018
Date
Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
Figure 3: Coverage Prediction using Planning Tools & DT Route
PAC Ref Item Site List, Polygon Border, DT Route and Coverage Prediction match with agred design
Result
Target
Match
Must be matched with agreed design
Pass
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
No. Checked
10 (52)
Program Sea Hawk 2018
Date
Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
-115<=DL RSRP (dBm)<-105
-105
Infinity
DL RSRP (dBm)<-115
-115
TOTAL
Village(%)
-115
Forest(%)
-100
Scrub(%)
-105<=DL RSRP (dBm)<-100
Green_Land(%)
-105
Road_Open_Area(%)
-90
SubUrban_Open_Area(%)
-100<=DL RSRP (dBm)<-90
Inland_Water(%)
-100
3.36 4.50 15.40 12.01 40.00 24.74 100%
% of Coverage Area
-85
Coverage Area(km2)
Infinity
=-90<=DL RSRP (dBm)<-85
Legend
DL RSRP (dBm)>=-85
-90
Percentage (%)
Max Vaule (dBm)
-85
Min Value (dBm)
RSRP Criteria (dBm)
Residenttial 2018_P5_EJ_4G_140.xlsx
1.8
3.4
0.0
0.0
0.0
30.5
44.0
25.5
0.0
2.5
4.5
0.0
0.0
0.0
16.0
47.3
36.7
0.0
8.4
15.4
0.0
0.0
0.0
17.1
34.8
48.1
0.0
6.6
12.0
0.0
0.0
0.0
22.2
42.0
35.7
0.0
21.9
40.0
0.0
0.0
0.0
23.1
36.2
40.8
0.0
13.6
24.7
0.0
0.0
0.3
20.5
38.2
41.3
0.0
54.8
100%
Figure 4: Residential Prediction using Planning Tools & RSRP Result
3
Performance Result
3.1
NMS KPI LTE (New Site) Cell KPI Aggregate for 7 days, taken at cell busy hour except for Availability. Availability is measured within 24 hours in a day. Cell busy hour is defined as the hour when downlink and uplink payload reach the peak value. Measurement period:
Before (Start - End) After (Start - End) 3.1.1
21-Nov-2018 28-Nov-2018
to to
27-Nov-2018 04-Nov-2018
Availability
No
Name
1
Cell Availability
Target (EPL) > 99%
CAC Before
CAC After
Status
99.91%
100.00%
Pass
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
3.1.2
No. Checked
11 (52)
Program Sea Hawk 2018
Date
Cluster Name 2018_P5_EJ_4G_140 Reference
Rev
Accessibility
No
Name
1 2
Session Setup Success Rate RRC Setup Success Rate
3.1.3
Target (EPL) > 99% > 98%
CAC Before
CAC After
Status
99.88% 99.96%
99.79% 99.91%
Pass Pass
Retainability
No
Name
Target (EPL)
CAC Before
CAC After
Status
1
Session Abnormal Release Rate
< 1.4%
0.09%
0.06%
Pass
3.1.4
Integrity
No
Name
Target (EPL)
1 2
UL Packet Loss (PDCP ) DL Packet Loss (PDCP )
3
Downlink User Throughput (Peak)*
4
Uplink User Throughput (Peak)*
5
Downlink User Throughput (Average)*
6
Uplink User Throughput (Average)*
7
DL Uu Latency
<0.001 <0.001 > 15 Mbps (3 MHz) > 50 Mbps (10 MHz) > 75 Mbps (15 MHz) > 4.5 Mbps (3 MHz) > 20 Mbps (10 MHz) > 33 Mbps (15 MHz) > 5.1 Mbps (3 MHz) > 17 Mbps (10 MHz) > 25.5 Mbps (15 MHz) > 3 Mbps (3 MHz) > 10 Mbps (10 MHz) > 15 Mbps (15 MHz) < 8 ms
3.1.5
CAC After
Status
4.97E-04 1.73E-05
Pass Pass
35.70 Mbps
39.45 Mbps
Info only*
18.99 Mbps
18.61 Mbps
Info only*
1.96 Mbps
2.66 Mbps
Info only*
0.97 Mbps
1.18 Mbps
Info only*
5.89 ms
3.28 ms
Pass
TX_RANK (Info Only) TX2
eNB ID
CAC Before 5.22E-04 2.07E-05
LTE Site Name
TX4
CID
ISD Remarks
(2T2R)
(4T4R)
MIMO (m)
544637
X4542427E_LTE_Tambak_Wedi_Kenjeran
4
22.66%
-
Normal
0
MIMO 2T2R
544637
X4542427E_LTE_Tambak_Wedi_Kenjeran
5
15.68%
-
Normal
1788
MIMO 2T2R
544637
X4542427E_LTE_Tambak_Wedi_Kenjeran
6
23.02%
-
Normal
683
MIMO 2T2R
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
3.1.6 No 1 2 3
Date
Rev
Target (EPL)
Name Handover Success Rate IntraFrequency Handover Success Rate InterFrequency Handover Success Rate Inter-RAT (PSHO, not RwR)
Cluster Name 2018_P5_EJ_4G_140 Reference
CAC Before
CAC After
> 98%
99.98%
99.97%
> 98%
N/A
N/A
> 95%
00.00%
00.00%
Status Pass Applicable whereby LTE 900/2300 are installed Pass
Utilization
No
Name 1
No 1 2 3 4 5 6
Checked
Program Sea Hawk 2018
Mobility
3.1.7
3.1.8
No.
12 (52)
Target
Maximum eNodeB CPU Utilization
< 70%
CAC Before
CAC After
13%
12%
CAC Before 4.7s 100% 1.2s 100% 1.6s 100%
CAC After 1.2s 100% 1.2s 100% 1.2s 100%
Status Pass
CSFB Name Voice - Outgoing Call Setup Time* Voice - Outgoing Call Setup Success Rate Voice - Incoming Call Setup Time* Voice - Incoming Call Setup Success Rate Voice - Time to Return to LTE* Voice - Return to LTE Success Rate*
Target (EPL) <5s > 97% < 3.5 s > 97% <5s > 97%
* Measured using probe (Smart Care or Anritsu)
3.1.9
Traffic and Capacity
3.1.9.1
Payload Name UL Volume (Gigabyte) DL Volume (Gigabyte)
Trend daily Payload (GB)
CAC Before 121.78 GB 1168.81 GB
CAC After 114.97 GB 1213.33 GB
Status Pass Pass Pass Pass Pass Pass
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
3.2
No. Checked
13 (52)
Program Sea Hawk 2018
Date
Cluster Name 2018_P5_EJ_4G_140 Reference
Rev
Date
Sum of UL Traffic Volume (GByte)
Sum of DL Traffic Volume (GByte)
11/28/2018
13.38479781
132.0842866
11/29/2018
15.61320875
172.0732834
11/30/2018
16.67449926
185.3820646
12/1/2018
16.90350905
181.4187014
12/2/2018
21.04366292
212.0229474
12/3/2018
16.14924691
171.3598992
12/4/2018
15.2103103
158.9922988
Grand Total
114.979235
1213.333481
NMS KPI LTE (Cluster Level) Cell KPI Aggregate for 7 days, taken at cell busy hour except for Availability. Availability is measured within 24 hours in a day. Cell busy hour is defined as the hour when downlink and uplink payload reach the peak value. Measurement period:
Before (Start - End) After (Start - End) 3.2.1
Name
1
Cell Availability
No
to to
27-Nov-2018 04-Nov-2018
Availability
No
3.2.2
21-Nov-2018 28-Nov-2018
Target (EPL) > 99%
CAC Before
CAC After
Status
99.37%
99.50%
Pass
Accessibility Name
Target (EPL)
CAC Before
CAC After
Status
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
1 2
3.2.3
No. Checked
14 (52)
Program Sea Hawk 2018
Date
Session Setup Success Rate RRC Setup Success Rate
Cluster Name 2018_P5_EJ_4G_140 Reference
Rev
> 99% > 98%
99.82% 99.92%
99.81% 99.91%
Pass Pass
Retainability
No
Name
Target (EPL)
CAC Before
CAC After
Status
1
Session Abnormal Release Rate
< 1.4%
0.06%
0.07%
Pass
3.2.4
Integrity
No
Name
Target (EPL)
1 2
UL Packet Loss (PDCP ) DL Packet Loss (PDCP )
3
Downlink User Throughput (Peak)*
4
Uplink User Throughput (Peak)*
<0.001 <0.001 > 15 Mbps (3 MHz) > 50 Mbps (10 MHz) > 75 Mbps (15 MHz) > 4.5 Mbps (3 MHz) > 20 Mbps (10 MHz) > 33 Mbps (15 MHz)
5
Downlink User Throughput (Average)*
6
Uplink User Throughput (Average)*
7
DL Uu Latency
3.2.5 No 1 2 3
> 5.1 Mbps (3 MHz) > 17 Mbps (10 MHz) > 25.5 Mbps (15 MHz) > 3 Mbps (3 MHz) > 10 Mbps (10 MHz) > 15 Mbps (15 MHz) < 8 ms
CAC Before 4.73E-04 6.45E-06
CAC After
Status
6.19E-04 1.10E-05
Pass Pass
39.75 Mbps
39.17 Mbps
Info only*
17.55 Mbps
19.43 Mbps
Info only*
1.29 Mbps
1.48 Mbps
Info only*
1.70 Mbps
1.79 Mbps
Info only*
5.23 ms
2.58 ms
Pass
Mobility Name Handover Success Rate IntraFrequency Handover Success Rate InterFrequency Handover Success Rate Inter-RAT (PSHO, not RwR)
Target (EPL)
CAC Before
CAC After
> 98%
99.91%
99.97%
> 98%
N/A
N/A
> 95%
00.00%
00.00%
Status Pass Applicable whereby LTE 900/2300 are installed Pass
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
3.2.6
Date
Rev
Name 1
No 1 2 3 4 5 6
Checked
Program Sea Hawk 2018
Cluster Name 2018_P5_EJ_4G_140 Reference
Utilization
No
3.2.7
No.
15 (52)
Target
Maximum eNodeB CPU Utilization
< 70%
CAC Before
CAC After
38%
36%
CAC Before 4.7s 100% 1.2s 100% 1.6s 100%
CAC After 1.2s 100% 1.2s 100% 1.2s 100%
Status Pass
CSFB Name Voice - Outgoing Call Setup Time* Voice - Outgoing Call Setup Success Rate Voice - Incoming Call Setup Time* Voice - Incoming Call Setup Success Rate Voice - Time to Return to LTE* Voice - Return to LTE Success Rate*
Target (EPL) <5s > 97% < 3.5 s > 97% <5s > 97%
* Measured using probe (Smart Care or Anritsu)
3.2.8
Traffic and Capacity
3.2.8.1
Payload Name UL Volume (Gigabyte) DL Volume (Gigabyte)
CAC Before 1491.99 GB 15145.05 GB
CAC After 1519.14 GB 15921.11 GB
Trend daily Payload (GB)
Date
Sum of UL Traffic Volume (GByte)
Sum of DL Traffic Volume (GByte)
11/28/2018
198.2864178
1965.320905
11/29/2018
218.0248763
2288.32945
11/30/2018
211.5704008
2258.401716
12/1/2018
219.9627944
2358.589724
12/2/2018
248.5099007
2627.042744
12/3/2018
214.628932
2234.241195
12/4/2018
208.1583446
2189.189795
Grand Total
1519.141667
15921.11553
Status Pass Pass Pass Pass Pass Pass
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
3.2.8.2
No. Checked
16 (52)
Program Sea Hawk 2018
Date
Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
PRB Utilization
Site ID LTE
LTE Site Name
CellID
DL PRB Utilization (%) Max
X4542427E
LTE_Tambak_Wedi_Kenjeran
4
98.31
31.90
DL PRB Utilization (%) (BH Daily averaged in a week) 91.09
X4542427E
LTE_Tambak_Wedi_Kenjeran
5
96.82
27.17
82.55
20.01
X4542427E
LTE_Tambak_Wedi_Kenjeran
6
98.52
43.37
95.33
35.86
UL PRB Utilization (%) Max
UL PRB Utilization (%) (BH Daily averaged in a week) 23.39
*Calculation: Busy hour is defined as the hour in which sum DL & UL payload reach the highest value Daily : on busy hour, UL/DL PRB utilization is averaged for each cell on each site Weekly : averaging daily value Provided for information only
3.2.8.3
Number of RRC Connected User
Site ID LTE
LTE Site Name
X4542427E
LTE_Tambak_Wedi_Kenjeran
RRC Connected User (Average Week, Daily Max) 344
RRC Connected User (Average Week, Daily Sum) 5548
*Calculation:
Busy hour is defined as the hour in which sum DL & UL payload reach the highest value Provided for information only
3.2.8.4
Number of IRAT HO Attempt
Site ID LTE
LTE Site Name
CellID
X4542427E
LTE_Tambak_Wedi_Kenjeran
4
IRAT HO Attempt Preparation (Sum daily, summing on a week) N/A
X4542427E
LTE_Tambak_Wedi_Kenjeran
5
N/A
X4542427E
LTE_Tambak_Wedi_Kenjeran
6
N/A
*Calculation: Busy hour is defined as the hour in which sum DL & UL payload reach the highest value Daily : on busy hour, IRAT HO Attempt is summed for each cell toward its relation Weekly : summing daily value Provided for information only Note: Attached xls showing cell relation below:
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
3.3
1
Date
Rev
Target
PAC Result
Status
Remark
< 1.4%
0.00%
Pass
In PAC, value is measured on mobility or stationary on each PCI
Name Session Abnormal Release Rate
Accessibility Name
Target
PAC Result
Status
1
Session Setup Success Rate
> 99%
100.00%
Pass
2
RRC Setup Success Rate
> 98%
100.00%
Pass
3.3.3
CSFB
No
Name
1 2 3 4
Voice - Outgoing Call Setup Time Voice - Outgoing Call Setup Success Rate Voice - Incoming Call Setup Time Voice - Incoming Call Setup Success Rate
5
Voice - Time to Return to LTE
6
Voice - Return to LTE Success Rate
3.3.4 No
Cluster Name 2018_P5_EJ_4G_140 Reference
Retainability
3.3.2 No
Checked
Program Sea Hawk 2018
Drive Test KPI
3.3.1 No
No.
17 (52)
Remark In PAC, value is measured on mobility or stationary on each PCI
Target
PAC Result
Status
≤5 s
4.46 s
Pass
>97%
100%
Pass
≤3.5s
1.28s
Pass
>97%
100%
Pass
≤5 s >97%
1.01 s 100%
Pass
Remark In PAC, value is measured on mobility or stationary on each PCI
Pass
Integrity Name
Target
PAC Result
Status
43.70 ms / 47.30 ms
Pass with Justification
1
RTT Packet Delay (ping) 32/1000 bytes
<= 20 ms / 30 ms
2
UL Packet Loss (PDCP )
< 1e-3
0
Pass
< 1e-3
0
Pass
3
DL Packet Loss (PDCP )
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
No
No. Checked
Program Sea Hawk 2018
Date
Name
18 (52)
Rev
Target
Downlink Peak User Throughput*
Cluster Name 2018_P5_EJ_4G_140 Reference
PAC Result
> 15 Mbps (3 MHz) > 50 Mbps (10 MHz)
Status
50.98 Mbps
Info only*
21.99 Mbps
Info only*
10.80 Mbps
Pass with justification
17.13 Mbps
Pass
43.70 ms
Pass
> 75 Mbps (15 MHz)
4
> 4.5 Mbps (3 MHz) Uplink Peak User Throughput*
> 15 Mbps (10 MHz) > 25 Mbps (15 MHz)
5
> 4 Mbps (3 MHz) Downlink Average User Throughput
> 15 Mbps (10 MHz) > 22.5 Mbps (15 MHz)
6
> 3 Mbps (3 MHz) Uplink Average User Throughput
> 15 Mbps (15 MHz)
7 8
> 10 Mbps (10 MHz)
Jitter (Uplink and Downlink)
< 50 ms
Note: all above values are measured on mobility or stationary on each PCI *Depends on single user scenario and Transmission Capacity
3.3.5 No 1 2 3
Mobility Name Handover Success Rate IntraFrequency Handover Success Rate InterFrequency Handover Success Rate InterRAT (PSHO, not RwR)
Ref
PAC Result
Status
Remark
> 98%
100%
Pass
100%
> 98%
N/A
N/A
Applicable if L900/L2300 are deployed
> 95%
100%
Pass
100%
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
3.3.6
No. Checked
19 (52)
Program Sea Hawk 2018
Date
Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
RSRP IDLE Drive Test
Figure 4: RSRP IDLE Drive Test Result Min Value (dBm)
RSRP Criteria (dBm)
Max Value (dBm)
Percentage (%)
16.04% 19.99% 40.78% 11.12% 9.87% 2.20%
-85
DL RSRP (dBm)>=-85
Infinity
-90
-90<=DL RSRP (dBm)<-85
-85
-100
-100<=DL RSRP (dBm)<-90
-90
-105
-105<=DL RSRP (dBm)<-100
-100
-115
-115<=DL RSRP (dBm)<-105
-110
-Infinity
DL RSRP (dBm)<-115
-115
Target
PAC Result (RSRP Plot >-105 dBm Result)
In 95% of cluster, the RSRP must be ≥ -105 dBm
-109 dBm @ 95%
No low RSRP ( < -105 dBm ) is found near site ± 300m)
Not found
Legend
Status Pass with justification Pass
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
No. Checked
20 (52)
Program Sea Hawk 2018
Date
Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
CDF Plot:
Figure 5: RSRP CDF Distribution
3.3.7
SINR-DL Dedicated Drive Test
Figure 6: SINR-DL Dedicated Drive Test Result
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
No. Checked
Min Value (dB) 20 10 3 0 -5 -Infinity
21 (52)
Program Sea Hawk 2018
Date
SINR Criteria (dB)
7.81% 48.23% 34.07% 4.40% 4.08% 1.41%
Cluster Name 2018_P5_EJ_4G_140 Reference
Rev
Max Value (dB) Infinity
Percentage (%)
20 10 3 0 -5
Legend
7.81% 48.23% 34.07% 4.40% 4.08% 1.41%
SINR ≥ 3
90.11%
Pass
Target In 85% of cluster, SINR-DL must be > 3 dB
PAC Result 5 dB @ 85%
Status Pass
No Low SINR (<3 dB) is found near site (± 300m)
Not found
Pass
CDF Plot :
Figure 7: CDF Plot on SINR-DL Drive Test
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
3.3.8
No. Checked
22 (52)
Program Sea Hawk 2018
Date
Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
PCI Plot
Figure 8 PCI Plot Target No partial / full cross feeder is detected
3.3.9
PAC Result Information only
CQI
Figure 9 CQI Distribution Result
Status Pass
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
Min Value 10 5 3 0
No. Checked
23 (52)
Program Sea Hawk 2018
Date
CQI 10 <= CQI Value < 15 5<= CQI Value < 10 3<= CQI Value < 5 0 <= CQI Value < 3
Rev
Max Value 2099 850 47 34
Item CQI Distribution*
3.3.10
Cluster Name 2018_P5_EJ_4G_140 Reference
Percentage (%) 69.27% 28.05% 1.55% 1.12% Status Info Only
RSRQ RSRQ is provided for information only.
Figure 10 RSRQ Drive Test Result Min Value (dB) -6 -9 -11 -14 -Infinity
RSRQ Criteria (dB) RSRQ (dB)>=-6 -9<=RSRQ (dB)<-6 -11<=RSRQ (dB)<-9 -14<=RSRQ (dB)<-11 RSRQ (dB)<-14
Max Value (dB) Infinity -6 -9 -11 -14
Percentage (%) 24.24% 55.23% 14.78% 4.61% 1.14%
Legend
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
3.3.11
No. Checked
24 (52)
Program Sea Hawk 2018
Date
Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
PS DL Throughput
Figure 11 PS DL Throughput Drive Test Result Min Value (Mbps)
DL Throughput (Mbps)
Max Value (Mbps)
Percentage (%)
30
DL Throughput (Mbps)>=30
Infinity
8.74%
10
10<=DL Throughput (Mbps)<30
30
53.59%
5
5<=DL Throughput (Mbps)<10
10
16.96%
3
3<=DL Throughput (Mbps)<5
5
7.44%
0
0
3
13.28%
Legend
PS DL Drive Test Target
PAC Result
Status
No low DL throughput ( < 3 Mbps) near site ( ± 300m)
Not Found
Pass
*PS DL Throughput test do in normal mode without cell bar.
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
3.3.12
No. Checked
25 (52)
Program Sea Hawk 2018
Date
Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
PS UL Throughput
Figure 12 PS UL Throughput Drive Test Result Min Value (Mbps)
UL Throughput (Mbps)
Max Value (Mbps)
Percentage (%)
15
UL Throughput (Mbps)>=15
Infinity
42.48%
10
10<=UL Throughput (Mbps)<15
15
24.64%
5
5<=UL Throughput (Mbps)<10
10
22.08%
3
3<=UL Throughput (Mbps)<5
5
4.75%
0
0
3
6.06 %
PS UL Drive Test Target
PAC Result
Status
No low DL throughput ( < 3 Mbps) near site ( ± 300m)
Not Found
Pass
*PS UL Throughput test do in normal mode without cell bar.
Legend
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
3.3.13
No. Checked
26 (52)
Program Sea Hawk 2018
Date
Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
Transmission Modes Plot
Note: provided for information only
Figure 20: Transmission Mode Plot eNB ID
eNB Name
ID
544723
LTE_LERPAK_BANGKALAN
544723
MIMO Check Result Design
Implementation
4
MIMO
MIMO
LTE_LERPAK_BANGKALAN
5
MIMO
MIMO
544723
LTE_LERPAK_BANGKALAN
6
MIMO
MIMO
543403
LTE_SELATAN_GEGER
4
MIMO
MIMO
543403
LTE_SELATAN_GEGER
5
MIMO
MIMO
543403
LTE_SELATAN_GEGER
6
MIMO
MIMO
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
3.3.14
No. Checked
27 (52)
Program Sea Hawk 2018
Date
Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
Channel Bandwidth Plot Note: provided for information only
Figure 13: Channel Bandwidth Plot
3.3.15
Event Failed
No event failed found.
Event 2018_P5_EJ_4G_140.xlsx
3.3.16
Sleeping Cell Identification Cellname
RACH SR (%)
Status
SB4G18_4542427E_4
78.38%
No Sleeping Cell
SB4G18_4542427E_5
83.76%
No Sleeping Cell
SB4G18_4542427E_6
79.38%
No Sleeping Cell
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
3.3.17
No. Checked
28 (52)
Program Sea Hawk 2018
Date
Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
External Interference Identification
3.3.18
Target
PAC Result
Status
No external interference is found
Not found
Information only
Cell Overshooting
No Found site overshooting Site name
Cell name
Inter Site Distance
Target
Overshooting Factor
Remark
(KM)
1822_KENJERAN
SB4G18_4541822E_4
0
>=80%
100
Pass
1822_KENJERAN
SB4G18_4541822E_5
4562
>=80%
99.99974
Pass
1822_KENJERAN
SB4G18_4541822E_6
1822
>=80%
99.75856
Pass
2542838_DukuhBulakBanteng
SB4G18_4542838E_4
1180
>=80%
99.98504
Pass
2542838_DukuhBulakBanteng
SB4G18_4542838E_5
1148
>=80%
100
Pass
2542838_DukuhBulakBanteng
SB4G18_4542838E_6
605
>=80%
99.96382
Pass
C863_KEDUNG COWEK
SB4G18_454C863E_4
903
>=80%
97.67098
Pass
C863_KEDUNG COWEK
SB4G18_454C863E_5
1102
>=80%
99.99965
Pass
C863_KEDUNG COWEK
SB4G18_454C863E_6
1587
>=80%
100
Pass
254C930_TambakWediAxis
SB4G18_454C930E_4
6515
>=80%
99.89931
Pass
254C930_TambakWediAxis
SB4G18_454C930E_5
293
>=80%
91.86734
Pass
254C930_TambakWediAxis
SB4G18_454C930E_6
513
>=80%
96.8416
Pass
MC254C516_BulakBantengWetan
SB4G18_MC454C516E_4
680
>=80%
99.99931
Pass
MC254C516_BulakBantengWetan
SB4G18_MC454C516E_5
1688
>=80%
100
Pass
MC254C516_BulakBantengWetan
SB4G18_MC454C516E_6
605
>=80%
99.86136
Pass
X3542427G_3G_Tambak_Wedi_Kenjeran
SB4G18_4542427E_4
0
>=80%
100
Pass
X3542427G_3G_Tambak_Wedi_Kenjeran
SB4G18_4542427E_5
1788
>=80%
96.36409
Pass
X3542427G_3G_Tambak_Wedi_Kenjeran
SB4G18_4542427E_6
683
>=80%
83.07241
Pass
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
3.3.19
No. Checked
29 (52)
Program Sea Hawk 2018
Date
Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
Bad Spot Optimization Result 3.3.19.1
Bad spot on PCI PCI BEFORE
3.3.20
Bad Spot analysis and Improvement
Target All bad spots are improved
3.3.20.1
PCI AFTER
PAC Result 3 badspot remain with justification
Status Pass with justification
Bad spot on RSRP RSRP Before
RSRP After
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
System
LTE
No. Checked
Legend
Rev
Before
17.13% 19.00%
-90<=DL RSRP (dBm)<-85
21.40% 22.00%
-100<=DL RSRP (dBm)<-90
38.22% 39.32%
-105<=DL RSRP (dBm)<-100
10.64%
-115<=DL RSRP (dBm)<-105
9.40%
DL RSRP (dBm)<-115
3.22%
9.47% 8.25% 1.97%
96.78%
98.03%
Level
Legend
SINR (dB)>=20 10<=SINR (dB)<20 3<=SINR (dB)<10 LTE
In 95% of cluster, the RSRP must be ≥ -105 dBm is improve from 96.78% to 98.03%
Bad spot on SINR SINR Before
System
Cluster Name 2018_P5_EJ_4G_140 Reference
After
DL RSRP (dBm)>=-85
Pass
3.3.20.2
Program Sea Hawk 2018
Date
Level
30 (52)
0<=SINR (dB)<3 -5<=SINR (dB)<0 SINR (dB)<-5 Pass
SINR After
Before
After
3.17% 40.95% 41.48% 6.82% 5.21% 2.37% 85.60%
7.81% 48.23% 34.07% 4.40% 4.08% 1.41% 90.11%
SINR >3 is improve from 85.60 % to 90.11%
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
3.3.20.3
No. Checked
Program Sea Hawk 2018
Date
Rev
LTE
Cluster Name 2018_P5_EJ_4G_140 Reference
Bad Spot on DL Throughput DL BEFORE
System
31 (52)
Level
DL AFTER
Before
After
DL Throughput (Mbps)>=30
2.21%
8.74%
10<=DL Throughput (Mbps)<30
39.74%
53.59%
5<=DL Throughput (Mbps)<10
20.71%
16.96%
3<=DL Throughput (Mbps)<5
12.02%
7.44%
0
25.32%
13.28%
41.95%
62.33%
PDCP > 10Mbps
Legend
PDCP > 10Mbps is improve from 41.95% to 62.33%
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
3.3.20.4
No. Checked
Program Sea Hawk 2018
Date
Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
Bad Spot on UL throughput UL BEFORE
System
32 (52)
Level
Legend
UL AFTER
Before
After
UL Throughput (Mbps)>=15
30.45%
42.48%
10<=UL Throughput (Mbps)<15
25.01%
24.64%
5<=UL Throughput (Mbps)<10
25.79%
22.08%
3<=UL Throughput (Mbps)<5
7.52%
4.75%
0
11.00%
6.06 %
55.46%
67.12%
LTE
PDCP > 10Mbps
PDCP > 10Mbps is improve from 55.46% to 67.12%
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
No. Checked
33 (52)
Program Sea Hawk 2018
Date
Cluster Name 2018_P5_EJ_4G_140 Reference
Rev
3.3.20.5 Root cause and Action taken No
Root Cause
Longitude
Bad RSRP SINR in line with bad DL and UL throughput Due to coverage issue far from nearest site and contour. Bad spot already covered by main lobe site LTE_KOMBANGAN sec 2 with distance 2.74km Bad RSRP SINR in line with UL throughput Due to coverage issue far from nearest site and contour. Bad spot already covered by side lobe site LTE_LERPAK_BANGKALAN sec 2 with distance 1.48 km
1
2
Bad RSRP due to coverage issue far from nearest site and contour. Bad spot already covered by main lobe site LTE_REP_BATUKOCENG sec 2 with distance 1.03 km
3
Bad DL throughput Due to coverage issue far from nearest site and contour. Bad spot already covered by main lobe site LTE_SELATAN_GEGER sec 3 with distance 1.56 km Bad RSRP SINR in line with bad DL and UL throughput Due to coverage issue far from nearest site and contour. Bad spot already covered by main lobe site LTE_SELATAN_GEGER sec 1 with distance 1.2km
4
5
3.3.1
112.953485°
Latitude
Action taken
-7.022186°
Propose new site at 112.955770° -7.023880° to cover bad spot on potential area
112.922513°
-7.031422°
112.910836°
-7.051427°
112.928406°
-7.018309°
112.938217°
-7.000218°
No potential area
Propose upgrade bandwidth site LTE_SELATAN_GEGER
Physical Tuning Summary
NEW SITE AND 1st TIER NEIGHBOR Cell ID
LONG
LAT
TAC
BW
-7.0244972
55441
10 MHz
Site ID
Site Name
4542545E
LTE_LERPAK_BANGKALAN
4
112.93380556
4542545E
LTE_LERPAK_BANGKALAN
5
112.93380556
-7.0244972
55441
10 MHz
4542545E
LTE_LERPAK_BANGKALAN
6
112.93380556
-7.0244972
55441
4544458E
LTE_SELATAN_GEGER
4
112.93018
-7.0076
4544458E
LTE_SELATAN_GEGER
5
112.93018
4544458E
LTE_SELATAN_GEGER
6
454A618E
LTE_REP_BATUKOCENG
454A618E 454A618E
3.3.1
Already do optimization & physical tuning audit on site: LTE_LERPAK_BANGKALAN sector 2 from Mk 1 to Mk 2. Already do optimization & physical tuning audit on site: LTE_REP_BATUKOCENG sec 2 from azimuth 190 to azimuth 195.
SITE TYPE
BEFORE H/AZ/E/M
FINAL H/AZ/E/M
Outdoor
70/9/6/1
70/9/6/2
Outdoor
70/250/6/1
70/250/6/2
10 MHz
Outdoor
70/350/6/1
70/350/6/2
55441
10 MHz
Outdoor
50/20/2/1
50/20/2/1
-7.0076
55441
10 MHz
Outdoor
50/100/2/1
50/100/2/1
112.93018
-7.0076
55441
10 MHz
Outdoor
50/200/2/1
50/200/2/1
4
112.919472
-7.042361
55448
10 MHz
Outdoor
51/30/8/6
51/20/8/6
LTE_REP_BATUKOCENG
5
112.919472
-7.042361
55448
10 MHz
Outdoor
51/190/4/8
51/195/4/8
LTE_REP_BATUKOCENG
6
112.919472
-7.042361
55448
10 MHz
Outdoor
51/290/11/8
51/290/11/8
Parameter Tuning Summary
No Parameter tuning or optimization done since the coverage already follow RF design & parameter standard (CDD) already implemented sucscessfully.
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
4
No. Checked
34 (52)
Program Sea Hawk 2018
Date
Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
NMS KPI RAN LTE TREND (New Site) Availability
Session Setup Success Rate
Cell AvailabilityRate is maintained above reference value99% RRC Setup Success Rate
Session Setup Success Rate is maintained above reference value99% Session Abnormal Release Rate
RRC Setup Success Rate is maintained above reference value 98%
Session Abnormal Release Rate is maintained below reference value 1.4 %
UL/DL PDCP Packet Loss
PDPCP UL/DL Packet Loss performance is below reference value 1e-3.
UL/DL Average Cell Throughput
Cell DL Throughput Average is 14Mbps, Cell UL Throughput Average is 4 Mbps.(Only for Information)
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
No. Checked
35 (52)
Program Sea Hawk 2018
Date
Rev
HOSR Intra-frequency
Cluster Name 2018_P5_EJ_4G_140 Reference
IRAT-HO SR
Handover Success Rate Intra Frequency is maintained above reference value 98.00% Processor Load
Handover Success Rate Inter RAT Frequency is maintained above reference value 95.00% 4G User Throughput
eNodeB processor load maximum is lower below reference value 70.00 %. 2G 3G LTE Payload Trend
3G and LTE User Number actually no issue. (Only for Information) LTE User Number
Payload actually no issue (only for information)
Throughput actually no issue(only for information)
Figure 23: NMS KPI Trend
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
5
No. Checked
36 (52)
Program Sea Hawk 2018
Date
Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
NMS KPI RAN LTE TREND (Cluster Level) Availability
Session Setup Success Rate
Cell AvailabilityRate is maintained above reference value99% RRC Setup Success Rate
Session Setup Success Rate is maintained above reference value99% Session Abnormal Release Rate
RRC Setup Success Rate is maintained above reference value 98%
Session Abnormal Release Rate is maintained below reference value 1.4 %
UL/DL PDCP Packet Loss
PDPCP UL/DL Packet Loss performance is below reference value 1e-3.
UL/DL Average Cell Throughput
Cell DL Throughput Average is 14Mbps, Cell UL Throughput Average is 4 Mbps.(Only for Information)
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
No. Checked
Date
HOSR Intra-frequency
37 (52)
Program Sea Hawk 2018 Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
IRAT-HO SR
Handover Success Rate Intra Frequency is maintained above reference value 98.00% Processor Load
Handover Success Rate Inter RAT Frequency is maintained above reference value 95.00% 4G User Throughput
eNodeB processor load maximum is lower below reference value 70.00 %. 2G 3G LTE Payload Trend
3G and LTE User Number actually no issue. (Only for Information) LTE User Number
Payload actually no issue (only for information)
Throughput actually no issue(only for information)
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
No. Checked
38 (52)
Program Sea Hawk 2018
Date
Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
Figure 23: NMS KPI Trend
6
KPI 2G & 3G
Drive Test is out of LTE vendor scope of work, hence the 2G & 3G DT KPI would be reviewed during quarterly Drive Test with PTHS. Therefore, the 2G & 3G aspect only review the NMS KPI, plus MRR data of 3G in PAC report.
The target for NMS KPI is maintained of improved, comparing the best week (within 3 weeks) after Frequency Carving/TRX Shutdown versus the week when PAC is collected. 2G & 3G nodes involved are applicable for nodes which are inside LTE polygon, regardless they have collocated LTE installed or not. All KPI, except availability are calculated during busy hour-payload UL+DL daily, averaged within a week. Availability is monitored 24 hr daily.
6.1
List of 2G, 3G & LTE sites inside LTE Polygon
Item Site List 2G & 3G inside the polygon is matched with actual
Target Must be matched with actual
PAC Result
Status
Match
Pass
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
6.2
No. Checked
39 (52)
Program Sea Hawk 2018
Date
Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
NMS 2G
KPI Assignment Success Rate Perceive Drop Rate Perceive Congestion Rate SDCCH Drop Rate SDCCH Congestion Rate SDCCH Success Rate TBF Failure Rate Cell Availability HO Success Rate
Baseline Week 1 98.53 1.27 0.36 0.43 0.05 99.94 0.12 99.98 97.94
PAC Week 2 99.06031944 0.78547619 0.460227778 0.182572222 0.041752778 99.95783611 0.167116667 99.91286111 97.837375
Comments Improved Improved Maintain Improved Improved Improved Maintain Improved Maintain
* Fill commentswith: Degraded or Maintained or Improved according to current week compared with baseline
6.3
NMS 3G
KPI RRC Success Rate Speech Access Rate PS Access Rate Speech Drop Rate PS Drop Rate RAB Congestion Cell Availability CS IRAT-HO SR
6.4
Baseline Week 1 99.2 99.52 99.2 0.35 3.66 0.02 99.6 99.9
PAC Week 2 99.05585406 99.69875857 98.90206286 0.329594286 0.381028571 0.000741429 99.02810286 99.58664
Comments Maintain Improved Maintain Improved Improved Improved Maintain Maintain
MRR 3G
During LTE Optimization process, some physical tuning might be executed to enhance LTE quality. While in some sites, the antenna is shared between 3G and LTE. Therefore, LTE vendor must provide the MRR before and after physical tuning is executed. The CPICH RSCP must be maintained, or if due to less sample, the deviation of 2% is accepted.
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
No. Checked
40 (52)
Program Sea Hawk 2018
Date
Cluster Name 2018_P5_EJ_4G_140 Reference
Rev
MR RSCP
RSCP Range
MR Number
Percentage (%)
(-65.00_Inf]
1
0.05%
(-75.00_-65.00]
71
3.72%
(-85.00_-75.00]
358
18.75%
(-95.00_-85.00]
1000
52.38%
(-Inf_-95.00]
479
25.09%
Total
1909
100.00%
Reference
MR Number
CAC Result
Status
RSCP ≥ -95 dBm
1430
74.91%
Only for Information
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
No. Checked
41 (52)
Program Sea Hawk 2018
Date
Cluster Name 2018_P5_EJ_4G_140 Reference
Rev
MR EcIo
EcIo Range
MR Number
Percentage (%)
(-4.00_Inf]
0
0.00%
(-8.00_-4.00]
4
0.20%
(-12.00_-8.00]
621
31.10%
(-16.00_-12.00]
1363
68.25%
(-Inf_-25.00]
9
0.45%
Total
1997
100.00%
Reference
MR Number
CAC Result
Status
EcIo ≥ -12 dB
625
31.30%
Only for Information
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
7
No. Checked
42 (52)
Program Sea Hawk 2018
Date
Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
FEATURE
PAC acceptance validates the feature state on each RAN LTE nodes. The validation refers to Bill of Quantity stated in Purchased Order with the actual feature status on the node. The feature may be applicable on the cell level, site level (eNB) or RRC Connected user level. Each LTE vendor may have their own feature ID. We define 2 type of feature: - Basic: standard deliverables on each product package - Optional: selectable feature chosen by customer.
CS Fallback to UTRAN
LOFD-001033
RF
Optional
YES
RECOMME NDED BASELINE ON
CS Fallback to GERAN CS Fallback with LAI to GERAN LoCation Services(LCS) Support of UE Category2/3/4 Enhanced Scheduling Active Queue Management(AQM) Enhanced Admission Control PS Inter-RAT Mobility between E-UTRAN and GERAN Security Mechanism
LOFD-001034
RF
Optional
YES
OFF
OFF
LOFD-001069
RF
Optional
YES
OFF
OFF
LOFD-001047
Product
Optional
YES
OFF
OFF
LOFD-001030
RF
Optional
YES
ON
ON
LOFD-001015
RF
Optional
YES
ON
ON
LOFD-001027
RF
Optional
YES
Trial
Trial
LOFD-001029
RF
Optional
YES
Trial
Trial
LOFD-001020
RF
Optional
YES
OFF
OFF
LOFD-001010
Product
Optional
YES
Intra-LTE Load Balancing
LOFD-001032
RF
Optional
YES
LOFD-070215
RF
Optional
YES
ON Temporary OFF Temporary OFF
ON Temporar y OFF Temporar y OFF
LOFD-001019
RF
Optional
YES
ON
ON
LOFD-001017
RF
Optional
YES
Temporary OFF
Temporar y OFF
LOFD-001052
RF
Optional
YES
ON
ON
LOFD-001053
RF
Optional
YES
OFF
OFF
LOFD-001054
RF
Optional
YES
Temporary OFF
Temporar y OFF
FEATURES
Intra-LTE User Number Load Balancing PS Inter-RAT Mobility between E-UTRAN and UTRAN RObust Header Compression (ROHC) Flash CS Fallback to UTRAN Flash CS Fallback to GERAN Flexible User Steering
FEATURE ID
FEATURE DOMAIN
FEATURE TYPE
BoQ Checking
Current Status ON
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
No. Checked
FEATURES Inter-RAT Load Sharing to UTRAN UL Interference Rejection Combining Automatic Neighbour Relation(ANR) Self-configuration PCI Collision Detection & Self-Optimization Mobility Robust Optimization (MRO) Remote Electrical Tilt Control RIM Based LTE Target Cell Selection DL 2x2 MIMO Enhanced Transmission QoS Management IP Performance Monitoring S1 and X2 over IPv6
Program Sea Hawk 2018
Date
FEATURE ID
43 (52)
Rev
FEATURE DOMAIN
Cluster Name 2018_P5_EJ_4G_140 Reference
FEATURE TYPE
BoQ Checking
RECOMME NDED BASELINE
Current Status
LOFD-001044
RF
Optional
YES
Trial
Trial
LOFD-001012
RF
Optional
YES
ON
ON
LOFD-002001
RF
Optional
YES
ON
ON
LOFD-002004
Product
Optional
YES
ON
ON
LOFD-002007
RF
Optional
YES
ON
ON
LOFD-002005
RF
Optional
YES
OFF
OFF
LOFD-001024
Product
Optional
YES
Scene On
Scene On
LOFD-070203
RF
Optional
YES
LOFD-001001
RF
Optional
YES
Temporary OFF ON
Temporar y OFF ON
LOFD-003011
Product
Optional
YES
ON
ON
LOFD-003012
Product
Optional
YES
LOFD-003017
Product
Optional
YES
Temporary OFF OFF
Temporar y OFF OFF
IPsec Public Key Infrastructure(PKI) Integrated Firewall
LOFD-003009
Product
Optional
YES
OFF
OFF
LOFD-003010
Product
Optional
YES
OFF
OFF
LOFD-003014
Product
Optional
YES
OFF
OFF
S1-flex 2G/3G and LTE Cotransmission UL 64QAM
LOFD-001018
Product
Optional
YES
ON
ON
LOFD-003002
Product
Optional
YES
Scene On
Scene On
LOFD-001006
RF
Optional
YES
ON
ON
Inter-RAT ANR
LOFD-002002
RF
Optional
YES
Trial
Trial
RACH Optimization RF Channel Intelligent Shutdown PSU Intelligent Sleep Mode
LOFD-002015
RF
Optional
YES
Scene On
Scene On
LOFD-001039
Product
Optional
YES
OFF
OFF
LOFD-001056
Product
Optional
YES
OFF
OFF
UL 2x2 MU-MIMO
LOFD-001002
RF
Optional
YES
Intra-eNodeB UL CoMP
LOFD-001066 LOFD00101501 LOFD00101502 LOFD-001094
RF
Optional
YES
Temporary OFF ON
Temporar y OFF ON
RF
Optional
YES
ON
ON
RF
Optional
YES
ON
ON
RF
Optional
YES
Trial
Trial
CQI Adjustment Dynamic Scheduling Control Channel IRC
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
No. Checked
FEATURES
44 (52)
Program Sea Hawk 2018
Date
Rev
FEATURE DOMAIN
FEATURE ID
Cluster Name 2018_P5_EJ_4G_140 Reference
FEATURE TYPE
BoQ Checking
RECOMME NDED BASELINE
Current Status
CS Fallback with LAI to UTRAN
LOFD-001068
RF
Optional
YES
ON
ON
SRVCC to UTRAN
LOFD-001022
RF
Optional
YES
Temporary OFF
Temporar y OFF
LOFD-070207
RF
Optional
YES
Scene On
Scene On
LOFD-070219
Product
Optional
YES
Scene On
Scene On
LOFD-001014
RF
Optional
YES
OFF
OFF
Static TDM eICIC
LAOFD002001
RF
Optional
YES
OFF
OFF
TTI Bundling
LOFD-001048
RF
Optional
YES
Temporary OFF
Temporar y OFF
RF
Optional
YES
OFF
OFF
RF
Optional
YES
Scene On
Scene On
Intelligent Access Class Control IP Active Performance Measurement Dynamic Inter-Cell Interference Coordination
LAOFD081234 LOFD-003029
FeICIC SFN CPRI Compression Cell Outage Detection and Compensation Enhanced Synchronization IPsec for IPv6
LOFD-001076
Product
Optional
YES
OFF
OFF
LOFD-002012
Product
Optional
YES
ON
ON
LOFD-003013
Product
Optional
YES
OFF
OFF
LOFD-003024
Product
Optional
YES
OFF
OFF
Ethernet OAM
LOFD-003004
Product
Optional
YES
OFF
OFF
Antenna Fault Detection Multi-mode BS Common Reference Clock
LOFD-002011
Product
Optional
YES
OFF
OFF
MRFD-231601
Product
Optional
YES
OFF
OFF
Below is the detail log file on feature validation:
Criteria
Result
Remark
Feature status matched with BoQ
Match
Pass
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
7
No. Checked
45 (52)
Program Sea Hawk 2018
Date
Cluster Name 2018_P5_EJ_4G_140 Reference
Rev
Issues, Recommendation and Exclusion Below is the explanation of the KPI that does not meet the target.
7.1.1
Ping Latency 32bit t1
t2
t1'
UE
t3
t2'
eNodeB
t4
t3'
SGW
t4'
PGW
FTP
t1 ≈ t1’、t2 ≈ t2’、t3 ≈ t3’、t4 ≈ t4’ RTT = t1 Ping Latency (UE to FTP) = t1 + t2 + t3 + t4 + t4’ + t3’ + t2’ + t1’ = 34.45 ms (UE ping Huawei FTP) Ping Latency (eNodeB to SGW) = t2 + t2’ = 39 ms Ping Latency(UE to FTP) − Ping Latency(eNodeB to SGW)
t1 +t3 +t4 = 2 RTT = t1 = 1.8ms – t3 – t4 < 8ms (Target)
=
34.45−39 2
= 2.27 ms
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
7.1.2
UE
No. Checked
46 (52)
Program Sea Hawk 2018
Date
Cluster Name 2018_P5_EJ_4G_140 Reference
Rev
Ping latency 1000bit t1
t2
t3
t4
t1'
t2'
t3'
t4'
eNodeB
SGW
PGW
FTP
t1 ≈ t1’、t2 ≈ t2’、t3 ≈ t3’、t4 ≈ t4’ RTT = t1 Ping Latency (UE to FTP) = t1 + t2 + t3 + t4 + t4’ + t3’ + t2’ + t1’ = 46.60ms (UE ping Huawei FTP) Ping Latency (eNodeB to SGW) = t2 + t2’ = 38 ms Ping Latency(UE to FTP) − Ping Latency(eNodeB to SGW)
t1 +t3 +t4 = 2 RTT = t1 = 5.33ms – t3 – t4 < 8ms (Target)
7.2
KPI 2G & 3G
KPI 2G & 3G are maintained
7.3
Justification
=
46.60−38 2
= 4.3ms
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
Bad Spot 1 Bad RSRP SINR DL and UL spot 1
No. Checked
47 (52)
Program Sea Hawk 2018
Date
Root Cause Bad RSRP SINR in line with bad DL and UL throughput Due to coverage issue far from nearest site and contour. Bad spot already covered by main lobe site LTE_KOMBANGAN sec 2 with distance 2.74km
Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
Longitude
Latitude
12.953485°
-7.022186°
Action taken Propose new site at 112.955770° -7.023880° to cover bad spot on potential area
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
Bad spot 2 Bad RSRP SINR and UL spot 2
No. Checked
48 (52)
Program Sea Hawk 2018
Date
Root Cause Bad RSRP SINR in line with UL throughput Due to coverage issue far from nearest site and contour. Bad spot already covered by side lobe site LTE_LERPAK_BANGKALAN sec 2 with distance 1.48 km
Rev
Longitude
112.922513°
Cluster Name 2018_P5_EJ_4G_140 Reference
Latitude
Action taken
-7.031422°
Already do optimization & physical tuning audit on site: LTE_LERPAK_BANGKALAN sector 2 from Mk 1 to Mk 2.
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
No Bad RSRP spot 3
No. Checked
Program Sea Hawk 2018
Date
Root Cause Bad RSRP due to coverage issue far from nearest site and contour. Bad spot already covered by main lobe site LTE_REP_BATUKOCENG sec 2 with distance 1.03 km
49 (52)
Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
Longitude
Latitude
112.910836°
-7.051427°
Action taken Already do optimization & physical tuning audit on site: LTE_REP_BATUKOCENG sec 2 from azimuth 190 to azimuth 195.
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
No
Bad DL spot 4
No. Checked
Program Sea Hawk 2018
Date
Root Cause Bad DL throughput due to coverage issue far from nearest site and contour. Bad spot already covered by main lobe site LTE_SELATAN_GEGER sec 3 with distance 1.56 km
50 (52)
Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
Longitude
Latitude
Action taken
112.048873°
-7.672218°
No potential area
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
No Bad RSRP, SINR, DL and UL spot 5
No. Checked
Program Sea Hawk 2018
Date
Root Cause Bad RSRP SINR in line with bad DL and UL throughput Due to coverage issue far from nearest site and contour. Bad spot already covered by main lobe site LTE_SELATAN_GEGER sec 1 with distance 1.2km
51 (52)
Rev
Cluster Name 2018_P5_EJ_4G_140 Reference
Longitude
Latitude
Action taken
112.938217°
-7.000218°
Propose upgrade bandwidth site LTE_SELATAN_GEGER
LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P Approved Waqas/ Kiki Chandra
No. Checked
52 (52)
Program Sea Hawk 2018
Date
Rev
8 Conclusions We conclude that PAC of Cluster 2018_P4_EJ_4G_222 is: Pass, without note Pass, with note Not pass *Tick one appropriate result
Cluster Name 2018_P5_EJ_4G_140 Reference