STQAC_Test Summary Report
Test Summary Report 1.0 SB Sales Boom Name Draft Preparation
Mr.Karna Ganapathi Muni
Reviewer
Sreevani
Signature
Date
1 Page No. of 10 Template Version No. : 2.0 Template Version Date : 01-05-2007
STQAC_Test Summary Report
Revision History Version 1.0
Date 29/10/08
Summary of changes
2 Page No. of 10 Template Version No. : 2.0 Template Version Date : 01-05-2007
STQAC_Test Summary Report
Table of Contents 1 EXECUTIVE SUMMARY................................................................................................. .......4 2 TEST SCOPE.................................................................................................................. ...........4 3 TEST PLANNING SUMMARY.......................................................................... .....................4 3.1 TEST DOCUMENTS........................................................................................................................4 3.2 PLANNED TEST CASES.................................................................................................................4 3.3 ISSUES DURING TEST PLANNING......................................................................................................5 4 TEST EXECUTION SUMMARY.................................................................. ..........................5 4.1 PLANNED VS ACTUAL SCHEDULE..................................................................................................5 4.2 TEST ITERATIONS.........................................................................................................................5 4.3 TEST CASES EXECUTED.................................................................................................................5 4.4 FEATURES UNTESTED / INVALID......................................................................................................5 4.5 DEFECT MANAGEMENT................................................................................................................6 4.6 ISSUES DURING TEST EXECUTION...................................................................................................6 5 TRACEABILITY MATRIX................................................................................................ ......6 6 DEFECTS SUMMARY................................................................................................ .............6 7 FINAL DEFECT SUMMARY-SEVERITY AND PRIORITY WISE....................................6 7.1 DEFERRED DEFECT SUMMARY.........................................................................................................7 8 DEFECT METRICS............................................................................................................ ......7 8.1 MODULE -WISE DEFECTS.........................................................................................................8 8.2 STATUS-WISE DEFECTS.................................................................................................................8 8.3 SEVERITY-WISE DEFECTS..............................................................................................................8 8.4 PRIORITY-WISE DEFECTS..............................................................................................................8 9 DEFECT ANALYSIS.......................................................................................................... .......9 9.1 RISKS........................................................................................................................................9 9.2 OBSERVATIONS.............................................................................................................................9 10 TEST TEAM..................................................................................................... .......................9 11 ANNEXURES............................................................................................................ .............10
3 Page No. of 10 Template Version No. : 2.0 Template Version Date : 01-05-2007
STQAC_Test Summary Report
1 EXECUTIVE SUMMARY Salesboom is a world leader in on demand Customer Relationship Management (CRM) and Enterprise Resource Planning software (ERP) business software solutions for the SMB market. Salesboom on demand platform drives innovation, enables business change, and enriches customer relations across the enterprise. Salesboom is a thought leader in CRM and enterprise applications. By building there software completely from the ground up, Salesboom has created what has come to be one of the most powerful and dynamic hosted CRM & ERP solutions available in the market today
2 TEST SCOPE The Scope of the Testing is to perform effective Functional Testing (or) Black Box testing to ensure that the application does not contain any critical or major defects.
3 TEST PLANNING SUMMARY 3.1 Test documents Executed Test ware by Module wise:
Salesboom_Optimise salesboom_Optimise Salesboom_optimize_ salesboom_Optimise d_Accounts_Quotes_Com mission Program s.xls d_Projects_Receipts_Expense Reports V2.0.xls Contacts_Cases_Solutions_Com d_forecasts_hom missions V2.0.xls epage_reimbursement_empl
Salesboom_Optimize _Opportunity_Timesheets_Products V2.0.xls
3.2 Planned Test Cases Module Name Accounts, Quotes, Commission Program Projects, Receipts, Expense Report Opportunity, Product, Time Sheet Contacts, Commission, Cases, Solution Forecasts, Homepage, Reimbursement, Employee Contract, Signup, Campaign, Policies Login, Invoice, Violation, Leads
Test Cases Planned 600 650 1050 1000 300 400 1000
4 Page No. of 10 Template Version No. : 2.0 Template Version Date : 01-05-2007
STQAC_Test Summary Report
3.3 Issues during Test planning • •
• •
Unavailability of Functional and Business Requirement document Unable to interact with client Understanding the functionality of the application with the help of customer Support Product Prototype is used during Test Planning and Execution stage
STC has faced all the above challenges and successfully understood the functionality and architecture and provided end-to-end testing services to the Binary Stream
4 TEST EXECUTION SUMMARY 4.1 Planned Vs Actual Schedule Salesboom_Project_ Plan-Ver1.0.xls
Project Deviation Details.doc
4.2 Test Iterations STC has tested the Multi Facility Processing using the comprehensive iteration type and executed all the planned test cases. STC is capable to do one more cycle of testing in the next stage once we receive the feed back form Binary Stream
4.3 Test Cases executed Module Name Accounts, Quotes, Commission Program Projects, Receipts, Expense Report Opportunity, Product, Time Sheet Contacts, Commission, Cases, Solution Forecasts, Homepage, Reimbursement, Employee Contract, Signup, Campaign, Policies Login, Invoice, Violation, Leads
Test Cases Planned 600
Test Cases Executed 525
Test Cases Pass 386
Test Cases Failed 139
650
609
527
82
1050 1000
1000 934
892 774
108 160
300
258
249
9
400
331
303
28
1000
956
771
185
4.4 Features untested / invalid < N/A> 5 Page No. of 10 Template Version No. : 2.0 Template Version Date : 01-05-2007
STQAC_Test Summary Report
4.5 Defect Management < N/A>
4.6 Issues during Test Execution < N/A>
5 TRACEABILITY MATRIX
SB_Projects,Receipts SB_Accounts,Quotes SB_Contacts,Commis B_FORECASTS-HOM SB_OPPORTUNITIES ,Expense Report_Traceability ,Comm Matix.xls ission Programs_Traceability sions,Cases Matrix.xls and Solution_Traceability EPAGE-EMPLOYEE-REIM_Traceability Matrix.xls _PRODUCTS_TIMESHEETS_Traceability Matrix.xls Matrix
SB_SIGNIN-LEADS-I SB_CAMPAIGN-CON NVOICES-VIOLATION_Traceability TRACTS-POLICIES-SIGNUP_Traceability Matrix.xls Matrix.xls
6 DEFECTS SUMMARY 7 FINAL DEFECT SUMMARY-SEVERITY AND PRIORITY WISE Defect Summary-Module wise Module Name Accounts, Quotes, Commission Program Projects, Receipts, Expense Report Opportunity, Product, Time Sheet Contacts, Commission, Cases, Solution Forecasts, Homepage, Reimbursement, Employee Contract, Signup, Campaign, Policies Login, Invoice, Violation, Leads Total
Final Defects 139 82 108 160 9 28 185 713
6 Page No. of 10 Template Version No. : 2.0 Template Version Date : 01-05-2007
STQAC_Test Summary Report
Defect Summary-Severity Wise Module Name Accounts, Quotes, Commission Programs Projects, Receipts, Expense Report Opportunity, Product, Time Sheet Contacts, Commissions, Cases, Solution
Severity 1
Severity 2
Severity 3
139
139
78
4 Forecasts, Homepage, Reimbursement, Employee Contract, Signup, Campaign, Policies Login, Invoice, Violation, Leads Total
Total
4
82
108
108
156
160
9
9
28
28 185 713
Defect Summary-Priority Wise Module Name Accounts, Quotes, Commission Programs
High
139 81 108
Projects, Receipts, Expense Report Opportunity, Product, Time Sheet Contacts, Commissions, Cases, Solution 4 Forecasts, Homepage, Reimbursement, Employee Contract, Signup, Campaign, Policies Login, Invoice, Violation, Leads Total
Medium
156 9 28
Low 1
Total 139 82 160 9 28 185 713
7.1 Deferred defect summary
8 DEFECT METRICS This section provides Pie Charts for the total defects from each module, defects by Status, defects by Priority, defects by Severity under.
STQAC_Status of Defects.xls
7 Page No. of 10 Template Version No. : 2.0 Template Version Date : 01-05-2007
STQAC_Test Summary Report
8.1 MODULE -wise Defects Module Name Accounts, Quotes, Commission Programs Projects, Receipts, Expense Report Opportunity, Product, Time Sheet Contacts, Commissions, Cases, Solution
Defects 139 82 108 160
Forecasts, Homepage, Reimbursement, Employee Contract, Signup, Campaign, Policies Login, Invoice, Violation, Leads
9 28 185
8.2 Status-wise Defects Status
Count
New Deferred Reject Open Reopen Fixed Retest Closed
8.3 Severity-wise Defects Severity
Count
Severity 1 Severity 2 Severity 3
8.4 Priority-wise Defects Sub-Status
Count
Low Medium High
8 Page No. of 10 Template Version No. : 2.0 Template Version Date : 01-05-2007
STQAC_Test Summary Report
9 DEFECT ANALYSIS 9.1 Risks
9.2 observations
10 TEST TEAM Test Lead Test Engineers
Mr. Devesh Vinod Kumar Siva Rama Raju Vishnu Vardhan Shekhar Veena Saira Bano Spandana
Test Lead Roles and Responsibilities: • • • • • •
•
Client coordination, escalation & reporting. Test planning, progress tracking and status reporting. Incident Reports review. Preparation of test exit Report. Review defect logs & test logs. Conduct defect review meetings. Publish defect reports.
Tester Roles and Responsibilities: • • • • •
Prepare Test Conditions and Test cases. Prepare Data Guidelines/Requirements. Prepare Test execution plan. Execute Test cases and record results. Prepare defect Logs and defect reporting
9 Page No. of 10 Template Version No. : 2.0 Template Version Date : 01-05-2007
STQAC_Test Summary Report
11 ANNEXURES
10 Page No. of 10 Template Version No. : 2.0 Template Version Date : 01-05-2007