SalesBoom_ Test Plan Ver1.0
Test Plan ver 1.0
www.SalesBoom.com
Name Draft Preparation
Mr.Karna Ganapathi Muni (STC)
Reviewer
Mr.Thirumal Raj(STC)
Signature
Date
Accepted By
--------------------------------------------------------------------------------------------------------------------------------Copyright © 2008. STC ThirdEye, All rights reserved. All information contained in this document is the property of STC ThirdEye Technology. The contents of this document are not to be disclosed by the recipients to third parties, neither allowed to be reproduced by or for third parties in any form or by any means, electronic nor mechanical, including photocopying, without prior written permission from STC ThirdEye.
Version 1.0
STC ThirdEye Confidential
Page 1 of 11
SalesBoom_ Test Plan Ver1.0
REVISION HISTORY Version
Version 1.0
Date
Summary of changes
STC ThirdEye Confidential
Page 2 of 11
SalesBoom_ Test Plan Ver1.0
TABLE OF CONTENTS
1. CLIENT INTRODUCTION 1.1 1.2
4
PURPOSE OF THIS DOCUMENT CLIENT AND BUSINESS
2. TEST SCOPE 2.1 2.2 2.3
4
FUNCTIONAL TESTING INCLUSIONS ASSUMPTIONS
3. TEST ENVIRONMENT 3.1 HARDWARE, SOFTWARE AND TOOLS 4. TEST APPROACH 4.1 4.2 4.3 4.4 4.5 4.6
5 6 7 8 9
10 11 12
FUNCTIONALITY TESTING APPROACH TEST TYPES TEST CYCLES INTERACTION MODEL BETWEEN STC AND SALESBOOM 7 SUSPENSION AND RESUMPTION EXITCRITERIA
HIGHLEVEL DELIVERY SCHEDULE RESOURCES ROLES AND RESPONSIBILITIES RISKS CONTINGENCY AND MITIGATION PLAN TEST RESULTS 9.1 9.2 9.3 9.4 9.5 9.6
DEFECT LOGGING DEFECT REPORTING DEFECT CLASSIFICATION DEFECTS CLASSIFICATION BY STATUS DEFECTS CLASSIFICATION BY SEVERITY DEFECTS CLASSIFICATION BY CATEGORY
DELIVERABLES DISTRIBUTION LIST ABOUT STC
Version 1.0
4 4 4 5 5
5 5 5 6 7 7 7 8
8 8 8 8 9 9 9 9 10 10 10
11 11 11
STC ThirdEye Confidential
Page 3 of 11
SalesBoom_ Test Plan Ver1.0
1. CLIENT INTRODUCTION 1.1 PURPOSE OF THIS DOCUMENT This document details the engagement between STC ThirdEye Technology (India) Pvt Ltd, and Salesboom for the purpose of End- to- End Testing Services. After understanding the scope and Base Line documents STC understood that testing will be start Functional Testing (or) Black Box testing to ensure that the application does not contain any critical or major defects. The methodologies used to setup and execute functional testing of the Salesboom application will be documented with results and all observations and/or recommendations noted. 1.2 CLIENT AND BUSINESS Salesboom is a world leader in on demand Customer Relationship Management (CRM) and Enterprise Resource Planning software (ERP) business software solutions for the SMB market.Salesboom has over 23,000 subscribers, 3000 customers in over 148 countries around the world. Salesboom on demand platform drives innovation, enables business change, and enriches customer relations across the enterprise. Salesboom is a thought leader in CRM and enterprise applications. By building our software completely from the ground up, Salesboom has created what has come to be one of the most powerful and dynamic hosted CRM & ERP solutions available in the market today. 2. Test scope The STC ThirdEye Technology (India) Pvt Ltd has been engaged to provide Functional testing of Salesboom software of Salesboom. The STCThirdEye Technology (India) Pvt Ltd will provide testing consultation to help define the testing approach and assist in meeting all business requirements 2.1 FUNCTIONAL TESTING The scope of the testing to provide Functional Testing (or) Black Box testing of the Salesboom software of Salesboom Inc. The STC ThirdEye Technology (India) Pvt Ltd will provide testing consultation to help define the testing approach and assist in meeting all business requirements. A series of application unit tests and an application functional benchmark test will be conducted for this purpose. The results will be useful to SALESBOOM for future functional evaluations. STC ThirdEye Technology (India) Pvt Ltd aims to find how well the system executes the functions it is supposed to execute-including user commands, data manipulation, searches and business processes, user screens, and integrations. Our testing procedure covers the obvious surface type of functions, as well as the back-end operations. Our experts test the individual components and processes before testing the entire system. We use industry standard defect tracking tools to track defects in the system and deliver detailed test metrics at the end of each test cycle. Based on the product functionality testing cycle we conduct Regression testing which ensures the proper behavior of an application after fixes or modifications are made to the system or its environment. Version 1.0
STC ThirdEye Confidential
Page 4 of 11
SalesBoom_ Test Plan Ver1.0
2.2INCLUSIONS STC ThirdEye is responsible to test the salesboom software which has been provided by SALESBOOM. S.no 1
Baseline Name http://secure2.salesboom.com/crm_logout.html
2.3ASSUMPTIONS Functional Testing of the Website is completed and the website is fit for use. Testing will be carried out in non-working hours. Testing will be carried out in 512 mbps bandwidth. Internet Explorer version 6.0 will be used during testing. All testing activity will be carried out against mutually agreed scope. All software components of the website have been unit and integration tested by the development team.
3. TEST ENVIRONMEMT 3.1 HARDWARE, SOFTWARE AND TOOLS Sno 1 2 3 4 Sno 1 2 3 4
Hardware CPU - Speed RAM Hard-disk Space Network Configuration Software Operating System Application Software Database Server Browser
Requirements Dual Core2.26 GHz Processor 2 GB 40 GB Web Application Requirements Windows XP Salesboom SalesBoom MSSQL IE 7.0
4. TEST APPROACH STC Third Eye follows unique test approach to assure client requirements and achieve 100% test coverage. The generic high-level stages, which will be performed by the test team during the course of testing the software, will include:
Version 1.0
STC ThirdEye Confidential
Page 5 of 11
SalesBoom_ Test Plan Ver1.0
4.1 FUNCTIONALITY TESTING APPROACH # 1
2
Stage Knowledge Transfer (one time)
Test Planning
Key activities • All project related functional documents, current test plans and test ware are obtained to gain an understanding of the testing requirements. • Team generates a clarification list to the business users on areas where more clarity is required. The clarification responses are processed, analyzed and absorbed. • Face to face meeting with business users • Training programs on product features, application systems, current testing process and any related tools • Reverse presentations to iron out gaps in understanding • Training to the rest of the team offshore • Preparation of test strategy • Preparation of test scenarios and test functions • Preparation of test conditions • Test Data preparation • Salesboom Team will supplement wherever data is insufficient
Location STC ThirdEye premises
Deliverables • •
STC ThirdEye premises
• • • • • •
3
4
Pre Test execution due diligence
•
Test Execution
• •
• • •
Version 1.0
STC shall supply a “ZERO DAY” Checklist to SALESBOOM Inc.This shall contain the expected resources and functionalities in the SIT environment for proper start of test execution.
STC ThirdEye premises
•
Review and fine tuning of the execution plan Test execution Test execution will be carried out in a separate controlled test environment provided by SALESBOOM, One comprehensive and one regression iterations of testing are proposed One week gap shall be allowed after iteration 1 for rectification of defects
STC ThirdEye premises
• • •
STC ThirdEye Confidential
•
• •
Clarification Tracker GAP Document
High-level Test Plan Test Strategy Test Conditions Test case Test scenarios Test Data
Day Zero Check List Execution Plan
Defect Log Defect Report Final Defect Report Traceability Matrix Test Summary Report
Page 6 of 11
SalesBoom_ Test Plan Ver1.0
#
Stage
Key activities raised by STC ThirdEye and resetting the environment for iteration 2 execution • Defect reporting and co ordination • Preparation of test summary reports
Location
Deliverables
4.2 TEST TYPES After discussions held with Salesboom, STC Third Eye agreed to carryout only Functional Testing
4.3 TEST CYCLES STC will carry out Testing of this project in one cycle, i.e Comprehensive and the other cycle Regression will be performed on additional cost to assure 100% coverage to the requirements.
Comprehensive cycle- In this cycle all the planned scenarios will be executed and system bottlenecks will be identified and reported to Salesboom. Regression cycle- This cycle will be carried out only after the bottlenecks identified in the pervious cycle have been eliminated by the developers of the website. In this cycle all the fixed bottlenecks and the dependent functionality will be executed to make sure that fixes are not affecting the existing functionality.
4.4INTERACTION MODEL BETWEEN STC AND SALESBOOM Salesboom has to arrange single point of contact to escalate all the issues till the closure phase of the Testing STC will also provide a single point of contact from engagement to till Closure of the Testing The Turn around time for review of all the Test ware documents will be 24 hrs. If the turn around time is greater than 24 hrs, Date of delivery schedule will be revised 4.5 SUSPENSION AND RESUMPTION
4.5.1SUSPENSION The following are circumstances under which, STC ThirdEye will suspend the testing Encountering the showstopper at the application level (or) showstopper at the module level which is critical for the functioning of the application On Transfer of the Wrong Soft base On Failure of Test Environment Any other circumstances (or) situations when the test team is conceived that the testing can’t be continued. On the request from Salesboom
4.5.2Resumption Version 1.0
STC ThirdEye Confidential
Page 7 of 11
SalesBoom_ Test Plan Ver1.0
STC ThirdEye Test Manager will resume the suspended testing on resolving the situation, which resulted in the suspension (or) on the specific request from client 4.6 EXIT CRITERIA
All the Planned Test scenarios and script should be executed and if there is any pending, necessary reason should be provided. On Preparation of final analysis report. 5. HIGH LEVEL DELIVERY SCHEDULE High level schedule for initiation, planning, Test ware Preparation, execution and Test Closure will be delivered as an Annexure Functional Testing Phase KT Planning Execution Closure
Start Date
End Date
18/08/2008
28/08/2008
29/08/2008
30/09/2008
01/10/2008
23/10/2008
24/10/2008
28/10/2008
6. RESOURCES 6.1 PERSONNEL A detailed document will be submitted to client after strategy sign-off
7. ROLES AND RESPONSIBILITIES Test Lead Roles and Responsibilities:
Client coordination, escalation & reporting. Test planning, progress tracking and status reporting. Incident Reports review. Preparation of test exit Report. Review test logs. Conduct review meetings. Publish reports. Preparation of Test Summary Report
Version 1.0
STC ThirdEye Confidential
Page 8 of 11
SalesBoom_ Test Plan Ver1.0
Tester Roles and Responsibilities:
Prepare Test Scenarios and Test scripts. Prepare Data Guidelines/Requirements. Prepare Test Scenarios execution plan. Execute Test Scenarios and record results. Prepare Summary and Detail analysis reports
8. RISKS CONTINGNECY AND MITIGATION PLAN Risk Description Delayed Review /feedback and
Probability
Impact
High
High
sign-off from client
Mitigation Plan Frequently follow-up with client, Revise Schedule/Cost
Change in the Scope of the project Unclear and unfrozen requirements
Medium High
High High
Revise schedule/cost for any rework. Availability of a Business Team to provide
Delay in issues resolution
Medium
Medium
faster resolution to all issues raised. Wait till issues are solved. Availability of resource to clarify on the issues listed.
9. TEST RESULTS
9.1 DEFECT LOGGING The defects raised by the testing team are made available to the development team at the earliest. All the defects will be logged in defect management system with necessary screen shot After Code fix only STC is responsible to either close the defect or reraise the defect If the Binary Stream is unable to fix the defect, necessary reason should be given to STC Binary Stream has the rights to defer the defect to next release with appropriate reason 9.2 DEFECT REPORTING All the defects encountered during the test execution will be logged into the defect management system. Defects will be categorized and reported based on the Severity, Priority and Category Defect expected resolution Date and status of open defects will be discussed during Daily/Weekly defect review meetings After discussion held with Binary Stream either the below template (or) test management tool will be used to report the defects
9.3 DEFECT CLASSIFICATION STC ThirdEye will classify the defects based on Status, Severity and category Version 1.0
STC ThirdEye Confidential
Page 9 of 11
SalesBoom_ Test Plan Ver1.0
9.4 DEFECTS CLASSIFICATION BY STATUS Status Raised/New Authorized Fixed Deferred Retest Closed Re-Raised
Description All new defects logged in the defect report are assigned this status Status assigned on customer acceptance or a raised defect and continues to remain in “authorized” status till the defect resolution is provided This Status would be assigned by Development once fix is done to the defect This Status would be assigned when the customer decides to defer the fix to the next release All the defects identified for retest based on developer communication Defects closed after successful execution of the test case This status is assigned if the defect persists after retest
9.5 DEFECTS CLASSIFICATION BY SEVERITY Severity Severity1 Severity2 Severity3 Severity4
Description These will be very serious defects that do not allow testing to proceed further and should be rectified for the testing to continue These defects are serious from business/customer point of view User can decide whether these need to be fixing before transfer to production Other defects that do not qualify as show stopper
9.6 DEFECTS CLASSIFICATION BY CATEGORY Category Name Code Change Document Change Data Related Parameter Setup User Maintenance Environment Tester Error Modify Cases Duplicate New Requirement Discussion Item
Description A defect which necessitate change(s) to the application code and has to be corrected by the development team Functionalities present in the application, but missing (or) not presented in the Business Requirements (or) other base line documents Defects that arise due to incorrect/specific nature of data used for testing Defect caused by incorrect Masters (or) Parameter Setup Defect caused due to incorrect maintenance Defects specific to Test Environment Incorrect defect raised by Tester Not accepted by customer as a defect, which results in modification of the test ware A Defect which is duplicate of another defect requiring a single fix This arises when the specific requirement is not explicitly mentioned in the BR/FS (or) any other base line documents-Confirmation from Development A defect which doesn’t fall logically into any of the other categories listed needs further investigation/discussion for categorization
10. DELIVERABLES Based on the discussion held with SALESBOOM, STC will deliver the below listed documents Version 1.0
STC ThirdEye Confidential
Page 10 of 11
SalesBoom_ Test Plan Ver1.0
Analysis Detail Reports High level Test Conditions Test Cases Test Data Test Script Test Pass Logs Defect Logs Defect Report Traceability Matrix Test Summary Report
11. DISTRIBUTION LIST Organisation Name SalesBoom STC ThirdEye Technology India Pvt Ltd
No of Copies 1 1
12. ABOUT STC THIRDEYE STC ThirdEye Technology (India) Pvt Ltd, is India’s largest niche I.T services organization providing independent End-to-End testing Services We build and operate dedicated India-based testing centers for our customers with the latest computing and data communication technologies, and deliver our services, with high standards of security and confidentiality. Consistent qualities of deliverables under compressed time schedules enable us to get repeat business. We help Fortune 500 ERP, BFSI, Healthcare, Gaming and Telecom solution providers Working with STC ThirdEye-ERP testing specialists will: • • • • •
Allow you to better manage the ERP implementation Increase the quality and ROI of your ERP solution Increase end-user confidence Reduce the cost and duration of the implementation Result in re-usable regression tests for future upgrades and maintenance
We are ISO 9001:2000 certified organization. For more details, please visit us at Visit us at www.stcthirdeye.com
Version 1.0
STC ThirdEye Confidential
Page 11 of 11