Mercury Business Process Testing Faster, Easier and Smarter Quality Assurance
SPAN Technologies www.spantechnologies.com
Agenda Objective Need for Automation Challenges with Traditional Automation BPT: the Big Picture BPT Addresses Traditional Automation Challenges BPT: Other Benefits Case Studies Q&A Copyright: SPAN Technologies and Mercury 2006. 2
Objective
To promote an understanding of business process Testing and its benefits for: – Users considering Mercury tools for automation – Existing users of QTP and Quality Center – Users who recently acquired BPT
Demographics
Testers
Automation Experts
Directors
LOB Owners
Managers
System Architects
Copyright: SPAN Technologies and Mercury 2006. 3
Need for Automation
Rapid execution of test scripts Repeatable, reliable, unattended testing Extensive enterprise environment and test plan coverage Accurate defect replication Platforms
1
Intel
Operating Systems
6
Windows XP, Windows ME, Win 2000, Win NT 4, Win 2003
Front End Clients
4
Internet Explorer 6, Netscape 6, Java, Visual C++
Business Processes
5
Data Sets
15
Total Tests to Run
Login, Search, Order Entry, Order Confirmation, Order Fulfillment Combinations of various usernames, passwords, search strings, order numbers, ship dates
1 X 6 X 4 X 5 X 15 = 1,440 Copyright: SPAN Technologies and Mercury 2006. 4
Challenges with Traditional Automation SMEs and Automation Experts Are Disjointed Subject Matter Experts
Test Automation
Business Requirements
Subject Matter Experts design requirements and test cases very early in the life cycle. Test Automation requires a fairly stable application, which is not available till much later in the life cycle. – Duplication of effort in documentation and application expertise – Lack of collaboration between SMEs and Automation Experts – Planning for automation does not start till stable application is available
Copyright: SPAN Technologies and Mercury 2006. 5
Challenges with Traditional Automation Automation Expert
SME
Tester
Not role-based—too many overlaps in duties Project 1 QTP Experts
Lack of standards in automation
Project 2 QTP Experts
Decentralized—inefficient use of resources
High maintenance without intelligent framework
Copyright: SPAN Technologies and Mercury 2006. 6
Challenges with Traditional Automation Summary Lack of collaboration between SMEs and automation experts Not role-based—too many overlaps in duties Decentralized—inefficient use of resources Lack of standards in automation High maintenance without an intelligent framework How does BPT address these challenges? Copyright: SPAN Technologies and Mercury 2006. 7
BPT: the Big Picture Mercury Quality Center™ Dashboard
TestDirector Requirements Management
Test Plan
Test Lab
Functional Testing QuickTest Professional
Defect Management
Business Process Testing Accelerators for SAP, Oracle, Security
WinRunner
Foundation Shared Data Repository
Central Administration
Workflows
Open APIs
Delivery Options Mercury Managed Services
Combination
Copyright: SPAN Technologies and Mercury 2006. 8
In-house Deployment
BPT: the Big Picture Requirements and design and test documentation
Development and initial build
Planning, automation framework
Developers
Automation QTP Experts Framework
Traditional Automation SMEs
SMEs
QTP Experts
Planning, build components, flows
Map objects
SMEs, Testers
Automation
Run tests
QTP Experts
QTP Experts
SMEs, Testers
Business Process Testing Automation Run tests
Copyright: SPAN Technologies and Mercury 2006. 9
Testers, QTP Experts
Modify tests
Modify tests
QTP Experts
BPT: the Big Picture
Additional Quality Center module A layer of abstraction between Requirements and Test Plans Structurally, Business Components are similar to reusable functions and actions in QTP
Copyright: SPAN Technologies and Mercury 2006. 10
BPT: the Big Picture SME Creates and Defines Business Components
Copyright: SPAN Technologies and Mercury 2006. 11
BPT: the Big Picture Creates Defines Business Components into Tests SME Assembles Creates and and DefinesBusiness BusinessComponents Components
Copyright: SPAN Technologies and Mercury 2006. 12
BPT: the Big Picture SME Can Reuse Business Components in Multiple Tests Login Component
Test One
Test Four
Test Two
Test Three
Copyright: SPAN Technologies and Mercury 2006. 13
BPT: the Big Picture QTP Experts Build the Automation Assets
QTP experts work behind the scenes creating the automation assets for the business components created by SMEs – – – – –
Implement function libraries Create object repositories Define application areas Define recovery scenarios Manage all resources in Quality Center
In this model, QTP experts focus purely on automation, with minimal knowledge of the application. SMEs/Testers then assemble and execute the tests and analyze the results.
Copyright: SPAN Technologies and Mercury 2006. 14
BPT: the Big Picture Easy Keyword-driven Approach for Automation
Once the automation assets have been developed by the QTP expert, automation is just a matter of using the keyword-driven approach to create test scripts
Copyright: SPAN Technologies and Mercury 2006. 15
Challenges with Traditional Automation Summary Revisited Lack of collaboration between SMEs and automation experts Not role-based—too many overlaps in duties Decentralized—inefficient use of resources Lack of standards in automation High maintenance without an intelligent framework How does BPT address these challenges? Copyright: SPAN Technologies and Mercury 2006. 16
BPT Addresses Traditional Automation Challenges Enables Collaboration of Business Users, Technical Automation Engineers Mercury Business Process Testing
Subject Matter Experts
Login Component
Business Requirements
PO Component
Data
Automation Experts
Invoice Component
Application Keywords
Centralized QA automation experts enable business experts via Mercury Business Process Testing
Subject-matter experts build, data-drive, and execute automated tests via web
Collaboration
Reuse of documentation Copyright: SPAN Technologies and Mercury 2006. 17
Early automation
BPT Addresses Traditional Automation Challenges Role-based Testing—Optimal Use of Resource Time
SME
QTP Expert
Defines business processes Defines and implements the components Combines the ready components into complete processes
Clear definition of roles
Builds the object repository Builds user-defined functions Builds application areas Builds recovery scenarios
Tester
Runs and analyzes test results
Optimal use of expertise
Copyright: SPAN Technologies and Mercury 2006. 18
BPT Addresses Traditional Automation Challenges Centralized and Standardized
Each project has its own SMEs and testers, but shares centralized automation experts with other projects in the organization – Need for fewer specialized automation experts, efficient use of resources – Facilitates efficient use of third-party vendors for automation – Sharing of knowledge and best practices between projects – Easier to implement automation standards given a central team
Efficient use of resources
Standardized automation
Copyright: SPAN Technologies and Mercury 2006. 19
BPT Addresses Traditional Automation Challenges Built-in Framework Reduces Maintenance
BPT entails the use of business components as building blocks for more complex business scenarios. This built-in framework enforces modularization. – When the application changes, all test scripts do not need to change. – Typically, business components do not change in a logical sense, only the underlying application and objects – Maintenance is quick and behind-the-scenes
Enforces modularization
Reduces maintenance
Copyright: SPAN Technologies and Mercury 2006. 20
BPT: Other Benefits Requirements and design and test documentation
Development and initial build
Planning, automation framework
Developers
Automation QTP Experts Framework
Traditional Automation SMEs
SMEs
QTP Experts
Planning, build components, flows
Map objects
SMEs, Testers
Automation
Run tests
QTP Experts
QTP Experts
SMEs, Testers
Business Process Testing Automation Run tests
Copyright: SPAN Technologies and Mercury 2006. 21
Testers, QTP Experts
Modify tests
Modify tests
QTP Experts
BPT: Other Benefits Business Sign-off Since the SMEs are involved in the creation of test scenarios, automation will make intuitive sense to them. This facilitates easier business sign-offs Auto-Documentation Single point of entry for documentation combined with the autodocumenting features of BPT will dramatically reduce the documentation effort. Scalability Since this model is not build around individual contributors, it is highly scalable. Efficient use of resources and a centralized model contributes to the scalability as well.
Faster, easier and smarter quality assurance
Copyright: SPAN Technologies and Mercury 2006. 22
Mercury Business Process Testing The Business-centric Quality Automation Solution
Provides entire QA team with collaborative solution Starts quality automation process sooner Automates maintenance and reduces costs Ensures visibility and verification with auto-documentation Copyright: SPAN Technologies and Mercury 2006. 23
Raymond James Leading US Financial Services Provider “Mercury Business Process Testing is our standard for functional testing. It enables our QA and Business Teams to operate as one, allowing the testing process to be more efficient and effective. ” Leanne Stumph, QA Management
Solution
Challenge
Business Teams unable to use traditional test automation tools QA team unable to handle volume of application changes Buy vs. build test automation framework
Mercury Quality Center Mercury Business Process Testing
Result
Copyright: SPAN Technologies and Mercury 2006. 24
Mercury Business Process Testing chosen as a result of buy vs. build feasibility study Team of 14 QA engineers and Business Analysts support 200+ Developers 50% reduction in compatibility testing time Existing test automation assets leveraged with Mercury
Avaya Global Leader in Communications Systems “Mercury Business Process Testing helps us align our project and testing teams so that line of business owners can set up the right business scenarios and tests for our applications. Instead of a long manual testing process, we now have an agile testing platform that keeps our applications finely tuned to support our business objectives and provide better service to our customers.” Dave Bishop, Sr. Manager, IT Applications
Solution
Challenge
Testing activity for billing app manual and documented in spreadsheets Text execution manual for string/functional and integration testing Defects, daily completion, and pass/fail stats tracked manually
Mercury Quality Center Mercury Business Process Testing
Result
Copyright: SPAN Technologies and Mercury 2006. 25
Testing activities more aligned with needs of the business Testing cycles shortened Testing and resulting stats more accurate