Sfs Test Automation

Test Automation

Presentation by ABDUL KALAM Synergy Financial Systems Limited

1

Who Are We: Financial Software Provider Company

• Headquartered in United kingdom. Location throughput … • Experts professionals • Rapidly growing and profitable

Synergy Financial Systems Limited

2

Agenda • Software Testing Challenges – Automation Context • Test Automation Perspective • Value Proposition • Synergy Test Automation Process (STAP) • Test Automation Architecture • Test Automation – Demo • Synergy Expertise

Synergy Financial Systems Limited

3

Software Testing Challenges: Regression Testing •Third Party Products •Deployment Config

Test Object

•Database •Operating System •Browser  Bug Fixes  Minor Modifications  New Functionality  Integrations

Test Environment

 Service Packs Synergy Financial Systems Limited

 Patches  Interfaces

4

Software Testing Challenges : Coping with development Development time Version 1.0 5000 days

Version 2.0 2500 days

Version 3.0 2000 days

Test time Version 1.0 5000 days

*

Version 2.0 + 1.0 *Version 3.0 + (2.0 + 1.0) * 2500 + 2500 days2000+ 1250 + 2000 days

Impact Analysis testing Synergy Financial Systems Limited

5

Test Automation(TA) : Perspective • TA aims at improving the effectiveness and efficiency of the test process throughout system life cycle. • TA helps in being able to test quickly & consistently • TA is not a good by itself, value addition to manual test • TA demands a paradigm shift from ‘tool-orientation’ to ‘process orientation’. • TA is long term investment.

Synergy Financial Systems Limited

6

Test Automation : Value Proposition  Reduction in testing costs  Un-attended  repeatability  Less machines & Improved machine utilization  QA engineers can focus on Kernel test activities  Shortened test lead times  Manual test effort reduction  Better Speed in executing tests  Re-usable test ware  Monitoring ‘Quality’:Health of the product  Insight about the risks Quickly  Consistency across test runs  Test frequently and thoroughly Synergy Financial Systems Limited

7

Should I go for Test Automation.. It depends         

Test effort levels Test Process maturity Organizational readiness Quality of documentation Quality of Test Documentation Knowledge levels of test automation Technical knowledge of the testing crew Business risks involved in not doing regression testing Stability, complexity and future plans of Application\Product

Synergy Financial Systems Limited

8

Synergy Test Automation Process (STAP) Objective: Improving the effectiveness and efficiency of the total Test Process by making use of test automation.

Strategy: Analysis of opportunities. Implementation of an architecture for the test suite.

Synergy Financial Systems Limited

9

STAP Feasibility Study Proof of Concept

Identify the Scenarios Design/Record the Script Modify the Test Script Run the Test Script Test Suite Maintenance Synergy Financial Systems Limited

10

Feasibility Study Test Related Feasibility: Objective & scope of the test How much % of application can be automated Organization Related Feasibility: Possible investments and Expectations Over all maturity of the process Technology Feasibility: Stability of Application under test (AUT) Test tool suitability

Synergy Financial Systems Limited

11

Proof of Concept (POC): POC helps in understanding the reality of Automation. 2 Major and critical test scenarios will be selected and the same are automated in terms of work flow and data flow. Result of Automation is re-usable scripts with application and data integrity. POC will help the client to understanding automation efforts and experience the time saving and capabilities of Synergy Test Automation skills.

Synergy Financial Systems Limited

12

STAP…. Identify the Scenarios: All the End-End scenarios will identified with data interactions for the automation. This scenarios are like a business flows. Design & Record the scripts: Design Hierarchical directory structure, naming conventions, coding standards, modular, single point maintenance, error recovery, checkpoint, logging, synchronization, and configuration management The basic skeleton is achieved using the tool and process is designed according to business flow. Modify the test scripts: Test scripts will be modified with necessary GUI check points, loops, conditions and constraints. Run the test scripts: Test scripts are run with real-time data for all the regression cycles. Synergy Financial Systems Limited

13

STAP… Test Suite Maintenance(TSM): TSM is fully dependent of Test Architecture. Test Architecture is friendly for incorporating the new functionality, work flow and GUI changes.

Synergy Financial Systems Limited

14

Test Architecture

Data tables

Business

Business

Function 1 Business

Function

Driver Script

N

Function 2

Cleanup

Generic Function 1 Generic Function 2 Generic Function N

Scripts

Log Files

Object Repository

Reports

Synergy Financial Systems Limited

15

Test Architecture Driver Script : Each test script is independent of the other scripts. Driver script covers one End-End business functionality, In the process it will call necessary generic and business functions. Business Functions: Applications are build to address the business needs, all such functionalities are identified and will be written as business functions Generic Functions: Functionalities that are developed to support the business functionalities are identified and will be written as generic functions. Synergy Financial Systems Limited

16

Test Architecture Start up Script: Initializes the test environment related parameters. Data tables : All the scripts are 100% dynamic, no code are constants are used in the script. All the data related items are separated and maintained as data tables in Excel / MS access/ Oracle and SQL Server

Object repository: All the GUI objects in the application would be identified and saved in a global Object Repository.

Synergy Financial Systems Limited

17

Test Architecture Log files: An independent user defined log file is maintained for each test run, typically contains header with information such as Log type, timestamp, test number etc. that can be filtered to extract specific details on a particular test step.

Clean-up scripts: This scripts are used to kill the necessary connections, test objects and clean the data tables. Test Results: Tool generated test results are maintained independently.

Synergy Financial Systems Limited

18

Test Architecture -- Features Maintainability: Test Automation Suites generally undergo changes in the following areas: ·

Application Functionality

·

Application User Interface

·

Automated Test Scripts

To minimize the re-work effort, each area of impact is effectively managed by adopting one level of indirection, abstraction and componentization of impacted areas.

Synergy Financial Systems Limited

19

Test Architecture – Unique Point What is unique in this Architecture? In this architecture we have followed Object Oriented design, All the set of functionalities that cover the respective business scenario are covered under one class and separate methods are written for each specific micro functionality.

Synergy Financial Systems Limited

20

Test Architecture -- Features Re-Usability: The entire test suite architecture is based on the best practices of componentization. The test script logic is built/assembled by two major components: ·

Generic Functions & Business Functions

Synergy Financial Systems Limited

21

Test Architecture -- Features Portability: Test Suite portability is built around three aspects: 1. Easily deployable in different client environments No hard coded path strings used 2. Configurable test environment settings Configurable environment settings using INI/ Config.xml files 3. Integration with test harness tools or work as standalone Use integration infrastructure to work with Test Director or work as stand-alone.

Synergy Financial Systems Limited

22

Test Architecture -- Features Usability: Test Suite reporting facilitates easy analysis of test execution status. Efficient reporting mechanism helps in pinpointing test success/failure. Reporting includes warning messages, completion messages, pass/fail information and assertions.

Synergy Financial Systems Limited

23

Test Architecture -- Features Reliability is crystallized in the following two aspects: ·

Recovery from exceptions in application

·

Recovery from exceptions in Test Suite and infrastructure

Application: Recovery from exceptions would be built utilizing the test tool features. Test Suite: Generic error and exception handling mechanism would be built as part of the test suite infrastructure

Synergy Financial Systems Limited

24

Demo on MM Product Scenario Name: Creating Message Purpose: The Purpose of this Scenario is to define item,creating message & Authorizing it. Test Steps: 1.Login to the <User> Module. 2 .Select “MM” from the Application menu. In “MM” select the “Enter”. 3 Enter an input for the message and enter all the relevant details for that message. 4.Select the “Enter” tab and enter for validation. Synergy Financial Systems Limited

25

Demo on MM Product 5. Save the message. 6. Close the “MM” window. 7. Select “Verify” from the “MM” menu. 8. Enter prompted value and select the verify tab. 9. Click the “verify” tab and enter the “Password”. 10. Click on to verify. 11 . Close the “verify” window. 12. Select “Approve” from the “MM” menu. 13. Search the “Message Type” and select the item from the list. 14. Press ENTER against the message and the “Approve” window gets opened. 15. Check the details of the message window. Synergy Financial Systems Limited

26

Questions ? ? ? ? ? ? ?

?

?

?

?

?

?

? ?

Synergy Financial Systems Limited

27

Thank You...

Synergy Financial Systems Limited

28