Agile Development Life Cycle And Soa Testing

Agile Business Webcast Test, Validate & Virtualize for Agile SOA Moderator Patrick Egan

- Publisher – Agile Journal

Speakers John Michelsen - Founder and Chief Scientist of iTKO LISA Zach Nies - Vice President, Products Rally Software

© CMC Media 2008

John Michelsen Founder and Chief Scientist of iTKO LISA, an automated SOA software testing and virtualization company. John has more than 15 years of highlevel enterprise development experience, as a chief architect of development teams and as an executive in designing, developing, and managing large-scale, object-oriented solutions in traditional and network architectures. He is the chief architect of iTKO's LISA automated testing and virtualization product, and a leading industry advocate for software quality, with several published articles and speaking appearances at technology conferences under his belt.

© CMC Media Inc. 2008

Zach Nies Zach Nies brings close to 20 years of engineering and product development experience to Rally’s innovative products. Prior to joining Rally, Zach served as Principal Architect and Director of Systems Architecture for Level 3 Communications and founded a small start up which was quickly acquired by the publicly traded Creo, Inc, now a division of Kodak. He also served as Chief Software Architect at Quark, where he provided the overarching technological vision for the company. Zach’s product vision has won numerous industry awards, including Jolt Product Excellence awards, Seybold HotPicks and the prized MacWorld Best of Show. Zach has served on standards bodies such as the W3C's HTML working group and currently serves on the board of directors for Agile Denver. At the age of 13, Zach began commercially publishing software and, at age 16, started a successful consulting business. A Boettcher Scholar, Zach received his BS with distinction in Computer Science Engineering from the University of Colorado at Boulder. He spends his spare time tuning his golf swing and spending time with his family.

© CMC Media Inc. 2008

Rally Perspective Zach Nies – Rally Software ₋ Vice President, Products

4

Rally – The #1 Agile Provider ∙ #1 On-Demand Tool

₋

₋

900 customers, 20,000 projects and 35,000 users across 50 countries and three-time JOLT Product Excellence awards Preferred provider for the large enterprise by Trail Ridge Consulting independent survey in 2007

∙ #1 Training Services for Agility

₋

₋

World’s largest source for Agile training with 90 expert trainers and 2,500 students trained Leading the forefront of Agile knowledge – more than 100,000 downloads of white papers, articles and webinars

∙ #1 Community for Collaboration

₋ ₋

Largest online community dedicated to advancing all aspects of software agility with more than 3,300 members Industry-disrupting Rally User Community includes a product backlog that is prioritized by customers

5

Thesis and Agenda ∙ Software can be delivered faster, with higher quality, when automation and lean thinking are applied to the development cycle. ∙ Agenda

₋ ₋ ₋

Cycles and Feedback – Lessons from Lean Short, Time-Boxed Development Automation and Visibility

6

Cycles and Feedback Lessons from Lean

Improving Cycle Times ∙ ∙ ∙ ∙ ∙ ∙

Limit work to capacity Even out the arrival of work Minimize the number of Things-in-Process Minimize the size of the Things-in-Process Establish a regular cadence Use pull scheduling

Poppendieck, Mary and Tom. “Managing the Pipeline.” Poppendieck.LLC. 7 Oct 2007. http://www.poppendieck.com/pipeline.htm.

8

Cycle Times and Going Faster 45

Cycle Time as a Function of Utilization and Batch Size Cycle Time (hours)

40

35

Large Batches

30

Medium Batches Small Batches

25

20 15 10

5 0 10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

©2003 Poppendieck.LL

Poppendieck, Mary and Tom. Lean Software Development, An Agile Toolkit. Boston: Addison-Wesley, 2003.

9

Development Cycle

10

Reduce Batching & Queuing

11

By Improving Your Automation

AUTOMATION

12

Short, Time-Boxed Development

Traditional Software Development Long, Large, Linear, Late Time to Market

Lifecycle

Deliverable s

12 to 36 months

Define

MRD

PRD

Code

Tech spec

Test

Code

14

Test plan

Deploy

Funct test

Doc

Train

Agile Software Development Iterate, Increment and Innovate Time to Market

1 to 6 months

Waterfall test

Lifecycle

Deliverable s

Waterfall 12 to 36 months

Working, tested code on short cycles

15

Waterfall deploy

Waterfall documentation

Working in a Time-Box

Fixed Time

Define

(Iteration)

Develop Accept

16

Fixed Resources

Plan

Story Card A Story Card B Story Card C Story Card D Story Card …

Review

Release Backlog

Automation and Visibility

Code Level Quality Feedback

18

Automated Functional Quality Feedback

19

Manual GUI & Regression Quality Feedback

20

Visibility from Rally

21

How Much Faster?

37% Faster Time-to-Market

23

Test, Validate & Virtualize for Agile SOA John Michelsen Founder & Chief Geek iTKO LISA September 23, 2008

© 2008, Interactive TKO, Inc. | PROPRIETARY / © 2008, iTKO, Inc. | PROPRIETARY / CONFIDENTIAL CONFIDENTIAL

24 24

WWW .I T KO .C OM

iTKO: Our Ecosystem Customers

Technology Partners

Delivery Partners

Awards

TestCenter

Everyone should own quality™. 25

© 2008, iTKO, Inc. | PROPRIETARY / CONFIDENTIAL

WWW .I T KO .C OM

Business Trends are Driving a Major Shift in IT Environments 

Mainframe

1980 … 26

•

Business Initiatives  Agility  Cost Reduction  Globalization  Mergers & Acquisitions  Compliance

1985

IT Initiatives • SOA • Outsource/Offshore • Agile Development • BPM • Leverage and Extend

Composite Applications/ SOA

Client/Server

…

1990

© 2008, iTKO, Inc. | PROPRIETARY / CONFIDENTIAL

…

1995

…

2000

…

2005

…

2010

…

WWW .I T KO .C OM

The Goal of Agile SOA Minimize Business Risk inherent in making Frequent Changes to Complex IT Environments SOA & Composite

Increasing Complexity in the IT environment

Apps

High Complexity High Change

 Shorter Time To Market

Client/server apps

 Reduced Failure Rate

Low Complexity Low Change Mainframe /

Web

Packaged

applications

Increasing rate of change in applications & workflows 27

© 2008, iTKO, Inc. | PROPRIETARY / CONFIDENTIAL

A strong collaborative methodology delivers:

 Faster Time To Recovery  Lower Maintenance Cost WWW .I T KO .C OM

Risk Factors for SOA  Inadequate Testing: Traditional testing techniques cannot automate testing against component and middleware-based workflows  Unintended Consequences: Individual components and technologies are changing at their own pace and can create severe issues within business processes  Lack of Controls: Governance techniques to dictate standards may be useless due to inability to enforce policies  Dependency on Constrained Systems: Access and capacity constraints on key systems reduces agility, and increases dependencies and costs between teams 28

© 2008, iTKO, Inc. | PROPRIETARY / CONFIDENTIAL

WWW .I T KO .C OM

Siloed Tests in the SOA Lifecycle Agile Developers

Integration Teams

QA/QE Teams

Operations Teams 1.2s

Unit Tests

Limited smoke testing at assembly

Functional & UI “Acceptance” tests, manual scripts

Performance Testing & Monitoring

What are the constraints that keep us from collaborating in a more parallel way for Agile SOA? 29

© 2008, iTKO ( Interactive TKO, Inc.) | PROPRIETARY / CONFIDENTIAL.

WWW .I TK O.COM

Agile SOA takes Collaboration Business Analysts outline business processes as „not implemented‟ test cases

Developers unit test components and jump-start QA with testability

QA expands dev tests and create functional and load tests for integration

Support rapidly debugs SLA or Policy issues and communicates appropriately

Production tests in deployment and report issues to support

30

© 2008, iTKO, Inc. | PROPRIETARY / CONFIDENTIAL

WWW .I T KO .C OM

Collaboration at Business Process level

31

© 2008, iTKO ( Interactive TKO, Inc.) | PROPRIETARY / CONFIDENTIAL.

WWW .I TK O.COM

Team to Team Collaboration Productio n

Production

Preproduction

Staging

Continuous Regression Testing

Test Bed

QA/QE

Test Bed

Developmen t

Dev Build

Component/ Service Teams Product

32

Dev Build

Component

Product

© 2008, iTKO ( Interactive TKO, Inc.) | PROPRIETARY / CONFIDENTIAL.

Continuous SOA Test Platform

Continuous Validation

Component

WWW .I TK O.COM

Complete SOA Testing - Simplified

Presentati on Layer

web UI

Service/Proce ss Layer

Java

Integration Layer

Data/ Applications 33

Batch Feeds

File System

Swing UI

BPM

ESB

Packaged Apps

© 2008, iTKO ( Interactive TKO, Inc.) | PROPRIETARY / CONFIDENTIAL.

CORBA

web 2.0 U

Web Service

Web Service

RMI

Database

Custom Apps

J2EE

Custom

Legacy WWW .I TK O.COM

Validating Complex, Distributed Systems 3

4 CORBA App

2 1

9

Ordering Swing App

6

Processing Web App

Business Process App B Additional Apps Now & Future

8 ESB

7 Database

34

Business Process App A

5

App Server EJB, WS, POJO

Problem may not appear for end users

Database

© 2008, iTKO ( Interactive TKO, Inc.) | PROPRIETARY / CONFIDENTIAL.

Error in message layer Problems will not appear in XML from SOAP

WWW .I TK O.COM

Contention for Shared Resources  Live services are not always available for dev & testing  Administrators control or prohibit access to prevent overload and downtime  Multiple dev & test teams create scheduling conflicts for access to key systems SOA Development = Constrained by Access

Traditional Dev & QA = Centralized Control, Longer Cycles Mainframe

Mainframe

IT Ops control

Live or Synthetic Transactions Dev team

Client test team Dev & Test teams

35

© 2008, iTKO ( Interactive TKO, Inc.) | PROPRIETARY / CONFIDENTIAL.

WWW .I TK O.COM

Dependencies in Development Cycles Conventional “Waterfall” development cycle… PROJECT TEAM Define

Develop

Test

Integrate

Deploy

Delivered Functionality

Attempt to break up SOA development to distributed teams Team1

Completed Dependency Completed

Team2 downtime Team/QA3

downtime Integration downtime

36

Delivered Functionality

Some Dependency improvement, Completed but dependencies on Dependency Tested finished services still limit agility

© 2008, iTKO ( Interactive TKO, Inc.) | PROPRIETARY / CONFIDENTIAL.

WWW .I TK O.COM

Expense of Test Data Creation Connect 

i T K O

 Gather info

L I S

 Get response

Invoke 

Test Context

Yo ur Sy st e m

Steps  A

React 

Connect 

i T K O

 Gather info

L I S

 Get response

Invoke 

Yo ur Sy st e m

Steps  A

React 

Test Process

Connect 

i T K O

 Gather info

L I S

 Get response

Invoke 

Yo ur Sy st e m

Steps  A

React 

Connect 

i T K O

 Gather info

L I S

 Get response

Invoke 

Service Metadata Transactional Data

Yo ur Sy st e m

Steps  A

React 

Customer Data

• Creating realistic, repeatable test scenarios for SOA represents a huge data maintenance effort • Changing behavior of services makes test data 37 brittle © 2008, iTKO ( Interactive TKO, Inc.) | PROPRIETARY / CONFIDENTIAL.

WWW .I TK O.COM

Virtualization Example Eliminating Dependency on Live Apps, Data & Components

CORBA App

Load & Performance Testers

Database Business Process App A

Ordering Swing App

Business Process App B App Server EJB, WS, POJO

Component Developers & Testers Processing Web App

Additional Apps Now & Future

ESB

LISA VSE Database

38

© 2008, iTKO, Inc. | PROPRIETARY / CONFIDENTIAL

WWW .I T KO .C OM

Performance Management in SOA requires Collaboration Without Component-Level Performance Testing Add more Hardware! Verify

Lookup

Solution

Quote

Timeline

Test 3.2 Seconds

Test: 4.0 Seconds

SLA 2.1 seconds

8 mo.

9 mo.

PR

With Earlier Component-Level Performance Testing, Deliver with Les Verify

0.5s 0.5s

Lookup

Quote

0.3s

1.9s

0.3s 0.5s

1.2s

1.2s

Test: 2.1 Seconds

Solution 39

© 2008, iTKO ( Interactive TKO, Inc.) | PROPRIETARY / CONFIDENTIAL.

WWW .I TK O.COM

Agility with Validation & Virtualization Data Svc Completed

OrderMgmt

Completed

PartnerPortal

Delivered Functionality

Conventional Delivery Date

Completed

Time saved

downtime Integration/Perf. downtime

Original SOA Delivery Date

Tested

 Team producing a service can provide a Virtual Service earlier in development to allow earlier access by other dependent teams  Team consuming a service can capture and model a current or incomplete Service as a Virtual Service 40

© 2008, iTKO ( Interactive TKO, Inc.) | PROPRIETARY / CONFIDENTIAL.

WWW .I TK O.COM

iTKO: Our Solution - LISA • Constraint Simulations • Eliminates Dependencies

• Complete

• Complete Environment

• Collaborative • Extensible

Testing

Virtualiza tion

• Supports Load • Pass thru mode

Validation • Continuous • Functional Monitoring • Policy Validation • Proactive Alerting

41

© 2008, iTKO, Inc. | PROPRIETARY / CONFIDENTIAL

WWW .I T KO .C OM

Summary: iTKO LISA  Complex SOA Dependencies and Rate of Change are causing Increase in Business Risk  iTKO LISA can help in minimizing this Risk through Best Practices and Technology

• For more info on LISA‟s SOA Testing, Validation & Virtualization capabilities: • Download Resources: http://www.itko.com • John‟s Blog: http://blog.itko.com • Email: [email protected] 42

© 2008, iTKO, Inc. | PROPRIETARY / CONFIDENTIAL

WWW .I T KO .C OM

Questions and Answers Please post your questions now using the “Ask a Question” box on left side of the screen

View other Webcasts in the Series at www.cmcrossroads.com/wc

© CMC Media Inc. 2008