THE DATA WAREHOUSE LIFECYCLE TOOLKIT
PROJECT PLAN
◗ ❍ ◗ ◗
◗ ❍ ◗ ◗
◗ ❍ ◗ ◗
❍
❍
❍ ● ● ● ● ● ◗ ❍
❍ ▲ ●
❍
❍
❍ ❍ ❍ ● ●
● ● ● ● ▲ ▲ ❍ ❍ ❍ ● ❍
❒
❒
❒
❍
❍
▲
❍ ● ❍
❍ ● ❍
❍
▲
❍ ●
❍ ❍
● ◗ ❍ ❍ ❍ ❍ ❍ ● ❍
◗ ◗
◗ ❍ ◗ ◗
◗ ❍ ◗ ◗
DW QA Analyst
◗ ❍ ◗ ◗
◗ ◗
Data Steward
❍ ❍
◗ ◗
DW Educator
◗
◗ ◗
Data Staging Programmer
❍ ❍
◗ ❍
◗ ◗
Tech Support Specialist
❍
● ❍ ❍ ❍
◗ ❍
◗ ◗ ◗
Tech/Security Architect
◗
❒
● ● ❍
Special Teams
OLAP Designer
◗
❒
ETL Designer
● ● ● ● ● ● ❍ ● ●
❍
DW DBA
● ● ◗ ❍ ◗ ❍ ● ❍ ❍
❍
Data Modeler
◗ ❍ ◗ ❍ ◗ ◗ ❍ ❍
◗
Business Sys. Analyst
Business Project Lead ● ● ●
❍ ❍ ◗
Regular Line-Up
Project Manager
Business Driver ❍ ❍ ●
Business Sponsor
❍ ❍ ◗
Business End Users
Project Task
IS Sponsor
Fans Front Office Coaches
◗ ❍ ◗ ▲
◗ ❍ ◗ ◗
◗ ❍ ◗ ▲
◗ ❍ ◗ ▲
PROJECT MANAGEMENT AND REQUIREMENTS PROJECT DEFINITION 1 Assess Data Warehousing Readiness 2 Develop Preliminary Project Scope 3 Build Business Justification
1 2 3 4 5 6 7 8 9
PROJECT PLANNING & MANAGEMENT Establish Project Identity Identify Project Resources Prepare Draft Project Plan Conduct Project Team Kick-Off & Planning Revise Project Plan Develop Project Communication Plan Develop Program to Measure Success Develop Process to Manage Scope Ongoing Project Management
1 2 3 4 5 6 7 8 9 10 11
USER REQUIREMENT DEFINITION Identify and Prepare Interview Team Select Interviewees Schedule Interviews Conduct User Kick-Off & Prepare Interviewees Conduct Business User Interviews Conduct IS Data Discovery Interviews Analyze Interview Findings Document Findings and Review Publish Requirements Deliverables Prioritize and Revise Project Scope User Acceptance/Project Review
❍ ❍
◗ ❒ ◗ ▲
❒ ◗ ❒
❒ ◗ ❒
◗ ❒ ❍ ❍
❍
❍
❍
❍ ❍ ◗ ❍
◗ ❍ ◗ ▲
▲ ▲ ▲ ❒ ◗ ❍
❍
❒
❒
❒
❒
❒
▲
▲
❍
▲
▲
▲
▲
▲
▲
DATA DESIGN 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17
DIMENSIONAL MODELING Build Matrix Choose Data Mart Declare Grain Choose Dimensions Develop Fact Table Diagram Document Fact Table Detail Design Dimension Detail Develop Derived Fact Worksheet User Review & Acceptance Review DB Design Recommendations for E/U Tool Review DB Design Recommendations for DBMS Complete Logical Database Design Identify Candidate Prestored Aggregates Develop Aggregation Table Design Strategy Review Logical Database Design w/Team Certify DB Design with DSS Tool Vendor User Acceptance/Project Review
1 2 3 4 5
ANALYZE DATA SOURCES Identify Candidate Data Sources Browse Data Content Develop Source to Target Data Map Estimate Number of Rows User Acceptance/Project Review
❍ ❍
❒
❒
◗ ❍
◗
❍
❍
❍
❍
● ◗ ● ● ● ● ● ❍ ❍ ❍ ❍ ❍ ● ❍ ❍
❍
❍
❍
▲ ▲ ▲ ▲ ▲ ▲ ▲ ● ● ● ❍ ● ● ● ❍
▲ ▲
❍ ❍ ❍ ❍ ❍
❍ ❍ ❍ ● ❍
❍
❒
❒
❒
❒
❍
❒
●
◗ ●
❍
◗ ❍
◗ ❍
❍ ❍
● ● ● ❍ ❍
❍
❍
❍
❍
▲
❍
❍
▲
❍
▲
▲
▲
▲ ▲ ● ▲
❍
▲
▲
❍
Page 1
THE DATA WAREHOUSE LIFECYCLE TOOLKIT
PROJECT PLAN
ARCHITECTURE 1 2 3 4 5 7 8 9
TECHNICAL ARCHITECTURE DESIGN Create Architecture Task Force Gather & Document Technical Requirements Review Current Technical Environment Create Architecture Plan Determine Phased Implementation Approach Create Infrastructure Plan Develop Configuration Recommendations User Acceptance/Project Review
1 2 3 4 5 6 7 8 9 10
IMPLEMENT TACTICAL SECURITY MEASURES Develop Tactical Security Plan Secure Physical Environment Install Virus Checking Software Secure Access into Environment Secure Access out of Environment Implement Rigorous Password Scheme Implement Controls for Software Installation Audit Security Violations Monitor Security Privileges by Individual User Acceptance/Project Review
1 2 3 4 5 6 7
DEVELOP STRATEGIC SECURITY PLAN Design Security Architecture Implement Access Tokens (Elim. Passwords) Implement Public/Private Keys for Authentication Implement Secure Tunneling for Remote Access Centralize Authentication & Access Control Impl. Signed Certificates for Software Downloads User Acceptance/Project Review
6 7 8 9
PRODUCT SELECTION (Repeat for each selection area) Develop Evaluation Matrix Research Candidate Products Develop Product Short List Evaluate Product Options Optional Prototype (May repeat for diff. products) Select Business Process / Data for Evaluation Define Completion Criteria Acquire Resources (Internal/Vendor) Determine Test Configuration Install Evaluation Prerequisites & Components Train the Evaluation Team Develop & Tune Prototype Conduct Tests Analyze & Document Results Determine Product Recommendation Present Findings / Results To Management Negotiate Contract User Acceptance/Project Review
1 2 3 4 5
PRODUCT INSTALLATION (Repeat for each product) Installation Planning Meet Prerequisites Install Hardware / Software Test Hardware / Software User Acceptance/Project Review
1 2 3 4 5
❍
◗ ❍ ◗
◗ ❍ ◗
◗ ❍ ◗
◗ ❍ ◗
❍
❍ ◗ ❍ ◗ ❍
❍
●
❒
❒
❒
❒
❍
❍ ❍ ❍
❍ ❍ ❍ ❍ ❍ ❍ ❍ ❍ ● ●
❍
❍ ❍ ❍ ❍ ❍ ❍ ●
❒
❒
❒
❒
● ❍ ❍ ❍
❍ ❍ ❍ ❍
❍ ❍ ❍ ❍
❍ ❍ ❍
❍ ❍ ❍
● ● ● ❍
❍
❍
◗
❒
❒
❒
❒
❒
❒
❒
❒
❒
❒
❒
❒
●
◗
❍ ● ● ❍
❍
❍
◗ ◗ ◗
❒
▲
❒ ❒
❒ ❒
❒ ❒
◗ ❍ ● ●
❒
❒
❒
●
❒
❒
❒
❍
● ❍ ◗ ● ● ● ● ❍
●
❒
❒
❒
❒
❒
● ● ● ● ● ● ● ❍
❍ ❍ ❍ ❍ ❍ ❍ ❍ ❍
❒
❒
❒
❒
● ❍ ❍ ● ● ● ❍ ● ❍ ❍
❍ ● ● ❍ ❍ ❍ ● ❍ ❍ ❍
❒
❒
❒
❒
● ● ● ● ● ● ❍
❍ ❍ ❍ ❍ ❍ ❍ ❍
❒
❒
❒
❍ ❍ ❍
● ● ● ●
❍ ❍
◗ ❍ ◗
❒
❒
❒
❍
❍
❍ ❍ ❍ ◗ ◗ ❍ ◗
❍ ❍ ● ◗ ◗ ❍ ◗
❍ ❍ ❍ ● ● ◗ ❍ ◗
❍ ❍ ❍ ● ● ◗ ❍ ◗
❍
❍
❍
❍
❍
❍
❍
❍
◗
◗ ◗
● ● ●
◗
❍ ◗
❍
▲
❍ ❍ ❍ ● ● ◗ ❍ ◗
● ❍ ❍ ❍ ◗ ● ● ◗
❍ ● ❍ ● ● ❍ ❍ ◗
❍
❍
❍
▲
▲
▲
❍
● ❍ ❍ ❍ ❍
❍ ● ● ● ❍
▲
▲
▲
IMPLEMENTATION PHYSICAL DATABASE DESIGN 1 Define Standards 2 Design Physical Tables & Columns 3 Estimate Database Size
◗
Page 2
THE DATA WAREHOUSE LIFECYCLE TOOLKIT
4 5 6 7
Develop Initial Index Plan Develop Initial Aggregation Plan Develop Initial Partitioning Plan User Acceptance/Project Review
1 2 3 4 5 6 7 8
PHYSICAL DATABASE IMPLEMENTATION Determine DBMS Fixed Parameters Install DBMS Optimize DBMS Changeable Parameters Build Physical Storage Structure Setup RAID Complete Table and Index Sizing Create Tables and Indexes User Acceptance/Project Review
15
DATA STAGING DESIGN & DEVELOPMENT Design High Level Staging Process Develop Detailed Staging Plan by Table Set Up Development Environment Define & Implement Staging Metadata Develop 1st Static Dimension Table Process (Extract, Transformation & Load) Develop 1st Dimension Maintenance Process Develop Remaining Dimension Table Processes Develop Fact Table Process (Extract, Transformation & Load) Develop Incremental Fact Table Process Design & Implement Data Cleansing Design & Develop Agregation Process Automate Entire Process Develop Data Quality Assurance Processes Implement DB Administration (Archive, Backup & Recovery) User Acceptance/Project Review
1 2 3 4 5 6
POPULATE & VALIDATE DATABASE Set Up Production Environment Load Initial Test Data Initial Data Validation/Quality Assurance Load Historical Data Perform Data Validation/Quality Assurance User Acceptance/Project Review
1 2 3 4 5
PERFORMANCE TUNING Set Up Benchmark Queries Review Indexing & Aggregation Review Tool Specific Tuning Conduct Ongoing Database Monitoring User Acceptance/Project Review
1 2 3 4 5 6 7 8
END USER (E/U) APPLICATION SPECIFICATION Identify & Prioritize Candidate Reports Design Template Navigation Approach Develop E/U Application Standards Document Detailed Template Specifications Review End User Application Specs w/Users Revise End User Application Specs Revise Project Scope User Acceptance/Project Review
1 2 3 4 5 6 7 8
END USER (E/U) APPLICATION DEVELOPMENT Select Implementation Approach Review Application Specifications Review Application Standards Populate E/U Tool Metadata Develop E/U Applications Provide Data Accuracy & Cleanliness Feedback Develop E/U Navigation Review w/Users
1 2 3 4 5 6 7 8 9 10 11 12 13 14
PROJECT PLAN
❒
❒
❒
❒
●
◗ ❍
◗ ❍
❍
❍
❒
❒
❒
●
◗ ❍ ❍
❒
❒
❒
❍
❍ ●
◗
❍
▲
❍
❒
❒
❒
❒
❍
❍
❍ ●
❍ ❍
❒
❍ ❍ ❍ ❒ ❍
❍ ❍ ❍ ❒ ●
● ◗ ❍ ◗ ● ◗ ● ●
◗
❍ ❒ ❒
❍ ❍
❍
❒ ❒ ❒
❒ ❒
❍ ❍
❍
❍
❍
❍
▲
▲
❍
▲
▲
▲
▲
▲
❍
❍
❍
●
◗
● ◗
● ● ❍ ●
◗
◗
❍
●
◗ ◗
◗ ◗
❍ ❍
● ●
◗
◗
❍
●
◗ ◗
◗ ◗ ◗
◗ ◗ ◗
❍
❍
❍
❍ ● ● ❍ ❍
● ● ● ● ❍
●
◗
❍
❍
❍
❍
❍
❍
❍
❍
❍ ❍
❍ ❍
▲
▲
● ● ❍ ● ❍
❍ ❍ ❍ ❍ ❍ ❍ ● ❍
❍ ◗ ◗ ❍ ❍ ◗ ◗ ❍
◗ ◗ ◗ ◗ ❍
❍ ❍ ❍ ◗
❍ ❍ ❍
❍ ❍
❍ ◗ ❍
❍
❍ ❍ ❍ ◗ ❍ ❍ ❍ ❍
❍
▲
❍
❍
▲
❍
❍
◗ ❍
◗
◗ ❍
◗
❍ ❍ ❍ ❍ ❍
❍
◗ ❍
◗ ❍
❍
◗
❍ ❍ ❍ ●
◗ ❍
❍
● ❍
▲
● ● ● ● ● ● ● ❍
◗ ❒
● ● ● ❍
❍
▲
▲
❍
❍
❍
● ❍ ● ❍ ❍
❍ ❍
❍
❍
●
❍ ❍
● ❍
❍
▲
▲
● ❍ ●
❍
❍
▲
❍
▲
▲
▲
▲
▲
◗ ▲
● ● ● ● ● ● ◗ ❍
◗ ▲
◗ ▲
◗ ❍
◗ ❍
◗ ▲
◗
◗
❍
❍
● ● ● ● ● ❍ ● ●
●
Page 3
THE DATA WAREHOUSE LIFECYCLE TOOLKIT
9 10 11 12
Document E/U Applications Develop E/U Application Maint. Procedures Develop E/U Application Release Procedures User Acceptance/Project Review
PROJECT PLAN
❍
❒
❒
❍
◗ ❍ ❍ ●
❍ ❍ ❍
❍
❍
❍
❍ ● ● ● ● ◗ ● ❍
❍ ❍ ◗ ❍ ◗ ❍ ❍
❍
❍
❍
❍
● ● ● ❍
▲
▲
●
◗
▲
▲
▲
❍
❍
DEPLOYMENT & GROWTH 1 2 3 4 5 6 7 8
DEPLOYMENT PLANNING Develop Desktop Infrastructure Checklist Develop Initial User Education Strategy Define User Support Strategy Define Release Plan Review Deployment Strategies & Release Plan Develop User Course Materials Develop Support Procedures User Acceptance/Project Review
1 2 3 4 5
COMPLETE SYSTEM TEST Run Complete Data Staging Process Perform Standard QA Procedures Run Core End User Applications Review Overall Process User Acceptance/Project Review
1 2 3 4 5
DEPLOYMENT (ALPHA, BETA & PROD'N) Assess Deployment Readiness Configure & Test Desktop Infrastructure Set Up Security Privileges Educate Users User Acceptance/Project Review
1 2 3 4 5 6 7 8
DATA WAREHOUSE MAINTENANCE Provide Ongoing User Support Provide Ongoing User Education Maintain Technical Infrastructure Monitor End User Query Performance Monitor Data Staging Performance Monitor Ongoing Success Communicate Continuously and Market Success User Acceptance/Project Review
DATA WAREHOUSE GROWTH 1 Establish Data Warehouse Steering Committee 2 Establish Enhancement Prioritization Strategy 3 Iteratively Use Business Dimensional Lifecycle
◗
❒ ◗
❒
❒
❒ ❒ ❍ ❍
❒
❒
❒
❒
● ● ● ● ◗ ● ●
❍
❍ ❍ ● ●
❍ ❍ ❍ ● ❍
●
●
❍ ●
❍ ❍ ❍
❒
❍ ❒
❒
❒
❒
❒
❍
❍ ❍
● ❍
◗ ❍ ❒
❒ ❍ ❒
❒ ❍ ❒
◗ ❍ ❍
● ● ●
● ❍ ❍ ❍ ❍ ● ● ❍
❍
● ● ❍
● ● ❍
● ● ❍
❍ ❍ ●
❍ ❍ ●
◗
❍ ❍ ❍
◗ ❍ ◗ ❍ ❍
❍ ❍
◗ ❍
◗ ❍
❍ ❍
❍ ❍
● ❍
● ❍
❍ ❍
❍ ❍
❍
◗ ❍ ❍ ◗ ❍ ◗ ❍ ❍
❍ ❍
❍ ● ❍ ❍
● ❍
❍ ❍ ❍ ❍
❍ ●
❍ ◗
● ❒ ◗ ❍ ●
❍ ❍ ❍
▲ ❍
❍ ◗
◗
❍
◗ ❍ ❍
◗ ❍ ❍
● ● ● ◗ ❍ ❍
❍
❍
❍
▲
❍
❒ ◗ ❍
◗ ❍
◗ ❍
◗ ❍
◗ ❍
▲
▲
❍ ❍
❍
❍
● ❍
❍
●
❍ ❍
❍ ❍
❍ ❍
❍
❍
❍
❍ ◗
❍ ◗
❍ ❍
❍ ❍
●
● ❍
❍
❍
❍ ●
●
◗ ❍ ❍
◗ ❍ ❍
◗ ❍ ❍
● ◗ ❍ ❍
◗ ❍ ❍
◗ ❍ ❍
❍
❍
❍
❍
❍
❍
● ● ◗ ❍ ❍
◗ ❍ ❍
❍
❍
LEGEND: Primary Responsibility for the Task =
●
Involved in the Task =
❍
Provides Input to the Task =
◗
Informed Task Results = Optional Involvement in the Task =
❒ ▲
Page 4