Opening Briefing Presentation C Appraisal Id: xxxxx January/6, 2008
Standard CMMI Appraisal Method for Process Improvement (SCAMPISM ) Crest Consulting SM
SCAMPI is a service mark of Carnegie Mellon University Page 1
Preliminary Findings Presentation
C Appraisal Id: xxxxx January/6, 2008 Standard CMMI Appraisal Method for Process Improvement (SCAMPISM ) Crest Consulting SM
SCAMPI is a service mark of Carnegie Mellon University Page 2
Final Findings Presentation
C Appraisal Id: xxxxx January/6, 2008 Standard CMMI Appraisal Method for Process Improvement (SCAMPISM ) Crest Consulting SM
SCAMPI is a service mark of Carnegie Mellon University Page 3
Presentation Topics Objectives of Appraisal Overview of Appraisal Appraisal Activities Scope of Appraisal Capability Maturity Model® Integration Findings Ratings
® Capability Maturity Model, Capability Maturity Modeling, and CMM are registered in the U.S. Patent & Trademark Office. Page 4
Objectives of Appraisal •
Process Improvements Business Objectives
- a; - a; - a •
SCAMPI Objectives
- Appraise the organization’s processes against the CMMI v1.2, Maturity Level 2 Process Areas using Staged Representation, and provide detailed findings of the results; - Report on the findings of the Appraisal including Strengths and Weaknesses; - Supply recommendations for process improvement.
Page 5
Overview of Appraisal Organization Undergoing Appraisal
C Sponsor of the Appraisal:
R Point-of-Contact of the Appraisal:
C Three (3) Projects will be appraised 123-
Page 6
Appraisal Team PA Assignment
Page 7
Appraisal Participants
Page 8
Scope of Appraisal (Model) Maturity Level: 2 - Investigating 6 Process Areas –Requirements Management –Project Planning –Project Monitoring and Control –Measurement and Analysis –Process and Product Quality Assurance –Configuration Management
PA will not be evaluated - Supplier Agreement Management
Page 9
CMMI Overview - Staged Level
Focus
Process Areas
5 Optimizing
Continuous Process Improvement
Organizational Innovation and Deployment Causal Analysis and Resolution
4 Quantitatively Managed
Quantitative Management
Organizational Process Performance Quantitative Project Management
3 Defined
2 Managed
Process Standardization
Basic Project Management
Requirements Development Technical Solution Product Integration Verification Validation Organizational Process Focus Organizational Process Definition +IPPD Organizational Training Integrated Project Management +IPPD Risk Management Decision Analysis and Resolution
Requirements Management Project Planning Project Monitoring and Control Supplier Agreement Management Measurement and Analysis Process and Product Quality Assurance Configuration Management Risk Rework
1 Initial Page 10
Pre-appraisal activities •Identify appraisal team leader Pre-appraisal •Determine appraisal objectives •Determine appraisal constraints •Determine appraisal scope •Determine outputs •Identify needed resources •Determine cost and schedule •Plan and manage logistics •Document and manage risks •Select team members •Prepare team •Obtain initial objective evidence •Perform readiness review •Prepare data collection plan
activities
Page 11
Source of Information Document Review
Interviews
Compliance Matrix
Draft Findings Briefing Presentations
Appraisal Team
Page 12
Types of Findings Strength – exemplary or noteworthy implementation of a CMMI model practice. Compliant – indicates in the team judgment an effective implementation of a component of the reference model. Weakness – indicates in the team judgment an ineffective implementation of a component of the reference model or one that is not institutionalized. Recommendation – suggestion for improvement.
Page 13
Rating Decision Rating decisions reflect judgment on findings: Findings are based on facts All findings are validated by the team Rating decisions reflect team consensus A model component can be rated satisfied even though it has validated weaknesses Types of ratings: – Practices: Fully Implemented, Largely Implemented, Partially Implemented, Not Implemented – Goals: satisfied or unsatisfied – PAs: – Maturity Level: Ratings will be provided for each: Practice Characterization, Goal, Maturity Level
Page 14
Rating of CMMI Goals The goal is rated Satisfied if – there are no findings that document the weaknesses associated with a goal,
OR – (a) all associated practices are characterized at the organizational unit level as either Largely Implemented or Fully Implemented, and – (b) the aggregate of weaknesses associated with the goal does not have a significant negative impact on goal achievement.
Otherwise the goal is rated Unsatisfied. Page 15
Goal Rating Profile
GG5 GG4 GG3 GG2 GG1
NA NA NA
SG3 SG2 SG1 P As= > O P F O P D O T P A - P roc es s A rea S G - S pec ific G oal G G - G eneric G oal
NA NA NA
NA NA NA NA O P P O ID
NA NA NA
PP
NA NA P M C S AM IP M
NA NA NA
NA NA RS KMQ P M
GG5 GG4 GG3 GG2 GG1 SG3 SG2 SG1
G oal S atis fied G oal Uns atis fied NA /NR P A 's are not s hown
Page 16
Rating of Process Areas Satisfied - all of the goals of the process area are rated as satisfied Unsatisfied - one or more of the goals of the process area are rated unsatisfied Not Applicable - the process area is outside the organizational unit’s scope of work Not Rated – Insufficient data is available to determine satisfaction – Process area is outside appraisal scope (model)
Page 17
Process Area Profile Optimizing Causal analysis & resolution Organizational innovation and deployment Quantitatively Managed Quantitative project management Organizational process performance Defined Decision analysis & resolution Risk management Integrated project management Organizational training Organizational process definition Organizational process focus Validation Verification Product Integration Technical solution Requirements Development
satisfied
Managed Configuration management Process & product quality assurance Measurement & analysis Supplier agreement management Project monitoring & control Project planning Requirements management
not satisfied
NA
not applicable
NR
not rated Page 18
Ground Rules Findings will adhere to non-attribution principles. Participants must also adhere to this for non-attribution to work. The results are confidential to the extent deemed appropriate by the sponsor. The interview notes contain attribution. All notes will be disposed of when the final report is completed.
Page 19
Participant Role – Conduct Appraisal Please be prompt to all interviews and briefings for which you are scheduled. Please be open and candid: the team needs to understand how business is done; greater collaboration results in improved accuracy in the findings; this makes the data more useful for process improvement efforts.
Page 20
Appraisal Results A Preliminary findings will be presented to the organization upon completion of the on-site period: Thursday, January/8 @ 3:30pm A Final findings will be presented: Friday, January/9 @ 2:00pm Action planning will be done based on the results of the appraisal.
Page 21
Reporting Appraisal Results A Final findings will be presented: Friday, January/9 @ 2:00pm Action planning will be done based on the results of the appraisal.
Page 22
Deliverables The results of the appraisal will provide: – A set of findings for all PAs; – Ratings against each component of the model (Scampi A); – A final briefing indicating findings.
Deliverables include: – – – –
Appraisal Plan Final Findings Briefing Appraisal Disclosure Statement (Scampi A) Appraisal Data (non-attributable)
Page 23
Detailed Schedule
Page 24
Tuesday, Jan/6 From/To
Activity
Participants
Location
7:30am/8:00am
Team Arrives
Appraisal Team
Sala 3 - Diretoria
8:00am/8:30am
Setup Opening Briefing
Appraisal Team
Sala 3 - Diretoria
8:30am/9:30am
Opening Briefings PresentationAll Participants
Auditório
9:30am/10:15am
Org. presentation
Auditório
10:15am/10:30am
Break
10:30am/11:00am
Org. Processes presentation
Appraisal Team
Auditório
11:00am/11:45am
Org. Tool Demonstration
Appraisal Team
Auditório
11:45am/12:30pm
Lunch
Appraisal Team
Restaurant
12:30am/4:00pm
Document Review
Appraisal Team
Sala 3 - Diretoria
4:00pm/4:15pm
Break
Appraisal Team
Sala 3 - Diretoria
4:15pm/6:30pm
Document Review
Appraisal Team
Sala 3 - Diretoria
6:30pm/07:00pm
Process Notes
Appraisal Team
Sala 3 - Diretoria
All Participants
Auditório
Page 25
Wednesday, Jan/7 From/To
Activity
Participants
Location
7:30am/8:00am
Team Arrives
Appraisal Team
Sala 3 - Diretoria
8:00am/9:00am
Prepare for Interviews
Appraisal Team
Sala 3 - Diretoria
9:00am/10:15am
Project Manager Interview
C.Ossandon
Sala 3 - Diretoria
10:15am/10:30am
Break and Tag Notes
Appraisal Team
Sala 3 - Diretoria
10:30am/11:30am
Configuration Management Interview
F.Silva
Sala 3 - Diretoria
11:30am/11:45am
Break and Tag Notes
Appraisal Team
Sala 3 - Diretoria
11:45am/12:30pm
Lunch
Appraisal Team
Restaurant
12:30pm/1:00pm
Prepare for Interviews
Appraisal Team
Sala 3 - Diretoria
1:00pm/2:15pm
Metrics Interview
R.Lopes
Sala 3 - Diretoria
2:15pm/2:45pm
Break and Tag Notes
Appraisal Team
Sala 3 - Diretoria
2:45pm/4:00pm
Requirements Interview
Carlos Bernardo
Sala 3 - Diretoria
4:00pm/4:30pm
Break and Tag Notes
Appraisal Team
Sala 3 - Diretoria
4:30pm/5:30pm
QA Interview
N.Fernandes
Sala 3 - Diretoria
5:30pm/6:00pm
Break and Tag Notes
Appraisal Team
Sala 3 - Diretoria
6:00pm/6:30pm
Process Review
Appraisal Team
Sala 3 - Diretoria Page 26
Thursday, Jan/8 From/To
Activity
Participants
Location
7:30am/8:00am
Team Arrives
Appraisal Team
Sala 3 - Diretoria
8:00am/10:00am
Document review and Craft Observations
Appraisal Team
Sala 3 - Diretoria
10:00am/11:45am
Full Team Consensus
Appraisal Team
Sala 3 - Diretoria
11:45pm/12:15pm
Lunch
Appraisal Team
Restaurant
12:15pm/1:30pm
Full Team Consensus (Contd)
Appraisal Team
Sala 3 - Diretoria
1:30pm/2:30PM
Create Draft Findings Presentation
Appraisal Leader
Auditorio
2:30pm/3:30pm
Review Draft Findings Presentation
Appraisal Team
Auditorio
3:30pm/5:00pm
Preliminary Findings Presentation
All Participants
Auditorio
5:00pm/6:30pm
Document Review and Update Appraisal Team findings
Sala 3 - Diretoria
6:30pm/7:00pm
Process Notes
Sala 3 - Diretoria
Appraisal Team
Page 27
Friday, Jan/9 From/To
Activity
Participants
Location
7:30am/8:00am
Team Arrives
Appraisal Team
Sala 3 - Diretoria
8:00am/10:00am
Full Team Consensus on Modified Observations
Appraisal Team
Sala 3 - Diretoria
10:00am/11:45am
Prepare Final Findings Presentation
Appraisal Leader
Auditório
11:45pm/12:30pm
Lunch
Appraisal Team
Restaurant
12:30pm/2:00pm
Review Final Findings Presentation
Appraisal Team
Auditório
2:00pm/3:15pm
Present Final Findings
All Participants
Auditório
3:15pm/4:00pm
Executive Session
Sponsor and Invitees
Auditório
4:00pm/5:00pm
Appraisal Close Out
Appraisal Team
Auditório Page 28
Findings Summary Maturity Level 2 Process Areas Process Areas Generic Practices
Page 29
Generic Practices GP 2.1 Establish an Organizational Policy COMPLIANCE: The
Page 30
Generic Practices GP 2.1 Establish an Organizational Policy RECOMMENDATION: 1-
Page 31
Generic Practices GP 2.1 Establish an Organizational Policy WEAKNESS: None.
Page 32
Generic Practices GP 2.2 Plan the Process COMPLIANCE: The
Page 33
Generic Practices GP 2.2 Plan the Process RECOMMENDATION: 1-
Page 34
Generic Practices GP 2.2 Plan the Process WEAKNESS: None.
Page 35
Generic Practices GP 2.3 Provide Resources COMPLIANCE: The
Page 36
Generic Practices GP 2.3 Provide Resources RECOMMENDATION: 1-
Page 37
Generic Practices GP 2.3 Provide Resources WEAKNESS: None.
Page 38
Generic Practices GP 2.4 Assign Responsibility COMPLIANCE: The
Page 39
Generic Practices GP 2.4 Assign Responsibility RECOMMENDATION: None.
Page 40
Generic Practices GP 2.4 Assign Responsibility WEAKNESS: None.
Page 41
Generic Practices GP 2.5 Train People COMPLIANCE: The
Page 42
Generic Practices GP 2.5 Train People RECOMMENDATION : 1-
Page 43
Generic Practices GP 2.5 Train People WEAKNESS: None.
Page 44
Generic Practices GP 2.6 Manage Configurations COMPLIANCE: The
Page 45
Generic Practices GP 2.6 Manage Configurations RECOMMENDATION: 1-
Page 46
Generic Practices GP 2.6 Manage Configurations WEAKNESS: 1-
Page 47
Generic Practices GP 2.7 Identify and Involve Relevant Stakeholders COMPLIANCE: 1-
Page 48
Generic Practices GP 2.7 Identify and Involve Relevant Stakeholders RECOMMENDATION: None.
Page 49
Generic Practices GP 2.7 Identify and Involve Relevant Stakeholders WEAKNESS: 1-
Page 50
Generic Practices GP 2.8 Monitor and Control the Process COMPLIANCE: The
Page 51
Generic Practices GP 2.8 Monitor and Control the Process RECOMMENDATION: None.
Page 52
Generic Practices GP 2.8 Monitor and Control the Process WEAKNESS: None.
Page 53
Generic Practices GP 2.9 Objectively Evaluate Adherence COMPLIANCE : The
Page 54
Generic Practices GP 2.9 Objectively Evaluate Adherence RECOMMENDATION : 1-
Page 55
Generic Practices GP 2.9 Objectively Evaluate Adherence WEAKNESS : None.
Page 56
Generic Practices GP 2.10 Review Status with Higher Level Management COMPLIANCE: 1-
Page 57
Generic Practices GP 2.10 Review Status with Higher Level Management RECOMMENDATION: None.
Page 58
Generic Practices GP 2.10 Review Status with Higher Level Management WEAKNESS : None.
Page 59
Findings Summary Maturity Level 2 Process Areas Process Areas Specific Practices
Page 60
Requirements Management Description: The purpose of Requirements Management is to manage the requirements of the project's products and product components and to identify inconsistencies between those requirements and the project's plans and work products. SG 1 Manage Requirements Compliances: Recommendations: Weakness: Crest Consulting - YYYY - Appraisal A
Page 61
Requirements Management SG 1 Manage Requirements The
Crest Consulting - YYYY - Appraisal A
Page 62
Requirements Management RECOMMENDATION : 1-
Page 63
Requirements Management WEAKNESS: 1-
Page 64
Project Planning Description: The purpose of Project Planning is to establish and maintain plans that define project activities. SG 1 Establish Estimates SG 2 Develop a Project Plan SG 3 Obtain Commitment to the Plan Compliances: Recommendations: Weakness: Page 65
Project Planning SG 1 Establish Estimates The
Page 66
Project Planning SG 2 Develop a Project Plan The
Page 67
Project Planning SG 3 Obtain Commitment to the Plan P
Page 68
Project Planning RECOMMENDATION: None.
Page 69
Project Planning WEAKNESS: 1-
Page 70
Project Monitoring and Control Description: The purpose of Project Monitoring and Control is to provide an understanding of the project’s progress so that appropriate corrective actions can be taken when the project’s performance deviates significantly from the plan. SG 1 Monitor Project Against Plan SG 2 Manage Corrective Action to Closure Compliances: Recommendations: Weakness:
Page 71
Project Monitoring and Control SG 1 Monitor Project Against Plan
The
Page 72
Project Monitoring and Control SG 2 Manage Corrective Action to Closure Data
Page 73
Project Monitoring and Control RECOMMENDATION:
1-
Page 74
Project Monitoring and Control WEAKNESS:
1-
Page 75
Measurement and Analysis Description: The purpose of Measurement and Analysis is to develop and sustain a measurement capability that is used to support management information needs. SG 1 Align Measurement and Analysis Activities SG 2 Provide Measurement Results Compliances: Recommendations: Weakness:
Page 76
Measurement and Analysis SG 1 Align Measurement and Analysis Activities The
Page 77
Measurement and Analysis SG 2 Provide Measurement Results The
Page 78
Measurement and Analysis RECOMMENDATION: None.
Page 79
Measurement and Analysis WEAKNESS: 1-
Page 80
Measurement and Analysis WEAKNESS: 4-
Page 81
Measurement and Analysis WEAKNESS: 7-
Page 82
Process and Product Quality Assurance Description: The purpose of Process and Product Quality Assurance is to provide staff and management with objective insight into processes and associated work products. SG 1 Objectively Evaluate Processes and Work Products SG 2 Provide Objective Insight Compliances: Recommendations: Weakness:
Page 83
Process and Product Quality Assurance SG 1 Objectively Evaluate Processes and Work Products The
Page 84
Process and Product Quality Assurance SG 2 Provide Objective Insight The
Page 85
Process and Product Quality Assurance RECOMMENDATION: 1-
Page 86
Process and Product Quality Assurance WEAKNESS: None.
Page 87
Configuration Management Description: The purpose of Configuration Management is to establish and maintain the integrity of work products using configuration identification, configuration control, configuration status accounting, and configuration audits. SG 1 Establish Baselines SG 2 Track and Control Changes SG 3 Establish Integrity Compliances: Weaknesses: Recommendations: Page 88
Configuration Management SG 1 Establish Baselines The
Page 89
Configuration Management SG 2 Track and Control Changes The
Page 90
Configuration Management SG 3 Establish Integrity The
Page 91
Configuration Management RECOMMENDATION: 1-
Page 92
Configuration Management WEAKNESS:
None.
Page 93
Supplier Agreement Management Description: The purpose of Supplier Agreement Management is to manage the acquisition of products from suppliers. SG 1 Establish Supplier Agreements SG 2 Satisfy Supplier Agreements Compliances: -3 Weaknesses: -0 Recommendations: - 0
Crest Consulting - Ação Sistemas - Appraisal A
Page 94
Supplier Agreement Management SG 1 Establish Supplier Agreements
Crest Consulting - Ação Sistemas - Appraisal A
Page 95
Supplier Agreement Management SG 2 Satisfy Supplier Agreements
Page 96
Supplier Agreement Management RECOMMENDATION:
Page 97
Supplier Agreement Management WEAKNESS:
Page 98
Findings Summary Compliances: Recommendations: Weaknesses: Strengths: Page 99
Strengths
Page 100
Reporting Appraisal Results
A Final findings will be presented: Friday, January/25 @ 2:00pm Action planning will be done based on the results of the appraisal.
Page 101
Generic Practices
Page 102
Specific Practices
Page 103
Page 104
Comments The organization already executes some practices required by ML 3 PAs like: – Organizational Process Focus – Organizational Process Definition – Verification (peer-review) – Validation – Technical Solution – Product Integration – Requirements Development Recommendation - Analyze all Weaknesses and Recommendations targeting their adoption. - Maintain the SCAMPI target date: march/2-6
Page 105
Appraisal Data • • • •
#Hours worked: 175hs Daily Start time: 8:00am Max time team stayed on any day: 7:00pm Appraisal documents:
Page 106
Thanks to 1. Appraisal Participantes 2. Sponsor -
3. POC 4. ATMs 1. S 2. E 3. R 4. P
Page 107
Appraisal Team Signature Page I support the findings in this presentation and affirm that to the best of my knowledge it represents an accurate portrayal of the state of the process in the appraised organization. Team Role
Name (printed/typed)
Signature
Date
Page 108