Calibration Template

Instructions to use: 1 2 3 4 5 6 7 8

9 10 11

12

13

Instructions to use:

Select 'Input data' sheet & paste the parameters that are measured in cell A6 Paste the Expert's scoring in cell B6. Paste the Appraiser's scoring from C6. Appraiser name should be identical for all the trials of the same appraiser. The number of trials should be the same for all appraisers. Do not leave blank columns between the appraisers. Fill in the thresholds for Within Appraisers, Between Appraisers, Each Appraiser Vs Standard and All Appraisers Vs Standard. Click on Attribute Agreement Analysis to view the results

In Results Sheet All Appraisers Vs Standard gives us percentage of parameters matched with 95% confidence interval for all the Appraisers, for Trials with the Standard Between Appraisers gives us the percentage of parameters matched with 95% confidence interval for all trials for all appraiser Within Appraiser gives us percentage of parameters matched with 95% confidence interval for all the Trials of each Appraiser

Each Appraiser Vs Standard gives us percentage of parameters matched with 95% confidence interval for all the Trials of each Appraiser with the Standard

The Graph for the Confidence intervals for "Repeatability","Reproducibility","Accuracy" and the "Overall Repeatability,Reprodu and Accuracy"," Repeatability and Accuracy Comparison" Graphs can be seen in the sheet"CIGraphs"

Threshold Within Appraiser (Repeatability)

90%

Between Appraiser (Reproducibility)

90%

Reset Attribute Agreement Analysis Trial1

Parameter

Expert

Trial2

Trial1

Each Appraiser Vs Sta (Repeatability& Accu

All Appraisers Vs Standard (Over Reproducibility & Acc Trial2

Threshold Each Appraiser Vs Standard (Repeatability& Accuracy)

sers Vs Standard (Overall Repeatability, Reproducibility & Accuracy)

90% 90%

Attribute Agreement Analysis Overall Repeatability, Reproducibilty & Accuracy

Reproducibilt

All Appraisers Vs Standard No. Inspected

No. Matched

% Matched

Lower CI

Upper CI

Between Appra No. Inspected

No. Matched

Repeatability

Within Appraiser Appraisers

No. Inspected

No. Matched

% Matched Lower CI Upper CI

Accuracy

Each Appra Appraisers

Date of Trial I

Date of Trial II

Please enter the trial dates here

Reproducibilty

Between Appraisers % Matched

Lower CI

Upper CI

Accuracy & Repeatability

Each Appraiser Vs Standard No. Inspected

No. Matched

% Matched Lower CI Upper CI

Overall Repeatability, Reproducibilty & Accuracy

All Appraisers Vs Standard % Matched

Lower Bound

Upper Bound

Repeatability Within Appraisers (Repeatability) Appraisers

% Matched

Lower Bound

Repeatab Each Appra (Repeatab Upper Bound

Appraisers

Reproducibilty

Between Appraisers % Matched

Lower Bound Upper Bound

Repeatability and Accuracy Comparison Appraisers Repeatability Accuracy

Repeatability& Each Appraiser VsAccuracy Standard (Repeatability & Accuracy) % Matched

Lower Bound Upper Bound