How Do I Create an Attribute MSA Report in Excel Using SigmaXL?

Attribute MSA (Binary)

Attribute MSA is also known as Attribute Agreement Analysis. The response must be binary (e.g. Pass/Fail, Good/Bad, G/NG, Yes/No).

1. Open the file Attribute MSA – AIAG.xls. This is an example from the AIAG MSA Reference Manual, 3rd Edition, page 127. Note that the worksheet data must be in stacked column format
2. Click SigmaXL > Measurement Systems Analysis > Attribute MSA (Binary). Ensure that the entire data table is selected. Click Next.
3. Select Part, Appraiser, Assessed Result and Reference as shown. Check Report Information and enter AIAG Example, Page 127:



4. Click OK. The Attribute MSA report is produced as shown below:

5. The report includes a summary showing the original data in unstacked format. This makes it easy to visually compare appraiser results by part:




6. Fleiss’ Kappa statistic is a “correlation coefficient” for discrete data. Kappa ranges from -1 to +1. A Kappa value of +1 indicates perfect agreement. If Kappa = 0, then agreement is the same as would be expected by chance. If Kappa = -1, then there is perfect disagreement. Kappa values > 0.9 indicate a very good measurement system; Kappa values > 0.7 indicate an acceptable measurement system.
7. The Between Appraiser Agreement and All Appraisers vs. Standard Agreement are also known as “System Effectiveness Scores”, with > 95% considered very good, 90-95% acceptable, 80 to < 90 % marginal, and < 80 % unacceptable.
8. Clearly this measurement system needs to be improved, but we should not be quick to judge Appraiser C. The confidence intervals are quite wide and overlap. It is a good practice to “blame the process not the people”. Look for unclear or confusing operational definitions, inadequate training, operator distractions or poor lighting. Consider the use of pictures to clearly define a defect. Use Attribute MSA as a way to “put your stake in the ground” and track the effectiveness of improvements to the measurement system.

 

Click here to download a Free 30-Day Trial.