Module 3 · Lesson 11 of 17
Attribute agreement analysis
This lesson and the entire Lean Six Sigma Black Belt academy are free of charge — no fees, ever.
Learning objectives
- Design an attribute agreement study for categorical decisions.
- Calculate within-, between- and standard-agreement rates.
- Investigate false-accept and false-reject risk at the boundary.
Where agreement matters
Attribute agreement evaluates whether inspectors classify the same items the same way and match an expert standard, especially near the acceptance boundary.
Percent agreement can look high when one category dominates; report agreement with the standard and use kappa cautiously.
Garment-factory example
Inspectors classify seam appearance as acceptable/unacceptable across a coded sample set including borderline cases, rating each item twice without seeing previous ratings.
Method
- Prepare a reference-graded sample set including boundary cases.
- Blind and randomise; rate each item twice.
- Cross-tabulate and calculate agreement rates.
- Investigate disagreements at the boundary.
Common mistakes
- Using only obvious defects.
- Reporting overall percent agreement when one category is 90% of the set.
Knowledge check
Pick one answer per question. Explanations appear after you submit.
1. Agreement with each other but not with the standard indicates:
2. Boundary samples are included to:
Author: NOSK.life · Last reviewed: 2026-07-21