Example of Gage R&R Study (ANOVA method)
main topic
     interpreting results     session command     see also 

In this example, we do a gage R&R study on two data sets: one in which measurement system variation contributes little to the overall observed variation (GAGEAIAG.MTW), and one in which measurement system variation contributes a lot to the overall observed variation (GAGE2.MTW). For comparison, we analyze the data using both the ANOVA method (below) and the Xbar and R method. You can also look at the same data plotted on a Gage Run Chart.

The GAGEAIAG data was taken from Measurement Systems Analysis Reference Manual, 3rd edition. (Chrysler, Ford, General Motors Supplier Quality Requirements Task Force). Ten parts were selected that represent the expected range of the process variation. Three operators measured the ten parts, three times per part, in a random order.

For the GAGE2 data, three parts were selected that represent the expected range of the process variation. Three operators measured the three parts, three times per part, in a random order.

Step 1: Use the ANOVA method with GAGEAIAG data

1    Open the worksheet GAGEAIAG.MTW.

2    Choose Stat > Quality Tools > Gage Study > Gage R&R Study (Crossed).

3    In Part numbers, enter Part.

4    In Operators, enter Operator.

5    In Measurement data, enter Measurement.

6    Under Method of Analysis, choose ANOVA.

7    Click Options. Under Process tolerance, choose Upper spec - Lower spec and enter 8.

8    Click OK in each dialog box.

Step 2: Use the ANOVA method with GAGE2 data

1    Open the file GAGE2.MTW.

2    Choose Stat > Quality Tools > Gage Study > Gage R&R Study (Crossed).

3    In Part numbers, enter Part.

4    In Operators, enter Operator.

5    In Measurement data, enter Response.

6    Under Method of Analysis, choose ANOVA.

7    Click OK.

Session window output

ANOVA method with GAGEAIAG data

Gage R&R Study - ANOVA Method

 

 

Two-Way ANOVA Table With Interaction

 

 

Source           DF       SS       MS        F      P

Part              9  88.3619  9.81799  492.291  0.000

Operator          2   3.1673  1.58363   79.406  0.000

Part * Operator  18   0.3590  0.01994    0.434  0.974

Repeatability    60   2.7589  0.04598

Total            89  94.6471

 

 

α to remove interaction term = 0.05

 

 

Two-Way ANOVA Table Without Interaction

 

 

Source         DF       SS       MS        F      P

Part            9  88.3619  9.81799  245.614  0.000

Operator        2   3.1673  1.58363   39.617  0.000

Repeatability  78   3.1179  0.03997

Total          89  94.6471

 

 

Gage R&R

 

 

                            %Contribution

Source             VarComp   (of VarComp)

Total Gage R&R     0.09143           7.76

  Repeatability    0.03997           3.39

  Reproducibility  0.05146           4.37

    Operator       0.05146           4.37

Part-To-Part       1.08645          92.24

Total Variation    1.17788         100.00

 

 

Process tolerance = 8

 

 

                                Study Var  %Study Var  %Tolerance

Source             StdDev (SD)   (6 × SD)       (%SV)  (SV/Toler)

Total Gage R&R         0.30237    1.81423       27.86       22.68

  Repeatability        0.19993    1.19960       18.42       14.99

  Reproducibility      0.22684    1.36103       20.90       17.01

    Operator           0.22684    1.36103       20.90       17.01

Part-To-Part           1.04233    6.25396       96.04       78.17

Total Variation        1.08530    6.51180      100.00       81.40

 

 

Number of Distinct Categories = 4

 

 

Gage R&R for Measurement

ANOVA method with GAGE2 data

Gage R&R Study - ANOVA Method

 

 

Two-Way ANOVA Table With Interaction

 

 

Source           DF      SS       MS        F      P

Part              2   38990  19495.2  2.90650  0.166

Operator          2     529    264.3  0.03940  0.962

Part * Operator   4   26830   6707.4  0.90185  0.484

Repeatability    18  133873   7437.4

Total            26  200222

 

 

α to remove interaction term = 0.05

 

 

Two-Way ANOVA Table Without Interaction

 

 

Source         DF      SS       MS        F      P

Part            2   38990  19495.2  2.66887  0.092

Operator        2     529    264.3  0.03618  0.965

Repeatability  22  160703   7304.7

Total          26  200222

 

 

Gage R&R

 

 

                            %Contribution

Source             VarComp   (of VarComp)

Total Gage R&R     7304.67          84.36

  Repeatability    7304.67          84.36

  Reproducibility     0.00           0.00

    Operator          0.00           0.00

Part-To-Part       1354.50          15.64

Total Variation    8659.17         100.00

 

 

                                Study Var  %Study Var

Source             StdDev (SD)   (6 × SD)       (%SV)

Total Gage R&R         85.4673    512.804       91.85

  Repeatability        85.4673    512.804       91.85

  Reproducibility       0.0000      0.000        0.00

    Operator            0.0000      0.000        0.00

Part-To-Part           36.8036    220.821       39.55

Total Variation        93.0547    558.328      100.00

 

 

Number of Distinct Categories = 1

 

 

Gage R&R for Response

Graph window output

ANOVA method with GAGEAIAG data

ANOVA method with GAGE2 data

Interpreting the results

Session Window Output - GAGEAIAG.MTW

·    Look at the p-value for the Operator*Part interaction in the ANOVA Table. When the p-value for Operator by Part is > 0.05, Minitab omits this from the full model. Notice there is an ANOVA table without the interaction because the p-value was 0.974.

·    Look at the %Contribution column in the Gage R&R table - the percent contribution from Part-To-Part (92.24) is larger than that of Total Gage R&R (7.76). This tells you that much of the variation is due to differences between parts.

·    Look at the %Study Var column - the Total Gage R&R equals 27.86% of the study variation. While the Total Gage R&R %Contribution is acceptable, there is room for improvement. See Guidelines for measurement system acceptability.

·    For this data, the number of distinct categories is four. According to the AIAG, you need at least five distinct categories to have an adequate measuring system. See Number of distinct categories statement.

Graph Window Output - GAGEAIAG.MTW

·    In the Components of Variation graph (located in the upper left corner), the percent contribution from Part-To-Part is larger than that of Total Gage R&R, telling you that much of the variation is due to differences between parts.

·    In the By Part graph (located in upper right corner), there are large differences between parts, as shown by the non-level line.

·    In the R Chart by Operator (located in middle of the left corner), Operator B measures parts inconsistently.

·    In the By Operator graph (located in the middle of the right column), the differences between operators are small compared to the differences between parts, but are significant (p-value = 0.00). Operator C appears to measure slightly lower than the others.

·    In the Xbar Chart by Operator (located in lower left corner), most of the points in the X and R chart are outside the control limits, indicating variation is mainly due to differences between parts.

·    The Operator* Part Interaction graph is a visualization of the p-value for Oper*Part - 0.974 in this case - indicating no significant interaction between each Part and Operator.

Session Window Output - GAGE2.MTW

·    Look at the p-value for the Operator*Part interaction in the ANOVA Table. When the p-value for Operator by Part is > 0.05, Minitab fits the model without the interaction and uses the reduced model to define the Gage R&R statistics.

·    Look at the %Contribution column in the Gage R&R table - the percent contribution from Total Gage R&R (84.36) is larger than that of Part-To-Part (15.64). Thus, most of the variation arises from the measuring system; very little is due to differences between parts.

·    Look at the %Study Var column - the Total Gage R&R equals 91.85% of the study variation. The measurement system is unacceptable and must be improved. See Guidelines for measurement system acceptability.

·    A 1 tells you the measurement system is poor; it cannot distinguish differences between parts.

Graph Window Output - GAGE2.MTW

·    In the Components of Variation graph (located in the upper left corner), the percent contribution from Total Gage R&R is larger than that of Part-to-Part, telling you that most of the variation is due to the measurement system - primarily repeatability; little is due to differences between parts.

·    In the By Part graph (located in upper right corner), there is little difference between parts, as shown by the nearly level line.

·    In the Xbar Chart by Operator (located in lower left corner), most of the points in the X and R chart are inside the control limits, indicating the observed variation is mainly due to the measurement system.

·    In the By Operator graph (located in the middle of the right column), there are no differences between operators, as shown by the level line.

·    The Operator*Interaction graph is a visualization of the p-value for Oper*Part - 0.484 in this case - indicating the differences between each operator/part combination are insignificant compared to the total amount of variation.