That’s where Minitab Statistical Software’s Design of Experiments (DOE) capabilities come in. A designed experiment is a series of runs, or tests, in which you adjust multiple variables. It’s an efficient way to improve a process because you can change and evaluate more than one factor at a time, then use statistical analysis to get meaningful results. Minitab can help you determine which factors are most important, and understand how they interact and drive your process. Armed with that knowledge, you can find the factor settings that produce optimal process performance.
Rose’s first task was to select and quantify the right response. Improving, or at least maintaining, the quality of the parts produced at a faster rate was a primary goal, so he selected cut quality as the critical response. One experimental "run" would consist of cutting one sheet of steel. Cut quality would be ranked on a 1-5 scale, with 5 being a perfect cut. To establish a baseline, Rose did a preliminary analysis of parts cut with the existing settings, which showed the process was producing cuts with an average score of 4.
A laser operator who was enthusiastic about helping to find faster settings volunteered to evaluate parts produced in each run. Like any researcher, Rose needed to make sure he could rely on the precision of the measurement system before the experiment could begin. He used Minitab to perform an attribute agreement analysis, which would demonstrate whether the operator could assess cut quality consistently and accurately, according to the established standards. Based on the results of the analysis, one laser operator was selected as the sole evaluator. He was even able to use a more precise scoring system that incorporated ¼ increments (.25) instead of the whole numbers used previously. This improved the power of the data collection.
With the factors, critical response, and a reliable data collection method in place, Rose was ready to design his experiment. He knew factorial experiment design would let him study the effects of multiple factors on the process, but he needed to find the type of factorial design that would yield reliable results with the fewest experimental runs. He used Minitab to explore his options and identify the best one.
One option was a full factorial experiment, a very thorough approach that measures responses at all combinations of the factor levels. But this option can require a prohibitive number of runs. For example, a two-level full factorial design with 5 factors requires 32 runs. Considering that an experimenter may want to then add replicates , or repeat the runs multiple times, in many cases a full factorial experiment isn’t a viable option.
Rose instead looked at fractional factorial designs, which reduce the number of runs to a manageable size by excluding some combinations of factor levels, but still yield a reliable analysis of the factors. The runs that are performed are a selected subset, or fraction, of the full factorial design. But not running all factor level combinations means that some effects are confounded, and cannot be estimated separately from other effects. Therefore, the fraction must be carefully chosen to achieve meaningful results. To make the process easier, Minitab displays an alias table which specifies the confounding patterns.
For his initial experiment, Rose used Minitab to create a ½ fraction factorial design that required just 16 runs (Figure 1), but still permitted him to estimate the effects of both the factors and their two-way interactions. Rose also replicated the 16 runs 3 times to improve the power of the data collection, thus increasing the likelihood the experiment would identify a significant difference.