FDS Plots Dialog

img

Advanced Design of Experiments: Overlay FDS Plots Dialog


SigmaXL > Design of Experiments > Advanced Design of Experiments: Overlay FDS Plots


img

  1. Select FDS Plot Sheets and enter Legend names as desired. The default Legend names are FDS 1 to FDS 5. A maximum of 5 FDS Plot Sheets may be selected to produce Overlay FDS Plots.

  2. See Example 5: Evaluating Response Surface Designs with the Fraction of Design Space (FDS) Plot.

    Power analysis is very useful to assist in the design of 2 level factorial and fractional-factorial experiments. In a similar manner, the Fraction of Design Space (FDS) Plot assists the practitioner to select and right size their multi-level response surface and optimal designs. The FDS Plot was introduced by Zahran, Anderson-Cook and Myers [10].


    The FDS Plot provides a visual representation of how well the design covers the experimental space and helps in assessing the precision of predictions that can be made from the design. This can be used to compare and select number of replicates, number of center points, Central Composite alpha axial value, Central Composite vs Box-Behnken and optimality criterion. The FDS Plot will show Prediction Standard Error of the Mean (SE Mean) vs Fraction of Design Space and Margin of Error vs Fraction of Design Space.


    Histogram Options



    When comparing FDS Plots, lower is better and flatter is better over the majority of the design space. If you know the process standard deviation you can use the Margin of Error plot to assess if the actual prediction error will be acceptable over the majority of the design space (typically use FDS = 80 to 95%).


    The FDS Plot is produced prior to any data collection. Like the power calculations used in factorial designs, FDS assumes that the model standard deviation is 1. If the standard deviation is known, multiply the FDS Plot values by this standard deviation to get actual response units.


    A model must be specified for FDS, typically that will be an RSM Quadratic model (Main Effects + 2- Way Interactions + Quadratic Terms) with 95% Confidence Level. The FDS Plots are computed using Monte Carlo simulation with a uniform distribution and coded values from -1 to +1, hence cuboidal. This occurs even for rotatable Central Composite designs which allows for comparison of FDS Plots across various design types. For formula details, see the Appendix:Fraction of Design Space (FDS) Plots.

    SE Mean and Margin of Error are computed for 100,000 random values. These are sorted from smallest to largest and the results are plotted as SE Mean vs Fraction of Design Space and Margin of Error (Interval Half-Width) vs Fraction of Design Space using 1000 plot points.


    Cake Bake RSM Example 1

    This is the layer cake baking experiment revisited. The response variable is Taste Score (on a scale of 1-7 where 1 is "awful" and 7 is "delicious"). Average scores for a panel of tasters have been recorded. The X Factors are A: Bake Time (20 to 40 minutes) and B: Oven Temperature (350 to 400 F). The experiment is a 10-Run, Central Composite Design (CCD) with 2 Center Points, Face Centered with Alpha Axial = 1.0. We will first introduce the concept of the Fraction of Design Space Plot by analyzing this data and manually inputting values into the Predicted Response Calculator.

  1. Cake Bake RSM Example 1 was created by clicking: SigmaXL > Design of Experiments > Advanced Design of Experiments: Response Surface > Response Surface Designs.


  2. Histogram Options


  3. This is a 10 Run, Central Composite Design with 2 Center Points, Face Centered, and 1 Replicate. The FDS Plot uses a Quadratic Model with 95% Confidence Interval. Click OK.


  4. Now open the file RSM FDS Example - Cake Bake.xlsx, Sheet Example 1. This is populated with the Taste Score response values.


  5. Histogram Chart Options

    Runs are randomized in the actual experiment, but standard order is used for this demonstration.


  6. Click SigmaXL > Design of Experiments > Advanced Design of Experiments: Response Surface > Analyze Response Surface Design. Select Responses and Model Terms as shown. Uncheck Residual Plots.


  7. Histogram Chart Options

  8. Click OK.


  9. Histogram Chart Options

  10. Scroll to the Predicted Response Calculator. Enter the center point values Time = 30 and Temp = 375. This gives a Predicted Response for Taste = 6.57 with a Standard Error = 0.15 and 95% CI = 6.15 to 6.99.


  11. Histogram Chart Options

    The Margin of Error (Interval Half-Width) is 6.99 - 6.57 = 0.42. This is a wide interval considering that the taste score is on a scale of 1 to 7.


  12. Now enter Time = 20 and Temp = 350. This gives a Predicted Response for Taste = 6.29 with a Standard Error = 0.22 and 95% CI = 5.66 to 6.91


  13. Histogram Chart Options

    The Margin of Error (Interval Half-Width) is 6.91 - 6.29 = 0.62. This is an even wider interval than that obtained with the center points.


  14. The Fraction of Design Space (FDS) Plot will repeat the above process 100,000 times using a uniform random number from 20 to 40 for Time and 350 to 400 for Temp. to obtain 100,000 SE and Half-Interval values. These are sorted from smallest to largest and the results are plotted as SE Mean vs Fraction of Design Space and Margin of Error (Interval Half-Width) vs Fraction of Design Space using 1000 plot points.


  15. Hover the mouse cursor on the FDS plot to obtain values for any fraction of design space.

  16. Histogram Chart Options

    Smaller is better and flatter is better, over the majority of the design space.


  17. The FDS Summary Statistics complement the FDS Plot.


  18. Histogram Chart Options


    Looking at the 95th Percentile (i.e., 95% of the design space), we see that the SE Mean can be as large as .72 and the Margin of Error (Interval Half-Width) as large as 1.99.


  19. To obtain units of Taste Score, we multiply by the model standard deviation: SE Mean = 0.72*0.25 = 0.18 and Half-Width = 1.99*0.25 = 0.5. As noted previously, this is a large margin of error considering that the taste score is on a 7-point scale.


  20. Note that the Confidence Level of 95% applies to the Margin of Error. The 95th Percentile applies to the Fraction/Proportion of Design Space.


  21. Since these percentiles are based on Monte Carlo simulation, slightly different results will be observed every time they are produced unless a fixed seed is used.


Define, Measure, Analyze, Improve, Control

img

Simulate, Optimize, Realize

img