A hypothetical experiment and Monte Carlo simulations were used to examine the effectiveness of statistical design of experiments methods in identifying from the experimental data the correct terms in postulated regression models for a variety of experimental conditions. Two analysis of variance techniques (components of variance and pooled mean square error) combined with F-test statistics were investigated with first-order and second-order regression models. It was concluded that there are experimental conditions for which one or the other of the procedures results in model identification with high confidence, but there are also other conditions in which neither procedure is successful. The ability of the statistical approaches to identify the correct models varies so drastically, depending on experimental conditions, that it seems unlikely that arbitrarily choosing a method and applying it will lead to identification of the effects that are significant with a reasonable degree of confidence. It is concluded that before designing and conducting an experiment, one should use simulations of the proposed experiment with postulated truths in order to determine which statistical design of experiments approach, if any, will identify the correct model from the experimental data with an acceptable degree of confidence. In addition, no significant change in the effectiveness of the methods in identifying the correct model was observed when systematic uncertainties of up to 10 percent in the independent variables and in the response were introduced into the simulations. An explanation is that the systematic errors in the simulation data caused a shift of the whole response surface up or down from the true value, without a significant change in shape. [S0098-2202(00)03102-3]
Skip Nav Destination
Article navigation
June 2000
Technical Papers
Limitations of Statistical Design of Experiments Approaches in Engineering Testing
Stelu Deaconu, Graduate Research Assistant,
Stelu Deaconu, Graduate Research Assistant
Propulsion Research Center, Mechanical and Aerospace Engineering Department, University of Alabama in Huntsville, Huntsville, AL 35899
Search for other works by this author on:
Hugh W. Coleman, Eminent Scholar in Propulsion and Professor, Fellow ASME
Hugh W. Coleman, Eminent Scholar in Propulsion and Professor, Fellow ASME
Propulsion Research Center, Mechanical and Aerospace Engineering Department, University of Alabama in Huntsville, Huntsville, AL 35899
Search for other works by this author on:
Stelu Deaconu, Graduate Research Assistant
Propulsion Research Center, Mechanical and Aerospace Engineering Department, University of Alabama in Huntsville, Huntsville, AL 35899
Hugh W. Coleman, Eminent Scholar in Propulsion and Professor, Fellow ASME
Propulsion Research Center, Mechanical and Aerospace Engineering Department, University of Alabama in Huntsville, Huntsville, AL 35899
Contributed by the Fluids Engineering Division for publication in the JOURNAL OF FLUIDS ENGINEERING. Manuscript received by the Fluids Engineering Division January 28, 1999; revised manuscript received March 2, 2000. Associate Technical Editor: M. R. Hajj.
J. Fluids Eng. Jun 2000, 122(2): 254-259 (6 pages)
Published Online: March 2, 2000
Article history
Received:
January 28, 1999
Revised:
March 2, 2000
Citation
Deaconu, S., and Coleman, H. W. (March 2, 2000). "Limitations of Statistical Design of Experiments Approaches in Engineering Testing ." ASME. J. Fluids Eng. June 2000; 122(2): 254–259. https://doi.org/10.1115/1.483252
Download citation file:
Get Email Alerts
Related Articles
Sensitivity Analysis of a 2.5 kW Proton Exchange Membrane Fuel Cell Stack by Statistical Method
J. Fuel Cell Sci. Technol (February,2009)
Effect of Geometrical Uncertainty on Cemented Hip Implant Structural Integrity
J Biomech Eng (May,2009)
A Statistical Analysis to Control the Growth of Cobalt Ferrite Nanoparticles Synthesized by the Thermodecomposition Method
J. Manuf. Sci. Eng (June,2010)
Comparison of Video Laryngoscopy Technologies
J. Med. Devices (June,2009)
Related Proceedings Papers
Related Chapters
The Data Analysis and Prediction of the Spiritual Comfort Demand of Home Care Security—Based on the Stata Statistical Software Technology and Logit Mode
International Conference on Information Technology and Computer Science, 3rd (ITCS 2011)
Incomplete Data
Taguchi Methods for Robust Design
A Learning-Based Adaptive Routing for QoS-Aware Data Collection in Fixed Sensor Networks with Mobile Sinks
Intelligent Engineering Systems through Artificial Neural Networks, Volume 20