Exclusive Content & Downloads from ASQ

Guidelines for Planning and Evidence for Assessing a Well-Designed Experiment

Summary: [This abstract is based on the authors' abstract.] Since the design of experiments was first introduced by Fisher 90 years ago, this scientific and statistical approach to system interrogation for acquiring knowledge has enjoyed success across industries and among products, processes, and services. In the last decade, military test organizations have been promoting the use of design of experiments (DOE) as the preferred method of constructing and analyzing test programs. Increasingly, design of experiments is being used to greater effect and its impact is reaching groups less experienced in the method. Stories of successful application continue to have a common thread: detailed, effective planning. But not all organizations have members experienced in DOE test planning. And although planning papers and how-to case studies have appeared in the literature, the volume of these contribution types is dwarfed by theory and methods papers. If an experiment is planned and the planning process is documented, how would one go about assessing that plan? If the desire is to gauge the probability of experiment success as defined by a robust and truthful understanding of the system revealed upon analysis of the data, can the plan be assessed prior to test execution? This article proposes guidelines and evidence that span all phases of the experiment cycle, which can inform assessment of experiment planning soundness. The experiment cycle of plan, design, execute, and analyze (consistent with literature and texts) is used to structure the discussion, geared toward an audience somewhat familiar with the DOE method. Checklists are provided for each experiment phase coupled with descriptions of what would constitute fingerprints of successful implementation.

Anyone with a subscription, including Site and Enterprise members, can access this article.

Other Ways to Access content:

Join ASQ

Join ASQ as a Full member. Enjoy all the ASQ member benefits including access to many online articles.

  • Topics: Design of Experiments
  • Keywords: Design of experiments (DOE), Checklists, Test plans, Military, Metrics, Planning
  • Author: Simpson, James R.; Listak, Charles M.; Hutto, Gregory T.;
  • Journal: Quality Engineering