1

Click here to load reader

The genealogy of combinatorial testing

Embed Size (px)

DESCRIPTION

I put together historical topics regarding combinatorial testing on this timeline. In the 1930s, Ronald Fisher developed the Design of Experiments. Rao introduced orthogonal arrays in the 1940s From the 1950s, Genichi Taguchi developed a methodology for applying statistics to improve quality in manufacturing and established the Quality Engineering. Afterwards, his methodology got a great reputation and was named "Taguchi method" in the United States. I think this reputation in the US was transmitted to Japan, Taguchi method drew attention in Japan in the early 1980s. Shortly after, software QA engineers at Fujitsu started to apply the Design of Experiments to software testing in 1983, and they published papers in 1984 and 1987. In the late 1980s, a few case studies were reported from NEC and IBM Japan, howe In 1989, Fujitsu introduced this technique to AT&T. After that, OATS, CATS and AETG were developed by AT&T group companies. From the mid 1990s, combinatorial testing began to spread in the US. In 1995, Dr. Phadke's paper was translated into Japanese and printed in the journal of Quality engineering. Also, some case studies were reported in the community of quality engineering in the late 1990s. However, combinatorial testing got much attention again after HAYST method was announced by Fuji Xerox in 2004. Currently, many Japanese testers consider that Combinatorial Testing is one of the must-have techniques. For Japan, we can say combinatorial testing is a re import technique.

Citation preview

Page 1: The genealogy of combinatorial testing

Genealogy of combinatorial testing

10 (c) K. Tatsumi 2013

1920-1930 Design of Experiment (Fisher)

1940 Orthogonal Array (Rao)

Quality Engineering (Taguchi)u

<Industry> Quality Engineering Forum founded

Robust testing for software engineering (Phadke)

Application of QE to software testing (Taguchi)

Case studies for software testing(Epson, Minolta, Matsushita)

Orthogonal array HAYST method development startbased testing

Presented at Book published Tool releasedApplication of DoE the symposiumto software testing Test Case Design Support System (Tatsumi)

Reported on Fujitsu's English journal

PictMaster (Iwatsu)Case studies (NEC, IBM Japan)

<Academia> CIT-BACHCombinatorial design Genetic Algorithm

u u "Taguchi methods" namedIntroduction of QE(Xerox,Bell Lab) u

Fujitsu-AT&T meeting

OATS (Brownlie, Phadke et.al.)CATS (Sherwood)

AETG (Cohen et.al.)Application of DoE to compiler testing (Mandl)

PICT(Microsoft) ACTS(NIST)

1995 2000 2005 20101985 19901950 1960 1970 1980

Quality

Engineering

Community

Software

Engineering

Community

JAPAN

USA

[Fuji Xerox]

[Fujitsu]

[AT&T]

[Osaka univ.]

Computational Approaches

Algebraic Approaches (OA, CA)

[Bellcore]