Mutation Churn Model

Michał Mnich,

Adam Roman,

Piotr Wawrzyniak


Mutation testing is considered as one of the most effective quality improvement technique by assessing the strength of the actual test suite. If no test is able to kill a given mutant, this means that the tests are not strong enough and we need to write additional one that will be able to kill this mutant. However, mutation testing is very time consuming. In this paper we investigate if it is possible to reduce the scope of the mutation analysis by running it only on the new or changed part of the code. Using data from the real open-source projects we analyze if there is a relation between mutation scope reduction and effectiveness of the mutation analysis.

Słowa kluczowe: Software testing, Mutation testing

[1] Millo R.A.D., Lipton R.J., Sayward F.G., Hints on test data selection: help for the practicing programmer. IEEE Computer, 1978, 11(4), pp. 34–41.

[2] Ammann P., Offutt J., Introduction to Software Testing. Cambridge University Press, Cambridge, UK, 2008.

[3] Zhang L., Marinov D., Khurshid S., Faster mutation testing inspired by test prioritization and reduction. In: ISSTA 2013 – Proceedings of the International Symposium on Software Testing and Analysis, 2013, pp. 235–245.

[4] Usaola M.P., Mateo P.R., Mutation testing cost reduction techniques: A survey. IEEE Software(, 2010, 27, pp. 80–86.

[5] Kim S., Clark J.A., McDermid J.A., Investigating the effectiveness of objectoriented testing strategies using the mutation method, software testing. Verification and Reliability, 2001, 11 (3), pp. 207–225.

[6] s. Ma Y., r. Kwon Y., Offutt J., Inter-class mutation operators for java. In: Proceedings of the 13th International Symposium on Software Reliability Engineering, IEEE, 2002, pp. 352–363.

[7] Papadakis M., Traon Y.L., Metallaxis-fl: mutation-based fault localization. Software Testing, Verification and Reliability, 2015 (25), pp. 605–628.

[8] PIT Mutation Testing., Accessed: 2016-12-30.

Czasopismo ukazuje się w sposób ciągły on-line.
Pierwotną formą czasopisma jest wersja elektroniczna.

Wersja papierowa czasopisma dostępna na