Mao, K; Harman, M; Jia, Y; (2016) Sapienz: Multi-objective automated testing for android applications. In: Zeller, A and Roychoudhury, A, (eds.) Proceedings of the 25th International Symposium on Software Testing and Analysis ISSTA 2016. (pp. pp. 94-105). ACM: Saarbrücken, Germany.

Preview

Text p_issta16_sapienz.pdf - Accepted Version Download (796kB) | Preview

Abstract

We introduce Sapienz, an approach to Android testing that uses multi-objective search-based testing to automatically explore and optimise test sequences, minimising length, while simultaneously maximising coverage and fault revelation. Sapienz combines random fuzzing, systematic and search-based exploration, exploiting seeding and multi-level instrumentation. Sapienz significantly outperforms (with large effect size) both the state-of-the-art technique Dynodroid and the widely-used tool, Android Monkey, in 7/10 experiments for coverage, 7/10 for fault detection and 10/10 for fault-revealing sequence length. When applied to the top 1, 000 Google Play apps, Sapienz found 558 unique, previously unknown crashes. So far we have managed to make contact with the developers of 27 crashing apps. Of these, 14 have confirmed that the crashes are caused by real faults. Of those 14, six already have developer-confirmed fixes.

Download activity - last month

Export as XMLCSVJSON

Download activity - last 12 months

Export as JSONCSVXML

Downloads by country - last 12 months

Export as XMLCSVJSON

Archive Staff Only

View Item