Academia.eduAcademia.edu

Outline

Test case reduction methods by using CBR

2010

Abstract

It has been proven that software testing usually consumes over 50% of the costs associated with the development of commercial software systems. Particularly, regression testing activities has been shown to be a critically important phase of software testing. Many reduction techniques have been proposed to reduce costs. Unfortunately, the cost is usually over budget and those methods are failed to reasonably control costs. The primarily outstanding issue is non-effective methods to remove redundancy tests while a bigger size of tests and a significant amount of time are still remaining. To resolve the issue, this paper proposes an artificial intelligent concept of case-based reasoning (CBR). CBR has an uncontrollable costs issue as same as testing. There are many effective algorithms researched over a long period of time. This study introduces three methods combined between CBR’s deletion algorithm and testing activities. Those methods aim to minimize size of tests and time, while pr...

References (41)

  1. REFERENCES
  2. A. Jefferson Offutt, Jie Pan and Jeffery M. Voas, "Procedures for Reducing the Size of Coverage-based Test Sets", 1995.
  3. Barry Smyth & Keane. "Remembering To Forget: A Competence Preserving Deletion Policy for Case-Based Reasoning Systems" In Proceedings of the 14 th International Joint Conference on Artificial Intelligence, 377-382. Morgan-Kaufman, 1995.
  4. Barry Smyth Ph.D. Thesis. "Case Based Design" Department of Computer Science, Trinity College, Dublin Ireland, 1996.
  5. Barry W. Boehm, "A Spiral Model of Software Development and Enhancement", TRW Defense Systems Group, 1998.
  6. Boris Beizer, "Software Testing Techniques, Van Nostrand Reinhold", Inc, New York NY, 2nd edition. ISBN 0-442-20672-0, 1990.
  7. Bo Qu, Changhai Nie, Baowen Xu and Xiaofang Zhang, "Test Case Prioritization for Black Box Testing", 31st Annual International Computer Software and Applications Conference (COMPSAC 2007), 2007.
  8. Cem Kaner, "Exploratory Testing", Florida Institute of Technology, Quality Assurance Institute Worldwide Annual Software Testing Conference, Orlando, FL, 2006.
  9. David C. Wilson. Ph.D. Thesis "A Case-Based Maintenance: The husbandry of experiences." Department of Computer Science, Indiana University, 2001.
  10. E. Lehmann and J. Wegener, "Test case design by means of the CTE XL", In Proc. of the 8th European International Conf. on Software Testing, Analysis & Review (EuroSTAR 2000), 2000.
  11. Gregg Rothermel, Roland H. Untch, Chengyun Chu and Mary Jean Harrold, "Prioritizing Test Cases for Regression Testing", IEEE Transactions on Software Engineering, 2001.
  12. Gregg Rothermel, R. H. Untch, C. Chu, and M. J. Harrold, "Test case prioritization: An empirical study", In Proceedings of the IEEE International Conference on Software Maintenance, pages 179-188, Oxford, England, UK, 1999.
  13. Gregg Rothermel, Mary Jean Harrold, Jeffery Ostrin and Christie Hong, "An Empirical Study of the Effects of Minimization on the Fault Detection Capabilities of Test Suites", In Proceedings of IEEE International Test Conference on Software Maintenance (ITCSM'98), Washington D.C., pp. 34-43, 1998.
  14. Gregg Rothermel, Mary Jean Harrold, Jeffery von Ronne and Christie Hong, "Empirical Studies of Test-Suite Reduction", In Journal of Software Testing, Verification, and Reliability, Vol. 12, No. 4, 2002.
  15. Gregg Rothermel and Mary Jean Harrold, "A Safe, Efficient Regression Test Selection Technique", ACM Transactions on Softw. Eng. And Methodology, 6(2): 173- 210, 1997.
  16. Gregg Rothermel and Mary Jean Harrold, "Analyzing Regression Test Selection Techniques", IEEE Transactions on Software Engineering, 22(8):529-551, 1996.
  17. Jirapun Daengdej, Ph.D. Thesis, "Adaptable Case Base Reasoning Techniques for Dealing with Highly Noise Cases" The University of New England, Australia, 1998.
  18. Jun Zhu and Quiang Yang. "Remembering To Add Competence-preserving Case Addition Policies for Case Base Maintenance." In Proceedings of the 16 th International Joint Conference in Artificial Intelligence, 234-241.
  19. Morgan-Kaufmann, 1999
  20. Mary Jean Harrold, Rajiv Gupta and Mary Lou Soffa, "A Methodology for Controlling the Size of A Test Suite", ACM Transactions on Software Engineering and Methodology, 2(3):270-285, 1993.
  21. Nicha Kosindrdecha and Jirapun Daengdej, "A Deletion Algorithm for Case-Based Maintenance Based on Accuracy and Competence", Assumption University, Thailand, 2003
  22. Nicha Kosindrdecha and Siripong Roongruangsuwan, "Reducing Test Case Created by Path Oriented Test Case Generation", AIAA 2007 Conference and Exhibition, Rohnert Park, California, USA, 2007.
  23. NIST, "The economic impacts of inadequate infrastructure for software testing", 2002.
  24. Saif-ur-Rebman Khan and Aamer Nadeem, "TestFilter: A Statement-Coverage Based Test Case Reduction Technique", 2006.
  25. Sara Sprenkle, Sreedevi Sampath and Amie Souter, "An Empirical Comparison of Test Suite Reduction Techniques for User-session-based Testing of Web Applications", Journal of Software. Testing, Verification, and Reliability, 4(2), 2002.
  26. Scott McMaster and Atif Memon, "Call Stack Coverage for Test Suite Reduction", Proceedings of the 21st IEEE International Conference on Software Maintenance (ICSM'05), pages 539-548, Budapest, Hungary, 2005.
  27. Scott McMaster and Atif Memon, "Call Stack Coverage for GUI Test-Suite Reduction", Proceedings of the 17th IEEE International Symposium on Software Reliability Engineering (ISSRE 2006), NC, USA, 2006.
  28. Scott McMaster and Atif Memon, "Fault Detection Probability Analysis for Coverage-Based Test Suite Reduction", IEEE, 2007.
  29. Sreedevi Sampath, Sara Sprenkle, Emily Gibson and Lori Pollock, "Web Application Testing with Customized Test Requirements -An Experimental Comparison Study", 17th International Symposium on Software Reliability Engineering (ISSRE'06), 2006.
  30. Siripong Roongruangsuwan and Jirapun Daengdej, "Techniques for improving case-based maintenance", Assumption University, Thailand, 2003
  31. Siripong Roongruangsuwan and Jirapun Daengdej, "Test Case Reduction", Technical Report 25521. Assumption University, Thailand, 2009.
  32. S. Elbaum, A. Malishevsky, and G. Rothermel, "Test Case Prioritization: A Family of Empirical Studies", IEEE Trans. on Software Engineering, vol. 28, 2002.
  33. S. Elbaum, A. G. Malishevsky and G. Rothermel, "Prioritizing Test Cases for Regression Testing", In Proceedings of the International Symposium on Software Testing and Analysis, pages 102-112, 2000.
  34. S. Elbaum, P. Kallakuri, A. G. Malishevsky, G. Rothermel, and S. Kanduri, "Understanding the effects of changes on the cost-effectiveness of regression testing techniques", Journal of Software Testing, Verification, and Reliability, 13(2):65-83, 2003.
  35. Todd L. Graves, Mary Jean Harrold, Jung-Min Kim, Adam Porter and Gregg Rothermel, "An Empirical Study of Regression Test Selection Techniques", 2000.
  36. W. Eric Wong, J. R. Horgan, Saul London and Hira Agrawal, "A Study of Effective Regression Testing in Practice", 8th IEEE International Symposium on Software Reliability Engineering (ISSRE'97), 1997.
  37. W. Eric Wong, Joseph R. Horgan, Saul London and Aditya P. Mathur, "Effect of Test Set Minimization on the Fault Detection Effectiveness of the All-Uses Criterion", In Proceedings of the 17th International Conference on Software Engineering, pages 41-50, 1995.
  38. Xiaofang Zhang, Baowen Xu, Changhai Nie and Liang Shi, "An Approach for Optimizing Test Suite Based on Testing Requirement Reduction", Journal of Software (in Chinese), 18(4): 821-831, 2007.
  39. Xiaofang Zhang, Baowen Xu, Changhai Nie and Liang Shi, "Test Suite Optimization Based on Testing Requirements Reduction", International Journal of Electronics & Computer Science, 7(1): 9-15, 2005.
  40. Xue-ying MA, Bin-kui Sheng, Zhen-feng HE and Cheng-qing YE, "A Genetic Algorithm for Test-Suite Reduction", IEEE, China, 2006.
  41. Yanbing Yu, James A. Jones and Mary Jean Harrold, "An Empirical Study of the Effects of Test-Suite Reduction on Fault Localization", Proceedings of ICSE'08, Germany, 2008.