Development of efficient t-way test data generation algorithm and execution strategies

For a typical software product, it is desired to test all possible combinations of input data in various configurations, Exhaustive testing is impossible to execute prior to release in the market. The lack of resources, cost factors and tight deadlines to market are some of the main factors that pre...

Full description

Bibliographic Details
Main Author: Khandakar Fazley, Rabbi
Format: Thesis
Language:English
Published: 2012
Subjects:
Online Access:http://umpir.ump.edu.my/id/eprint/3659/
http://umpir.ump.edu.my/id/eprint/3659/1/CD6307_KHANDAR_FAZLEY_RABBI.pdf
id ump-3659
recordtype eprints
spelling ump-36592015-03-03T08:02:28Z http://umpir.ump.edu.my/id/eprint/3659/ Development of efficient t-way test data generation algorithm and execution strategies Khandakar Fazley, Rabbi QA Mathematics For a typical software product, it is desired to test all possible combinations of input data in various configurations, Exhaustive testing is impossible to execute prior to release in the market. The lack of resources, cost factors and tight deadlines to market are some of the main factors that prevent this consideration. In current practice, usually the test-data are selected and executed randomly. Many useful strategies (2-Way and TWay sampling) were developed to generate test-data and facilitate smooth testing process. Comprehensive test data generation is nondeterministic polynomial hard problem (NP-complete). Hence, optimization in terms of number of generated test-data and execution time is in demand. Motivated by these, this thesis addresses the design, implementation and validation of four effective test data generation strategies in terms of 2-way and T-way as follows: (I) PS2Way (Pairwise Search for 2-way Test Data Generation) strategy is based on parameters pair technique. This strategy is able to reduce the number of test data, but the execution time is not optimized. (II) EasyA (Easy Algorithm for 2-way Test Data Generation) is developed based on matrix based calculation to overcome the time constrains by keeping the number of test data in an acceptable range. This strategy is unable to support non uniform values. (III) R2Way (Random Search for 2-way Test Data Generation) with execution tool is developed to support both uniform and non-uniform values using search based software engineering. R2Way outperforms other existing strategies but cannot support higher interaction level (T > 2). And finally, (IV) MTTG (Multi-Tuple based T-way Test Data Generation) strategy is developed inspiring kids “Card Game” to overcome the limitations of interaction strength. An executable prototype tool is also developed for auto test execution besides efficient test data generation. Empirical data shows that MTTG is effective and outperforms other strategies in terms of number of test data generation time (more than 74% improvement), maintaining a tolerable test data size. All the proposed strategies are simpler to implement and handle. They are also efficient in terms of execution time and able to generate highly reduced test data suites to fulfil the current demand (easy and faster process) by software development companies. 2012-09 Thesis NonPeerReviewed application/pdf en http://umpir.ump.edu.my/id/eprint/3659/1/CD6307_KHANDAR_FAZLEY_RABBI.pdf Khandakar Fazley, Rabbi (2012) Development of efficient t-way test data generation algorithm and execution strategies. Masters thesis, Universiti Malaysia Pahang.
repository_type Digital Repository
institution_category Local University
institution Universiti Malaysia Pahang
building UMP Institutional Repository
collection Online Access
language English
topic QA Mathematics
spellingShingle QA Mathematics
Khandakar Fazley, Rabbi
Development of efficient t-way test data generation algorithm and execution strategies
description For a typical software product, it is desired to test all possible combinations of input data in various configurations, Exhaustive testing is impossible to execute prior to release in the market. The lack of resources, cost factors and tight deadlines to market are some of the main factors that prevent this consideration. In current practice, usually the test-data are selected and executed randomly. Many useful strategies (2-Way and TWay sampling) were developed to generate test-data and facilitate smooth testing process. Comprehensive test data generation is nondeterministic polynomial hard problem (NP-complete). Hence, optimization in terms of number of generated test-data and execution time is in demand. Motivated by these, this thesis addresses the design, implementation and validation of four effective test data generation strategies in terms of 2-way and T-way as follows: (I) PS2Way (Pairwise Search for 2-way Test Data Generation) strategy is based on parameters pair technique. This strategy is able to reduce the number of test data, but the execution time is not optimized. (II) EasyA (Easy Algorithm for 2-way Test Data Generation) is developed based on matrix based calculation to overcome the time constrains by keeping the number of test data in an acceptable range. This strategy is unable to support non uniform values. (III) R2Way (Random Search for 2-way Test Data Generation) with execution tool is developed to support both uniform and non-uniform values using search based software engineering. R2Way outperforms other existing strategies but cannot support higher interaction level (T > 2). And finally, (IV) MTTG (Multi-Tuple based T-way Test Data Generation) strategy is developed inspiring kids “Card Game” to overcome the limitations of interaction strength. An executable prototype tool is also developed for auto test execution besides efficient test data generation. Empirical data shows that MTTG is effective and outperforms other strategies in terms of number of test data generation time (more than 74% improvement), maintaining a tolerable test data size. All the proposed strategies are simpler to implement and handle. They are also efficient in terms of execution time and able to generate highly reduced test data suites to fulfil the current demand (easy and faster process) by software development companies.
format Thesis
author Khandakar Fazley, Rabbi
author_facet Khandakar Fazley, Rabbi
author_sort Khandakar Fazley, Rabbi
title Development of efficient t-way test data generation algorithm and execution strategies
title_short Development of efficient t-way test data generation algorithm and execution strategies
title_full Development of efficient t-way test data generation algorithm and execution strategies
title_fullStr Development of efficient t-way test data generation algorithm and execution strategies
title_full_unstemmed Development of efficient t-way test data generation algorithm and execution strategies
title_sort development of efficient t-way test data generation algorithm and execution strategies
publishDate 2012
url http://umpir.ump.edu.my/id/eprint/3659/
http://umpir.ump.edu.my/id/eprint/3659/1/CD6307_KHANDAR_FAZLEY_RABBI.pdf
first_indexed 2023-09-18T21:58:04Z
last_indexed 2023-09-18T21:58:04Z
_version_ 1777414212491935744