This free survey is powered by
0%
Exit Survey
 
 
Dear exploratory testing practitioner,

You are invited to participate in our survey where we intend to assess different types of test charters for their advantages and disadvantages. We classify test charters in five different types between the spectrum of fully scripted testing and free style exploratory testing. To ensure the same understanding of these test charter types across the respondents of this survey, these charter types are explained below:

1. Fully scripted: The tester is provided with the test steps, but also with the test data, which does not provide room for exploration steps.
2. Low degree of exploration: Besides the information for Medium degree of exploration, the tester is also required to follow certain test steps, which further may bias the tester and reduce the exploration space. The tester is encouraged to choose the test data to be used in the test steps.
3. 
Medium degree of exploration: The tester is provided with one or more high goals for the test session. At the same time additional restrictions are required, that may bias and thus limit the tester in his/her testing session. Biasing aspects could be too detailed goals, priorities, risks that the tester is required to focus on, tools used, the functionality that needs to be covered, or the test method to be used.
4. High degree of exploration: The tester is provided with one or more high goals for the test session, also knowing the test object.  Besides that, the tester can freely explore the system. 
5. Freestyle: Only the test object is provided to the tester. The tester can freely explore the system.


It will take approximately 10 minutes to complete the questionnaire.

Your survey responses will be strictly confidential and data from this research will be reported only in the aggregate. Your information will be coded and will remain confidential. If you have questions at any time about the survey or the procedures, you may contact us at the email addresses specified below.

Thank you very much for your time and support. Please start with the survey now by clicking on the Continue button below.


Sincerely,
Ahmad Nauman Ghazi ([email protected])
Prof. Kai Petersen ([email protected])
Dr. Elizabeth Bjarnason (elizabeth.bjarnason@cs.lth.se)

 
 
 
Contact Information
First Name : 
Last Name : 
Email Address : 
 
 
 
* Experience as software tester (in years)
   
* Overall experience in the software industry (in years)
   
* Current product and organization where you work
   
 
 
How Frequently you use the different types of test charters in your work as a tester?
Never Sometimes Always
Fully Scripted
Low degree of exploration
Medium degree of exploration
High degree of exploration
Freestyle
 
 
How does fully scripted test charter design influence the following variables?

(Please take note: Fully scripted: The tester is provided with the test steps, but also with the test data, which does not provide room for exploration steps.)
Negative No influence Positive
* Facilitates better learning
* Easy to trace coverage
* Time efficiency
* Effort to prepare tests
* Ease of designing new tests
* Stability of test cases (Resilience to change test cases)
* Effort to maintain test cases
* Filling knowledge gap when new requirements are added
* Ability to fulfil conformance and legal requirements
* Scripted test knowledge biases in conducting exploratory testing
Negative No influence Positive
* Ability to check verification of requirements
* Reproducibility of defects
* Suitability for testing stability/ performance
* Challenging expected outcomes through critical thinking
* Facilitates to find more significant defects
* Facilitates to find new(previously unknown) defects
* Motivates the testers
 
 
How does 'low degree of exploration' test charter design influence the following?

(Please take note: Low degree of exploration: Besides the information for Medium degree of exploration, the tester is also required to follow certain test steps, which further may bias the tester and reduce the exploration space. The tester is encouraged to choose the test data to be used in the test steps.)
Negative No Influence Positive
* Facilitates better learning
* Easy to trace coverage
* Time efficiency
* Effort to prepare tests
* Ease of designing new tests
* Stability of test cases (Resilience to change test cases)
* Effort to maintain test cases
* Filling knowledge gap when new requirements are added
* Ability to fulfil conformance and legal requirements
* Scripted test knowledge biases in conducting exploratory testing
Negative No Influence Positive
* Ability to check verification of requirements
* Reproducibility of defects
* Suitability for testing stability/ performance
* Challenging expected outcomes through critical thinking
* Facilitates to find more significant defects
* Facilitates to find new(previously unknown) defects
* Motivates the testers
 
 

How does 'medium degree of exploration' test charter design influence the following?

(Please take note: Medium degree of exploration: The tester is provided with one or more high goals for the test session. At the same time additional restrictions are required, that may bias and thus limit the tester in his/her testing session. Biasing aspects could be too detailed goals, priorities, risks that the tester is required to focus on, tools used, the functionality that needs to be covered, or the test method to be used.)


Negative No Influence Positive
* Facilitates better learning
* Easy to trace coverage
* Time efficiency
* Effort to prepare tests
* Ease of designing new tests
* Stability of test cases (Resilience to change test cases)
* Effort to maintain test cases
* Filling knowledge gap when new requirements are added
* Ability to fulfil conformance and legal requirements
* Scripted test knowledge biases in conducting exploratory testing
Negative No Influence Positive
* Ability to check verification of requirements
* Reproducibility of defects
* Suitability for testing stability/ performance
* Challenging expected outcomes through critical thinking
* Facilitates to find more significant defects
* Facilitates to find new(previously unknown) defects
* Motivates the testers
 
 

How does 'high degree of exploration' test charter design influence the following?

(Please take note: High degree of exploration: The tester is provided with one or more high goals for the test session, also knowing the test object.  Besides that, the tester can freely explore the system.)


Negative No Influence Positive
* Facilitates better learning
* Easy to trace coverage
* Time efficiency
* Effort to prepare tests
* Ease of designing new tests
* Stability of test cases (Resilience to change test cases)
* Effort to maintain test cases
* Filling knowledge gap when new requirements are added
* Ability to fulfil conformance and legal requirements
* Scripted test knowledge biases in conducting exploratory testing
Negative No Influence Positive
* Ability to check verification of requirements
* Reproducibility of defects
* Suitability for testing stability/ performance
* Challenging expected outcomes through critical thinking
* Facilitates to find more significant defects
* Facilitates to find new(previously unknown) defects
* Motivates the testers
 
 

How does 'freestyle' test charter design influence the following?

(Please take note: Freestyle: Only the test object is provided to the tester. The tester can freely explore the system)


Negative No Influence Positive
* Facilitates better learning
* Easy to trace coverage
* Time efficiency
* Effort to prepare tests
* Ease of designing new tests
* Stability of test cases (Resilience to change test cases)
* Effort to maintain test cases
* Filling knowledge gap when new requirements are added
* Ability to fulfil conformance and legal requirements
* Scripted test knowledge biases in conducting exploratory testing
Negative No Influence Positive
* Ability to check verification of requirements
* Reproducibility of defects
* Suitability for testing stability/ performance
* Challenging expected outcomes through critical thinking
* Facilitates to find more significant defects
* Facilitates to find new(previously unknown) defects
* Motivates the testers