07c - Introduction to Software Testing

Testing Types and Techniques
Challenges of Security Testing
Black box testing approaches are not sufficient
Contradicts traditional Quality Assurance approaches May require a high level of expertise and skill to conduct
Test script maintenance
Adoption and acceptance Training and skill set
Unrealistic automation goals
Testing Types and Techniques
Summary
A variety of test techniques are needed to measure the quality of an application
Testing Types and Techniques
White Box Testing
White Box Testing uses the code structure of the
software requires knowledge of the code
• Tests cannot be created until the code is complete
Are formats correct the particular culture?
L10N testing requires tester who have some experience with the target culture.
Testing Types and Techniques
Testing Types and Techniques
Internationalization (I18N) Pseudotranslation
A common technique in internationalization testing is to translate parts of every string and message with special characters.
No knowledge of the programming is used
Software
Testing Types and Techniques
Black Box Testing
Pros and Cons
Pros
• Catches issues that end uses would see • No special knowledge
Can start earlier in the development lifecycle
Testing Types and Techniques
Performance Testing
A broad test area focused on measuring the following:
• Response time • Scalability
Testing Types and Techniques
Internationalization (I18N) testing
Internationalization testing ensures that an application can be adapted to different languages without requiring additional engineering.
costs
• End result is better quality
Testing Types and Techniques
Benefits of Automated Testing
Reduced test time
Reduced test costs More consistent test execution
• Load
Testing Types and Techniques
Security Testing
Security testing attempts to determine the risk of
intrusion and/or theft The more important the information the greater need for
Different test types use different tools and
techniques and tend to uncover different types of problems
It is important to understand the pros and cons of the various types of testing before you can create a successful test plan
Ensure that an applications functionality is not broken when utilizing a different language or locale Additionally I18N testing confirms that all the messages are properly externalized. Externalized strings will display the new language not the original.
Pseudo-translation allows testers to visually inspect the application to confirm that the strings have been properly externalized. This approach allows users to test the product without needing to know another language or fully translate the message files. Inexpensive and effective technique to check an application before having it localized.
Cons
• Takes more time to write test cases
Must understand the code Difficult to perform independently
• Cannot start until code is complete • Does not directly test end user functionality • Will not find omitted requirements
• Tests are designed early based only on requirements
Cons
• May be inefficient if input domain is large
• Large parts of code may not be covered
• May duplicate unit tests
Testing Types and Techniques
Localization Testing (L10N)
Localization Testing (L10N) confirms that the application
is properly adapted to a particular culture Is the translation correct?
Allows comprehensive regression testing
Pre-requisite for some types of testing (e.g., load testing)
Testing Types and Techniques
Challenges of Automated Testing
Automated Testing
Automated testing is an approach where tests are
executed using driver application instead of manually Record and play applications allow tester to record
activities and then replay them for regression testing
Test results are stored in logs or in databases Automated testing allows increased testing with reduced
Testing Types and Techniques
Testing Types and Techniques
Overview
Black box
White box
Stability
Usability
Gray box
Performance Security
Internationalization
and localization Test automation
Analyzes paths through the code and internal data values
Code
Test case
Testing Types and Techniques
White Box Testing