INTRODUCTION TO SOFTWARE TESTING

By U. HAMAD

CONTENTS PART OVERVIEW INTRODUCTION 11 ACTIVITIES OF A TEST ENGINEER 111 TESTING LEVELS BASED ON SOFTWARE ACTIVITY 112 BEIZER’S TESTING LEVELS BASED ON TEST PROCESS MATURITY 113 AUTOMATION OF TEST ACTIVITIES 12 SOFTWARE TESTING LIMITATIONS AND TERMINOLOGY 13 COVERAGE CRITERIA FOR TESTING 131 INFEASIBILITY AND SUBSUMPTION 132 CHARACTERISTICS OF A GOOD COVERAGE CRITERION 14 OLDER SOFTWARE TESTING TERMINOLOGY 15 BIBLIOGRAPHIC NOTES PART COVERAGE CRITERIA GRAPH COVERAGE 21 OVERVIEW 22 GRAPH COVERAGE CRITERIA 221 STRUCTURAL COVERAGE CRITERIA 222 DATA FLOW CRITERIA 223 SUBSUMPTION RELATIONSHIPS AMONG GRAPH COVERAGE CRITERIA 23 GRAPH COVERAGE FOR SOURCE CODE 231 STRUCTURAL GRAPH COVERAGE FOR SOURCE CODE 232 DATA FLOW GRAPH COVERAGE FOR SOURCE CODE 24 GRAPH COVERAGE FOR DESIGN ELEMENTS 241 STRUCTURAL GRAPH COVERAGE FOR DESIGN ELEMENTS 242 DATA FLOW GRAPH COVERAGE FOR DESIGN ELEMENTS 25 GRAPH COVERAGE FOR SPECI?CATIONS 251 TESTING SEQUENCING CONSTRAINTS 252 TESTING STATE BEHAVIOR OF SOFTWARE 26 GRAPH COVERAGE FOR USE CASES 261 USE CASE SCENARIOS 27 REPRESENTING GRAPHS ALGEBRAICALLY 271 REDUCING GRAPHS TO PATH EXPRESSIONS 272 APPLICATIONS OF PATH EXPRESSIONS 273 DERIVING TEST INPUTS 274 COUNTING PATHS IN A FLOW GRAPH AND DETERMINING MAX PATH LENGTH 275 MINIMUM NUMBER OF PATHS TO REACH ALL EDGES 276 COMPLEMENTARY OPERATIONS ANALYSIS 28 BIBLIOGRAPHIC NOTES LOGIC COVERAGE 31 OVERVIEW: LOGIC PREDICATES AND CLAUSES 32 LOGIC EXPRESSION COVERAGE CRITERIA 321 ACTIVE CLAUSE COVERAGE 322 INACTIVE CLAUSE COVERAGE 323 INFEASIBILITY AND SUBSUMPTION 324 MAKING A CLAUSE DETERMINE A PREDICATE 325 FINDING SATISFYING VALUES 33 STRUCTURAL LOGIC COVERAGE OF PROGRAMS 331 PREDICATE TRANSFORMATION ISSUES 34 SPECI?CATION-BASED LOGIC COVERAGE 35 LOGIC COVERAGE OF FINITE STATE MACHINES 36 DISJUNCTIVE NORMAL FORM CRITERIA 37 BIBLIOGRAPHIC NOTES INPUT SPACE PARTITIONING 41 INPUT DOMAIN MODELING 411 INTERFACE-BASED INPUT DOMAIN MODELING 412 FUNCTIONALITY-BASED INPUT DOMAIN MODELING 413 IDENTIFYING CHARACTERISTICS 414 CHOOSING BLOCKS AND VALUES 415 USING MORE THAN ONE INPUT DOMAIN MODEL 416 CHECKING THE INPUT DOMAIN MODEL 42 COMBINATION STRATEGIES CRITERIA 43 CONSTRAINTS AMONG PARTITIONS 44 BIBLIOGRAPHIC NOTES SYNTAX-BASED TESTING 51 SYNTAX-BASED COVERAGE CRITERIA 511 BNF COVERAGE CRITERIA 512 MUTATION TESTING 52 PROGRAM-BASED GRAMMARS 521 BNF GRAMMARS FOR LANGUAGES 522 PROGRAM-BASED MUTATION 53 INTEGRATION AND OBJECT-ORIENTED TESTING 531 BNF INTEGRATION TESTING 532 INTEGRATION MUTATION 54 SPECI?CATION-BASED GRAMMARS 541 BNF GRAMMARS 542 SPECI?CATION-BASED MUTATION 55 INPUT SPACE GRAMMARS 551 BNF GRAMMARS 552 MUTATION FOR INPUT GRAMMARS 56 BIBLIOGRAPHIC NOTES APPLYING CRITERIA IN PRACTICE PRACTICAL CONSIDERATIONS 61 REGRESSION TESTING 62 INTEGRATION AND TESTING 621 STUBS AND DRIVERS 622 CLASS INTEGRATION TEST ORDER 63 TEST PROCESS 631 REQUIREMENTS ANALYSIS AND SPECI?CATION 632 SYSTEM AND SOFTWARE DESIGN 633 INTERMEDIATE DESIGN 634 DETAILED DESIGN 635 IMPLEMENTATION 636 INTEGRATION 637 SYSTEM DEPLOYMENT 638 OPERATION AND MAINTENANCE 639 SUMMARY 64 TEST PLANS 65 IDENTIFYING CORRECT OUTPUTS 651 DIRECT VERI?CATION OF OUTPUTS 652 REDUNDANT COMPUTATIONS 653 CONSISTENCY CHECKS 654 DATA REDUNDANCY 66 BIBLIOGRAPHIC NOTES ENGINEERING CRITERIA FOR TECHNOLOGIES 71 TESTING OBJECT-ORIENTED SOFTWARE 711 UNIQUE ISSUES WITH TESTING OO SOFTWARE 712 TYPES OF OBJECT-ORIENTED FAULTS 72 TESTING WEB APPLICATIONS AND WEB SERVICES 721 TESTING STATIC HYPER TEXT WEB SITES 722 TESTING DYNAMIC WEB APPLICATIONS 723 TESTING WEB SERVICES 73 TESTING GRAPHICAL USER INTERFACES 731 TESTING GUIS 74 REAL-TIME SOFTWARE AND EMBEDDED SOFTWARE 75 BIBLIOGRAPHIC NOTES BUILDING TESTING TOOLS 81 INSTRUMENTATION FOR GRAPH AND LOGICAL EXPRESSION CRITERIA 811 NODE AND EDGE COVERAGE 812 DATA FLOW COVERAGE 813 LOGIC COVERAGE 82 BUILDING MUTATION TESTING TOOLS 821 THE INTERPRETATION APPROACH 822 THE SEPARATE COMPILATION APPROACH 823 THE SCHEMA-BASED APPROACH 824 USING JAVA RE?ECTION 825 IMPLEMENTING A MODERN MUTATION SYSTEM 83 BIBLIOGRAPHIC NOTES CHALLENGES IN TESTING SOFTWARE 91 TESTING FOR EMERGENT PROPERTIES: SAFETY AND SECURITY 911 CLASSES OF TEST CASES FOR EMERGENT PROPERTIES 92 SOFTWARE TESTABILITY 921 TESTABILITY FOR COMMON TECHNOLOGIES 93 TEST CRITERIA AND THE FUTURE OF SOFTWARE TESTING 931 GOING FORWARD WITH TESTING RESEARCH 94 BIBLIOGRAPHIC NOTES