INTELLIGENT NETWORK VIDEO
CONTENTS THE EVOLUTION OF VIDEO SURVEILLANCE SYSTEMS VCR-BASED ANALOG CCTV SYSTEMS DVR-BASED ANALOG CCTV SYSTEMS NETWORK DVR-BASED ANALOG CCTV SYSTEMS VIDEO ENCODER-BASED NETWORK VIDEO SYSTEMS NVRS AND HYBRID DVRS NETWORK CAMERA-BASED NETWORK VIDEO SYSTEMS THE COMPONENTS OF NETWORK VIDEO WHERE IS NETWORK VIDEO USED? THE NETWORK CAMERA COMPARING A NETWORK CAMERA AND AN ANALOG CAMERA THE VIDEO ENCODER THE NETWORK THE SERVER AND STORAGE VIDEO MANAGEMENT SOFTWARE INTELLIGENT VIDEO NETWORK CAMERAS NETWORK CAMERA COMPONENTS TYPES OF NETWORK CAMERAS FIXED NETWORK CAMERAS FIXED DOME NETWORK CAMERAS PTZ (PAN, TILT, ZOOM) NETWORK CAMERAS NONMECHANICAL-PTZ NETWORK CAMERAS PTZ DOME NETWORK CAMERAS PTZ CAMERAS ELECTRONIC IMAGE STABILIZATION PRESETS AND GUARD TOURS PRIVACY MASKING E-?IP PTZ PERFORMANCE JOYSTICK CONTROL SELECTING THE RIGHT VIEWING ANGLE TYPICAL NONMECHANICAL-PTZ CAMERA COMPARISON WITH A PTZ CAMERA DAY AND NIGHT NETWORK CAMERAS IR ILLUMINATORS DAY AND NIGHT APPLICATIONS MEGAPIXEL NETWORK CAMERAS THE BENE?TS OF MEGAPIXEL MEGAPIXEL APPLICATIONS THE DRAWBACKS OF MEGAPIXEL BEST PRACTICES CAMERA TECHNOLOGIES LIGHT LIGHT CHARACTERISTICS ILLUMINANCE THE DE?NITION OF LUX LUX RATING OF NETWORK CAMERAS LUX RATING OF ANALOG VERSUS NETWORK CAMERAS COLOR TEMPERATURE INVISIBLE LIGHT LENSES LENS TYPES LENS MOUNT STANDARDS FIELD OF VIEW (FOCAL LENGTH) MATCHING LENS AND SENSOR APERTURE OR IRIS DIAMETER F-NUMBER (F-STOP) DEPTH OF FIELD FOCUSING LENS QUALITY 4 2 10 MEGAPIXEL LENSES IMAGE SENSORS CCD TECHNOLOGY CMOS TECHNOLOGY MORE ABOUT IMAGE SENSORS MEGAPIXEL SENSORS IMAGE SCANNING TECHNIQUES INTERLACED SCANNING DEINTERLACING TECHNIQUES PROGRESSIVE SCANNING IMAGE PROCESSING EXPOSURE BACKLIGHT COMPENSATION WIDE DYNAMIC RANGE BAYER DEMOSAICING NOISE WHITE BALANCE SHARPENING AND CONTRAST ALIASING RESOLUTION NTSC AND PAL RESOLUTIONS VGA RESOLUTIONS MPEG RESOLUTION MEGAPIXEL RESOLUTION ASPECT RATIOS HIGH-DE?NITION TELEVISION (HDTV) RESOLUTIONS VIDEO COMPRESSION TECHNOLOGIES THE BASICS OF COMPRESSION IMAGE AND VIDEO COMPRESSION LOSSLESS AND LOSSY COMPRESSION BLOCK AND TRANSFORM PREDICTION LATENCY COMPRESSION RATIO COMPRESSION STANDARDS THE ITU AND ISO HISTORY OF COMPRESSION FORMATS COMPRESSION FORMATS JPEG MOTION JPEG 5 3 12 COMPRESSION FORMAT TIMELINE MORE ON MPEG COMPRESSION FRAME TYPES GROUP OF PICTURES VARIABLE AND CONSTANT BIT RATES PRO?LE@LEVEL LICENSING BACKWARDS COMPATIBILITY ENCODER QUALITY AUDIO TECHNOLOGIES AUDIO MODES SIMPLEX HALF DUPLEX FULL DUPLEX AUDIO EQUIPMENT AUDIO INPUT (MICROPHONES) CONDENSER MICROPHONES ELECTRET CONDENSER MICROPHONES DYNAMIC MICROPHONES DIRECTIONAL MICROPHONES AUDIO OUTPUT (SPEAKERS) ACOUSTICAL ADJUSTMENTS VOLUME AND GAIN ECHO CANCELLATION SPEECH FILTER NOISE CANCELLATION AUDIO DETECTION ALARM AUDIO COMPRESSION SAMPLING FREQUENCY BIT RATE CODECS AAC-LC G 711 PCM G 726 ADPCM G 722 2 OR AMR-WB AUDIO AND VIDEO SYNCHRONIZATION THE FUTURE OF AUDIO IN NETWORK VIDEO VIDEO ENCODERS COMPONENTS OF A VIDEO ENCODER STAND-ALONE VIDEO ENCODERS RACK-MOUNTED VIDEO ENCODERS VIDEO ENCODERS WITH PTZ AND DOME CAMERAS VIDEO DECODER WIRED NETWORKS THE EVOLUTION OF ETHERNET 10-MBPS ETHERNET FAST ETHERNET GIGABIT ETHERNET 10-GIGABIT ETHERNET NETWORK TOPOLOGIES BUS TOPOLOGY STAR TOPOLOGY NETWORK CABLING COAXIAL CABLE AND BNC CABLE CATEGORIES TWISTED-PAIR CABLE TYPES GLASS FIBER TYPES THE BASICS OF ETHERNET MAC ADDRESSES FRAMES CARRIER SENSE MULTIPLE ACCESS/COLLISION DETECTION (CSMA/CD) HALF AND FULL DUPLEX NETWORKING EQUIPMENT HUBS SWITCHES ROUTERS FIREWALLS INTERNET CONNECTIONS POWER OVER ETHERNET THE 802 3AF STANDARD MIDSPANS AND SPLITTERS FUTURE STANDARDS VIRTUAL LOCAL AREA NETWORKS (VLANS) WIRELESS NETWORKS THE BASICS OF WIRELESS NETWORKS WIRELESS SPECTRUMS SIGNAL STRENGTH ANTENNAS RADIO WAVE PROPAGATION WIRELESS NETWORK ARCHITECTURES POINT-TO-POINT NETWORK POINT-TO-MULTIPOINT NETWORK MESH NETWORK 802 11 WLAN STANDARDS THE 802 11B EXTENSION THE 802 11A EXTENSION THE 802 11G EXTENSION THE 802 11N EXTENSION THE 802 11S EXTENSION THE BASICS OF 802 11 NETWORKS AD HOC NETWORK INFRASTRUCTURE NETWORK 802 11 FREQUENCIES CHANNELS WLAN SECURITY WIRED EQUIVALENT PRIVACY (WEP) TEMPORARY KEY INTEGRITY PROTOCOL (TKIP) ADVANCED ENCRYPTION STANDARD (AES) PRE-SHARED KEY (PSK) 802 1X WI-FI PROTECTED ACCESS (WPA2) OTHER WIRELESS SOLUTIONS BLUETOOTH UNIVERSAL MOBILE TELECOMMUNICATIONS SYSTEM (UMTS) WIRELESS INTEROPERABILITY FOR MICROWAVE ACCESS (WIMAX) PROPRIETARY WIRELESS SOLUTIONS PERFORMANCE OF WIRELESS NETWORKS NETWORKING TECHNOLOGIES 10 1 OSI REFERENCE MODEL 10 1 1 LAYER 1: THE PHYSICAL LAYER 10 1 2 LAYER 2: THE DATA-LINK LAYER 10 1 3 LAYER 3: THE NETWORK LAYER 10 1 4 LAYER 4: THE TRANSPORT LAYER 10 1 5 LAYER 5: THE SESSION LAYER 10 1 6 LAYER 6: THE PRESENTATION LAYER 10 1 7 LAYER 7: THE APPLICATION LAYER 10 2 THE TCP/IP REFERENCE MODEL 10 2 1 THE INTERNET PROTOCOL (IP) 10 2 2 IPV4 ADDRESSES 10 2 3 SUBNETS 10 2 4 NAT 10 2 5 SERVICES AND PORT NUMBERS 10 2 6 PORT FORWARDING 10 2 7 1 IPV6 ADDRESSES 10 3 MANAGING IP ADDRESSES 10 3 1 SETTING IP ADDRESSES 10 3 1 1 MANUAL ADDRESS ALLOCATION 10 3 1 2 DYNAMIC ADDRESS ALLOCATION 10 3 2 CON?GURATION-FREE NETWORKING 10 3 2 1 UPNP AND ZEROCON?G C O N T E N T S 10 3 2 2 BONJOUR 10 3 3 MAC AND IP ADDRESS RESOLUTION 10 3 3 1 ADDRESS RESOLUTION PROTOCOL (ARP) 10 3 4 DOMAIN NAME SYSTEM (DNS) 10 3 4 1 DYNAMIC DNS 10 4 DATA TRANSPORT 10 4 1 USER DATAGRAM PROTOCOL (UDP) 10 4 2 TRANSMISSION CONTROL PROTOCOL (TCP) 10 5 APPLICATION LAYER PROTOCOLS 10 5 1 HYPERTEXT TRANSFER PROTOCOL (HTTP) 10 5 2 FILE TRANSFER PROTOCOL (FTP) 10 5 3 SIMPLE NETWORK MANAGEMENT PROTOCOL (SNMP) 10 5 4 SIMPLE MAIL TRANSFER PROTOCOL (SMTP) 10 5 5 REAL-TIME TRANSPORT PROTOCOL (RTP) 10 6 UNICAST, BROADCAST, AND MULTICAST 10 7 QUALITY OF SERVICE 10 7 1 DE?NITION 10 7 2 QOS IN NETWORK VIDEO 10 8 NETWORK SECURITY 10 8 1 USERNAME AND PASSWORD AUTHENTICATION 10 8 2 IP FILTERING 10 8 3 802 1X 10 8 4 VIRTUAL PRIVATE NETWORK (VPN) 10 8 5 HYPERTEXT TRANSFER PROTOCOL SECURE (HTTPS) SERVERS AND STORAGE 11 1 SERVERS 11 1 1 HARDWARE PLATFORMS 11 1 2 OPERATING SYSTEMS 11 1 3 VIDEO FILE SYSTEMS 11 2 HARD DISKS 11 2 1 THE SCSI INTERFACE 11 2 2 THE ATA AND SATA INTERFACES 11 2 3 HARD DISK FAILURE RATES 11 3 STORAGE ARCHITECTURES 11 3 1 ON-BOARD STORAGE 11 3 2 SINGLE SERVER STORAGE 11 3 3 NETWORK ATTACHED STORAGE (NAS) 11 3 4 STORAGE AREA NETWORK (SAN) 11 3 5 INTERNET SMALL COMPUTER SYSTEM INTERFACE (ISCSI) C O N T E N T S 11 4 REDUNDANCY 11 4 1 RAID SYSTEMS 11 4 2 DATA REPLICATION 11 4 3 TAPE BACKUP 11 4 4 SERVER CLUSTERING 11 4 5 MULTIPLE SERVERS 11 5 BEST PRACTICES VIDEO MANAGEMENT 12 1 HARDWARE PLATFORMS 12 1 1 PC SERVER PLATFORM 12 1 2 NVR PLATFORM 12 2 SOFTWARE PLATFORMS 12 2 1 BUILT-IN FUNCTIONALITY 12 2 2 WINDOWS CLIENT-BASED SOFTWARE 12 2 3 WEB-BASED SOFTWARE 12 2 4 OPEN VERSUS VENDOR-SPECI?C SOFTWARE 12 2 5 SCALABILITY OF VIDEO MANAGEMENT SOFTWARE 12 2 6 LICENSING OF VIDEO MANAGEMENT SOFTWARE 12 3 SYSTEM FEATURES 12 3 1 RECORDING 12 3 1 1 VIDEO RECORDING 12 3 1 2 AUDIO RECORDING 12 3 1 3 RECORDING AND STORAGE 12 3 1 4 ADVANCED SEARCH 12 3 1 5 EXPORTING FILES 12 3 2 VIEWING 12 3 2 1 LIVE VIEWING 12 3 2 2 VIEWING OF RECORDINGS 12 3 2 3 MULTI-STREAMING 12 3 2 4 MAPPING FUNCTIONALITY 12 3 3 EVENT MANAGEMENT 12 3 3 1 EDGE-DEVICE EVENTS 12 3 3 2 RESPONSES 12 3 3 3 VIDEO MOTION DETECTION (VMD) 12 3 3 4 INPUT AND OUTPUT PORTS 12 3 3 5 EVENT LOG FILES 12 3 4 ADMINISTRATION AND MANAGEMENT FEATURES 12 3 4 1 MANAGING CAMERAS 12 3 4 2 TIME SYNCHRONIZATION C O N T E N T S 12 3 4 3 SECURITY 12 3 4 4 AUDIT LOG FILES 12 4 INTEGRATED SYSTEMS 12 4 1 APPLICATION PROGRAMMING INTERFACE 12 4 2 POINT OF SALE 12 4 3 ACCESS CONTROL 12 4 4 BUILDING MANAGEMENT 12 4 5 INDUSTRIAL CONTROL SYSTEMS 12 4 6 RADIO-FREQUENCY IDENTI?CATION (RFID) 12 5 BEST PRACTICES 13 1 WHAT IS INTELLIGENT VIDEO? 13 2 THE GENESIS OF INTELLIGENT VIDEO 13 3 WHY INTELLIGENT VIDEO? 13 3 1 LIMITED ATTENTION SPAN 13 3 2 RETRIEVING STORED VIDEO 13 3 3 NEW APPLICATIONS 13 4 INTELLIGENT VIDEO ARCHITECTURES 13 4 1 CENTRALIZED SYSTEMS 13 4 1 1 DVR-BASED INSTALLATIONS 13 4 1 2 PC SERVER–BASED INSTALLATIONS 13 4 2 DISTRIBUTED SYSTEMS 13 4 2 1 NETWORK-CENTRIC INSTALLATIONS 13 4 2 2 INTELLIGENCE AT THE EDGE INSTALLATIONS 13 4 3 INTEGRATING INTELLIGENT VIDEO APPLICATIONS 13 5 APIS AND STANDARDS 13 5 1 METADATA 13 6 BEST PRACTICES INTELLIGENT VIDEO APPLICATIONS 14 1 CATEGORIZING IV APPLICATIONS 14 1 1 PIXELS, BLOBS, AND OBJECTS 14 1 2 CATEGORIZATION OF INTELLIGENT VIDEO APPLICATIONS 14 2 PIXEL-BASED INTELLIGENCE 14 2 1 VIDEO MOTION DETECTION 14 2 2 CAMERA TAMPERING DETECTION 14 2 3 IMAGE ENHANCEMENT 14 3 OBJECT-BASED APPLICATIONS 14 3 1 OBJECT CLASSI?CATION C O N T E N T S 14 3 2 OBJECT COUNTING 14 3 2 1 PEOPLE COUNTING 14 3 2 2 CROWD DETECTION 14 3 3 OBJECT TRACKING 14 3 3 1 DIGITAL FENCE 14 3 3 2 OBJECT LEFT BEHIND 14 3 3 3 LOITERING 14 3 3 4 SINGLE-CAMERA PEOPLE TRACKING 14 3 3 5 PEOPLE TRACKING USING PTZ CAMERAS 14 3 3 6 MULTI-CAMERA PEOPLE TRACKING 14 4 SPECIALIZED APPLICATIONS 14 4 1 AUTOMATIC NUMBER PLATE RECOGNITION 14 4 2 FACIAL RECOGNITION 14 4 3 FIRE AND SMOKE DETECTION 14 5 IV AND PRIVACY ISSUES 14 6 REALISTIC EXPECTATIONS OF INTELLIGENT VIDEO 14 7 BEST PRACTICES 14 7 1 VIDEO IMAGE QUALITY 14 7 2 EF?CIENT INTELLIGENT VIDEO ALGORITHMS 14 7 3 COMPUTER PROCESSING POWER 14 7 4 CON?GURATION AND FINE-TUNING THE SYSTEM SYSTEM DESIGN CONSIDERATIONS 15 1 SELECTING A NETWORK CAMERA 15 1 1 TYPE OF CAMERA 15 1 2 IMAGE QUALITY 15 1 3 RESOLUTION 15 1 3 1 DETERMINING THE RESOLUTION NEEDED 15 1 4 COMPRESSION 15 1 5 NETWORKING FUNCTIONALITY 15 1 6 OTHER FUNCTIONALITIES 15 1 7 VENDOR 15 2 INSTALLING A NETWORK CAMERA 15 2 1 SURVEILLANCE OBJECTIVE 15 2 2 USE LOTS OF LIGHT OR ADD LIGHT IF NEEDED 15 2 3 AVOID DIRECT SUNLIGHT 15 2 4 AVOID BACKLIGHT 15 2 5 LENS SELECTION 15 3 PROTECTING A NETWORK CAMERA 15 3 1 CAMERA ENCLOSURES IN GENERAL C O N T E N T S 15 3 2 TRANSPARENT COVERING 15 3 3 POSITIONING OF FIXED CAMERA 15 3 4 ENVIRONMENTAL PROTECTION 15 3 5 VANDAL AND TAMPERING PROTECTION 15 3 5 1 THE GOALS OF VANDAL PROTECTION 15 3 5 2 MECHANICAL DESIGN 15 3 5 3 MOUNTING 15 3 5 4 CAMERA PLACEMENT 15 3 5 5 INTELLIGENT VIDEO PROTECTING CAMERAS 15 3 6 TYPES OF MOUNTING 15 3 6 1 CEILING MOUNTS 15 3 6 2 WALL MOUNTS 15 3 6 3 POLE MOUNT 15 3 6 4 PARAPET MOUNT 15 3 6 5 SPECIAL MOUNTS 15 3 7 HOUSING RATINGS 15 3 7 1 IP RATINGS 15 3 7 2 NEMA RATINGS 15 3 7 3 IK RATINGS 15 3 7 4 IECEX AND ATEX CERTI?CATIONS 15 4 STORAGE AND SERVER CONSIDERATIONS 15 4 1 SMALL SYSTEM: 1 TO 30 CAMERAS 15 4 2 MEDIUM SYSTEM: 25 TO 100 CAMERAS 15 4 3 LARGE CENTRALIZED SYSTEM: 50 TO 1000+ CAMERAS 15 4 4 LARGE DISTRIBUTED SYSTEM: 25 TO 1000+ CAMERAS 15 4 5 DIMENSIONING THE SERVER 15 4 6 CALCULATING STORAGE 15 4 6 1 CALCULATING STORAGE NEEDS 15 4 6 2 AN EXAMPLE 15 5 DESIGNING THE NETWORK BANDWIDTH 15 5 1 LIMITING THE BANDWIDTH 15 5 2 NETWORK LATENCY 15 6 SYSTEM DESIGN TOOLS 15 7 LEGAL ASPECTS THE COST OF A NETWORK VIDEO SYSTEM 16 1 RESEARCH APPROACH 16 2 TYPICAL SYSTEM 16 3 COST TO PURCHASE AND INSTALL C O N T E N T S 16 4 RESEARCH RESULTS 16 4 1 OVERALL COMPARISON 16 4 2 DETAILED COST COMPARISON 16 4 3 COST AS A FUNCTION OF THE NUMBER OF CHANNELS 16 4 4 ADDITIONAL OBSERVATIONS 16 5 CONCLUSIONS