Non Half Hourly Data Aggregation (NHHDA)
System Management Guide
Version Number 20.210
Error! Reference source not found.NHHDA System Management Guide Version 20.0
Non Half Hourly Data Aggregation (NHHDA)System Management Guide
Status / : / FinalDraft
Version / : / 20.210
Date / : / 5 November 201522 February 2018
Prepared by / : / CognizantCGI
Approved by (CognizantCGI) / : / Project Manager
Table Ofof Contents
1 Introduction 5
1.1 Purpose 5
1.2 Scope 5
1.3 Structure of Document 5
1.4 Amendment History 6
1.5 Summary of Changes 9
1.6 Changes Forecast 9
1.7 References 9
1.8 Abbreviations 10
1.9 Intellectual Property Rights and Copyright 11
2 Overview of the System 12
2.1 Users of the System 12
2.2 Data Interfaces 13
3 System Structure 14
3.1 Aggregation Run (NAR) Subsystem 14
3.2 Check Data Collector Data (NCD) Subsystem 15
3.3 Manage Instructions (NMI) Subsystem 16
3.4 Load Data File (NLD) Subsystem 17
3.5 File Receipt Manager (CFR) Subsystem 18
3.6 Scheduler (CSC) Subsystem 18
3.7 Logging (CLG) Subsystem 19
3.8 File Sender (CFS) Subsystem 19
3.9 Report Display (CRP) Subsystem 20
3.10 User Administration (NUA) Subsystem 20
3.11 EAC Data for Distributor (NDP) Subsystem 20
4 Application Environment 22
4.1 Hardware 22
4.2 Software 24
4.3 Configuration Management Procedures 27
4.3.1 Introduction 27
4.3.2 Build and Release numbers 27
4.3.3 Deliverables maintained under Configuration Control 28
4.3.4 Compatibility of Deliverable Products 29
4.4 External Support 30
4.5 Schedule of Activities 31
5 Database Organisation 32
5.1 Database Tables 32
5.2 Partitions 35
5.3 Tablespaces 36
5.4 Timestamps 37
5.5 Domains 37
5.6 Database Sizing 45
5.7 Physical Organisation (Tablespaces/Files) 45
5.8 Oracle Parameters 46
5.9 Oracle Object Storage Parameters 46
5.10 Oracle Performance Tuning : Optimiser Statistics 47
6 System Organisation 49
6.1 Directory Structure 49
6.2 File Names 50
6.3 File Locations 51
6.4 Receiving files - cdb_file_processing 53
6.5 Sending files - cdb_export_configuration 54
6.6 File Sizing 55
6.7 Configuring Temporary Files 56
6.8 Batch Queues 56
6.9 Locations of Aggregation Intermediate Files 58
6.10 NHHDA Processes 58
7 System Parameters 60
8 User Accounts, Privileges and Security 66
8.1 Server Operating System 66
8.2 Oracle Database Tables 67
8.3 Oracle Forms access 68
8.4 Password Management Through Oracle Profile 68
8.5 Maintain User 68
8.6 Breaches of security 69
9 Auditing 70
9.1 Audit Database Tables 70
9.2 Audit Log Files 71
9.3 Auditing of Data Aggregation Runs 73
10 Starting Up and Shutting Down the System 75
10.1 Starting the System 75
10.2 Shutting Down the System 76
11 Monitoring the System 77
11.1 Operator and Error Logs 77
11.2 Scheduler Logs 78
11.3 Audit Logs 78
11.4 Aggregation Exception Log File 79
11.5 Aggregation Run Log 79
11.6 Data Collector Exception Log 79
11.7 Load MDD Exception Log 79
11.8 Load Data Aggregation and Settlement Timetable File Exceptions Log 79
11.9 Directories 79
11.10 File Receipt and File Send Logs 80
11.11 EAC Data To Distributor Exception Logs 80
12 Archiving 81
12.1 Archiving Operating System Files 81
12.1.1 Archive the Files to the Archive Directory 83
12.1.2 Copy Files to Archive Media 83
12.1.3 Record the Archive Media of the Files 84
12.1.4 Record the removal of the files from Archive Directory 84
12.2 Archiving Database Data 84
12.2.1 Database Archive Criteria 85
12.2.2 Back Up Database Data 88
12.2.3 Archive Database Data 88
12.3 Archiving of Instruction Data – Archive Groups ‘FIN’ and ‘FIS’ 89
12.4 Restoring Operating System Files 89
12.5 Archiving of Instruction Data – Archive Groups ‘FIN’ and ‘FIS’ 90
12.6 Restoring Database Data 91
13 Backup and Recovery 92
13.1 Guidelines on Backup Policy 92
13.2 Checkpointing 92
13.3 Daily Off-line Backups of the NHHDA Database 92
13.4 Daily Backups of the NHHDA File Store 93
13.5 Backup Prior to Refresh of the Database 93
13.6 Restoration for Recovery 94
13.6.1 Recovery from Power Failure 94
13.6.2 Recovery from Fatal Errors 94
13.6.3 Recovery from Media (disk) Failure 94
13.6.4 Recovery from Activity Status Tracking Problems 96
13.6.5 Disaster Recovery 97
13.6.6 Recovery of temporary tables 97
13.7 Restoration for Auditing 97
14 PRS Refresh 98
14.1 Pre-requisites to the Application of a Refresh Instruction 98
14.2 Logs Containing Information Relating to the Refresh Process 99
14.2.1 Changes made to ndb_registrations table 99
14.2.2 Changes made to ndb_data_agg_apps 99
14.2.3 Changes made to ndb_ms_prs_dets 99
14.2.4 Changes to ndb_dc_apps 100
14.2.5 Instruction Failure Reasons 100
14.2.6 Summary Report 100
14.3 Action to take after the Refresh completed 101
14.3.1 Refresh status is "Applied" 101
14.3.2 Refresh status is "Validation Errors" 101
14.3.3 Refresh status is "Discarded" 101
14.4 Manage Refresh Instruction Failure 102
14.5 Restarting the NHHDA Application Software After Refresh 103
15 System Management of Application Server 104
15.1 Remove the Old Report Files 104
Appendix A Application Error Messages 105
A.1 Error Log Messages 105
A.1.1 Data Aggregation 105
A.1.2 Check Data Collector Data 108
A.1.3 Instruction Processing 109
A.1.4 Data Loading 111
1 Introduction 5
1.1 Purpose 5
1.2 Scope 5
1.3 Structure of Document 5
1.4 Amendment History 6
1.5 Summary of Changes 9
1.6 Changes Forecast 9
1.7 References 9
1.8 Abbreviations 10
1.9 Intellectual Property Rights and Copyright 11
2 Overview of the System 12
2.1 Users of the System 12
2.2 Data Interfaces 13
3 System Structure 14
3.1 Aggregation Run (NAR) Subsystem 14
3.2 Check Data Collector Data (NCD) Subsystem 15
3.3 Manage Instructions (NMI) Subsystem 16
3.4 Load Data File (NLD) Subsystem 17
3.5 File Receipt Manager (CFR) Subsystem 18
3.6 Scheduler (CSC) Subsystem 18
3.7 Logging (CLG) Subsystem 19
3.8 File Sender (CFS) Subsystem 19
3.9 Report Display (CRP) Subsystem 20
3.10 User Administration (NUA) Subsystem 20
3.11 EAC Data for Distributor (NDP) Subsystem 20
4 Application Environment 22
4.1 Hardware 22
4.2 Software 24
4.3 Configuration Management Procedures 27
4.3.1 Introduction 27
4.3.2 Build and Release numbers 27
4.3.3 Deliverables maintained under Configuration Control 28
4.3.4 Compatibility of Deliverable Products 29
4.4 External Support 30
4.5 Schedule of Activities 31
5 Database Organisation 32
5.1 Database Tables 32
5.2 Partitions 35
5.3 Tablespaces 36
5.4 Timestamps 37
5.5 Domains 37
5.6 Database Sizing 45
5.7 Physical Organisation (Tablespaces/Files) 45
5.8 Oracle Parameters 46
5.9 Oracle Object Storage Parameters 46
5.10 Oracle Performance Tuning : Optimiser Statistics 47
6 System Organisation 49
6.1 Directory Structure 49
6.2 File Names 50
6.3 File Locations 51
6.4 Receiving files - cdb_file_processing 53
6.5 Sending files - cdb_export_configuration 54
6.6 File Sizing 55
6.7 Configuring Temporary Files 56
6.8 Batch Queues 56
6.9 Locations of Aggregation Intermediate Files 58
6.10 NHHDA Processes 58
7 System Parameters 60
8 User Accounts, Privileges and Security 66
8.1 Server Operating System 66
8.2 Oracle Database Tables 67
8.3 Oracle Forms access 68
8.4 Password Management Through Oracle Profile 68
8.5 Maintain User 68
8.6 Breaches of security 69
9 Auditing 70
9.1 Audit Database Tables 70
9.2 Audit Log Files 71
9.3 Auditing of Data Aggregation Runs 73
10 Starting Up and Shutting Down the System 75
10.1 Starting the System 75
10.2 Shutting Down the System 76
11 Monitoring the System 77
11.1 Operator and Error Logs 77
11.2 Scheduler Logs 78
11.3 Audit Logs 78
11.4 Aggregation Exception Log File 79
11.5 Aggregation Run Log 79
11.6 Data Collector Exception Log 79
11.7 Load MDD Exception Log 79
11.8 Load Data Aggregation and Settlement Timetable File Exceptions Log 79
11.9 Directories 79
11.10 File Receipt and File Send Logs 80
11.11 EAC Data To Distributor Exception Logs 80
12 Archiving 81
12.1 Archiving Operating System Files 81
12.1.1 Archive the Files to the Archive Directory 83
12.1.2 Copy Files to Archive Media 83
12.1.3 Record the Archive Media of the Files 84
12.1.4 Record the removal of the files from Archive Directory 84
12.2 Archiving Database Data 84
12.2.1 Database Archive Criteria 85
12.2.2 Back Up Database Data 88
12.2.3 Archive Database Data 88
12.3 Archiving of Instruction Data – Archive Groups ‘FIN’ and ‘FIS’ 89
12.4 Restoring Operating System Files 89
12.5 Archiving of Instruction Data – Archive Groups ‘FIN’ and ‘FIS’ 90
12.6 Restoring Database Data 91
13 Backup and Recovery 92
13.1 Guidelines on Backup Policy 92
13.2 Checkpointing 92
13.3 Daily Off-line Backups of the NHHDA Database 92
13.4 Daily Backups of the NHHDA File Store 93
13.5 Backup Prior to Refresh of the Database 93
13.6 Restoration for Recovery 94
13.6.1 Recovery from Power Failure 94
13.6.2 Recovery from Fatal Errors 94
13.6.3 Recovery from Media (disk) Failure 94
13.6.4 Recovery from Activity Status Tracking Problems 96
13.6.5 Disaster Recovery 97
13.6.6 Recovery of temporary tables 97
13.7 Restoration for Auditing 97
14 PRS Refresh 98
14.1 Pre-requisites to the Application of a Refresh Instruction 98
14.2 Logs Containing Information Relating to the Refresh Process 99
14.2.1 Changes made to ndb_registrations table 99
14.2.2 Changes made to ndb_data_agg_apps 99
14.2.3 Changes made to ndb_ms_prs_dets 99
14.2.4 Changes to ndb_dc_apps 100
14.2.5 Instruction Failure Reasons 100
14.2.6 Summary Report 100
14.3 Action to take after the Refresh completed 101
14.3.1 Refresh status is "Applied" 101
14.3.2 Refresh status is "Validation Errors" 101
14.3.3 Refresh status is "Discarded" 101
14.4 Manage Refresh Instruction Failure 102
14.5 Restarting the NHHDA Application Software After Refresh 103
15 System Management of Application Server 104
15.1 Remove the Old Report Files 104
Appendix A Application Error Messages 105
A.1 Error Log Messages 105
A.1.1 Data Aggregation 105
A.1.2 Check Data Collector Data 108
A.1.3 Instruction Processing 109
A.1.4 Data Loading 111
1 Introduction 5
1.1 Purpose 5
1.2 Scope 5
1.3 Structure of Document 5
1.4 Amendment History 6
1.5 Summary of Changes 9
1.6 Changes Forecast 9
1.7 References 9
1.8 Abbreviations 10
1.9 Intellectual Property Rights and Copyright 11
2 Overview of the System 12
2.1 Users of the System 12
2.2 Data Interfaces 13
3 System Structure 14
3.1 Aggregation Run (NAR) Subsystem 14
3.2 Check Data Collector Data (NCD) Subsystem 15
3.3 Manage Instructions (NMI) Subsystem 16
3.4 Load Data File (NLD) Subsystem 17
3.5 File Receipt Manager (CFR) Subsystem 18
3.6 Scheduler (CSC) Subsystem 18
3.7 Logging (CLG) Subsystem 19
3.8 File Sender (CFS) Subsystem 19
3.9 Report Display (CRP) Subsystem 20
3.10 User Administration (NUA) Subsystem 20
3.11 EAC Data for Distributor (NDP) Subsystem 20
4 Application Environment 22
4.1 Hardware 22
4.2 Software 24
4.3 Configuration Management Procedures 27
4.3.1 Introduction 27
4.3.2 Build and Release numbers 27
4.3.3 Deliverables maintained under Configuration Control 28
4.3.4 Compatibility of Deliverable Products 29
4.4 External Support 30
4.5 Schedule of Activities 31
5 Database Organisation 32
5.1 Database Tables 32
5.2 Partitions 35
5.3 Tablespaces 36
5.4 Timestamps 37
5.5 Domains 37
5.6 Database Sizing 45
5.7 Physical Organisation (Tablespaces/Files) 45
5.8 Oracle Parameters 46
5.9 Oracle Object Storage Parameters 46
5.10 Oracle Performance Tuning : Optimiser Statistics 47
6 System Organisation 49
6.1 Directory Structure 49
6.2 File Names 50
6.3 File Locations 51
6.4 Receiving files - cdb_file_processing 53
6.5 Sending files - cdb_export_configuration 54
6.6 File Sizing 55
6.7 Configuring Temporary Files 56
6.8 Batch Queues 56
6.9 Locations of Aggregation Intermediate Files 58
6.10 NHHDA Processes 58
7 System Parameters 60
8 User Accounts, Privileges and Security 66
8.1 Server Operating System 66
8.2 Oracle Database Tables 67
8.3 Oracle Forms access 68
8.4 Password Management Through Oracle Profile 68
8.5 Maintain User 68
8.6 Breaches of security 69
9 Auditing 70
9.1 Audit Database Tables 70
9.2 Audit Log Files 71
9.3 Auditing of Data Aggregation Runs 73
10 Starting Up and Shutting Down the System 75
10.1 Starting the System 75
10.2 Shutting Down the System 76
11 Monitoring the System 77
11.1 Operator and Error Logs 77
11.2 Scheduler Logs 78
11.3 Audit Logs 78
11.4 Aggregation Exception Log File 79
11.5 Aggregation Run Log 79
11.6 Data Collector Exception Log 79
11.7 Load MDD Exception Log 79
11.8 Load Data Aggregation and Settlement Timetable File Exceptions Log 79
11.9 Directories 79
11.10 File Receipt and File Send Logs 80
11.11 EAC Data To Distributor Exception Logs 80
12 Archiving 81
12.1 Archiving Operating System Files 81
12.1.1 Archive the Files to the Archive Directory 83
12.1.2 Copy Files to Archive Media 83
12.1.3 Record the Archive Media of the Files 84
12.1.4 Record the removal of the files from Archive Directory 84
12.2 Archiving Database Data 84
12.2.1 Database Archive Criteria 85
12.2.2 Back Up Database Data 88
12.2.3 Archive Database Data 88
12.3 Archiving of Instruction Data – Archive Groups ‘FIN’ and ‘FIS’ 89
12.4 Restoring Operating System Files 89
12.5 Archiving of Instruction Data – Archive Groups ‘FIN’ and ‘FIS’ 90
12.6 Restoring Database Data 91
13 Backup and Recovery 92
13.1 Guidelines on Backup Policy 92
13.2 Checkpointing 92
13.3 Daily Off-line Backups of the NHHDA Database 92
13.4 Daily Backups of the NHHDA File Store 93
13.5 Backup Prior to Refresh of the Database 93
13.6 Restoration for Recovery 94
13.6.1 Recovery from Power Failure 94
13.6.2 Recovery from Fatal Errors 94
13.6.3 Recovery from Media (disk) Failure 94
13.6.4 Recovery from Activity Status Tracking Problems 96
13.6.5 Disaster Recovery 97
13.6.6 Recovery of temporary tables 97
13.7 Restoration for Auditing 97
14 PRS Refresh 98
14.1 Pre-requisites to the Application of a Refresh Instruction 98
14.2 Logs Containing Information Relating to the Refresh Process 99
14.2.1 Changes made to ndb_registrations table 99
14.2.2 Changes made to ndb_data_agg_apps 99
14.2.3 Changes made to ndb_ms_prs_dets 99
14.2.4 Changes to ndb_dc_apps 100
14.2.5 Instruction Failure Reasons 100
14.2.6 Summary Report 100