Hydrology Professional Development Series (PDS) 2 : Develop, Implement and Maintain Models and Tools

PCU 2: Configure operational framework to incorporate models and tools within the specific forecasting system

Producers:
Alaina MacFarlane - Mid-Atlantic River Forecast Center, State College, PA
John Schmidt - Southeast River Forecast Center, Peachtree City, GA

Description of Job Competency to be Achieved :
Test and modify the modeling system so that it can be used to generate real time forecasts or information.

Description of Need :
As existing models are improved or additional models are implemented, they must be introduced into the operational forecasting environment. This requires that the models are tested prior to being used for operations forecasts.

Abilities/Performance Elements:

• Be familiar with the overall CHPS/FEWS conceptual and physical architecture.
• Integrate the relevant operational data required for the model to run.
• Configure CHPS to migrate the new model.
• Integrate the new stand-alone system into the current operational system.
• Run the model to generate the actual forecast output.

Ability 1. Be familiar with the overall CHPS/FEWS conceptual and physical architecture. IC Title: Introduction to CHPS Type: Formal Training (via NWSTC) URL/location: https://training.weather.gov/nwstc/CHPS/chps101/ Description: This course introduces the Community Hydrologic Prediction System (CHPS) through descriptions, examples, and illustrations. Vetted: Yes IC Title: CHPS Basic Configuration Training Type: Formal Training (via NWSTC) URL/location: https://training.weather.gov/nwstc/CHPS/basic/index.html Description: This course provides detailed instruction on the configuration of CHPS, the software associated with the Flood Early Warning System (FEWS). Vetted: Yes

Ability 2. Integrate the relevant operational data required for the model to run. Skill 2.1. Ensure the source and format of real time and forecast data is applicable for the modeling system. (Refer to PDS1, PCU3, Ability 1 for more information) Ensure continuous access to the data in real time. Skill 2.2. Import the data into the operational modeling system. IC Title: CHPS Basic Configuration Training, Lesson 3: Configure Input Data Type: Formal Training (via NWSTC) URL/location: https://training.weather.gov/nwstc/CHPS/basic/lesson3/index.html Description: Working with input or static configurations allows you to control what data the system uses, where the data is processed and viewed, the values and units given to the data, and how various portions of data are filtered. This lesson provides information configuring static and dynamic input data. By the end of this lesson, you should be able to: List types of input data, Configure location data, Configure parameter data. Configure units and unit conversions, Configure filters, Configure grids. Describe decimal options, Set data expiry times, Configure data synch levels. Vetted: Yes

Ability 3. Configure the processing, setup, and modification of the CHPS interface to integrate the new model into the off-line, stand-alone system prior to operational configuration. Skill 3.1. Interpret and edit the eXtensible Markup Language and schema. IC Title: CHPS Basic Configuration Training, Lesson 1: Introduction Type: Formal Training (via NWSTC) URL/location: https://training.weather.gov/nwstc/CHPS/basic/lesson1/index.html Description: Understanding what tools you have, where they are located, and how they are organized is critical to any profession. This lesson introduces the basics of the tools used by RFC professionals. This lesson describes CHPS Focal Point roles and responsibilities and basic information on configuring CHPS. By the end of this lesson, you should be able to: Identify the Configuration Focal Point roles and responsibilities. List the main configuration directories. Describe the use of XML in CHPS. Review XML specifications. Describe the CHPS naming convention. Apply version control when creating files. Recall the CHPS file retention policy. Vetted: Yes Skill 3.2. Identify the configuration files and parameters to be changed or added. IC Title: CHPS Basic Configuration Training, Lesson 1: Introduction Type: Formal Training (via NWSTC) URL/location: https://training.weather.gov/nwstc/CHPS/basic/lesson1/index.html Description: Understanding what tools you have, where they are located, and how they are organized is critical to any profession. This lesson introduces the basics of the tools used by RFC professionals. This lesson describes CHPS Focal Point roles and responsibilities and basic information on configuring CHPS. By the end of this lesson, you should be able to: Identify the Configuration Focal Point roles and responsibilities. List the main configuration directories. Describe the use of XML in CHPS. Review XML specifications. Describe the CHPS naming convention. Apply version control when creating files. Recall the CHPS file retention policy. Vetted: Yes IC Title: CHPS Basic Configuration Training, Lesson 4: Modules Type: Formal Training (via NWSTC) URL/location: https://training.weather.gov/nwstc/CHPS/basic/lesson4/index.html Description: Refining the forecast process makes the system run quicker and makes it easier for the forecaster to create accurate forecasts. Modules are the activities in CHPS you can configure to achieve those goals. This lesson provides details on configuring CHPS modules. By the end of this lesson, you should be able to: Define modules. Identify specific modules. Edit module configuration files. Configure modules using a multi-file process. List opportunities for optimizing modules. Vetted: Yes IC Title: CHPS Basic Configuration Training, Lesson 5: Workflows Type: Formal Training (via NWSTC) URL/location: https://training.weather.gov/nwstc/CHPS/basic/lesson5/index.html Description: While modules are the activities and operations, workflows are specific tasks (often containing modules) executed for the forecast group. You must configure workflows properly in order to complete a forecast. This lesson provides information on configuring CHPS workflows. By the end of this lesson, you should be able to: Define workflows and workflow components. List the workflow directories. Describe the process of configuring workflows. Add a module to a workflow. Use the Workflow Navigator. Clean up code in existing workflow configuration files. Optimize user experience with workflows. Vetted: Yes Skill 3.3. Integrate the calibrated parameter sets for the model into CHPS. IC Title: CHPS Basic Configuration Training, Lesson 4: Modules Type: Formal Training (via NWSTC) URL/location: https://training.weather.gov/nwstc/CHPS/basic/lesson4/index.html Description: Refining the forecast process makes the system run quicker and makes it easier for the forecaster to create accurate forecasts. Modules are the activities in CHPS you can configure to achieve those goals. This lesson provides details on configuring CHPS modules. By the end of this lesson, you should be able to: Define modules. Identify specific modules. Edit module configuration files. Configure modules using a multi-file process. List opportunities for optimizing modules. Vetted: Yes Skill 3.4. Test the configuration repeatedly until no more configuration or model execution errors appear in the schema and/or file interdependencies. IC Title: CHPS Basic Configuration Training, Lesson 6: Troubleshooting Type: Formal Training (via NWSTC) URL/location: https://training.weather.gov/nwstc/CHPS/basic/lesson6/index.html Description: A basic understanding of troubleshooting techniques helps you narrow down potential issues when CHPS is not functioning properly. This lesson provides information on troubleshooting in CHPS as well as reporting issues. By the end of this lesson, you should be able to: Follow general troubleshooting techniques. List types of errors. Describe troubleshooting steps. List examples of debugging an issue. Set log files to debug mode. Locate and interpret log files. Use CHPS applications to troubleshoot. Report issues to FogBugz. Vetted: Yes Skill 3.5. Run the model to see if it had a good handle on the situation. Review the model output for inconsistencies and identify configuration files and/or parameters that need modified.

Ability 4. Integrate the new stand-alone configuration into the current operational system. Skill 4.1. Merge configuration changes with current operational configuration, per local office policy. Validate and upload configuration changes to the operational system. IC Title: CHPS Basic Configuration Training, Lesson 2: Configuration Basics Type: Formal Training (via NWSTC) URL/location: https://training.weather.gov/nwstc/CHPS/basic/lesson2/index.html Description: Configuration files affect not only the appearance of CHPS, but also the entire operation of the system. Follow the standard XML editing procedure to avoid creating more work for yourself.

Ability 5. Run the model to generate the actual forecast output. (Refer to PDS1, PCU3, Ability 4 for more information) Skill 5.1. Identify meaningful output format Post process model output to generate operational products Specific training module needed. References: Koehler, R. 2004. Raster-Based Analysis and Visualization of Hydrologic Time-Series. PhD dissertation. University of Arizona, Tucson, AZ. 189 pp. https://repository.arizona.edu/handle/10150/280516 Seo, D.J., H. D. Herr, and J. C. Schaake. 2006. A statistical post-processor for accounting of hydrologic uncertainty in short-range ensemble streamflow prediction. Hydrol. Earth Syst. Sci. Discuss., 3, 1987-2035, 2006 https://www.hydrol-earth-syst-sci-discuss.net/3/1987/2006/hessd-3-1987-2006-print.pdf Tufte, E. 1990. Envisioning Information. Cheshire, CT: Graphics Press. https://dl.acm.org/citation.cfm?id=78223Needs Work Tufte, E. 2001. The Visual Display of Quantitative Information: Second Edition. Cheshire, CT: Graphics Press https://dl.acm.org/citation.cfm?id=33404 Zhao, L., Duan, Q., Schaake, J., Ye, A., and Xia, J.: A hydrologic post-processor for ensemble streamflow predictions, Adv. Geosci., 29, 51-59, doi:10.5194/adgeo-29-51-2011, 2011. https://adgeo.copernicus.org/articles/29/51/2011/