Verification of Extratropical Cyclones within the NCEP Operational Models. Part II: The Short-Range Ensemble Forecast System

This paper verifies the strengths and positions of extratropical cyclones around North America and the adjacent oceans within the Short Range Ensemble Forecast (SREF) system at the National Centers for Environmental Prediction (NCEP) during the 2004-07 cool seasons (October-March). The SREF mean for cyclone position and central pressure has a smaller error than the various subgroups within SREF and the operational North American Mesoscale (NAM) model in many regions on average, but not the operational Global Forecast System (GFS) for many forecast times. Inclusion of six additional Weather Research and Forecasting (WRF) model members into SREF during the 2006-07 cool season did not improve the SREF mean predictions. The SREF has slightly more probabilistic skill over the eastern United States and western Atlantic than the western portions of the domain for cyclone central pressure. The SREF also has slightly greater probabilistic skill than the combined GFS and NAM for central pressure, which is significant at the 90% level for many regions and thresholds. The SREF probabilities are fairly reliable, although the SREF is overconfident at higher probabilities in all regions. The inclusion of WRF did not improve the SREF probabilistic skill. Over the eastern Pacific, eastern Canada, and western Atlantic, the SREF is overdispersed on average, especially early in the forecast, while across the central and eastern United States the SREF is underdispersed later in the forecast. There are relatively large biases in cyclone central pressure within each SREF subgroup. As a result, the best-member diagrams reveal that the SREF members are not equally accurate for the cyclone central pressure and displacement. Two cases are presented to illustrate examples of SREF developing large errors early in the forecast for cyclones over the eastern United States.