Encl (2) to COMDTINST 16010.8
Oil Spills: The baseline has been revised based on a new data analysis.
Hence, the goal target for FY99 has also changed from the target in the
FY99 Performance Plan. The baseline is established by a regression curve
obtained from several years of data. Performance is measured against a
selected year on the curve. Data on oil spilled is obtained from the Coast
Guard Marine Safety Information System (MSIS). Data on waterborne
shipments of oil obtained from Army Corps of Engineers "Waterborne
Commerce Statistics." Oil spills of 1 million gallons or more are
excluded from data. These spills are extremely rare (less than .1% of
spills) and would have an inordinate influence on statistical trends.
Only spills from regulated vessels and facilities are counted. MSIS data
is verified by field offices. Data is also checked during processing into
the analysis database. Program managers also validate a sample of MSIS
data against incident case records. Confidence in measure is moderate.
Plastics and Garbage Debris: The baseline has been revised based on a new
data analysis. Hence, the goal target for FY99 has also changed from the
target in the FY99 Performance Plan. The baseline is established by a
regression curve obtained from several years of data. Performance is
measured against a selected year on the curve. 1997 figure is a projection
based on historical data (1990-96). The associated measure was changed
from "pounds of debris" to "number of marine debris items" for better
measurement. Data on debris items obtained from the Center for Marine
Conservation, "National Coastal Cleanup Results." A recent National
Marine Fisheries Service study corroborated CMC data trends. Confidence
in the measure is moderate.
Pollution Response: This
measure replaces the oil removal rate
measure
contained in previous performance plans. Attempts over the past 4 years
to use oil removal rates as a measure of response effectiveness presented
significant validity problems. Spill removal data is susceptible to bias
in the form of underestimated spill sizes and inflated removal amounts.
Removal estimates are confounded by the dynamics of weathering. The
problems that make removal rates a poor performance management measure
have resulted in a reevaluation to develop a better indicator of pollution
response effectiveness and readiness. A multiple factor rating system for
this purpose continues to be developed. The system will likely take the
form of a post-incident assessment of preparedness for the incident and
performance to mitigate the incident. The assessment will assign a rating
(P1-5) similar to the Status of Readiness and Training System (SORTS.) It
should be ready for testing in FY99. An additional measure evaluating the
effectiveness of federal response to spills over 1000 gallons is also
under development.
Domestic Fisheries: Data will be provided by NMFS through each of the
Regional Fisheries Management Councils' staffs for the changes in the
number of listed species that improve in status from year to year. Data
will be verified by NMFS personnel.
56 Measurement Issues