In 2015, the USGS began to implement a series of major changes to Landsat data products and processing systems that support long-term plans for the generation of higher-level science data products and improve traceability in subsequent analyses. Changes to Level-1 products will provide users with more detailed, robust metadata and quality information at the scene and pixel levels. Another major change will involve the implementation of a new Level-1 product naming convention, in support of a new collection management scheme planned for Landsat Level-1 products.
The primary focus of 2016 will be to implement a collection management scheme for Landsat Level-1 products that will provide a quality controlled selection of radiometrically calibrated and consistently geolocated data with sufficiently geographically aligned pixels to support time series analysis through the full Landsat record. Many factors were considered when establishing this collection management scheme, particularly those that would facilitate automated scene identification and processing of time-stacked Landsat products.
For all Landsat scenes that meet the highest quality standards to support time-series analysis, the inventory designation will be as follows:
Tier 1: The intent is to create a clearly identified ‘Tier 1’ collection of the Landsat archive in which the radiometry is well characterized and inter-calibrated across the different Landsat sensors; the georegistration of every Landsat scene is consistent and within prescribed tolerances (<11.9m radial root mean square error); and the product format is stable. All data within the Tier 1 collection will be highest available quality and processing level, and will be suitable for time-series processing analysis. These data will be designated “T1”.
For Landsat scenes that do not meet the radiometric and geometric quality criteria of Tier 1, there will be two other collections:
The Landsat 4-5 Thematic Mapper (TM) archive contains data that cannot be precision and terrain corrected to a Level-1T (L1T) product, either because of incomplete payload correction (PCD) data or missing parameters in the original archive data. These data will be processed to systematically corrected Level-1G (L1G) products and therefore will not meet the criteria for the Tier 1 collection. These data will be designated “T2.”
Real Time: After acquisition, Landsat 7 ETM+ data require a short period of instrument trending/characterization (about 1 week) which results in calibration parameter adjustments to finalize the geometric correction model. When Landsat 7 data are initially downlinked, they are processed in ‘near-real time’ using predicted ephemeris and initial bumper mode parameters and then made available for download. These data will be designated “RT” until all geometric processing parameters (e.g. bumper mode parameters, definitive ephemeris) are finalized and the data are reprocessed and moved to the Tier 1 or Tier 2 collection based on the radial root mean square error (RMSEr) determined from the post-fit verification of the geometric model.
At this time, processing of Landsat 1-5 Multispectral Scanner (MSS) data remains unchanged until investigation and characterization of the radiometric and geometric quality of these data are completed.
More information about the Landsat Level-1 product collections, such as a Collection Definition Document, Collection Management Plan, and the chronological order in which the data will be reprocessed, will be posted to the Landsat Missions Web site once details are finalized.
A number of changes and enhancements are being made to the Landsat Level-1 Product Generation System (LPGS) in order to support the generation and management of the Landsat Level-1 product collections. Many of these changes will be implemented in May 2016, although the schedule and sequence for reprocessing of all TM, ETM+, and OLI/TIRS are still under development.
To better identify in which collection a scene is contained, a new Landsat product ID will be created, and used to download Level-1 products. It will also be added to the metadata (MTL.txt) file. The currently used scene ID will remain in the metadata file as a source for metadata searching. The proposed Product ID will be as follows:
L = Landsat (constant)
X = Sensor (C = OLI/TIRS Combined, O=OLI-only, E = ETM, T = TM, M= MSS)
SS = Satellite (e.g., 09 for Landsat 9, 10 for Landsat 10)
LLL = Processing Correction level (e.g., L1T: precision and terrain, L1G: systematic terrain, L1S: systematic)
PPP = WRS path
RRR = WRS row
YYYYMMDD = Acquisition Year (YYYY) / Month (MM) / Day (DD)
yyyymmdd = Processing Year (yyyy) / Month (mm) / Day (dd)
CC = Collection number (e.g., 01, 02)
TX = Collection Category: "RT" for real-time, “T1” for Tier 1 , or "T2" for Tier 2
In April 2016, a new parameter (TIRS_SSM_MODEL) will be added to the Landsat 8 data metadata (MTL.txt) file, to help users identify the effects of the SSM encoder current anomaly. Details about the SSM anomaly are provided in an article in the last section of this Update.
The new parameter will have one of three values:
When the TIRS_SSM_MODEL parameter is "Preliminary", the IMAGE_QUALITY_TIRS parameter in the MTL file will be set to a lower value to provide an additional indication that the TIRS quality is not normal. The new mode of operations will result in the scenes being processed through LPGS twice. The first run will use "Preliminary" estimated SSM encoder position information and will be reprocessed after the "Final" version of the information is available.
A file containing parameters needed to calculate the per-pixel solar illumination and sensor view angle bands will be added to Landsat TM, ETM+ and OLI/TIRS scenes. A Linux tool to generate angle bands will also be made available on the Landsat Missions Web site.
The solar zenith angle band can be used in combination with rescaling factors contained in the metadata (.MTL.txt) file to calculate per-pixel top of atmosphere (TOA) reflectance for the solar reflective bands, and brightness temperature for the thermal bands. (Note that thermal constants, located in the metadata, are needed to calculate brightness temperature.)
Initially proposed in 2015, information will be provided in the QA band for flagging dropped pixels, radiometric saturation, clouds, cloud shadows, and snow/ice in Landsat 4-5 TM and Landsat 7 ETM+ data products, and will be compatible with the updated Landsat 8 OLI/TIRS QA band. The QA band for Landsat MSS will include values for only fill, non-cloudy, and cloudy pixels.
The table below shows the proposed QA bits and values for Landsat 1-7, and updated bits for Landsat 8, which include saturation bits.
Quality Assessments bits will be populated to indicate whether radiometric saturation occurs in any band. The saturation bit values are:
00 = No saturation
01 = 1 to 2 bands saturated
10 = 3 to 4 bands saturated
11 = 4 or more bands saturated
The bands that have saturation will be noted in the metadata (MTL.txt) file in a new yet-to-be-named parameter.
A land-based cloud cover assessment (CCA) will provide an estimate of land in a continental coastal scene that is cloud covered. The percentage of land pixels affected by clouds will be calculated, and written to the metadata file (MTL.txt) as a scene-based score in a new parameter (CLOUD_COVER_LAND). This parameter will become a searchable metadata attribute in the collections.
The land mask, used to determine land pixels included in the CCA score, is derived from the NOAA World Vector Shoreline dataset.
On November 1, 2015, the Thermal Infrared Sensor experienced an anomalous condition related to the instrument's ability to accurately measure the location of the Scene Select Mirror (SSM). While all TIRS data continue to be collected since this date, they are processed and made available as “zero-fill” (black/no data), until processing parameters and algorithm changes are made to allow reprocessing of nominal Level-1 products containing valid TIRS data.
An alternative operations concept for determining the exact position of the SSM through analysis of instrument telemetry data provides information to regularly update the line of sight (LOS) model that is used for geometric correction and alignment of TIRS and OLI data. All collected TIRS data will become available in Level-1 products once the LOS model parameters are finalized, and the geometric processing algorithms and code in the Landsat Level-1 Product Generation System (LPGS) have been updated, tested, and verified.
As of February 12, 2016, many* of the Landsat 8 scenes acquired from October to December 2015 have been reprocessed into nominal Level-1 products containing valid TIRS data and are available for download, and can also be submitted for higher-level Surface Reflectance data processing via the ESPA On-demand interface.
*A number of scenes acquired from approximately 10 pm CT on November 1, 2015 to approximately 5 pm CT on November 2, 2015 will still contain zero-fill TIRS data . These scenes will not be reprocessed until April 2016.
Landsat 8 scenes acquired from January to March 2016 will be reprocessed and made available starting in April 2016.
Additional Information about TIRS SSM can be found on the following Landsat Missions Web site pages:
Shortly after the launch of Landsat 8, the Landsat calibration team noticed that thermal energy from outside the normal field of view (stray light) was affecting the data collected by the satellite’s Thermal Infrared Sensor (TIRS). Ground-based measurements indicate a significant error in the radiance measured by the sensor, and investigations showed that stray light increases the reported temperature by up to 4 Kelvin (K) in band 10 and up to 8 K in band 11. The errors vary throughout the scene and depend upon radiance outside the instrument field of view, which is not inherently correctable in the Landsat Level-1 processing.
An algorithm to correct the stray light is showing promise to reduce the errors. The amount of stray light in the scenes is estimated using scenes acquired before and after the target scene, as well as the edge pixels of the target scene. The stray light estimate is then subtracted from the target scene.
Even after this correction, the results will not be considered precise enough to use a split-window algorithm for surface temperature retrieval. More information will be provided as results from further analyses become available.
Additional Information about TIRS Stray Light can be found on the following Landsat Missions Web site pages: