In 2016, the USGS identified a need to improve the capability of the Landsat data archive to support time series analysis through the full Landsat record. This required the reprocessing of all archived Landsat Level-1 data to achieve radiometric and geometric consistency through time and across all Landsat sensors.
Collection 1 consists of Landsat 4-5 Thematic Mapper, Landsat 7 Enhanced Thematic Mapper Plus, and Landsat 8 Operational Land Imager and Thermal Infrared Sensor data. Landsat 1-5 Multispectral Scanner data may be incorporated in the future.
New Landsat Product Identifiers, “Collection” and “Tier” designations, metadata changes, modified processing level designations, additional supporting files, and new cloud-cover algorithms are all included in Collection 1 Level-1 data products. (Collection 1 Higher-Level science data products will inherit characteristics of the Level-1 data.)
This Landsat Update AGU Edition provides a status of the Collection 1 reprocessing effort and describes the characteristics of the Landsat Collection 1 Level-1 data products.
The Landsat Collections webpage provides complete information on Collection 1: https://landsat.usgs.gov/landsat-collections.
Since starting in August 2016, over 667,000 Landsat 7 (L7) Enhanced Thematic Mapper Plus (ETM+) and 672,000 Landsat 4-5 (L4-5) Thematic Mapper (TM) scenes have been reprocessed into Collection 1 Level-1 data products, and are available to download from EarthExplorer (EE): https://earthexplorer.usgs.gov.
Figure 1 shows the location of both the Collection 1 Level-1 and the Pre-Collection data sets on the EE Dataset tab.
L7 ETM+ and L4-5 TM Collection 1 reprocessing will complete during the spring of 2017. A status of the reprocessing efforts (updated weekly) is visible on the Landsat Missions Website: https://landsat.usgs.gov.
Collection 1 Level-1 reprocessing for Landsat 8 (L8) Operational Land Imager/Thermal Infrared Sensor (OLI/TIRS) scenes is scheduled to begin in January 2017, and data will start becoming available in February 2017.
Samples of Landsat 8 Collection 1 Level-1 data are available to download from https://landsat.usgs.gov/landsat-collections#sample.
NOTE: Users are encouraged to begin using Landsat Collection 1 Level-1 data products, as Pre-Collection data sets will remain available for only a limited time after the completion of Collection 1 reprocessing.
The ability to request Surface Reflectance and Higher-Level science data products for Landsat 4-5 TM and Landsat 7 ETM+ Collection 1 scenes will become available in January 2017, using the USGS Earth Resources Observation and Science (EROS) Center Science Processing Architecture (ESPA) on-demand interface: https://espa.cr.usgs.gov or EarthExplorer: https://earthexplorer.usgs.gov (Surface Reflectance only). See Page 5 for more details about Landsat Higher-Level science data products.
Changes and enhancements have been made to the Landsat data processing system to support the generation and management of the Landsat Collection 1 Level-1 data products.
Processing Level Designations have been modified in support of Collection 1 reprocessing. Table 1 below compares the processing level designations of Landsat Pre-Collection Level-1 data products (left column) to Collection 1 Level-1 data products (right column).
Landsat Tiers are the inventory structure for Landsat Collection 1 Level-1 data products and are based on data quality and level of processing.
Landsat scenes with the highest data quality are placed into Tier 1, and scenes not meeting Tier 1 criteria are assigned to Tier 2. The Real-Time Tier is a temporary assignment for newly acquired Landsat 7 and Landsat 8 scenes, as described in Table 2 below.
Table 3 below compares the Landsat Pre-Collection Level-1 Scene ID (left box) to the Landsat Collection 1 Level-1 Product Identifier (right box). The Landsat Product Identifier contains information inherited from the Pre-Collection Scene ID, along with updated processing levels, processing date, collection number, and collection category (red colored text).
Landsat Collection 1 Level-1 data products for each scene contain the image data bands; metadata (MTL.txt) file; a new Quality Assessment (QA) band for Landsat 4-5 and Landsat 7 data products (a revised QA band will be used for Landsat 8 Collection 1); and a new Angle Coefficient File. The QA bands and Angle Coefficient File are described below.
The Landsat Collection 1 Quality Assessment (QA) band allows users to apply per pixel filters to Landsat Level-1 data products. Each pixel in the QA band contains unsigned integers that represent bit-packed combinations of surface, atmospheric, and sensor conditions that can affect the overall usefulness of a given pixel. Table 4 illustrates the designated bits for Landsat Collection 1 Level-1 QA bands.
Note: Although the cloud detection algorithm has undergone some degree of validation, the snow cover detection algorithm has not. Additional information about the Landsat Collection 1 QA band can be found at https://landsat.usgs.gov/collectionqualityband.
The Landsat Collection 1 Level-1 Angle Coefficient File provides sensor viewing angle model coefficients that can be used to compute the solar illumination and sensor viewing angles for every Landsat pixel in a scene.
Figure 2 shows the contents of the Angle Coefficient File.
Angle bands allow users to better understand how the sensor viewing geometry and solar illumination geometry affect the object being sensed by the imaging instrument, and can be used in science algorithms to produce more accurate results over the current practice of using the single scene-center solar illumination and sensor viewing angles.
NOTE: For most applications, users can continue to use the standard Level-1 data, but the information in this file provides opportunities to investigate refinements to the solar zenith angle corrections in higher-level science data products. Future plans include implementing an end-user web-based tool; however, currently users are responsible for creating usable angle bands.
Tools that allow users to create angle bands in a LINUX environment are available to download from solar-illumination-and-sensor-viewing-angle-coefficient-file.
A number of different cloud cover algorithms were used in Landsat Pre-Collection Level-1 data. In order to consistently calculate cloud cover in Collection 1 Level-1 data, the C Function of Mask (CFMask) algorithm has been implemented.
CFMask identifies cloud, cloud confidence, cloud shadow, and snow/ice pixels in the processing of Landsat Level-1 data products, with the results represented as bit-mapped values within the Landsat Collection 1 Level-1 Quality Assessment (QA) Band. The multi-pass algorithm uses decision trees to progressively label pixels in a scene; it then validates or discards those labels according to scene-wide statistics. It also creates a cloud shadow mask by iteratively estimating cloud heights and projecting them onto the ground.
CFMask provides full-image “Scene Cloud Cover” estimation, as well as a new “Land Cloud Cover” score, which is calculated over only land pixels in a scene. Both cloud cover scores are listed in the metadata file that is delivered with the Collection 1 Level-1 data product.
(Users should be aware that, like other cloud algorithms, CFMask may have difficulties over bright targets such as building tops, beaches, snow/ice, sand dunes, and desert playas. Optically thin clouds will always be challenging to identify and have a higher probability of being omitted by the algorithm. In addition, the algorithm performance has only been validated for cloud detection, and to a lesser extent for cloud shadows. No rigorous evaluation of the snow/ice detection has been performed. For further information on the CFMask algorithm, visit https://landsat.usgs.gov/what-cfmask.)
Higher-level science data products (such as Climate Data Records (CDRs) and Essential Climate Variables (ECVs)) can be used to document changes to Earth's terrestrial environment and provide an authoritative basis for regional to continental scale identification of historical change, monitoring current conditions, and helping to predict future scenarios.
Atmospherically-corrected Surface Reflectance (SR) data for Collection 1 Landsat 7 ETM+ and Landsat 4-5 TM scenes will become available to order from EarthExplorer in January 2017. Landsat 8 Higher-Level science data products will become available a short time after the release of Landsat 8 Collection 1 Level-1 products (See Page 1).
The Earth Resources Observation and Science (EROS) Center Science Processing Architecture (ESPA) On-demand interface accepts orders for not only Surface Reflectance data, but also Top-of-Atmosphere Reflectance, Brightness Temperature, and CFMask outputs, as well as multiple spectral indices derived from surface reflectance data, and allows users to customize output formats, map reprojection, and pixel resizing. Figure 3 shows the ESPA on-demand interface.
Surface reflectance and other higher-level science data products are processed and delivered directly from the ESPA on-demand Interface.
The ESPA User Guide provides further information on how to place an order through ESPA.
Further questions about Landsat Collection 1 Level-1 or Landsat Higher-Level science data products can be directed to Landsat User Services: firstname.lastname@example.org.
Landsat Communication Outlets
Connect with us!
USGS Landsat: @USGSLandsat
NASA Landsat: @NASA_Landsat
NASA Landsat: https://www.facebook.com/NASA.Landsat