New SST data in CMR?

[OB.DAACx - SeanBailey]

SST and OC are separate streams, so no relation should be expected.  That said, the SST typically reach refined status earlier.  For ocean color, we process the data as soon as possible (QLP - quick-look preliminary), after the best possible ancillary are available (QL) and again after the forward stream calibration has been "refined".

Sean

[earthengine_urs]

Sean - how do these three stages map onto filenames?

[OB.DAACx - SeanBailey]

For ocean color products, they don't - for now.  When we reprocess, there will be only two "stages", NRT and refined and they will follow the same pattern as the SST, with NRT in the name for the NRT files.  We'll be dropping the QL (or QLP, depending on your viewpoint) because we'll be switching ancillary sources and the refined version of the new source has a frequency that is more in line with our calibration update frequency.

Sean

[earthengine_urs]

Got it. When approximately do you expect to reprocess the rest?

[OB.DAACx - SeanBailey]

Oh, last month...apparently we missed our target :wink:

I'm still shooting for sometime this calendar year, but I never make promises about these things - they usually turn into lies....

Sean

[earthengine_urs]

Right, deadlines are tough. :grin: I'll keep an eye on your announcements then.

[earthengine_urs]

Sean,

I am a bit confused about concept ids. For MODIS L3 mapped data for CHL, FLH, POC, RRS, and SST I have this:
Terra:
        'C1458097478-OB_DAAC',
        'C1458097483-OB_DAAC',
        'C1458097505-OB_DAAC',
        'C1200034429-OB_DAAC',
        'C1615934288-OB_DAAC'

Aqua:
        'C1442922862-OB_DAAC',
        'C1442922863-OB_DAAC',
        'C1442922871-OB_DAAC',
        'C1442922873-OB_DAAC',
        'C1615905770-OB_DAAC'

However, the names for the second and third datasets in these lists don't quite match. C1458097483-OB_DAAC is "Terra Moderate Resolution Imaging Spectroradiometer (MODIS) Fluorescence Line Height (FLH) Global Mapped Data, reprocessing v2018", while C1442922863-OB_DAAC is "Aqua Moderate Resolution Imaging Spectroradiometer (MODIS) Fluorescence Line Height (FLH) Global Mapped Data" - no "reprocessing". Did I get any of them wrong?

Thanks,
Simon

[OB.DAACx - amscott]

Hi Simon,

Concept IDs are Earthdata Search's way of keeping track of datasets so we don't have control over those. The good news is that what you have found is correct. The text you mentioned is "free text", so that may change slightly from one reprocessing to another. The best way to verify the version is by looking for the version tag/attribute for the product. You can see it displayed in gray on the bottom of the product description in Earthdata Search. https://search.earthdata.nasa.gov/search?q=C1442922863-OB_DAAC

To find the products by the name we assign at OBPG, use the name shown in gray before version: "MODISA_L3m_FLH". Then you will find any product by that name, any version that exists.

[earthengine_urs]

Thank you! Next problem: CMR lack data for all but SST files (out of those I care about) starting on May 2, 2020. See
https://cmr.earthdata.nasa.gov/search/granules.json?concept_id%5b%5d=C1458097478-OB_DAAC&temporal%5b%5d=2020-05-01/2020-05-03&page_size=1&page_num=1
which returns https://oceandata.sci.gsfc.nasa.gov/cmr/getfile/T2020122.L3m_DAY_CHL_chl_ocx_4km.nc
vs
https://cmr.earthdata.nasa.gov/search/granules.json?concept_id%5b%5d=C1458097478-OB_DAAC&temporal%5b%5d=2020-05-02/2020-05-03&page_size=1&page_num=1
which returns nothing

[OB.DAACx - SeanBailey]

That "concept id" points to the refined processing, which can lag 60-90 days (or more in these pandemic times).
If you. want more current data, you'll need to look at the corresponding NRT collections.
In this particular case (MODIS-Terra chlorophyll):

C1458097478-OB_DAAC = MODIST_L3m_CHL
C1458149042-OB_DAAC = MODIST_L3m_CHL_NRT

Sean