missing_value ?
-
- Subject Matter Expert
- Posts: 4
- Joined: Wed May 31, 2023 11:14 pm America/New_York
missing_value ?
Under what circumstances should I use the missing_value attribute in my Earth Science data product?
-
- User Services
- Posts: 422
- Joined: Mon Sep 30, 2019 10:00 am America/New_York
- Has thanked: 31 times
- Been thanked: 8 times
- Contact:
Re: missing_value ?
Hi @pleonard Could you please provide us with a little more information? I.e. which dataset are you using and what are you trying to accomplish?
Subscribe to the LP DAAC listserv by sending a blank email to lpdaac-join@lists.nasa.gov.
Sign up for the Landsat listserv to receive the most up to date information about Landsat data: https://public.govdelivery.com/accounts/USDOIGS/subscriber/new#tab1.
Sign up for the Landsat listserv to receive the most up to date information about Landsat data: https://public.govdelivery.com/accounts/USDOIGS/subscriber/new#tab1.
-
- Subject Matter Expert
- Posts: 4
- Joined: Wed May 31, 2023 11:14 pm America/New_York
Re: missing_value ?
I am producing a gridded soil-moisture product in netCDF.
The data in each grid cell can be either high quality, low quality or missing.
There are many reasons for why data can be missing from a grid cell, and I think it is worth noting why the data are missing in each case.
How should I represent these different cases of missing data in my product?
The data in each grid cell can be either high quality, low quality or missing.
There are many reasons for why data can be missing from a grid cell, and I think it is worth noting why the data are missing in each case.
How should I represent these different cases of missing data in my product?
-
- Subject Matter Expert
- Posts: 73
- Joined: Thu May 27, 2021 2:52 pm America/New_York
- Been thanked: 1 time
Re: missing_value ?
Hi @pleonard, in general the netCDF CF convention (http://cfconventions.org/) provides two attributes that you can use to specify a single missing value, one is _FillValue and the other is missing_value. But _FillValue is preferred as your data will get better support from the netCDF library. Here are some example cases that _FillValue can be use in: 1) you want to assign a _FillValue to grid cells falling within water bodies; and 2) if your soil moisture data is a time series but you couldn't produce data at certain time periods due to sensor failure or other reasons.
To specify quality level of your data, the CF convention suggests you define ancillary variables. Here are some examples for your reference:
- Ancillary quality flag data: http://cfconventions.org/Data/cf-conventions/cf-conventions-1.10/cf-conventions.html#quality-flag-ex
- A flag variable, using flag_values: http://cfconventions.org/Data/cf-conventions/cf-conventions-1.10/cf-conventions.html#flag-variable-flag-values-ex
Hope this helps.
To specify quality level of your data, the CF convention suggests you define ancillary variables. Here are some examples for your reference:
- Ancillary quality flag data: http://cfconventions.org/Data/cf-conventions/cf-conventions-1.10/cf-conventions.html#quality-flag-ex
- A flag variable, using flag_values: http://cfconventions.org/Data/cf-conventions/cf-conventions-1.10/cf-conventions.html#flag-variable-flag-values-ex
Hope this helps.
Dr. Yaxing Wei (weiy@ornl.gov)
Lead Scientist, ORNL DAAC
Environmental Sciences Division
Oak Ridge National Laboratory
https://daac.ornl.gov
Lead Scientist, ORNL DAAC
Environmental Sciences Division
Oak Ridge National Laboratory
https://daac.ornl.gov