Page 1 of 1

HTTP File Search API broken

Posted: Thu Jan 09, 2025 1:13 pm America/New_York
by dem1
Hi,

Since yesterday 7:35pm UTC the HTTP File Search API returns code 500.
I have already informed connection_problems@oceancolor.sci.gsfc.nasa.gov and they should have raised the issue to the web team, but I prefer post the info here too.

Thanks,
Julien
Copernicus Marine OCTAC Service

Re: HTTP File Search API broken

Posted: Thu Jan 09, 2025 5:18 pm America/New_York
by OB.DAAC - amscott
Hello,

Thank you for contacting the connection_problems email. Has this team emailed back any helpful insights?

In my own testing, I have not been able to replicate this issue. Sometimes stale settings cause issues with websites. It may help to clear cache, restart the web browser and try accessing the site again. Let us know if you are still having issues.

Re: HTTP File Search API broken

Posted: Thu Jan 09, 2025 9:05 pm America/New_York
by roger_scott
Just confirming that we're also seeing this issue. This is with wget rather than a web browser so it isn't related to any cache or cookies.

$ wget --post-data="dtype=anc&sensor=aqua&cksum=1&results_as_file=1&search=*P2025007*" https://oceandata.sci.gsfc.nasa.gov/api/file_search
--2025-01-10 12:47:18-- https://oceandata.sci.gsfc.nasa.gov/api/file_search
Resolving oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)... 169.154.128.84, 2001:4d0:2418:128::84
Connecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|169.154.128.84|:443... connected.
HTTP request sent, awaiting response... 500 Internal Server Error
2025-01-10 12:47:19 ERROR 500: Internal Server Error.

It's possible something has changed with the way the queries should be structured which I've missed but the "500" code suggests it's more likely a server issue.

Thanks,
Roger.

Re: HTTP File Search API broken

Posted: Fri Jan 10, 2025 8:43 am America/New_York
by dem1
Hi,

After a deeper analysis I found that wildcards seem broken in the 'search' field, example:
this works:

Code: Select all

curl -X POST -d "sensor=aqua&dtype=L2&results_as_file=1&sdate=2025-01-10 09:30:00&edate=2025-01-10 09:35:00&search=AQUA_MODIS.20250110T093000.L2.OC.NRT.nc" https://oceandata.sci.gsfc.nasa.gov/api/file_search
but this returns error 500:

Code: Select all

curl -X POST -d "sensor=aqua&dtype=L2&results_as_file=1&sdate=2025-01-10 09:30:00&edate=2025-01-10 09:35:00&search=AQUA_MODIS.*.L2.OC.NRT.nc" https://oceandata.sci.gsfc.nasa.gov/api/file_search
Do you confirm the issue?

I will try to implement a workaround on our side to no more use wildcards to be able to restart our service.

Is there a way to be notified when there are changes on the File Search API?

Thanks,
Julien
Copernicus Marine OCTAC Service

Re: HTTP File Search API broken

Posted: Fri Jan 10, 2025 11:18 am America/New_York
by OB.DAAC - amscott
Thanks for the additional information. I tried wget also, but did not attempt to use a wildcard character. Let me check to see if that's expected behavior. We can notify the oceancolor mailing list upon changes and bug fixes. Instructions to join are here: https://oceancolor.gsfc.nasa.gov/resources/mailing-lists/

Re: HTTP File Search API broken

Posted: Fri Jan 10, 2025 1:50 pm America/New_York
by OB.DAAC - amscott
The issue should be fixed. It was a bug not an enhancement. Thanks for informing us of it. Are you able to get successful results from wget and curl now?

Re: HTTP File Search API broken

Posted: Sun Jan 12, 2025 4:23 pm America/New_York
by roger_scott
I can confirm it's working with wget now. Thank you.

Roger.

Re: HTTP File Search API broken

Posted: Mon Jan 13, 2025 4:15 am America/New_York
by dem1
Thanks a lot for the quick fix, I confirm that wildcards work now as expected.