Search found 8 matches

by sethdd
Tue Feb 18, 2025 3:19 pm America/New_York
Forum: Home
Question: S3 to Azure Blob Storage using azcopy
Replies: 8

Re: S3 to Azure Blob Storage using azcopy

karthick_rn wrote: > Hello, > > We're using the bulk download script > (https://git.earthdata.nasa.gov/projects/LPDUR/repos/hls-bulk-download/browse/getHLS.sh) > to transfer the HLS data into an Azure Storage account. With more than > 7,000 Tile IDs to download, the process is quite time-consuming. ...
by sethdd
Tue Feb 18, 2025 3:15 pm America/New_York
Forum: Home
Question: Listing files from an Earthdata Cloud collection
Replies: 4

Re: Listing files from an Earthdata Cloud collection

LP DAAC - dgolon wrote:
> Just closing the loop on this for other users. We were able to fix an issue
> we had in the LP DAAC bucket policy. Rclone should successfully run now.

Thanks again for the support on resolving this!
by sethdd
Wed Feb 05, 2025 4:31 pm America/New_York
Forum: Home
Question: Listing files from an Earthdata Cloud collection
Replies: 4

Re: Listing files from an Earthdata Cloud collection

Excellent! I reached out yesterday, early evening, and hoping to hear back soon.
by sethdd
Thu Jan 30, 2025 6:46 pm America/New_York
Forum: Home
Question: S3 to Azure Blob Storage using azcopy
Replies: 8

Re: S3 to Azure Blob Storage using azcopy

@karthick_rn, the issue you're running into with the "list objects" error is similar to what I just posted here: https://forum.earthdata.nasa.gov/viewtopic.php?t=6406 Could you try copying this file (159 MB) from the ORNL DAAC bucket and see if you get a similar error: s3://ornl-cumulus-pr...
by sethdd
Thu Jan 30, 2025 6:34 pm America/New_York
Forum: Home
Question: Listing files from an Earthdata Cloud collection
Replies: 4

Listing files from an Earthdata Cloud collection

I'm currently working on a project that requires listing files from an Earthdata AWS Cloud bucket. I'm using rclone to connect to the bucket for a given collection and mounting it on my system as a folder. I want to note that this issue is not specific to rclone but any tool, like AWS CLI, to perfor...
by sethdd
Wed Sep 11, 2024 2:05 pm America/New_York
Forum: Home
Question: L1 and L2 GEDI mission collections missing HTTPS Endpoint
Replies: 3

Re: L1 and L2 GEDI mission collections missing HTTPS Endpoint

Appreciate the response! While there was a notice about the migration back in April (https://lpdaac.usgs.gov/news/gedi-version-2-migrates-to-earthdata-cloud/), I haven't seen any information on when access would be removed. Ideally, it would be nice to have awareness of when collection migrations su...
by sethdd
Mon Sep 09, 2024 1:23 pm America/New_York
Forum: Home
Question: L1 and L2 GEDI mission collections missing HTTPS Endpoint
Replies: 3

L1 and L2 GEDI mission collections missing HTTPS Endpoint

I'm not seeing any of the L1 and L2 GEDI data up on https://e4ftl01.cr.usgs.gov/, which has been missing since September 6th. I'm not sure if the collection has been moved to a different HTTPS endpoint but the CMR (https://cmr.earthdata.nasa.gov/search/concepts/C2142776747-LPCLOUD.html) is still poi...
by sethdd
Thu Mar 28, 2024 3:11 pm America/New_York
Forum: Home
Question: Impossible to establissh SSL conncection when downloading subset with wget
Replies: 2

Re: Impossible to establissh SSL conncection when downloading subset with wget

Hi griecof, which DAAC is that data located on? I've recently found out that some DAACs like ORNL do not play well with using .netrc files for authentication. I ended up having to use a Bearer token through my account to get some success.