Multilevel Processing Issues with Seadas
Multilevel Processing Issues with Seadas
Hello,
I am converting a series of GOCI L1 files into L2 with the l2gen tool in Seadas. If done individually in the OCSWW window it works fine, however when trying to do multiple images with the multilevel_processor tool I keep getting this error:
execution exception: java.io.IOException: multilevel_processor failed with exit code 1.
Check log for more details.
Error! File /Users/catherine/Desktop/Seadas/IO_OCSSW_PARAMS/ifile_list specified the following input files which could not be located:
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906001644.he5
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906011644.he5
In this instance a list for the directory and file names have been put into the ifile_list file. There are 8 files it should be processing if it would work, all in the same usr/Desktop/GOCI_L1/ directory. I'm also unsure if it is my java that's not working, but if that were the case then I believe that running a single image through the l2gen would cause problems as well. Does anyone have any idea why it's returning this error? Thanks.
I am converting a series of GOCI L1 files into L2 with the l2gen tool in Seadas. If done individually in the OCSWW window it works fine, however when trying to do multiple images with the multilevel_processor tool I keep getting this error:
execution exception: java.io.IOException: multilevel_processor failed with exit code 1.
Check log for more details.
Error! File /Users/catherine/Desktop/Seadas/IO_OCSSW_PARAMS/ifile_list specified the following input files which could not be located:
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906001644.he5
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906011644.he5
In this instance a list for the directory and file names have been put into the ifile_list file. There are 8 files it should be processing if it would work, all in the same usr/Desktop/GOCI_L1/ directory. I'm also unsure if it is my java that's not working, but if that were the case then I believe that running a single image through the l2gen would cause problems as well. Does anyone have any idea why it's returning this error? Thanks.
Filters:
-
- Subject Matter Expert
- Posts: 713
- Joined: Tue Feb 09, 2021 5:42 pm America/New_York
- Been thanked: 9 times
Re: Multilevel Processing Issues with Seadas
Can you share the content of /Users/catherine/Desktop/Seadas/IO_OCSSW_PARAMS/ifile_list?
Were the other 6 L2 files created to your desired directory?
Were the other 6 L2 files created to your desired directory?
Re: Multilevel Processing Issues with Seadas
Yes, it's as follows:
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906001644.he5
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906011644.he5
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906021644.he5
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906031644.he5
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906041644.he5
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906051644.he5
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906061643.he5
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906071643.he5
There's nothing before or after it in the file, only the directories and names of each file.
As for the other 6 files, they are not created. I think the error occurs before it can run the process at all.
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906001644.he5
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906011644.he5
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906021644.he5
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906031644.he5
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906041644.he5
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906051644.he5
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906061643.he5
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906071643.he5
There's nothing before or after it in the file, only the directories and names of each file.
As for the other 6 files, they are not created. I think the error occurs before it can run the process at all.
-
- Subject Matter Expert
- Posts: 713
- Joined: Tue Feb 09, 2021 5:42 pm America/New_York
- Been thanked: 9 times
Re: Multilevel Processing Issues with Seadas
Are your GOCI files in usr/Desktop/GOCI_L1/ or /Users/catherine/Desktop/GOCI_L1/?
Can you check by "ls -al /Users/catherine/Desktop/GOCI_L1/"?
Can you check by "ls -al /Users/catherine/Desktop/GOCI_L1/"?
Re: Multilevel Processing Issues with Seadas
Sorry yes they are in /Users/catherine/Desktop/GOCI_L1/
-
- Subject Matter Expert
- Posts: 713
- Joined: Tue Feb 09, 2021 5:42 pm America/New_York
- Been thanked: 9 times
Re: Multilevel Processing Issues with Seadas
Can you do "ls -al /Users/catherine/Desktop/GOCI_L1/"?
I do get error like
"Error! File */ifile_list specified the following input files which could not be located:" when the file in the ifile_list does not exsit
I do get error like
"Error! File */ifile_list specified the following input files which could not be located:" when the file in the ifile_list does not exsit
Re: Multilevel Processing Issues with Seadas
Yes, it returns:
total 17144440
drwxr-xr-x 40 catherine staff 1280 2 Jun 16:16 .
drwx------+ 52 catherine staff 1664 31 May 15:44 ..
-rw-r--r--@ 1 catherine staff 8196 3 Jun 10:48 .DS_Store
-rw-r--r--@ 1 catherine staff 1013065957 31 May 11:46 COMS_GOCI_L1B_GA_20110906001644.he5
-rw-r--r--@ 1 catherine staff 1013107397 31 May 11:47 COMS_GOCI_L1B_GA_20110906011644.he5
-rw-r--r--@ 1 catherine staff 1013101261 31 May 11:47 COMS_GOCI_L1B_GA_20110906021644.he5
-rw-r--r--@ 1 catherine staff 1013100377 31 May 11:47 COMS_GOCI_L1B_GA_20110906031644.he5
-rw-r--r--@ 1 catherine staff 1013113305 31 May 11:47 COMS_GOCI_L1B_GA_20110906041644.he5
-rw-r--r--@ 1 catherine staff 1013112841 31 May 11:47 COMS_GOCI_L1B_GA_20110906051644.he5
-rw-r--r--@ 1 catherine staff 1013118625 31 May 11:47 COMS_GOCI_L1B_GA_20110906061643.he5
-rw-r--r--@ 1 catherine staff 1013113053 31 May 11:47 COMS_GOCI_L1B_GA_20110906071643.he5
-rw-r--r-- 1 catherine staff 34346876 2 Jun 14:51 G2011249001539.L2_LAC_OC
-rw-r--r-- 1 catherine staff 46886436 2 Jun 15:08 G2011249011539.L2_LAC_OC
-rw-r--r-- 1 catherine staff 47053110 2 Jun 15:29 G2011249021538.L2_LAC_OC
-rw-r--r-- 1 catherine staff 46630291 2 Jun 15:41 G2011249031538.L2_LAC_OC
-rw-r--r-- 1 catherine staff 47127927 2 Jun 15:53 G2011249041538.L2_LAC_OC
-rw-r--r-- 1 catherine staff 47724816 2 Jun 16:07 G2011249051538.L2_LAC_OC
-rw-r--r-- 1 catherine staff 379029188 2 Jun 16:24 G2011249061538.L2_LAC_OC
-rw-r--r--@ 1 catherine staff 14998 2 Jun 16:24 OCSSW_LOG_l2gen.txt
drwxr-xr-x 3 catherine staff 96 26 May 11:19 Output
-rw-r--r-- 1 catherine staff 428 26 May 11:12 Params_for_GOCI
-rw-r--r-- 1 catherine staff 16384 2 Jun 15:42 ancillary_data.db
-rw-r--r-- 1 catherine staff 162 2 Jun 14:33 l2gen-tmpParFile1195492200162734052.par
-rw-r--r-- 1 catherine staff 252 2 Jun 15:31 l2gen-tmpParFile1734840618871116778.par
-rw-r--r-- 1 catherine staff 252 2 Jun 15:18 l2gen-tmpParFile1977950663505711837.par
-rw-r--r-- 1 catherine staff 162 2 Jun 14:38 l2gen-tmpParFile2095676295842763228.par
-rw-r--r-- 1 catherine staff 162 2 Jun 15:17 l2gen-tmpParFile2187744033429230657.par
-rw-r--r-- 1 catherine staff 252 2 Jun 16:09 l2gen-tmpParFile2598132657172012214.par
-rw-r--r-- 1 catherine staff 252 2 Jun 14:40 l2gen-tmpParFile3491154330074317952.par
-rw-r--r-- 1 catherine staff 226 2 Jun 14:39 l2gen-tmpParFile3808563141778987748.par
-rw-r--r-- 1 catherine staff 162 2 Jun 16:08 l2gen-tmpParFile4357575019684759233.par
-rw-r--r-- 1 catherine staff 162 2 Jun 14:39 l2gen-tmpParFile5022778011310873181.par
-rw-r--r-- 1 catherine staff 162 2 Jun 15:30 l2gen-tmpParFile5309273649410298377.par
-rw-r--r-- 1 catherine staff 252 2 Jun 14:57 l2gen-tmpParFile5662545860895875444.par
-rw-r--r-- 1 catherine staff 252 2 Jun 15:56 l2gen-tmpParFile7213035118431902626.par
-rw-r--r-- 1 catherine staff 162 2 Jun 15:30 l2gen-tmpParFile7377932783140023861.par
-rw-r--r-- 1 catherine staff 162 2 Jun 15:42 l2gen-tmpParFile7631586698447615786.par
-rw-r--r-- 1 catherine staff 162 2 Jun 15:56 l2gen-tmpParFile7692512815721623244.par
-rw-r--r-- 1 catherine staff 162 2 Jun 14:57 l2gen-tmpParFile8907458223918739389.par
-rw-r--r-- 1 catherine staff 252 2 Jun 15:42 l2gen-tmpParFile986755201560224638.par
total 17144440
drwxr-xr-x 40 catherine staff 1280 2 Jun 16:16 .
drwx------+ 52 catherine staff 1664 31 May 15:44 ..
-rw-r--r--@ 1 catherine staff 8196 3 Jun 10:48 .DS_Store
-rw-r--r--@ 1 catherine staff 1013065957 31 May 11:46 COMS_GOCI_L1B_GA_20110906001644.he5
-rw-r--r--@ 1 catherine staff 1013107397 31 May 11:47 COMS_GOCI_L1B_GA_20110906011644.he5
-rw-r--r--@ 1 catherine staff 1013101261 31 May 11:47 COMS_GOCI_L1B_GA_20110906021644.he5
-rw-r--r--@ 1 catherine staff 1013100377 31 May 11:47 COMS_GOCI_L1B_GA_20110906031644.he5
-rw-r--r--@ 1 catherine staff 1013113305 31 May 11:47 COMS_GOCI_L1B_GA_20110906041644.he5
-rw-r--r--@ 1 catherine staff 1013112841 31 May 11:47 COMS_GOCI_L1B_GA_20110906051644.he5
-rw-r--r--@ 1 catherine staff 1013118625 31 May 11:47 COMS_GOCI_L1B_GA_20110906061643.he5
-rw-r--r--@ 1 catherine staff 1013113053 31 May 11:47 COMS_GOCI_L1B_GA_20110906071643.he5
-rw-r--r-- 1 catherine staff 34346876 2 Jun 14:51 G2011249001539.L2_LAC_OC
-rw-r--r-- 1 catherine staff 46886436 2 Jun 15:08 G2011249011539.L2_LAC_OC
-rw-r--r-- 1 catherine staff 47053110 2 Jun 15:29 G2011249021538.L2_LAC_OC
-rw-r--r-- 1 catherine staff 46630291 2 Jun 15:41 G2011249031538.L2_LAC_OC
-rw-r--r-- 1 catherine staff 47127927 2 Jun 15:53 G2011249041538.L2_LAC_OC
-rw-r--r-- 1 catherine staff 47724816 2 Jun 16:07 G2011249051538.L2_LAC_OC
-rw-r--r-- 1 catherine staff 379029188 2 Jun 16:24 G2011249061538.L2_LAC_OC
-rw-r--r--@ 1 catherine staff 14998 2 Jun 16:24 OCSSW_LOG_l2gen.txt
drwxr-xr-x 3 catherine staff 96 26 May 11:19 Output
-rw-r--r-- 1 catherine staff 428 26 May 11:12 Params_for_GOCI
-rw-r--r-- 1 catherine staff 16384 2 Jun 15:42 ancillary_data.db
-rw-r--r-- 1 catherine staff 162 2 Jun 14:33 l2gen-tmpParFile1195492200162734052.par
-rw-r--r-- 1 catherine staff 252 2 Jun 15:31 l2gen-tmpParFile1734840618871116778.par
-rw-r--r-- 1 catherine staff 252 2 Jun 15:18 l2gen-tmpParFile1977950663505711837.par
-rw-r--r-- 1 catherine staff 162 2 Jun 14:38 l2gen-tmpParFile2095676295842763228.par
-rw-r--r-- 1 catherine staff 162 2 Jun 15:17 l2gen-tmpParFile2187744033429230657.par
-rw-r--r-- 1 catherine staff 252 2 Jun 16:09 l2gen-tmpParFile2598132657172012214.par
-rw-r--r-- 1 catherine staff 252 2 Jun 14:40 l2gen-tmpParFile3491154330074317952.par
-rw-r--r-- 1 catherine staff 226 2 Jun 14:39 l2gen-tmpParFile3808563141778987748.par
-rw-r--r-- 1 catherine staff 162 2 Jun 16:08 l2gen-tmpParFile4357575019684759233.par
-rw-r--r-- 1 catherine staff 162 2 Jun 14:39 l2gen-tmpParFile5022778011310873181.par
-rw-r--r-- 1 catherine staff 162 2 Jun 15:30 l2gen-tmpParFile5309273649410298377.par
-rw-r--r-- 1 catherine staff 252 2 Jun 14:57 l2gen-tmpParFile5662545860895875444.par
-rw-r--r-- 1 catherine staff 252 2 Jun 15:56 l2gen-tmpParFile7213035118431902626.par
-rw-r--r-- 1 catherine staff 162 2 Jun 15:30 l2gen-tmpParFile7377932783140023861.par
-rw-r--r-- 1 catherine staff 162 2 Jun 15:42 l2gen-tmpParFile7631586698447615786.par
-rw-r--r-- 1 catherine staff 162 2 Jun 15:56 l2gen-tmpParFile7692512815721623244.par
-rw-r--r-- 1 catherine staff 162 2 Jun 14:57 l2gen-tmpParFile8907458223918739389.par
-rw-r--r-- 1 catherine staff 252 2 Jun 15:42 l2gen-tmpParFile986755201560224638.par
Re: Multilevel Processing Issues with Seadas
Sorry I should clarify as well, the L2 files that are in this folder are from running the l2gen tool for each individual file, not for the multilevel_processor tool.
-
- Subject Matter Expert
- Posts: 713
- Joined: Tue Feb 09, 2021 5:42 pm America/New_York
- Been thanked: 9 times
Re: Multilevel Processing Issues with Seadas
Can you do "SeaDAS-OCSSW -> SeaDAS/System Info" on SeaDAS GUI?
Re: Multilevel Processing Issues with Seadas
Yes, and this may be the issue since that I see a few warnings? Here they are below:
Main Application Platform:
Application Version: SeaDAS 8.0.0 (Beta)
Installation Directory: /Users/catherine/Desktop/Seadas
Data Directory: /Users/catherine/.seadas8
Configuration: /Users/catherine/Desktop/Seadas/etc/snap.properties
WARNING!! File '/Users/catherine/Desktop/Seadas/etc/snap.properties' does not exist
Configuration2: /Users/catherine/.seadas8/etc/snap.properties
VM Configuration: /Users/catherine/Desktop/Seadas/bin/pconvert.vmoptions
WARNING!! File '/Users/catherine/Desktop/Seadas/bin/pconvert.vmoptions' does not exist
VM Configuration (gpt): /Users/catherine/Desktop/Seadas/bin/gpt.vmoptions
WARNING!! File '/Users/catherine/Desktop/Seadas/bin/gpt.vmoptions' does not exist
Desktop Specification Version: 8.0.1
Engine Specification Version: 8.0.1
JRE: Java(TM) SE Runtime Environment 1.8.0_201-b09
JVM: Java HotSpot(TM) 64-Bit Server VM by Oracle Corporation
Memory: 3641 MiB
OCSSWROOT (Java Env): null
Python3 Directory:
/Library/Frameworks/Python.framework/Versions/3.9/bin/python3
SeaDAS Toolbox:
SeaDAS Toolbox Specification Version: 1.0.0
Configuration: /Users/catherine/.seadas8/etc/seadas.properties
OCSSW Root Directory: /Users/catherine/Desktop/Seadas/ocssw
OCSSW Log Directory: /
OCSSW Location: local
Environment {$OCSSWROOT} (external): null
WARNING!: An environment variable for OCSSWROOT exists which does not match the GUI configuration. The GUI will use '/Users/catherine/Desktop/Seadas/ocssw' as the ocssw root inside the GUI.
-----------------------------------------------
NASA Science Processing (OCSSW):
Environment {$OCSSWROOT}: /Users/catherine/Desktop/Seadas/ocssw
Environment {$OCDATAROOT}: /Users/catherine/Desktop/Seadas/ocssw/share
l2gen version: msl12 9.5.1-V2020.1 (Oct 6 2020 10:49:30)
l2bin version: 6.2.0
l3bin version: 5.13
l3mapgen version: l3mapgen 2.3.0-V2020.1 (Oct 6 2020 10:48:39)
Installed Missions: ['goci']
General System and Software:
Operating system: MacOS 10.14.6
Python version: 2.7.16
Java version: 16.0.1
Is there a specific installation I have to do to get these properties into the SeaDAS application, or should I just redownload it completely?
Main Application Platform:
Application Version: SeaDAS 8.0.0 (Beta)
Installation Directory: /Users/catherine/Desktop/Seadas
Data Directory: /Users/catherine/.seadas8
Configuration: /Users/catherine/Desktop/Seadas/etc/snap.properties
WARNING!! File '/Users/catherine/Desktop/Seadas/etc/snap.properties' does not exist
Configuration2: /Users/catherine/.seadas8/etc/snap.properties
VM Configuration: /Users/catherine/Desktop/Seadas/bin/pconvert.vmoptions
WARNING!! File '/Users/catherine/Desktop/Seadas/bin/pconvert.vmoptions' does not exist
VM Configuration (gpt): /Users/catherine/Desktop/Seadas/bin/gpt.vmoptions
WARNING!! File '/Users/catherine/Desktop/Seadas/bin/gpt.vmoptions' does not exist
Desktop Specification Version: 8.0.1
Engine Specification Version: 8.0.1
JRE: Java(TM) SE Runtime Environment 1.8.0_201-b09
JVM: Java HotSpot(TM) 64-Bit Server VM by Oracle Corporation
Memory: 3641 MiB
OCSSWROOT (Java Env): null
Python3 Directory:
/Library/Frameworks/Python.framework/Versions/3.9/bin/python3
SeaDAS Toolbox:
SeaDAS Toolbox Specification Version: 1.0.0
Configuration: /Users/catherine/.seadas8/etc/seadas.properties
OCSSW Root Directory: /Users/catherine/Desktop/Seadas/ocssw
OCSSW Log Directory: /
OCSSW Location: local
Environment {$OCSSWROOT} (external): null
WARNING!: An environment variable for OCSSWROOT exists which does not match the GUI configuration. The GUI will use '/Users/catherine/Desktop/Seadas/ocssw' as the ocssw root inside the GUI.
-----------------------------------------------
NASA Science Processing (OCSSW):
Environment {$OCSSWROOT}: /Users/catherine/Desktop/Seadas/ocssw
Environment {$OCDATAROOT}: /Users/catherine/Desktop/Seadas/ocssw/share
l2gen version: msl12 9.5.1-V2020.1 (Oct 6 2020 10:49:30)
l2bin version: 6.2.0
l3bin version: 5.13
l3mapgen version: l3mapgen 2.3.0-V2020.1 (Oct 6 2020 10:48:39)
Installed Missions: ['goci']
General System and Software:
Operating system: MacOS 10.14.6
Python version: 2.7.16
Java version: 16.0.1
Is there a specific installation I have to do to get these properties into the SeaDAS application, or should I just redownload it completely?