Challenge 3 Event 3 Result Summary.xlsx
URL: https://data.openei.org/files/5997/E3LB_master_20240605.xlsx
Event 3 Results Summary Spreadsheet with tabs data, edata, sdata,switching, obj vs time, Top 5 scores, Top 5 speeds, summary, source mapping, and Exit Codes. The "data" tab is based on Arun's event_results_all_E3.1_2024_05_29_10_41_36_837817275.csv collected from all Event 3 runs and contains 1989 rows (14 teams x (109 scenarios plus 30 with switching not allowed and 3 extra time runs; total 142) plus the tabulation row. The Data tab is sorted by team, model, scenario, and allow switching. Tab edata is the same data sorted by model, scenario, SW, score, and team. Tab sdata is sorted by speed instead of score. Speed is defined as score/runtime in seconds. Tab switching analyses the impact of switching. Tab obj vs time plots score vs runtime. Tab Top 5 scores shows the 5 best results for each of the 139 scenarios. Tab Top 5 speeds does the same for speed. Tab summary has rows for each scenario and columns rows for each scenario and columns for objective, feasibility, score, and scaled score (fraction of best score) for each team. Below that are summaries used in the Event 3 Leaderboard. Tab source mapping gives the ___location on Globus of each of the 109 scenarios and which team generated the data (GaTech, NREL, TAMU, or UW-Madison). The Exit Codes tab provides descriptions of the exit codes listed in the data tab as well as a description of the Deception computer. Column V in the data tab gives the URL of a tar.gz file on rcdtn1.pnl.gov that contains the results from each run on PNNL's Deception machine. The tar file typically contains the feasiblity.log from running the Evaluation code, a jobs.log, messages.log, the solver log, the solution.json, and a evaluation summary in csv and json formats. This csv feeds into the master csv Arun generates along with the runtime information (times, exit codes, reruns, etc.). Industry datasets do not include the solver log or the solution file.
Source: ARPA-E Grid Optimization (GO) Competition Challenge 3
About this Resource
| Last updated | unknown |
|---|---|
| Created | unknown |
| Name | Challenge 3 Event 3 Result Summary.xlsx |
| Format | MS Excel File |
| License | Creative Commons Attribution |
| Created | 1 year ago |
| Media type | application/vnd.openxmlformats-officedocument.spreadsheetml.sheet |
| has views | False |
| id | c8561776-00c3-4f80-a40c-1741333d45a6 |
| metadata modified | 1 year ago |
| package id | 58f9e8d2-2286-4c1d-9da3-d33a9a404f6f |
| position | 26 |
| state | active |
| tracking summary | {'total': 0, 'recent': 0} |