Skip to content

dataset-template.md

Latest commit

 

History

History
69 lines (45 loc) · 2.7 KB

dataset-template.md

File metadata and controls

69 lines (45 loc) · 2.7 KB

1 Access Instructions

Data is stored on Amazon Web Services (AWS). Access is given through the AWS Command Line Interface (CLI). Instructions on how to install and use are given in the AWS CLI documentation.

Listing files is done by e.g.:

aws s3 ls --no-sign-request s3://nasa-radiant-data/helioai-datasets/<DATASET_NAME>/

Downloading files is done by e.g.

aws s3 cp --no-sign-request s3://nasa-radiant-data/helioai-datasets/<AWS PATH> <LOCAL PATH> --recursive

You will need to replace <AWS PATH> with the path to the data sample you want to download (see table) and <LOCAL PATH> with the path on your local machine where you want to save the data.

Data Product AWS Path Size Download time (@100 Mbps)
Processed <DATASET_NAME>/processed_data/
Raw <DATASET_NAME>/raw_data/
Results <DATASET_NAME>/results/
Miscellaneous <DATASET_NAME>/miscellaneous/

2 Dataset Description

There are three levels of description available for this dataset:

  • A high-level summary (this document) for users to quickly become familiar with the dataset.
  • A detailed description (see the Technical Memorandum).
  • The full source code used to process the data and create the models (see the GitHub Repository).

2.1 Processed Data

2.2 Raw Data

3. System Requirements

There are two sets of system requirements:

  1. Requirements to create the data products. These can be found in the GitHub Repository.
  2. Requirements for using the data products
Component Minimum
CPU
RAM
GPU
Storage