How do I download public datasets on the SPARC Portal?

Accessing public datasets on the SPARC portal

Users can get access to public datasets directly through the SPARC Portal. Datasets smaller than 5GB can be downloaded directly through the browser and all datasets can be accessed on Amazon’s S3 service using your own AWS account. In order to access the public datasets, go to the Browse Data tab and select one of the datasets. Then, click on the Get Dataset button for information on where to get the specific dataset.

workflow

Download Datasets under 5GB

Datasets smaller than 5GB can be downloaded directly through the browser by clicking on the Download Dataset button. Clicking on the button will start the download process through the web-browser.

Access Datasets larger than 5GB

Dataset larger than 5GB are made available directly on Amazon’s S3 service. This allows you to access the data in the cloud, or download the data. Detailed information on how to setup your AWS account how to download/transfer data can be found using the following links:

  1. Setting up your AWS Account
  2. Installing and configuring the AWS CLI
  3. Transferring public data to a private Amazon S3 Bucket
  4. Downloading a public SPARC Dataset