ASF Bulk Download Service

About this service:

This service provides an easy way to give users a bulk download script that aids in downloading multiple products. The service will either embed a specified list of fully-qualified product URLs directly in the script, or provide a blank "dummy" script for use in downloading products using metalink or CSV files.

Because using this service requires nothing more than crafting a link or posting form data, it is easy to use and flexible. Links to the service can be used anywhere a typical link can be used: use it on your website, your data archive search app, post it on facebook and reddit, tweet it, run it through a URL-shortener and text it to your friend, put it in a QR-code and stick it to a lamp post.

About the bulk download script:

For a full description and guide on using the bulk download script itself, please see https://asf.alaska.edu/how-to/data-tools/data-tools/#bulk_download

The bulk download script provided by this service uses Earthdata Login for authentication and is compatible with any provider that authenticates against the same, or does not require authentication. The script stores its Earthdata session information in ~/.bulk_download_cookiejar.txt. If that file does not exist, or the session is not valid, the user will be asked for credentials and a session will be established and stored for future re-use.

The bulk download script provided by this service is compatible with python >= 2.6.5, 2.7.5, 3.0.

Available options:

products=

A comma-separated list of fully-qualified URLs of products to be embedded in the script. Each URL should reference a specific file. This parameter can be specified multiple times, each containing one or more product URLs to be included in the generated script.

Example 1: (comma-separated list) https://bulk-download.asf.alaska.edu/?products=http%3A%2F%2Fhost.com%2Fproduct1.zip%2Chttp%3A%2F%2Fhost.com%2Fproduct2.zip
Example 2: (multiple products=) https://bulk-download.asf.alaska.edu/?products=http%3A%2F%2Fhost.com%2Fproduct1.zip&products=http%3A%2F%2Fhost.com%2Fproduct2.zip
Example 3: (combination of both) https://bulk-download.asf.alaska.edu/?products=http%3A%2F%2Fhost.com%2Fproduct1.zip%2Chttp%3A%2F%2Fhost.com%2Fproduct2.zip&products=http%3A%2F%2Fhost.com%2Fproduct3.zip%2Chttp%3A%2F%2Fhost.com%2Fproduct4.zip


filename=

A specific filename to be used when generating the script. By default, the filename will incorporate a timestamp and be of the form "download-all-YYYY-MM-DD_HH24-MI-SS.py" but this parameter will override that. The filename (whether specified or the default) will be used as the name of the file downloaded by the user, and is also embedded in the brief help block at the start of the script.

Example: https://bulk-download.asf.alaska.edu/?filename=Notable_Event_Products.py


/view

Using this path prior to the query string will override the default Content-Disposition and wrap the script in html for display in the browser. Any specified parameters still apply, although filename= will only affect the descriptive block at the start of the script.

Example: https://bulk-download.asf.alaska.edu/view


/help

View this document.

Example: https://bulk-download.asf.alaska.edu/help

Example usage of this service:

Empty Script:
1 product:
10 products:
Named script:
Provider smorgasbord: