Example SST usage

Download recursively

Download www.example.com, and recurse through links to download those files as well. Download only those files that are newer than the ones already on the failover site, and do not create a host directory www.example.com/.

Example: sst -r -N -nH http://www.example.com

  • Domain: www.example.com
  • Option: -r --recursive: Links within the targeted page will be followed and their associated content/pages will also be downloaded
  • Option: -N --timestamping: Only include files if they are newer than any files that were previously downloaded.
  • Option: -nH --no-host-directories: Do not include a hostname directory in the hierarchy.

Download based on content

Load the cookies file and download based on its contents; include page requisites, and add the noted Referrer header.

Example: sst -p --load-cookies=cookies.txt --header=“Referrer: http://www.example.com/index.jsp” http://www.example.com

  • Domain: www.example.com
  • Option: -p --page-requisites: Download any other associated files that may be required to properly display the page.
  • Option: --load-cookies: Load the cookies contained in a specific file.
  • Option: --header: Specify a desired <STRING> to be included with HTTP requests’ headers.

Download newer files from a list

Download the files listed in clipart.txt and the page requisites needed to display the pages, but download files only if they are newer than the ones on the failover site.

Example: sst -p -N --input-file=clipart.txt

  • Option: -p --page-requisites: Download any other associated files that may be required to properly display the page.
  • Option: -N --timestamping: Only include files if they are newer than any files that were previously downloaded.
  • Option: --input-file: Get the list of URLs to download from a named file.