+
+
+
+
+
+
+
+
+
+
1. Tutorial Overview
+
This notebook demonstrates how to download NOAA@NSIDC data using R, it includes examples for downloading a single file and all the files in a directory.
+
+
Credits
+
This notebook was developed by Jennifer Roebuck of NSIDC.
+
For questions regarding the notebook or to report problems, please create a new issue in the NSIDC-Data-Tutorials repo
+
+
+
Learning Objectives
+
By the end of this demonstration you will be able to:
+
+- Download a single file from a NOAA@NSIDC data set
+- Download all the files in a directory on the NOAA@NSIDC HTTPS server
+
+
+
+
Prerequisites
+
+- The library
rvest
installed
+
+
+
+
Time requirement
+
Allow approximately 5 to 10 minutes to complete this tutorial.
+
+
+
+
2. Tutorial steps
+
+
Import necessary libraries
+
We need to import the following libraries.
+
+
+
+
library(base)
+library(rvest)
+
+
+
+
+
+
Set working directory
+
We need to set the directory we wish to download our files to. Edit the variable below to include the path to the directory where you wish to store the downloaded data.
+
+
+
+
setwd("/Users/jero7025/Documents/NOAA/HTTPS_switch")
+
+
+
+
+
+
Downloading a single file
+
This demonstrates how to download a single file, we will use the Sea Ice Index (G02135) data set as an example.
+
+
+
+
# set the url for the file you want to download
+url <- "https://noaadata.apps.nsidc.org/NOAA/G02135/south/daily/geotiff/2023/05_May/S_20230501_concentration_v3.0.tif"
+
+# set the name of the file you are downloading
+destination <- "S_20230501_concentration_v3.0.tif"
+
+# download the file
+download.file(url, destination, mode = "wb")
+
+
+
+
+
+
Downloading all the files in a directory
+
This demonstrates downloading all of the files in a single directory, again we will use the Sea Ice Index (G02135) data set as an example.
+
+
+
+
# set the URL for the directory you want to download files from
+url <- "https://noaadata.apps.nsidc.org/NOAA/G02135/south/daily/geotiff/2023/05_May"
+
+# read html content from url
+page <- read_html(url)
+
+# Get a list of the files listed in the directory at this url
+files <- page %>% html_nodes("a") %>% html_attr("href")
+
+for(i in 2:length(files)){
+ # generate the url for each of the files
+ u <- paste(url,files[i], sep="/")
+ # download each of the files
+ download.file(u,files[i], mode = "wb")
+}
+
+
+
+
+
+
+
+
3. Learning outcomes recap
+
We have learned how to: 1. Download a single file from a NOAA@NSIDC data set 2. Download all the files in a directory related to a NOAA@NSIDC data set.
+
+
+
+
CgotLS0KdGl0bGU6ICJIb3cgdG8gZG93bmxvYWQgTk9BQUBOU0lEQyBkYXRhIHVzaW5nIFIiCm91dHB1dDogaHRtbF9ub3RlYm9vawotLS0KCiMjIDEuIFR1dG9yaWFsIE92ZXJ2aWV3IApUaGlzIG5vdGVib29rIGRlbW9uc3RyYXRlcyBob3cgdG8gZG93bmxvYWQgTk9BQUBOU0lEQyBkYXRhIHVzaW5nIFIsIGl0IGluY2x1ZGVzIGV4YW1wbGVzIGZvciBkb3dubG9hZGluZyBhIHNpbmdsZSBmaWxlIGFuZCBhbGwgdGhlIGZpbGVzIGluIGEgZGlyZWN0b3J5LgoKIyMjIENyZWRpdHMKVGhpcyBub3RlYm9vayB3YXMgZGV2ZWxvcGVkIGJ5IEplbm5pZmVyIFJvZWJ1Y2sgb2YgTlNJREMuCgpGb3IgcXVlc3Rpb25zIHJlZ2FyZGluZyB0aGUgbm90ZWJvb2sgb3IgdG8gcmVwb3J0IHByb2JsZW1zLCBwbGVhc2UgY3JlYXRlIGEgbmV3IGlzc3VlIGluIHRoZSBbTlNJREMtRGF0YS1UdXRvcmlhbHMgcmVwb10oaHR0cHM6Ly9naXRodWIuY29tL25zaWRjL05TSURDLURhdGEtVHV0b3JpYWxzL2lzc3VlcykKCiMjIyBMZWFybmluZyBPYmplY3RpdmVzCgpCeSB0aGUgZW5kIG9mIHRoaXMgZGVtb25zdHJhdGlvbiB5b3Ugd2lsbCBiZSBhYmxlIHRvOgoKMS4gRG93bmxvYWQgYSBzaW5nbGUgZmlsZSBmcm9tIGEgTk9BQUBOU0lEQyBkYXRhIHNldAoyLiBEb3dubG9hZCBhbGwgdGhlIGZpbGVzIGluIGEgZGlyZWN0b3J5IG9uIHRoZSBOT0FBQE5TSURDIEhUVFBTIHNlcnZlciAKCiMjIyBQcmVyZXF1aXNpdGVzIAoKMS4gVGhlIGxpYnJhcnkgYHJ2ZXN0YCBpbnN0YWxsZWQgCgojIyMgVGltZSByZXF1aXJlbWVudCAKCkFsbG93IGFwcHJveGltYXRlbHkgNSB0byAxMCBtaW51dGVzIHRvIGNvbXBsZXRlIHRoaXMgdHV0b3JpYWwuCgojIyAyLiBUdXRvcmlhbCBzdGVwcyAKCiMjIyBJbXBvcnQgbmVjZXNzYXJ5IGxpYnJhcmllcwpXZSBuZWVkIHRvIGltcG9ydCB0aGUgZm9sbG93aW5nIGxpYnJhcmllcy4KYGBge3J9CmxpYnJhcnkoYmFzZSkKbGlicmFyeShydmVzdCkKYGBgCgojIyMgU2V0IHdvcmtpbmcgZGlyZWN0b3J5CldlIG5lZWQgdG8gc2V0IHRoZSBkaXJlY3Rvcnkgd2Ugd2lzaCB0byBkb3dubG9hZCBvdXIgZmlsZXMgdG8uIEVkaXQgdGhlIHZhcmlhYmxlIGJlbG93IHRvIGluY2x1ZGUgdGhlIHBhdGggdG8gdGhlIGRpcmVjdG9yeSB3aGVyZSB5b3Ugd2lzaCB0byBzdG9yZSB0aGUgZG93bmxvYWRlZCBkYXRhLgpgYGB7cn0Kc2V0d2QoIi9Vc2Vycy9qZXJvNzAyNS9Eb2N1bWVudHMvTk9BQS9IVFRQU19zd2l0Y2giKQpgYGAKCgojIyMgRG93bmxvYWRpbmcgYSBzaW5nbGUgZmlsZSAKVGhpcyBkZW1vbnN0cmF0ZXMgaG93IHRvIGRvd25sb2FkIGEgc2luZ2xlIGZpbGUsIHdlIHdpbGwgdXNlIHRoZSBTZWEgSWNlIEluZGV4IChHMDIxMzUpIGRhdGEgc2V0IGFzIGFuIGV4YW1wbGUuCmBgYHtyfQojIHNldCB0aGUgdXJsIGZvciB0aGUgZmlsZSB5b3Ugd2FudCB0byBkb3dubG9hZAp1cmwgPC0gImh0dHBzOi8vbm9hYWRhdGEuYXBwcy5uc2lkYy5vcmcvTk9BQS9HMDIxMzUvc291dGgvZGFpbHkvZ2VvdGlmZi8yMDIzLzA1X01heS9TXzIwMjMwNTAxX2NvbmNlbnRyYXRpb25fdjMuMC50aWYiCgojIHNldCB0aGUgbmFtZSBvZiB0aGUgZmlsZSB5b3UgYXJlIGRvd25sb2FkaW5nCmRlc3RpbmF0aW9uIDwtICJTXzIwMjMwNTAxX2NvbmNlbnRyYXRpb25fdjMuMC50aWYiCgojIGRvd25sb2FkIHRoZSBmaWxlIApkb3dubG9hZC5maWxlKHVybCwgZGVzdGluYXRpb24sIG1vZGUgPSAid2IiKQpgYGAKCiMjIyBEb3dubG9hZGluZyBhbGwgdGhlIGZpbGVzIGluIGEgZGlyZWN0b3J5ClRoaXMgZGVtb25zdHJhdGVzIGRvd25sb2FkaW5nIGFsbCBvZiB0aGUgZmlsZXMgaW4gYSBzaW5nbGUgZGlyZWN0b3J5LCBhZ2FpbiB3ZSB3aWxsIHVzZSB0aGUgU2VhIEljZSBJbmRleCAoRzAyMTM1KSBkYXRhIHNldCBhcyBhbiBleGFtcGxlLiAKYGBge3J9CiMgc2V0IHRoZSBVUkwgZm9yIHRoZSBkaXJlY3RvcnkgeW91IHdhbnQgdG8gZG93bmxvYWQgZmlsZXMgZnJvbQp1cmwgPC0gImh0dHBzOi8vbm9hYWRhdGEuYXBwcy5uc2lkYy5vcmcvTk9BQS9HMDIxMzUvc291dGgvZGFpbHkvZ2VvdGlmZi8yMDIzLzA1X01heSIgCgojIHJlYWQgaHRtbCBjb250ZW50IGZyb20gdXJsCnBhZ2UgPC0gcmVhZF9odG1sKHVybCkKCiMgR2V0IGEgbGlzdCBvZiB0aGUgZmlsZXMgbGlzdGVkIGluIHRoZSBkaXJlY3RvcnkgYXQgdGhpcyB1cmwKZmlsZXMgPC0gcGFnZSAlPiUgaHRtbF9ub2RlcygiYSIpICU+JSBodG1sX2F0dHIoImhyZWYiKQoKZm9yKGkgaW4gMjpsZW5ndGgoZmlsZXMpKXsKICAjIGdlbmVyYXRlIHRoZSB1cmwgZm9yIGVhY2ggb2YgdGhlIGZpbGVzIAogIHUgPC0gcGFzdGUodXJsLGZpbGVzW2ldLCBzZXA9Ii8iKQogICMgZG93bmxvYWQgZWFjaCBvZiB0aGUgZmlsZXMKICBkb3dubG9hZC5maWxlKHUsZmlsZXNbaV0sIG1vZGUgPSAid2IiKQp9CgoKYGBgCgojIyAzLiBMZWFybmluZyBvdXRjb21lcyByZWNhcAoKV2UgaGF2ZSBsZWFybmVkIGhvdyB0bzoKMS4gRG93bmxvYWQgYSBzaW5nbGUgZmlsZSBmcm9tIGEgTk9BQUBOU0lEQyBkYXRhIHNldAoyLiBEb3dubG9hZCBhbGwgdGhlIGZpbGVzIGluIGEgZGlyZWN0b3J5IHJlbGF0ZWQgdG8gYSBOT0FBQE5TSURDIGRhdGEgc2V0LiAKCgo=
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
diff --git a/notebooks/NOAA_Access/img/nsidc_logo.png b/notebooks/NOAA_Access/img/nsidc_logo.png
new file mode 100644
index 0000000..35a06e0
Binary files /dev/null and b/notebooks/NOAA_Access/img/nsidc_logo.png differ