{"id":8980,"date":"2016-07-07T05:04:30","date_gmt":"2016-07-07T10:04:30","guid":{"rendered":"http:\/\/www.ssec.wisc.edu\/news\/?p=8980"},"modified":"2019-03-05T16:55:39","modified_gmt":"2019-03-05T16:55:39","slug":"data-rescue-project-blends-analog-digital-technologies","status":"publish","type":"post","link":"https:\/\/www.ssec.wisc.edu\/news\/articles\/8980","title":{"rendered":"Data ‘rescue’ project blends analog, digital technologies"},"content":{"rendered":"
\"IMG_5917\"<\/a>

One of 95 boxes of nine-track tape reels the SSEC Data Center is digitizing and value-adding for NASA’s Goddard Space Flight Center. Credit: Sarah Witman.<\/p><\/div>\n

The Space Science and Engineering Center (SSEC) Data Center receives and archives massive amounts of satellite data each day, distributed to thousands of users around the world. A new project, however, calls for a slightly different set of skills \u2014 hearkening back to a time when SSEC operated in analog.<\/p>\n

By special request from NASA\u2019s Goddard Space Flight Center last fall, SSEC Data Center staff Dan Forrest, Nancy Troxel-Hoehn,\u00a0Douglas Ratcliff, and Jerry Robaidek, and University of Wisconsin-Madison computer sciences student Chad Hammacher, have spent the past eight months attempting to read, digitize, and decode data from more than\u00a01,400 nine-track tape reels from the 1970s and ’80s.<\/p>\n

Currently occupying 95 cardboard boxes (emblazoned with the NASA logo) the reels contain data transmitted by two early NASA satellites: Synchronous Meteorological Satellites (SMS) 1 and 2, launched in 1974 and 1975, respectively. But the team won\u2019t know exactly what is on the tapes until they have been read (they are a little over halfway there), and then decoded by Forrest.<\/p>\n

Not only is SSEC one of the few organizations with the requisite equipment and expertise, but these data, if usable, will fill a gap in the Data Center’s historical archive \u2014 making it the perfect place to conduct this \u201cdata rescue\u201d effort, says Robaidek.<\/p>\n

Nine-track tape was the most common form of data storage at that time, relying on a series of eight-bit characters recorded on half-inch wide magnetic tape. While the Data Center is equipped to handle \u201cbig data,\u201d Robaidek says, these tapes will likely contain less than a terabyte altogether.<\/p>\n

\u201cThe amount of data on each tape has varied, but we’ve found that most hold about 25 megabytes, and many were not filled to capacity,\u201d says Ratcliff. \u201cIt\u2019s not a lot of data by today\u2019s standards, but it is important data.\u201d<\/p>\n

\"Picture2\"<\/a>

A scan of a nine-track tape reel from the SSEC data rescue project. Credit: SSEC Data Center.<\/p><\/div>\n

Extracting those data, so far, has been a labor-intensive process, he says. Each reel must be scanned on a flatbed scanner to record information (or metadata) about its contents, then read on a nine-track tape drive, then entered into an online workspace<\/a>. If all goes well, this can take 20-30 minutes per reel.<\/p>\n

The process is somewhat delicate, Robaidek explains, since the iron oxide coating on nine-track tape gradually erodes during each reading.<\/p>\n

Furthermore, \u201cthe binders that adhere the iron oxide to the plastic are known to degrade over time,\u201d says Schwerdtfeger Library director Jean Phillips, adding that the lifespan of these media often depends on their storage conditions. If the reels had previously been stored lying flat or in a non-climate-controlled environment, that could accelerate degradation.<\/p>\n

Some of the tapes, therefore, might only survive one or two readings before becoming completely obscured. If a reel is deemed unreadable by the first of two nine-track tape drives at SSEC, procured specially for the project, Forrest assumes the responsibility of what he calls \u201cbeating on bits,\u201d says Ratcliff, to try to coax out some usable information with the second tape drive.<\/p>\n

Once the team has sent the digitized data and metadata back to NASA, Forrest will lead an effort to decode the files using software he developed \u2013 making the imagery viewable to the human eye \u2013 and make them publicly available.<\/p>\n

Forrest already used the software to decode a sample tape from NASA last year. That sample, Robaidek says, contained SMS-2 satellite imagery from 6 May 1975 \u2014 an infamous date in meteorological history, as a major tornado outbreak swept across Omaha, Nebraska, killing three people and injuring more than 100.<\/p>\n

\"oldsms1_vis\"<\/a>

Five-minute imagery created from 6 May 1975 Synchronous Meteorological Satellites (SMS) data by SSEC Data Center staff as a “sample” for the data rescue project. Credit: SSEC Data Center.<\/p><\/div>\n

That this sample tape was so poignant makes Robaidek even more curious to find out what remains on the full collection.<\/p>\n

\u201cThese data don\u2019t exist digitally anywhere in the world. Some have probably not been seen since they were originally scanned in the 1970s,\u201d he says. \u201cWe have been speculating whether data and imagery from the night of the Edmund Fitzgerald<\/a> wreck could be in this.\u201d<\/p>\n

The storm that sunk the S.S. Edmund Fitzgerald, a Great Lakes freighter, causing the tragic loss of its entire crew, is one that is well documented colloquially (perhaps most notably by Canadian songwriter Gordon Lightfoot\u2019s 1976 hit) but still perplexes meteorologists. For example, Cooperative Institute for Meteorological Satellite Studies (CIMSS) director Steve Ackerman has explored the event in great detail<\/a>. However, very little satellite data exists from that evening, so the prospect that these reels could help shed some light on the circumstances leading up to the wreck is heartening.<\/p>\n

It just so happens that a weather-satellite data rescue is closely, fundamentally tied to SSEC\u2019s history. In the early years of satellite meteorology, the National Oceanic and Atmospheric Administration (NOAA) regularly overwrote data as a way to reuse and conserve computer reel tapes. As such, a national archive of satellite-transmitted data did not exist until 1979, when SSEC co-founder Verner Suomi suggested that such a record could prove advantageous to future generations of scientists.<\/p>\n

The archive was a videocassette-based digital system. SSEC happened to be the most suitable location for such an archive, since it was Suomi\u2019s son, Eric, an engineer working at SSEC, who had developed<\/a> a unique method for recording and storing GOES satellite data on U-matic tape cartridges in 1977-78.<\/p>\n

Eric Suomi \u201cdesigned and perfected the modification of video recording machines to record digital data,\u201d recalls SSEC building manager Dave Jones. \u201cIt was a method of recording that was well before its time.\u201d<\/p>\n

Video recorders were ideal for this application<\/a>, in part, because they had high bandwidths and long recording times. And the format of successive satellite scans to build a picture of the Earth matched well with the successive scans written onto the videocassettes, says Jones.<\/p>\n

\u201cAt that time, long before I started working at SSEC, we hired students to change the tapes manually in the middle of the night, to keep a continuous record,\u201d Robaidek recalls.<\/p>\n

Ratcliff notes that the archival process would have been laborious, much more so than presently. To transfer data would have taken as much time, or more, than the documented event.<\/p>\n

\u201cThree months of real-time data would have taken three months to pull from a tape,\u201d he says, \u201cand if the request was for a certain section they would have had to manually stop and start.\u201d<\/p>\n

SSEC remained the National Archive of Satellite Data until 2004, when the National Climatic Data Center (NCDC) took it over \u2013 however, the Data Center is often able to provide a backup for the archive during East Coast outages. To this day, the Data Center maintains a digital archive of all the GOES data ever transmitted, plus data from several other geostationary satellites worldwide, making it the largest archive \u2013 and growing \u2013 of geostationary weather-satellite data in the world.<\/p>\n

by Sarah Witman<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

Per a request from NASA’s Goddard Space Flight Center, the SSEC Data Center team has taken on a data rescue project that entails reading, digitizing, and decoding data stored on more than 1,400 nine-track tape reels from the 1970-80s.<\/p>\n","protected":false},"author":10,"featured_media":8982,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[3],"tags":[14],"class_list":["post-8980","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news-articles","tag-cimss"],"acf":{"short_title":"Data rescue","ssec_home_page_carousel_image":false,"sub_title":"Ongoing project blends analog, digital technologies"},"_links":{"self":[{"href":"https:\/\/www.ssec.wisc.edu\/news\/wp-json\/wp\/v2\/posts\/8980","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ssec.wisc.edu\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ssec.wisc.edu\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ssec.wisc.edu\/news\/wp-json\/wp\/v2\/users\/10"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ssec.wisc.edu\/news\/wp-json\/wp\/v2\/comments?post=8980"}],"version-history":[{"count":13,"href":"https:\/\/www.ssec.wisc.edu\/news\/wp-json\/wp\/v2\/posts\/8980\/revisions"}],"predecessor-version":[{"id":11747,"href":"https:\/\/www.ssec.wisc.edu\/news\/wp-json\/wp\/v2\/posts\/8980\/revisions\/11747"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.ssec.wisc.edu\/news\/wp-json\/wp\/v2\/media\/8982"}],"wp:attachment":[{"href":"https:\/\/www.ssec.wisc.edu\/news\/wp-json\/wp\/v2\/media?parent=8980"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ssec.wisc.edu\/news\/wp-json\/wp\/v2\/categories?post=8980"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ssec.wisc.edu\/news\/wp-json\/wp\/v2\/tags?post=8980"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}