{"id":6813,"date":"2014-11-12T11:26:55","date_gmt":"2014-11-12T17:26:55","guid":{"rendered":"http:\/\/www.ssec.wisc.edu\/news\/?p=6813"},"modified":"2014-11-17T13:08:29","modified_gmt":"2014-11-17T19:08:29","slug":"milestone-delivery-cloud-properties-dataset-to-ncdc","status":"publish","type":"post","link":"https:\/\/www.ssec.wisc.edu\/news\/articles\/6813","title":{"rendered":"Milestone delivery: Cloud properties dataset to NCDC"},"content":{"rendered":"<p>Earlier this year a team of National Oceanic and Atmospheric Administration (NOAA) and Cooperative Institute for Meteorological Satellite (CIMSS) scientists reached a major milestone by delivering an operational PATMOS-x (Pathfinder Atmospheres Extended) cloud properties Climate Data Record (CDR) to the National Climatic Data Center (NCDC).<\/p>\n<p>The team followed a rigorous process to comply with NCDC\u2019s requirements for submitting a CDR. This new CDR consists of a consistent, long-term series of cloud property observations derived from Advanced Very High Resolution Radiometer (AVHRR) data from the Polar-orbiting Operational Environmental Satellites (POES) extending back to 1978. The cloud properties include cloud-top height, cloud-top temperature, cloud-top pressure, cloud optical depth, and cloud particle size.<\/p>\n<div id=\"attachment_6820\" class=\"wp-caption alignnone\"><a href=\"http:\/\/www.ssec.wisc.edu\/news\/wp-content\/uploads\/sites\/19\/2014\/11\/cod_global.png\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-6820\" class=\"size-large wp-image-6820\" src=\"http:\/\/www.ssec.wisc.edu\/news\/wp-content\/uploads\/sites\/19\/2014\/11\/cod_global-583x400.png\" alt=\"PATMOS-x cloud product\" width=\"583\" height=\"400\" srcset=\"https:\/\/www.ssec.wisc.edu\/news\/wp-content\/uploads\/sites\/19\/2014\/11\/cod_global-583x400.png 583w, https:\/\/www.ssec.wisc.edu\/news\/wp-content\/uploads\/sites\/19\/2014\/11\/cod_global-300x205.png 300w, https:\/\/www.ssec.wisc.edu\/news\/wp-content\/uploads\/sites\/19\/2014\/11\/cod_global-437x300.png 437w, https:\/\/www.ssec.wisc.edu\/news\/wp-content\/uploads\/sites\/19\/2014\/11\/cod_global.png 639w\" sizes=\"auto, (max-width: 583px) 100vw, 583px\" \/><\/a><p id=\"caption-attachment-6820\" class=\"wp-caption-text\">Example of a PATMOS-x 0.1\u00ba level-2b cloud product (optical depth) viewed globally over a single day.<\/p><\/div>\n<p>Led by NOAA scientist Andrew Heidinger of the Advanced Satellite Products Branch (ASPB), a team of CIMSS researchers and programmers contributed to the project. Andrew Heidinger and Andi Walther developed the scientific algorithms, Denis Botambekov handled validation and quality control, Mike Foster was tasked with turning the Level 2 data into Level 3 data, as well as managing the reporting and documentation, while Mike Hiley handled the processing.<\/p>\n<p>Producing a dataset for NCDC\u2019s CDR Program requires following a set of precise guidelines. First and foremost, the dataset needs to be long-term \u2014 30+ years \u2014 and stable.<\/p>\n<p>\u201cThe great thing about PATMOS-x is that it\u2019s a very long time series. For a climate record, we need this long-term data. And we could prove through publications that the time series is stable enough to be seen as a climate data record,\u201d Walther said.<\/p>\n<p>Publishing peer-reviewed articles to establish the dataset as stable and suitable for a CDR is just one component of the CDR process, which also included completing a maturity matrix and undergoing validation. The end goal is to ensure that the dataset could be used in climate applications. With its successful delivery of a CDR, this NOAA\/CIMSS team has achieved something quite unique.<\/p>\n<p>\u201cWe are one of a handful of multi-decadal satellite climate records in the world,\u201d noted Walther.<\/p>\n<p>Heidinger added that, prior to the PATMOS-x delivery, the International Satellite Cloud Climatology Project (ISCCP) dataset had been the main long-term cloud data record available.<\/p>\n<p>While preparing the CDR, the team relied on prior experience working with NCDC, specifically their 2010 delivery of calibrated AVHRR reflectances. This new dataset, however, is a significant extension of that prior delivery.<\/p>\n<p>\u201cThe big step for us this time was that we actually have our cloud products submitted, the things that we derive ourselves,\u201d commented Foster, adding that this new CDR allows for a near real-time generation capability.<\/p>\n<p>\u201cFor the first time, you can get up to within a four-to-five-day latency the entire PATMOS-x cloud record, which is nice for climate monitoring applications,\u201d he remarked.<\/p>\n<p>This work complements research for which CIMSS and the Space Science and Engineering Center (SSEC) are already well known.<\/p>\n<p>\u201cWe really are a center of satellite climate datasets,\u201d noted Heidinger, highlighting the cloud climatology from SSEC\u2019s Paul Menzel and Don Wylie and polar cloud work from ASPB\u2019s Jeff Key.<\/p>\n<p>As the team learned, creating the CDR at SSEC had certain benefits. Heidinger specifically called out the importance of computing resources available at SSEC that offered the ability to reprocess the data as needed. Walther echoed Heidinger\u2019s comment, also noting how the vast improvements in computing speed and memory over the last decade have made their work significantly easier.<\/p>\n<p>In fact, it was just over a decade ago when the initial work on this project began. Heidinger related how small, pilot projects through NOAA\u2019s Office of Research and Applications led to connections with the Global Energy and Water Cycle Experiment (GEWEX) research program. Participating in GEWEX brought opportunities to begin the process of comparing and validating their dataset. In 2006 Heidinger and his team formally proposed the creation of the CDR. In addition to those named above, many NOAA and CIMSS scientists, including Mike Pavolonis, Christine Molling and William Straka, contributed to the PATMOS-x project over the years.<\/p>\n<div id=\"attachment_6817\" class=\"wp-caption alignnone\"><a href=\"http:\/\/www.ssec.wisc.edu\/news\/wp-content\/uploads\/sites\/19\/2014\/11\/equatorial_local_crossing_time.png\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-6817\" class=\"size-large wp-image-6817\" src=\"http:\/\/www.ssec.wisc.edu\/news\/wp-content\/uploads\/sites\/19\/2014\/11\/equatorial_local_crossing_time-600x225.png\" alt=\"NOAA and MetOp equatorial crossing times\" width=\"584\" height=\"219\" srcset=\"https:\/\/www.ssec.wisc.edu\/news\/wp-content\/uploads\/sites\/19\/2014\/11\/equatorial_local_crossing_time-600x225.png 600w, https:\/\/www.ssec.wisc.edu\/news\/wp-content\/uploads\/sites\/19\/2014\/11\/equatorial_local_crossing_time-300x112.png 300w, https:\/\/www.ssec.wisc.edu\/news\/wp-content\/uploads\/sites\/19\/2014\/11\/equatorial_local_crossing_time-500x187.png 500w, https:\/\/www.ssec.wisc.edu\/news\/wp-content\/uploads\/sites\/19\/2014\/11\/equatorial_local_crossing_time.png 1133w\" sizes=\"auto, (max-width: 584px) 100vw, 584px\" \/><\/a><p id=\"caption-attachment-6817\" class=\"wp-caption-text\">Time range and equatorial crossing time of the NOAA and MetOp polar-orbiting satellites that comprise the PATMOS-x\/AVHRR record.<\/p><\/div>\n<p>With this CDR delivery behind them, the team is forging ahead on a number of related projects. With funding from NCDC, they are beginning year two of a three-year project to develop a merged AVHRR + HIRS (High resolution Infrared Radiation Sounder) record. Foster noted that \u201cwe have initial files with HIRS and AVHRR measurements collocated and we\u2019ve already gotten some really interesting results.\u201d<\/p>\n<p>\u201cWe certainly know HIRS + AVHRR is better than AVHRR alone,\u201d Heidinger added.<\/p>\n<p>Heidinger described this project, which combines the records of an imager and a sounder, as a way to get \u201ca common channel base going back to the early 1980s.\u201d This would improve the consistency of the dataset, which is once again essential to climate applications.<\/p>\n<p>Heidinger is hopeful that his team will be able to complete the requirements to deliver this new dataset as a CDR to NCDC in the future.<\/p>\n<p>Other extensions of the PATMOS-x record include Botambekov\u2019s efforts to incorporate VIIRS measurements \u2014 thereby broadening the number of polar sensors covered. There are also plans to make use of the SSEC Data Center GOES archive to develop a PATMOS-x GOES dataset; Heidinger noted they are preparing this geostationary dataset in a way that it could also become a CDR available through NCDC.<\/p>\n<p>In the meantime, NOAA\u2019s Center for Satellite Applications and Research (STAR) has funded a CIMSS climate data portal. This portal will allow the team to make its experimental datasets available \u2014 datasets not available through NCDC. Eventually, Heidinger would like to see the portal as a place where they could host all of their climate datasets.<\/p>\n<p>Heidinger made it clear that their work is far from over. There is still much to learn from \u201cthese old sensors,\u201d as he noted some might describe them, whether it is finding better ways to extract information or taking the datasets and applying them to climate research, an area in which they are playing a role as well.<\/p>\n<p>\u201cWe\u2019re not just data providers. We dabble as much as we can into climate analysis. We\u2019re part of the climate research community, too,\u201d Heidinger said.<\/p>\n<p>Heidinger touted the expertise of his team, describing how their experiences, particularly with work on GOES-R and JPSS, have prepared them for the challenges ahead.<\/p>\n<p>\u201cBecause of those programs, we\u2019ve processed [the data from] just about every [active or planned] polar or geostationary imager,\u201d he said. \u201cSo we\u2019re in a good position to extend our climatology records.\u201d<\/p>\n<p><em>by Leanne Avila<\/em><\/p>\n<p><em>For more information on the recent PATMOS-x cloud properties CDR, see this recent article by Heidinger et al.:<\/em><\/p>\n<p><em><span class=\"author\">Heidinger<\/span>, Andrew K., <span class=\"author\">Michael J. Foster<\/span>, <span class=\"author\">Andi Walther<\/span>, <span class=\"author\">Xuepeng (Tom) Zhao<\/span>, 2014:\u00a0The Pathfinder Atmospheres\u2013Extended AVHRR Climate Dataset, Bulletin of the American Meteorological Society, <strong>95<\/strong>, pp. 909-922.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Cloud properties dataset delivered to NCDC<\/p>\n","protected":false},"author":6,"featured_media":6816,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[3],"tags":[14],"class_list":["post-6813","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news-articles","tag-cimss"],"acf":false,"_links":{"self":[{"href":"https:\/\/www.ssec.wisc.edu\/news\/wp-json\/wp\/v2\/posts\/6813","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ssec.wisc.edu\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ssec.wisc.edu\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ssec.wisc.edu\/news\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ssec.wisc.edu\/news\/wp-json\/wp\/v2\/comments?post=6813"}],"version-history":[{"count":10,"href":"https:\/\/www.ssec.wisc.edu\/news\/wp-json\/wp\/v2\/posts\/6813\/revisions"}],"predecessor-version":[{"id":6827,"href":"https:\/\/www.ssec.wisc.edu\/news\/wp-json\/wp\/v2\/posts\/6813\/revisions\/6827"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.ssec.wisc.edu\/news\/wp-json\/wp\/v2\/media\/6816"}],"wp:attachment":[{"href":"https:\/\/www.ssec.wisc.edu\/news\/wp-json\/wp\/v2\/media?parent=6813"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ssec.wisc.edu\/news\/wp-json\/wp\/v2\/categories?post=6813"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ssec.wisc.edu\/news\/wp-json\/wp\/v2\/tags?post=6813"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}