How can the long-term archival of data be achieved without maintaining multiple versions of multiple I/O libraries?
This one-year research project, funded by NOAA Climate Program Office(CPO) Scientific Data Stewardship(SDS), provides a solution to migrate data to a single standards-based archive format. Specifically, we will investigate on how to store NASA ECS data and metadata into HDF5 Archival Information Packages (AIP). To achieve this, the HDF4 to HDF5 conversion tool has been enhanced so that converted ECS data can be read through the NetCDF4 interface. In addition, metadata tools will be developed that convert ECS collection and granule level metadata to NOAA's collection level and NARA's METS standard.
May 2008 saw the 2.0 release of the HDF4 to HDF5 conversion tool. This release includes new functionality as the converted ECS data can be read through the NetCDF4 interface. Information for the release can be found at http://www.hdfgroup.org/h4toh5/.
We have tested 33 typical HDF-EOS2 products at the National Snow and Ice Data Center (NSIDC) that include EOS swath, grid and point files. Figure 1A shows monthly rainfall in July 2007 over land based on a AMSR EOS2 file. Figure 1B shows the same field converted to an HDF5 file with the enhanced HDF4 to HDF5 conversion tool. The fact that Figure 1A and Figure 1B are the same reflects that the enhanced conversion tool works correctly.
For more information about NOAA SDS project please check http://www.hdfgroup.uiuc.edu/noaasds/home.html
- - Last modified:June 27th 2008