Next: Sky Surveys
Up: Virtual Observatory and Archives
Previous: Construction of the Japanese Virtual Observatory (JVO)
Table of Contents - Subject Index - Author Index - Search - PS reprint - PDF reprint

Seaman, R., Zárate, N., Lauer, T., & Warner, P. B. 2003, in ASP Conf. Ser., Vol. 295 Astronomical Data Analysis Software and Systems XII, eds. H. E. Payne, R. I. Jedrzejewski, & R. N. Hook (San Francisco: ASP), 100

The NOAO Science Archive, Version 2.0

R. Seaman, N. Zárate, T. Lauer, P. B. Warner
Data Products Program, National Optical Astronomy Observatory1, 950 North Cherry Ave., Tucson, AZ 85719

Abstract:

The NOAO Science Archive (NSA) is a major step toward building a comprehensive scientific archive of the optical and infrared data holdings of the National Optical Astronomy Observatory. The goals for the NSA are to rapidly create a scientifically useful archive of NOAO Survey data, to develop in-house expertise in the relevant technologies, to identify requirements for NOAO's developing comprehensive archive, and to create a high level of visibility as well as utility for both the NOAO Archive and NOAO Surveys, for example, through new Web services.

The holdings of the NSA are drawn from the NOAO Survey program as well as from other coherent imaging or spectral, optical/IR reduced datasets that may be identified as candidates from NOAO or community facilities. Catalogs and other derived data products will be included in addition to images, spectra and the tools necessary to evaluate them. Synoptic, time-domain data is a special focus in anticipation of the needs of the LSST.

The NSA team is working in coordination with other groups at NOAO who are focusing on data handling and data pipeline systems in the context of supporting NOAO instrumentation as well as the emerging National Virtual Observatory infrastructure.

Planning for the NSA was started in November of 2001 by the Science Data Systems Group of the NOAO Data Products Program.Version 1.0 of the NSA was released in April, version 1.1 in July and version 1.2 in October of 2002. We discuss plans for Version 2.0 of NSA to be released in January of 2003.

1. NOAO Science Archive Overview

The NOAO Science Archive (NSA) provides a rapid prototyping environment of techniques, hardware and software while at the same time building an operational archive of scientifically interesting data sets. NSA represents the first major project of the newly established NOAO Data Products Program that seeks to construct a complete data handling system from data capture to public archiving of the resulting data products, anticipating the requirements and possibilities of the National Virtual Observatory and the Large Synoptic Survey Telescope.

Data products contained in the NSA are the results of the successful NOAO Survey Program. Survey teams provide the key to the NSA by providing a wide range of extremely useful datasets. The survey teams reduce and calibrate the data before it is ingested into the archive.

A major requirement of NSA is to not only build an archive system--but to build the community who will use that system. In such a case it is highly desirable to keep the development team in close communication with all the users of the system, including the survey teams themselves. In general, the NOAO Data Products Program seeks to build community partnerships wherever possible with both data providers and data customers.

Figure 1: The NOAO Cutout Tool is dynamically connected to all data holdings - over 15,000 calibrated images as of January 2003.
\begin{figure}
\epsscale{.90}
\plotone{P1.12_1.eps}
\end{figure}

2. NSA Web Interface

The NOAO Science Archive is accessed through a Web interface using HTML and JavaScript for the client interface, and Apache, MySQL, PHP, C and IRAF task executables for server-side procedures. The interface provides the user the capability to search the NSA via coordinate information, object name, observation date, photometric depth, survey name, and filter. Access to SIMBAD or NED is enabled through C client libraries, kindly provided by each of these projects.

The NOAO Science Archive Image Viewer and Cutout Service was derived from the NOAO Deep-Wide Field Survey Image Viewer and benefits from ongoing work for NOAO's National Virtual Observatory efforts.

Search results include the ability to view the full FITS header, download the FITS file, create a cutout region of the image for download, and a shopping cart mechanism to assemble datasets (that is, either full images or cutout regions) for bulk download.

Figure 2: The NOAO Science Archive Shopping Cart.
\begin{figure}
\epsscale{.90}
\plotone{P1.12_2.eps}
\end{figure}

3. NOAO Science Archive Status

Work on the NSA project started in the Fall of 2001 with a part time team of four. Current staffing has grown to about seven. The initial version 1.0 of NSA was finished and released in April of 2002 and included data from three survey projects and the ability to search the database, retrieve data files and perform various utility chores such as ingesting data and logging traffic. Static preview images and the ability to display the FITS headers were also included.

A follow-up NSA version 1.1 was immediately initiated and was released in June of 2002. This version was principally a support release for the NOAO Deep-Wide Field Survey and included a revised version of their release 1 data products along with data quality masks and related improvements. Version 1.2 of NSA was released in October of 2002. Even incremental releases like version 1.2 include significant new data holdings--version 1.2 approximately doubled the data holdings. This release also marked the first appearance of the new database-enabled NOAO image cutout server.

In addition to including data from many more of the NOAO survey projects, version 2.0 will include full support for the NOAO cutout server for all data holdings. This is being implemented dynamically directly from the NSA MySQL database information, rather than using a static index file as was originally done for the NDWFS data. An ``NSA Shopping Cart'' is being implemented to service ``push'' requests for multiple data files. A mirror archive will be hosted at CTIO in La Serena, Chile. The hardware, including a one Terabyte class RAID array, is in the process of being configured. The data, database, software and web pages will be copied onto the new disks before the system is shipped to the Southern hemisphere.

The long term goal is a fully engineered archive to serve as a major component of the Virtual Observatory. Planning activities for how to transition subsystems of the NSA onto the corresponding engineered subsystems are in progress. It is likely that significant portions of the NSA--and large amounts of data holdings--will remain in operation indefinitely.

Acknowledgments

IRAF is distributed by the National Optical Astronomy Observatory, which is operated by the Association of Universities for Research in Astronomy, Inc., under cooperative agreement with the National Science Foundation.

This research has made use of the NASA/IPAC Extragalactic Database (NED) which is operated by the Jet Propulsion Laboratory, California Institute of Technology, under contract with the National Aeronautics and Space Administration.

This service is provided in collaboration with the SIMBAD project, Centre de Données Astronomiques de Strasbourg, France.

References

Davis, L., Fitzpatrick, M. & Tody, D. 2002, in ASP Conf. Ser., Vol. 281, Astronomical Data Analysis Software and Systems XI, ed. David A. Bohlender, Daniel Durand and T. H. Handley (San Francisco: ASP), 367

Seaman, R. 1994, in ASP Conf. Ser., Vol. 77, Astronomical Data Analysis Software and Systems IV, ed. R. A. Shaw, H. E. Payne, & J. J. E. Hayes (San Francisco: ASP), 119

Seaman, R. 2000, in ASP Conf. Ser., Vol. 238, Astronomical Data Analysis Software and Systems X, ed. F. R. Harnden, Jr., Francis A. Primini, & Harry E. Payne (San Francisco: ASP), 133

Shaw, R., Boroson, T., & Smith, C. 2002, in Information Technologies: Observatory Operations to Optimize Scientific Return III, ed. P. Quinn, Proc. SPIE, 4844, in press

Tody, D. & Fitzpatrick, M. 2002, in ASP Conf. Ser., Vol. 281, Astronomical Data Analysis Software and Systems XI, ed. David A. Bohlender, Daniel Durand and T. H. Handley (San Francisco: ASP), 177



Footnotes

...1
National Optical Astronomy Observatory, operated by the Association of Universities for Research in Astronomy, Inc. (AURA) under cooperative agreement with the National Science Foundation

© Copyright 2003 Astronomical Society of the Pacific, 390 Ashton Avenue, San Francisco, California 94112, USA
Next: Sky Surveys
Up: Virtual Observatory and Archives
Previous: Construction of the Japanese Virtual Observatory (JVO)
Table of Contents - Subject Index - Author Index - Search - PS reprint - PDF reprint