Note on Three Classes of Data Grid Operations

Arcot Rajasekar, Hao Xu, Reagan Moore

School of Information and Library Science, University of North Carolina at Chapel Hill, Chapel Hill, USA.

DOI: 10.4236/jcc.2014.26001                

Abstract

Traditional grid computing focuses on the movement of data to compute resources and the management of large scale simulations. Data grid computing focuses on moving the operations to the storage location and on operations on data collections. We present three types of data grid operations that facilitate data driven research: the manipulation of time series data, the reproducible execution of workflows, and the mapping of data access to software-defined networks. These data grid operations have been implemented as operations on collections within the NSF DataNet Federation Consortium project. The operations can be applied at the remote resource where data are stored, improving the ability of researchers to interact with large collections.

Keywords

Component, Data Grid, Policy-Based, Operations

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	DataNet Federation Consortium. http://datafed.org
[2]	Rajasekar, R., Wan, M., Moore, R., Schroeder, W., Chen, S.-Y., Gilbert, L., Hou, C.-Y., Lee, C., Marciano, R., Tooby, P., De Torcy, A. and Zhu, B. (2010) iRODS Primer: Integrated Rule-Oriented Data System. Morgan & Claypool.
[3]	Ward, J., Wan, M., Schroeder, W., Rajasekar, A., de Torcy, A., Russell, T., Xu, H. and Moore, R. (2011) The Integrated Rule-Oriented Data System (iRODS 3.0) Micro-Service Workbook. DICE Foundation, Amazon.com.
[4]	Ocean Observatories Initiative. http://oceanobservatories.org
[5]	NetCDF Network Common Data Form. http://www.unidata.ucar.edu/software/NetCDF/
[6]	OPeNDAP Protocol. http://www.opendap.org
[7]	ERDDAP Environmental Research Division’s Data Access Program. http://coastwatch.pfeg.noaa.gov/erddap/index.html
[8]	PyDAP Python Data Access Protocol. http://www.pydap.org
[9]	NEXRAD Next Generation Radar. http://www.ncdc.noaa.gov/oa/radar/radarresources.html
[10]	LandSat Thematic Mapper Data. http://landsat.gsfc.nasa.gov
[11]	NASA MODIS Moderate Resolution Imaging Spectroradiometer Data. http://modis.gsfc.nasa.gov
[12]	NCEP/NCAR National Centers for Environmental Prediction/National Center for Atmospheric Research Reanalysis. http://www.esrl.noaa.gov/psd/data/reanalysis/reanalysis.shtml
[13]	The iPlant Collaborative. https://www.iplantcollaborative.org
[14]	OpenFlow Switch. https://www.opennetworking.org/sdn-resources/onf-specifications/openflow
[15]	ExoGeni Global Environment for Network Innovation Testbed. http://www.exogeni.net