Grid-oriented storage: Difference between revisions

Revision as of 18:06, 26 June 2007

Latest revision as of 01:44, 17 November 2018

(25 intermediate revisions by 16 users not shown)

Line 1:

{{primary sources|article|date=March 2009}}

{{wikify}}

'''Grid-oriented Storage (GOS)''' is a dedicated data storage architecture which can be connected directly to a computational grid to support advanced data bank services and reservoirs for data that can be shared among multiple computers and end users on the grid.

'''Grid-oriented Storage''' ('''GOS''') was a term used for data storage by a university project during the era when the term [[grid computing]] was popular.

== Description ==

GOS iswas a successor of well-usedthe term [[network-attached storage]] (NAS) products in the [[Grid Computing]] era. A GOS-specific File System (GOS-FS), a [[P2P]] clustering technique, the single-purpose intent of a GOS operating system (OS), and a browser-based management console motivate and enable this new architecture. GOS is the first demonstration that Office/database/Web/media applications can be accelerated by tenfold in real-world tests. GOS systems usually contain one or morecontained hard disks, often arranged into logical, redundant storage containers or [[RAID]]s (redundant arrays of independent disks), as dolike traditional file servers.

[[Image:gosongrid.jpg]][[Image:gosunit |thumb|upright=1.jpg4]]

GOS was designed to deal with long-distance, cross-___domain and single-image file operations, which is typical in Grid environments. GOS behaves like a file server via the file-based GOS-FS protocol to any entity on the grid. Similar to [[Advanced Resource Connector|GridFTP]], GOS-FS integrates a parallel stream engine and [[Grid Security Infrastructure]] (GSI).

[[Image:gosongrid.jpg]][[Image:gosunit.jpg]]

GOS is designed to deal with long-distance, cross-___domain and single-image file operations, which is typical in Grid environments. GOS behaves like a file server via the file-based GOS-FS protocol to any entity on the grid. Inspired by the success of [[Advanced Resource Connector|GridFTP]], GOS-FS integrates a parallel stream engine and [[Grid Security Infrastructure]] (GSI). Conforming to the universal VFS (Virtual Filesystem Switch), GOS-FS can be pervasively used as an underlying platform to best utilize the increased transfer bandwidth and accelerate the [[networkNetwork fileFile systemSystem (protocol)|NFS]]/[[CIFS]]-based applications. GOS can also run over [[SCSI]], [[Fibre Channel]] or [[iSCSI]], which does not affect the acceleration performance, offering both file level protocols and block level protocols for [[Storagestorage Areaarea Networknetwork]] (SAN) from the same system.

GeographicallyIn distributeda naturegrid ofinfrastructure, resources thatmay makebe upgeographically thedistant gridfrom infrastructureeach other, alongproduced withby theirdiffering heterogeneitymanufacturers, and differenthave differing access control policies. inThis differentmakes domains,access maketo the availability of thesegrid resources dynamic and conditional upon local constraints. Centralized management techniques for these resources are limited in their scalability both in terms of execution efficiency and fault tolerance. Provision of services across such platforms requires a distributed resource management mechanism. One ofand the designpeer-to-peer goals of theclustered GOS Cluster is toappliances allow a single storage image to continue to expand, even if a single GOS appliance reaches its capacity limitations. [[P2P]]The clustered GOS appliancescluster shareshares a common, aggregate presentation of the data stored on all participating GOS appliances. Each GOS appliance manages its own internal storage space. The major benefit of this aggregation is that clustered GOS storage can be accessed by users as a single mount point.

GOS products fit the thin-server categorization. Compared with traditional “fat server”-based storage architectures, thin-server GOS appliances deliver numerous advantages, such as the alleviation of potential network/grid bottle-necks, CPU and OS optimized for I/O only, ease of installation, remote management and minimal maintenance, low cost and Plug and Play, etc. Examples of similar innovations include NAS, printers, fax machines, routers and switches.

Line 18:

== History ==

Grid-oriented[[Frank Storage (GOS) was proposed by Prof. FrankZhigang Wang]] and Dr. Na Helian in 2003 inproposed a funding proposal, to the UK government titled “Grid-Oriented Storage (GOS): Next Generation Data Storage System Architecture for the Grid Computing Era”, toin the UK government2003. The proposal was approved and granted one million pounds{{citation needed|date=March 2009}} in 2004. The first prototype was constructed in 2005 at [http://www.cranfield.ac.uk/soe/amac/computing/ Centre for Grid Computing, Cambridge-Cranfield High Performance Computing Facility]. The first conference presentation was at IEEE Symposium on Cluster Computing and Grid (CCGrid), 9 - 129–12 May 2005, Cardiff, UK. As one of the five best work-in-progress, it was included in the IEEE Distributed Systems Online. In 2006, the GOS architecture and its implementations was published in IEEE Transactions on Computers, titled “Grid-oriented Storage: A Single-Image, Cross-Domain, High-Bandwidth Architecture”. From
Starting in January 2007, thedemonstrations GOSwere invention led to invitations to present demonstrationspresented at [[Princeton University]], Cambridge University (Computer Lab), IBM, Rolls Royce, BBC, Xerox, Carnegie Mellon University, CERN, and EADS, etc. A number of collaborations have been fostered with industrial giantsothers.

By 2013, the Cranfield Centre still used future tense for the project.<ref name="Cranfield CGC">{{cite web |url= http://www.cranfield.ac.uk/soe/departments/appliedmaths/gridcomputing/index.html |title= Centre for Grid Computing |accessdate= June 14, 2013 |publisher=Cranfield University}} <!-- --></ref>

== External Links ==

[http://www.cranfield.ac.uk/soe/amac/computing/ Grid Computing is already moving from a research vision into production]

==Academic papers==

• Frank Wang, Na Helian, Sining Wu, Yuhui Deng, Yike Guo, Steve Thompson, Ian Johnson, Dave Milward & Robert Maddock, Grid-Oriented Storage, IEEE Distributed Systems Online, Volume 6, Issue 9, Sept. 2005.

• Frank Wang, Sining Wu, Na Helian, Andy Parker, Yike Guo, Yuhui Deng, Vineet Khare, Grid-oriented Storage: A Single-Image, Cross-Domain, High-Bandwidth Architecture, IEEE Transaction on Computers, Vol.56, No.4, pp. 474-487, 2007.

[[Peer-to-peer file sharing]]s use similar techniques.

• Frank Zhigang Wang, Sining Wu, Na Helian, An Underlying Data-Transporting Protocol for Accelerating Web Communications, International Journal of Computer Networks, Elsevier, ISSN: 1389-1286, 2007.

==Notes==

• Frank Zhigang Wang, Sining Wu, Na Helian, Yuhui Deng, Vineet Khare, Chris Thompson and Michael Parker, Grid-based Data Access to Nucleotide Sequence Database with 6x Improvement in Response Times, New Generation Computing, No.2, Vol.25, 2007.

{{reflist}}

==Further reading==

• Yuhui Deng and Frank Wang, A Heterogeneous Storage Grid Enabled by Grid Service, ACM Operating System Review, No.1, Vol.41, 2007.

•* Frank Wang, Na Helian, Sining Wu, Yuhui Deng, Yike Guo, Steve Thompson, Ian Johnson, Dave Milward & Robert Maddock, Grid-Oriented Storage, IEEE Distributed Systems Online, Volume 6, Issue 9, Sept. 2005.

•* Frank Wang, Sining Wu, Na Helian, Andy Parker, Yike Guo, Yuhui Deng, Vineet Khare, Grid-oriented Storage: A Single-Image, Cross-Domain, High-Bandwidth Architecture, IEEE TransactionTransactions on Computers, Vol.56, No.4, pp. 474-487&nbsp;474–487, 2007.

•* Frank Zhigang Wang, Sining Wu, Na Helian, An Underlying Data-Transporting Protocol for Accelerating Web Communications, International Journal of Computer Networks, Elsevier, ISSN: 1389-1286, 2007.

•* Frank Zhigang Wang, Sining Wu, Na Helian, Yuhui Deng, Vineet Khare, Chris Thompson and Michael Parker, Grid-based Data Access to Nucleotide Sequence Database with 6x Improvement in Response Times, New Generation Computing, No.2, Vol.25, 2007.

* Frank Wang, Yuhui Deng, Na Helian, Evolutionary Storage: Speeding up a Magnetic Disk by Clustering Frequent Data, IEEE Transactions on Magnetics, Issue.6, Vol.43, 2007.

* Frank Zhigang Wang, Na Helian, Sining Wu, Yuhui Deng, Vineet Khare, Chris Thompson and Michael Parker, Grid-based Storage Architecture for Accelerating Bioinformatics Computing, Journal of VLSI Signal Processing Systems, No.1, Vol.48, 2007.

•* Yuhui Deng and Frank Wang, A Heterogeneous Storage Grid Enabled by Grid Service, ACM Operating System Review, No.1, Vol.41, 2007.

* Yuhui Deng & Frank Wang, Optimal Clustering Size of Small File Access in Network Attached Storage Device, Parallel Processing Letters, No.1, Vol.17, 2007.

{{DEFAULTSORT:Grid-Oriented Storage}}

[[Category:Data management]]