Wikipedia

Comparison of distributed file systems: Difference between revisions

Browse history interactively
← Previous edit
Content deleted Content added
VisualWikitext
→Proprietary: S3 inserted
removed stub template
 
(10 intermediate revisions by 10 users not shown)
Line 3:
{{See also|List of file systems#Distributed parallel fault-tolerant file systems|l1=Comparison of distributed parallel fault-tolerant file systems}}
 
In computing, a [[distributed file system]] (DFS) or network file system is any [[file system]] that allows access from multiple hosts to [[computer file|files]] from multiple hosts [[resource sharing|sharingshared]] via a [[computer network]]. This makes it possible for multiple users on multiple machines to share files and storage resources.
 
Distributed file systems differ in their performance, mutability of content, handling of concurrent writes, handling of permanent or temporary loss of nodes or storage, and their policy of storing content.
Line 97:
|
|-
|! {{no|Volumerh}} |[[LizardFS]]<ref>{{cite web |url=https://github.com/chrislusflizardfs/seaweedfslizardfs/wikiissues/Replication805#issuecomment-2238866486 | title=ReplicationIs LizardFS development still alive?| website=[[GitHub]]}}</ref>▼
! {{rh}} |[https://github.com/juicedata/juicefs JuiceFS]
| Go
| {{free|Apache License 2.0}}
| [[POSIX]], [[Filesystem in Userspace|FUSE]], [[HDFS]], [[Amazon S3|S3]]
| {{yes}}
| {{yes}}
| {{yes|Reed-Solomon}}
| {{yes|Object}}
| 2021
|▼
|-
! {{rh}} |[https://github.com/freakmaxi/kertish-dfs Kertish-DFS]
| Go
| {{free|GPLv3}}
|HTTP(REST), CLI, C# Client, Go Client
|{{yes}}
|
| {{no|Replication}}
|
|2020
|
|-
! {{rh}} |[[LizardFS]]▼
| C++
| {{free|GPLv3}}
Line 173 ⟶ 151:
| {{no|Volume}}<ref>{{cite web |url=http://docs.openafs.org/AdminGuide/HDRWQ192.html |title=Replicating Volumes (Creating Read-only Volumes)
}}</ref>
| 2000 <ref>{{Cite web|url=https://www.openafs.org/release/openafs-1.0.html|title=OpenAFS}}</ref>
|
|-
Line 186 ⟶ 164:
| 2015
| 0.5
|-
! {{rh}} |Ori<ref>{{cite web
| url=http://ori.scs.stanford.edu
| title=Ori: A Secure Distributed File System}}</ref>
| C, C++▼
| {{free|MIT}}
| libori, [[Filesystem in Userspace|FUSE]]
|
|
| {{no|Replication}}
| {{no|Filesystem}}<ref>{{cite journal
|first1=Ali Jose |last1=Mashtizadeh
|first2=Andrea |last2=Bittau
|first3=Yifeng Frank |last3=Huang
|first4=David |last4=Mazières
|title=Replication, History, and Grafting in the Ori File System
|url=http://sigops.org/s/conferences/sosp/2013/papers/p151-mashtizadeh.pdf
}}</ref>
| 2012
|
|-
! {{rh}} |[[Quantcast File System]]
Line 227 ⟶ 185:
| {{no|Volume}}<ref>{{cite web |url=http://rozofs.github.io/rozofs/develop/SettingUpRozoFS.html#exportd-configuration-file |title=Setting up RozoFS: Exportd Configuration File}}</ref>
| 2011<ref>{{cite web |url=https://github.com/rozofs/rozofs/commit/9818e92f73fe4432c8d29236158e271da9ee3bf2 |title=Initial commit.|website=[[GitHub]]}}</ref>
|
|-
! {{rh}} |[https://github.com/chrislusf/seaweedfs SeaweedFS]
| Go, Java
| {{free|Apache License 2.0}}
| HTTP ([[REST]]), [[POSIX]], [[Filesystem in Userspace|FUSE]], [[Amazon S3|S3]], [[HDFS]]
| {{no|requires CockroachDB, undocumented config}}
|
| {{yes|Reed-Solomon}}<ref>{{cite web |url=https://github.com/chrislusf/seaweedfs/wiki/Erasure-coding-for-warm-storage |title=Erasure Coding for warm storage|website=[[GitHub]]}}</ref>
▲| {{no|Volume}}<ref>{{cite web |url=https://github.com/chrislusf/seaweedfs/wiki/Replication |title=Replication|website=[[GitHub]]}}</ref>
| 2015
|
|-
! {{rh}} |[https://github.com/storj Storj]
| Go
| {{free|Apache License 2.0, [[Affero General Public License]] v3}}
| HTTP ([[REST]]), [[Amazon S3|S3]], Native ([[Go (programming language)|Go]], [[C (programming language)|C]], [[Python (programming language)|Python]], [[Java (programming language)|Java]])
| {{yes|Yes}}
|
| {{yes|Reed-Solomon<ref name="storjv3-whitepaper">{{cite web |url=https://www.storj.io/storjv3.pdf |title=Storj: A Decentralized Cloud Storage Network Framework v3.0 |date=30 October 2018}}</ref>}}
| {{yes|Object<ref name="storjv3-whitepaper" />}}
| 2018
|
|-
Line 294 ⟶ 230:
GPLv2 client
| [[Posix#POSIX.1|POSIX]]
▲|-
▲! {{rh}} |[[LizardFSCloudian]]
▲| C, C++
| {{proprietary}}▼
|[[Amazon S3|AWS S3]], NFS, [[SMB/CIFS]], Rest API
|-
! {{rh}} |[[ObjectiveFS]]<ref>{{cite web
Line 311 ⟶ 252:
| {{proprietary}}
| [[Posix#POSIX.1|POSIX]], [[Network File System|NFS]], [[Filesystem in Userspace|FUSE]], [[Amazon S3|S3]], [[Apache Hadoop#HDFS|HDFS]], CLI
|-
! {{rh}} |[https://www.panasas.com/panfs-architecture/panfs/ PanFS]
| C, C++
▲| {{proprietary}}
| [[Panasas#DirectFlow|DirectFlow]], [[POSIX]], [[Network File System|NFS]], [[Server Message Block|SMB/CIFS]], [[Hypertext Transfer Protocol|HTTP]], [[Command-line interface|CLI]]
|-
! {{rh}} |[[Infinit (file system)|Infinit]]<ref>{{cite web
| url=http://infinit.sh
| title=The Infinit Storage Platform}}</ref>
| C++
| {{proprietary}} (to be open sourced)<ref>{{cite web
| url=http://infinit.sh/open-source
| title=Infinit's Open Source Projects| date=13 August 2019}}</ref>
| [[Filesystem in Userspace|FUSE]], [[Installable File System]], [[Network File System|NFS]]/[[Server Message Block|SMB]], [[Posix#POSIX.1|POSIX]], [[Command-line interface|CLI]], [[Software Development Kit|SDK]] (libinfinit)
|-
! {{rh}} |[[OneFS distributed file system|Isilon OneFS]]
Line 331 ⟶ 258:
| [[Posix#POSIX.1|POSIX]], [[Network File System|NFS]], [[SMB/CIFS]], [[HDFS]], [[HTTP]], [[FTP]], SWIFT Object, [[Command-line interface|CLI]], Rest API
|-
! {{rh}} |[[Qumulo|Qumulo]]
| C/C++
| {{Proprietary}}
Line 341 ⟶ 268:
| [[Filesystem in Userspace|FUSE]], [[Network File System|NFS]], [[Representational state transfer|REST]], [[AWS S3]]
|-
! {{rh}} |[https://www.quobyte.com/product Quobyte[VaultFS]]
| Java, C/C++
| {{proprietary}}
| [[Posix#POSIX.1|POSIX]], [[Filesystem in Userspace|FUSE]], [[Network File System|NFS]], [[SMB/CIFS]], [[HDFS]],Command-line [[AWS S3]], [[TensorFlowinterface| TensorFlow PluginCLI]], [[Command-lineAmazon interfaceS3|CLIS3]], Rest API
|}
 
Line 370 ⟶ 297:
| [[HTTP]] ([[REST]])
|-
| {{rh}} |[[IBM Cloud Object Storage]]
|[[IBM]] (formerly [[Cleversafe Inc.|Cleversafe]])<ref>{{cite web|url=https://www-03.ibm.com/press/us/en/pressrelease/47776.wss|archive-url=https://web.archive.org/web/20151008001155/http://www-03.ibm.com/press/us/en/pressrelease/47776.wss|url-status=dead|archive-date=October 8, 2015|title=IBM Plans to Acquire Cleversafe for Object Storage in Cloud|date=2015-10-05|website=www-03.ibm.com|language=en-US|access-date=2019-05-06}}</ref>
| [[HTTP]] ([[REST]])
|}
Line 392 ⟶ 319:
[[Category:Network file systems]]
[[Category:Software comparisons|Distributed file systems]]
[[Category:Long stubs with short prose]]
 
 
{{compu-storage-stub}}
Retrieved from "https://en.wikipedia.org/wiki/Comparison_of_distributed_file_systems"