Comparison of distributed file systems: Difference between revisions

Revision as of 02:41, 22 January 2021

Revision as of 06:15, 16 April 2021

Line 73:

|

|-

! {{rh}} |[[Moose File System|MooseFSHDFS]]

| CJava

| {{free|GPLv2}}

| [[Posix#POSIX.1|POSIX]], [[Filesystem in Userspace|FUSE]]

| {{no|master}}

| {{no}}

| {{no|Replication}}<ref>Only available in the proprietary version 4.x {{cite web |url=https://github.com/moosefs/moosefs/issues/8 |title=[feature] erasure-coding #8}}</ref>

| {{yes|File}}<ref>{{cite web |url=https://fossies.org/linux/moosefs/mfsmanpages/mfsgoal.1 |title=mfsgoal(1)}}</ref>

| 2008

|

|-

! {{rh}} |[[Quantcast File System]]

| C

| {{free|Apache License 2.0}}

| Java and C client, HTTP, FUSE<ref>{{cite web |url=https://cwiki.apache.org/confluence/display/HADOOP2/MountableHDFS |title=MountableHDFS}}</ref>

| C++ client, [[Filesystem in Userspace|FUSE]] (C++ server: MetaServer and ChunkServer are both in C++)

| {{noyes|transparent master failover}}

| {{no}}

| {{yes|Reed-Solomon}}<ref>{{cite web |url=https://wwwissues.csapache.utah.eduorg/~harijira/teachingbrowse/bigdata/qfsHDFS-ovsiannikov.pdf7285 |title=TheHDFS-7285 Erasure Coding QuantcastSupport Fileinside SystemHDFS}}</ref>

| {{yes|File}}<ref>{{cite web |url=https://githubhadoop.comapache.org/quantcastdocs/qfs/blob/2r2.24.21/srchadoop-project-dist/cchadoop-common/tools/cptoqfs_mainFileSystemShell.cchtml#L259setrep |title=qfs/src/cc/tools/cptoqfs_main.ccApache Hadoop: setrep}}</ref>

| 20122005

|

|-

Line 104 ⟶ 93:

| {{yes|Block}}<ref>{{cite web |url=https://docs.ipfs.io/reference/cli/#ipfs-bitswap-wantlist |title=CLI Commands: ipfs bitswap wantlist}}</ref>

| 2015<ref>{{cite web |url=https://techcrunch.com/2015/10/04/why-the-internet-needs-ipfs-before-its-too-late/ |title=Why The Internet Needs IPFS Before It’s Too Late}}</ref>

|

|-

! {{rh}} |[https://github.com/juicedata/juicefs JuiceFS]

| Go

| {{free|AGPLv3}}

| [[POSIX]], [[Filesystem in Userspace|FUSE]], [[HDFS]], [[Amazon S3|S3]]

| {{yes}}

| {{no}}

| {{yes|Reed-Solomon}}

| {{yes|Object}}

| 2021

|

|-

Line 149:

| {{yes|Object}}<ref>{{cite web |url=https://github.com/minio/minio/tree/master/docs/erasure/storage-class |title=MinIO Storage Class Quickstart Guide}}</ref>

| 2014

|

|-

! {{rh}} |[[Moose File System|MooseFS]]

| C

| {{free|GPLv2}}

| [[Posix#POSIX.1|POSIX]], [[Filesystem in Userspace|FUSE]]

| {{no|master}}

| {{no}}

| {{no|Replication}}<ref>Only available in the proprietary version 4.x {{cite web |url=https://github.com/moosefs/moosefs/issues/8 |title=[feature] erasure-coding #8}}</ref>

| {{yes|File}}<ref>{{cite web |url=https://fossies.org/linux/moosefs/mfsmanpages/mfsgoal.1 |title=mfsgoal(1)}}</ref>

| 2008

|

|-

Line 173 ⟶ 184:

| 2015

| 0.5

|-

! {{rh}} |Ori<ref>{{cite web

| url=http://ori.scs.stanford.edu

| title=Ori: A Secure Distributed File System}}</ref>

| C, C++

| {{free|MIT}}

| libori, [[Filesystem in Userspace|FUSE]]

|

|

| {{no|Replication}}

| {{no|Filesystem}}<ref>{{cite journal

|first1=Ali Jose |last1=Mashtizadeh

|first2=Andrea |last2=Bittau

|first3=Yifeng Frank |last3=Huang

|first4=David |last4=Mazières

|title=Replication, History, and Grafting in the Ori File System

|url=http://sigops.org/s/conferences/sosp/2013/papers/p151-mashtizadeh.pdf

}}</ref>

| 2012

|

|-

! {{rh}} |[[Quantcast File System]]

| C

| {{free|Apache License 2.0}}

| C++ client, [[Filesystem in Userspace|FUSE]] (C++ server: MetaServer and ChunkServer are both in C++)

| {{no|master}}

| {{no}}

| {{yes|Reed-Solomon}}<ref>{{cite web |url=https://issueswww.apachecs.orgutah.edu/jira~hari/browseteaching/HDFSbigdata/qfs-7285ovsiannikov.pdf |title=HDFS-7285 Erasure CodingThe SupportQuantcast insideFile HDFSSystem}}</ref>

| {{yes|File}}<ref>{{cite web |url=https://github.com/quantcast/qfs/blob/2.2.2/src/cc/tools/cptoqfs_main.cc#L259 |title=qfs/src/cc/tools/cptoqfs_main.cc}}</ref>

| 2012

|

|-

! {{rh}} |[[RozoFS]]

Line 207 ⟶ 249:

| {{yes|File}}<ref>{{cite web |url=https://tahoe-lafs.readthedocs.io/en/latest/architecture.html#file-encoding |title=Tahoe-LAFS Architecture: File Encoding}}</ref>

| 2007

|

|-

! {{rh}} |[[HDFS]]

| Java

| {{free|Apache License 2.0}}

| Java and C client, HTTP, FUSE<ref>{{cite web |url=https://cwiki.apache.org/confluence/display/HADOOP2/MountableHDFS |title=MountableHDFS}}</ref>

| {{yes|transparent master failover}}

| {{no}}

| {{yes|Reed-Solomon}}<ref>{{cite web |url=https://issues.apache.org/jira/browse/HDFS-7285 |title=HDFS-7285 Erasure Coding Support inside HDFS}}</ref>

| {{yes|File}}<ref>{{cite web |url=https://hadoop.apache.org/docs/r2.4.1/hadoop-project-dist/hadoop-common/FileSystemShell.html#setrep |title=Apache Hadoop: setrep}}</ref>

| 2005

|

|-

Line 229 ⟶ 260:

| {{yes|File}}<ref>{{cite web |url=http://www.xtreemfs.org/quickstart_repl.php |title=Quickstart: Replicate A File}}</ref>

| 2009

|

|-

! {{rh}} |Ori<ref>{{cite web

| url=http://ori.scs.stanford.edu

| title=Ori: A Secure Distributed File System}}</ref>

| C, C++

| {{free|MIT}}

| libori, [[Filesystem in Userspace|FUSE]]

|

|

| {{no|Replication}}

| {{no|Filesystem}}<ref>{{cite journal

|first1=Ali Jose |last1=Mashtizadeh

|first2=Andrea |last2=Bittau

|first3=Yifeng Frank |last3=Huang

|first4=David |last4=Mazières

|title=Replication, History, and Grafting in the Ori File System

|url=http://sigops.org/s/conferences/sosp/2013/papers/p151-mashtizadeh.pdf

}}</ref>

| 2012

|

|}