SeaweedFS is an easy and highly-scalable distributed file system that’s an unbiased Apache-licensed open supply challenge.
SeaweedFS began as an Object Retailer to deal with small recordsdata effectively. As an alternative of managing all file metadata in a central grasp, the central grasp solely manages file volumes, and it lets these quantity servers handle recordsdata and their metadata. The challenge can transparently combine with the cloud.
“With sizzling information on native cluster, and heat information on the cloud with O(1) entry time, SeaweedFS can obtain each quick native entry time and elastic cloud storage capability, with none shopper facet modifications,” the working group behind the challenge wrote in a post.
SeaweedFS began by implementing Facebook’s Haystack design paper and implements erasure coding with concepts from f4: Fb’s Heat BLOB Storage System.
Additionally, the Filer can help directories and POSIX attributes. Filer is a separate linearly-scalable stateless server with customizable metadata shops, MySQL, Postgres, MongoDB, Redis, Cassandra, Elastic Search, LevelDB, MemSQL, TiDB, etcd, CockroachDB, and extra.
Further options embrace the power to decide on no replication or completely different replication ranges, rack and information heart conscious, in addition to computerized grasp server failover, computerized GZip compression relying on file mime kind, and different automated options and help.