DataEngineering · File System

File System

• juicedata/juicefs on GitHub, opens in a new tab

  14.3Kstars

  A high-performance Cloud-Native file system driven by object storage for large-scale data storage.

  Go·Apache License 2.0·active·7 hours ago

• s3ql/s3ql on GitHub, opens in a new tab

  1.3Kstars

  A file system that stores all its data online using storage services like Google Storage, Amazon S3, or OpenStack.

  Python·Other·active·2 weeks ago

• spotify/snakebite on GitHub, opens in a new tab

  857stars

  A pure python HDFS client.

  Python·Apache License 2.0·dormant·4 years agoarchived

• chrislusf/seaweedfs on GitHub, opens in a new tab

  36stars

  Seaweed-FS is a simple and highly scalable distributed file system. There are two objectives: to store billions of files! to serve the files fast! Instead of supporting full POSIX file system semantics, Seaweed-FS choose to implement only a key~file mapping. Similar to the word "NoSQL", you can call it as "NoFS".

  Go·Apache License 2.0·active·4 weeks ago

• tuplejump/snackfs-release on GitHub, opens in a new tab

  13stars

  A bite-sized, lightweight HDFS compatible file system built over Cassandra.

  Scala·dormant·11 years ago