SeaweedFS is a distributed storage system for object storage (S3), file systems, and Iceberg tables, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.

大数据入门指南 ⭐

Ceph is a distributed object, block, and file storage platform

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

Utils for streaming large files (S3, HDFS, gzip, bz2...)

The Universal Storage Engine

大数据知识仓库涉及到数据仓库建模、实时计算、大数据、数据中台、系统设计、Java、算法等。

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

A native go client for HDFS

A fast and versatile ETL tool that can transfer data between RDBMS and NoSQL seamlessly

A pure python HDFS client

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

💎🔥大数据学习笔记

Real Time Analytics and Data Pipelines based on Spark Streaming

Deprecated - See Lenses.io Community Edition

CloudEon uses Kubernetes to install and deploy open-source big data components, enabling the containerized operation of an open-source big data platform. This allows you to reduce your focus on underlying resource management and maintenance.

Big Data Ecosystem Docker

Fundamentals of Spark with Python (using PySpark), code examples

StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service