DataEngineering · Serialization format

Serialization format

• protocolbuffers/protobuf on GitHub, opens in a new tab

  71.7Kstars

  Protocol Buffers - Google's data interchange format.

  C++·Other·active·6 hours ago

• google/snappy on GitHub, opens in a new tab

  6.6Kstars

  A fast compressor/decompressor. Used with Parquet.

  C++·Other·active·2 weeks ago

• EsotericSoftware/kryo on GitHub, opens in a new tab

  6.5Kstars

  A fast and efficient object graph serialization framework for Java.

  HTML·BSD 3-Clause "New" or "Revised" License·active·5 hours ago

• HMAKT99/AKF on GitHub, opens in a new tab

  15stars

  The AI native file format. Trust scores, source provenance, and compliance metadata that embed into 20+ formats (DOCX, PDF, images, code). EXIF for AI.

  Python·MIT License·active·2 weeks ago

• ImpossibleForge/pfc-jsonl on GitHub, opens in a new tab

  6stars

  Specialized JSONL log compressor with block-level timestamp indexing and DuckDB integration. Achieves ~9% compression ratio (better than gzip) with time-range random access queries.

  Other·active·2 months ago