The Central Go Modules Repository

To use GoCenter:
export GOPROXY=https://gocenter.io
10
Stars
MIT
License
104
Downloads
April 25th 2020
Last Modified
Version:
Loading...

BlobsFile

builds.sr.ht status    Godoc Reference

BlobsFile is an append-only (i.e. no update and no delete) content-addressed blob store (using BLAKE2b as hash function).

It draws inspiration from Facebook’s Haystack, blobs are stored in flat files (called BlobFile) and indexed by a small kv database for fast lookup.

BlobsFile is BlobStash’s storage engine.

Features

  • Durable (data is fsynced before returning)
  • Immutable (append-only, can’t mutate or delete blobs)
  • Optional compression (Snappy or Zstandard)
  • Extra parity data is added to each BlobFile (using Reed-Solomon error correcting code), allowing the database to repair itself in case of corruption.
    • The test suite is literraly punching holes at random places