a nice byproduct of my backfill is i'm now the proud owner of one of the largest dataset of bluesky posts, roughly all 2.6 billion of them, with all their metadata from the post lexicon living in 552GB zstd'd parquet files, which for now live on a simple hetzner storage box