S3 lacks native deduplication and safe expiration for backup jobs

6/10 Medium

Running backup jobs to S3 creates safety issues when attempting to implement deduplication and expire old data. There is no built-in incremental feature to address this common backup use case.

Category
architecture
Workaround
hack
Stage
build
Freshness
persistent
Scope
single_lib
Upstream
open
Recurring
No
Buyer Type
team
Maintainer
slow

Sources

Collection History

Query: “What are the most common pain points with S3 for developers in 2025?4/5/2026

You can run backup jobs to S3, but there are some safety issues if you want deduplication and you want to expire old data... It would be nice if S3 had this small, incremental additional feature.

Created: 4/5/2026Updated: 4/5/2026