member badge
Tom Raganowicz
This isn't possible with pure S3, but for our managed storage we could theoretically allow "block level" updates using different protocol.
Challenges:
  • regenerate whole file MD5 after every block change?
  • if content is encrypted using V2 cipher, shall we also regenerate the unencrypted hash?
  • can we skip MD5 altogether? What ETag we would then return from S3 endpoint? What if e.g. 200GB image gets updated frequently? Hash regeneration would kill performance dramatically.
Interesting projects:
https://github.com/archiecobbs/s3backer