Amazon S3 Bloat - How to fix it

290 views · Published 20 December 2018 · 8:52 · Indexed 20 November 2026

Channel: majorgeeks · 2018 · Science & Technology

Watch on YouTube

I’ve had an Amazon S3 account for some time.  It has worked fine. Recently, I noticed costs and storage going up dramatically with no real change to how I used the service nor anything I could diagnose on my end. 

The culprit was failed multipart uploads. You cannot  see these  in your account though the AWS interface.  There is no report or the like so you cannot monitor these items.  You CAN see this junk data using CLI and if you’re familiar with Linux – but that is it.  If you are interested in CLI Here's the docs. https://docs.aws.amazon.com/AmazonS3/latest/dev/setup-aws-cli.html

This problem of broken multipart uploads  combined with versioning,  bloated my storage from a few hundred gig to 4 Terabytes quickly.  That made my cheap S3 storage rather expensive - quickly.   Amazon charges for their tech support  to get the answer on how to fix this issue - so I figured I’d share it here so you could do it for free. Geeks FTW!

More from this channel