How To Easily Delete Large S3 Buckets?

Deleting an Amazon S3 bucket can be a difficult task. It is even a bigger task if it has a large number of objects in it because you cannot delete non-empty buckets.

Automated solutions such as ‘S3cmd’ or ‘S3nukem’ would either break or take weeks to delete an S3 bucket depending on its size and the number of objects in it.

The best approach is to use AWS, which comes with the benefit of a self-service platform and provides an option of setting lifecycle policy for S3 objects.

AWS lifecycle policies help in defining actions on Amazon S3 during an object’s lifetime. For example, transitioning objects to another storage class, archiving them, or deleting them after a specified period.

Using a shared prefix (that is, objects that have names that begin with a common string), you can define the lifecycle policy for all objects or a subset of objects in the S3 bucket. And using a lifecycle policy, you can define actions specific to current and non-current object versions.

Note: The objects inside the AWS S3 would be gone forever after a day.

This solution is not instant but it takes a day to execute, which is faster than other solutions.

Here’s How to Set Lifecycle of an S3 Bucket

  • Log in to the AWS Management Console and open the Amazon S3 console at https://console.aws.amazon.com/s3/.
  • To create a lifecycle policy for a bucket, choose the name of the bucket from the Bucket name list.

How to Easily Delete Large S3 Buckets?
  • Choose the Management tab, and then choose Add lifecycle rule.

How to Easily Delete Large S3 Buckets?

  • Give the rule a name and click Next if you want to delete the whole bucket. Also, you can set the lifecycle rule for objects with a specified name prefix (that is, objects with names that begin with a common string), limit the lifecycle rule scope to one or more object tags, and combine a prefix and several tags.

How to Easily Delete Large S3 Buckets?

  • Click Next on the Transitions tab without any changes.
  • Select the options as shown in the image below.

How to Easily Delete Large S3 Buckets?

  • Verify the settings for your rule under Review.
  • If you need to make changes, choose Previous. Otherwise, click Save.

How to Easily Delete Large S3 Buckets?

From now on, AWS does the dirty work for you. S3 will do its own housekeeping, and after a day, everything inside your bucket will be deleted.

This approach can be used if you regularly create stacks with CloudFormation or Terraform, and the buckets won’t delete if there are objects in them.

Instead of writing scripts and adding to the workload you can easily setup lifecycle rules to take action on the AWS S3.

There are a number of things that can be accomplished using lifecycle rules. You can read more about them below.

Object Lifecycle Management

How Do I Create a Lifecycle Policy for an S3 Bucket?

Learn how lifecycle policies can help with cost optimization here

How To Easily Delete Large S3 Buckets?

Smart Scheduling at your fingertips

Go from simple to smart, real-time AWS resource scheduling to save cost and increase team productivity.

Learn More
More Posts

You Might Also Like

AWS Use Case Files
Launch EC2 Instances with CloudFormation
CloudFormation is the gateway to Infrastructure-as-code for AWS users. Learn how you can deploy Cloudformation templates through Totalcloud workflows and increase your customization.
June 25, 2020
Hrishikesh
AWS Use Case Files
JIRA Triggered Cloud Management
What if cloud management were as easy as raising a JIRA ticket? Almost every DevOps team uses JIRA as a standard means of issue tracking & task management. It’s a given that it would be a seamless process if you could also integrate your cloud processes with it.
June 16, 2020
Hrishikesh
AWS Use Case Files
Totalcloud Launches New Temporary Rightsizing Feature
You can't always shut down your EC2 machine outside of business hours since some machines are needed up for longer periods. Totalcloud's new downgrade feature lets you optimize your costs by letting you downgrade your machines in a fixed schedule.
June 8, 2020
Hrishikesh
AWS Use Case Files
S3 Cost Saving: Archiving Compressed S3 Data into Glacier
We've devised a new workflow to cut your archiving costs. Simplify the storage, compression, and transfer of your S3 data into S3 Glacier with 1 workflow and 8 nodes.
June 8, 2020
Hrishikesh
AWS Use Case Files
Creating a 3-tier Application With Totalcloud’s Code-Free Workflows
As part of a new request by a customer, we've developed a workflow to deploy 3-tier applications much faster. Utilising merely 3 workflows to achieve a result that would have you scripting and troubleshooting for hours. This post gives you an idea of how this workflow functions, the services being used, and how you can benefit from it.
June 2, 2020
Hrishikesh
AWS Tips & Tricks
Componentized Cloud Management: The way ahead for Cloud Automation
When something gets complex, our primary approach is to break it down — even cloud management. If you’re a part of a growing company that uses the cloud, you can see your infrastructure becoming more…
May 29, 2020
Sayonee