How To Easily Delete Large S3 Buckets?

Deleting an Amazon S3 bucket can be a difficult task. It is even a bigger task if it has a large number of objects in it because you cannot delete non-empty buckets.

Automated solutions such as ‘S3cmd’ or ‘S3nukem’ would either break or take weeks to delete an S3 bucket depending on its size and the number of objects in it.

The best approach is to use AWS, which comes with the benefit of a self-service platform and provides an option of setting lifecycle policy for S3 objects.

AWS lifecycle policies help in defining actions on Amazon S3 during an object’s lifetime. For example, transitioning objects to another storage class, archiving them, or deleting them after a specified period.

Using a shared prefix (that is, objects that have names that begin with a common string), you can define the lifecycle policy for all objects or a subset of objects in the S3 bucket. And using a lifecycle policy, you can define actions specific to current and non-current object versions.

Note: The objects inside the AWS S3 would be gone forever after a day.

This solution is not instant but it takes a day to execute, which is faster than other solutions.

Here’s How to Set Lifecycle of an S3 Bucket

  • Log in to the AWS Management Console and open the Amazon S3 console at https://console.aws.amazon.com/s3/.
  • To create a lifecycle policy for a bucket, choose the name of the bucket from the Bucket name list.

How to Easily Delete Large S3 Buckets?
  • Choose the Management tab, and then choose Add lifecycle rule.

How to Easily Delete Large S3 Buckets?

  • Give the rule a name and click Next if you want to delete the whole bucket. Also, you can set the lifecycle rule for objects with a specified name prefix (that is, objects with names that begin with a common string), limit the lifecycle rule scope to one or more object tags, and combine a prefix and several tags.

How to Easily Delete Large S3 Buckets?

  • Click Next on the Transitions tab without any changes.
  • Select the options as shown in the image below.

How to Easily Delete Large S3 Buckets?

  • Verify the settings for your rule under Review.
  • If you need to make changes, choose Previous. Otherwise, click Save.

How to Easily Delete Large S3 Buckets?

From now on, AWS does the dirty work for you. S3 will do its own housekeeping, and after a day, everything inside your bucket will be deleted.

This approach can be used if you regularly create stacks with CloudFormation or Terraform, and the buckets won’t delete if there are objects in them.

Instead of writing scripts and adding to the workload you can easily setup lifecycle rules to take action on the AWS S3.

There are a number of things that can be accomplished using lifecycle rules. You can read more about them below.

Object Lifecycle Management

How Do I Create a Lifecycle Policy for an S3 Bucket?

Learn how lifecycle policies can help with cost optimization here

How To Easily Delete Large S3 Buckets?

Smart Scheduling at your fingertips

Go from simple to smart, real-time AWS resource scheduling to save cost and increase team productivity.

Learn More
More Posts

You Might Also Like

DevOps World
Effective Transition to Remote Working for DevOps
The COVID-19 pandemic has changed the work culture among DevOps, take advantage of these proven strategies to maintain productivity. Everything from cloud migration to automation tools and work culture is addressed to keep you going strong.
April 6, 2020
Hrishikesh
Product
Cloud Parking
Our automated Cloud Parking offers more scalability and flexibility than the standard AWS Instance Scheduler, guaranteeing you reasonable billing of your Cloud Architecture.
March 24, 2020
Sayonee
AWS Tips & Tricks
The Proven Practices for Successful AWS Cost Optimization
Running your AWS cloud architecture can be expensive, you need to adopt strategies that tried and tested to bring down your expenses. Here are the best AWS cost optimization strategies available currently.
March 4, 2020
Hrishikesh
AWS Tips & Tricks
AWS Cost Optimization Checklist
Want to cut down on the costs of maintaining your cloud services? Here's a list of things you need to make sure when running your AWS architecture.
March 2, 2020
Hrishikesh
AWS Tips & Tricks
How to Schedule RDS Instances with an AWS Lambda function?
Save your costs with scheduled operation of your database. Start and stop the RDS instances manually with python Lambda functions.
February 25, 2020
Hrishikesh
Product
Introducing the TotalCloud Smart Scheduler
Announcing the launch of the TotalCloud Resource Scheduler! Take complete advantage of AWS's 'pay for what you consume' model by putting a power control for every AWS resource that you use.
January 14, 2020
Sayonee