AWS S3 Bucket limitations

Software systems always have some limits, reasons for limitations can varies. Hard limits boils down to limitations of underlying hardware resources. Soft limits can be to avoid noisy neighbor problems, that's where rate-limiting, service quotas comes into place.

Let's explore on limitations of AWS S3 bucket


 

Number of S3 buckets in a AWS Account

By default, you can create up to 100 buckets in each of your AWS accounts. If you need additional buckets, you can increase your account bucket limit to a maximum of 1,000 buckets by submitting a service limit increase. There is no difference in performance whether you use many buckets or just a few.

TL;DR; 1000 buckets per account

Cannot change S3 Bucket name or Region

When you create a bucket, you choose its name and the AWS Region to create it in. After you create a bucket, you can't change its name or Region.

Reuse S3 bucket name

You can reuse S3 bucket name, but.. when you delete the bucket and the name becomes available for reuse, another AWS account might create a bucket with that name. In addition, some time might pass before you can reuse the name of a deleted bucket.

TL;DR; If you want to reuse bucket name, safe option is don't delete it ;)


Comments

Post a Comment

Popular posts from this blog

Gradient descent algorithm in Machine learning

Image
Machine Learning and Deep Learning commonly uses Gradient descent (GD) to find a local minimum/maximum of a given function. Gradient descent minimises a cost/loss function (e.g. in a linear regression). In mathematical terms, Gradient descent is a way to minimize an objective function J(θ) parameterized by a model’s parameters θ ∈ Rd by updating the parameters in the opposite direction of the gradient of the objective function ∇θJ(θ) w.r.t. to the parameters. The learning rate η determines the size of the steps we take to reach a (local) minimum. In other words, we follow the direction of the slope of the surface created by the objective function downhill until we reach a valley. There are three variants of gradient descent, which differ in how much data we use to compute the gradient of the objective function. Choice of variant depends on accuracy and time taken to compute parameters. Batch Gradient descent A batch gradient descent, computes the gradient of the cost function w.r.t. to
Read more

Linux limits on threads per process

Image
I came across an interesting learning on number of threads a process can hold. # of threads per process = total virtual memory / (stack size*1024*1024) Increase in virtual memory can directly leads to increase in # threads per process. Virtual memory can be at most swap memory Increase in stack size decreases # of threads per process Check Virtual Memory:  ulimit -v (default is unlimited, thus you need to increase swap memory to increase this) Total Stack Size: ulimit -s (default is 8Mb) Command to update these values: ulimit -s newvalue ulimit -v newvalue Reference https://dustycodes.wordpress.com/2012/02/09/increasing-number-of-threads-per-process/
Read more