You Can’t Afford to Put All Of Your Data in the Cloud

Do they call it a cloud because the costs are sky high?

The public cloud has long been seen as an affordable alternative to on-premises data storage, but it turns out that is not always the case. Depending on how much data you store in the cloud, and in a world of exploding data creation we all now have massive volumes of data, the costs can be several times that of storing the data on-premises.

This was highlighted by a recent Blocks and Files article which stated that a financial analyst found that the cost of using an Amazon file system to store a petabyte of data in can be “400 per cent more per month than storing it in an on-premises all-flash file store”. That figure includes the cost of a full-time storage admin to manage the data and replication costs.

Yes, 400% more. And that is just the beginning.

That number does not include hosting data in multiple regions, which can double the costs, or snapshots and ingress/egress charges, which further drive up the price. The egress charges in particular can add to the costs of cloud storage.

Big Data applications, such as Splunk, that store cold and frequently accessed data in an object store can be significantly impacted by those high egress charges. You can read about why that is here.

The Cloud Paradox

As these high costs become a burden on organizations, many are faced with the cloud paradox, where there is a tipping point for cloud storage. For smaller organizations with limited data sets, the cloud is the best, most affordable option. There is a point however, where data sets become large enough that the cloud data storage costs becomes a massive burden on the organization. 

Is there a better way?

Big Data and modern applications have moved to storing data in an object store. The Pavilion HyperParallel Data Platform is the most performant and dense solution available for fast object storage. Using Pavilion organizations can continue to use their applications that run in S3, on local high-performance flash storage. They can also tier to the cloud for affordable, long-term archival.

Still, one of the main benefits of cloud storage is its ability to scale on demand. Fortunately, the unique architecture of the Pavilion HyperParallel Data Platform allows a seamless linear scaling of performance and or capacity to support the largest data sets.

Contact us to learn more about how Pavilion can help you avoid the high costs of the cloud.