Traditionally, backup has been time consuming and cost-heavy, even when updating incrementally. This situation has largely been due to the reliance on file-level based backups, mostly using the Network Data Management Protocol (NDMP). But block-level storage backups are changing that paradigm, making it possible to create backups in much less time and at a fraction of the cost of tape- and NDMP-based methods for NAS backup.
In this blog we’ll take a look at some of the problems with file-level backups, how block-level backups with NetApp Cloud Backup work, and why they’re faster and more cost effective.
Read on, or use the links below to jump down to the sections on:
For a technology that has been relied on for years, file-level back up methods—including those that rely on NDMP—suffer from extreme inefficiencies. These inefficiencies can cost you time and money.
For a technology that has been relied on for years, file-level back up methods—including those that rely on NDMP—suffer from extreme inefficiencies. These inefficiencies can cost you time and money. But first, let’s explain the difference between file-level and block-level backups.
When we describe backups as “file-level” it means that they back up entire files and update entire files, even if only single data blocks within that file have changed since the previous backup was created.
When we describe backups as being “block-level” what we mean is that these backups update only individual, changed data blocks as opposed to updating entire files. Snapshot technology is integral to creating these block-based backups.
Block-level backups are much more efficient than file-level backups.
What’s the reason behind file-level backup’s inefficiency? There are multiple factors involved.
The amount of data that needs to be copied and moved from the data source to the backup destination varies significantly depending on the type of backup.
The issue with the file-level backup method is that copying over entire files will inevitably copy over more data than has been changed since the last backup has been created. For example, if a 1 TB file contains 3 KBs that have changed, the entire 1 TB file needs to be copied over.
Backing up entire files like this takes time and puts a lot of stress on the network. The more time it takes to create a backup, the more likely that changes to the live copy won’t make it over to the current backup. That means data loss, a red flag for effective backup systems.
Traditional NDMP-based backup solutions can only perform up to nine consecutive incremental backups. After that point, they need to create an entirely new full backup copy. That’s a time-consuming and costly task.
Typically, these systems are configured to perform five daily backups followed by a full backup over the weekend.
But for businesses that operate 24/7/365, the weekend may not offer the luxury to pause the system while that full backup is created. That means there will be some significant data loss between the primary and the copy.
Since NDMP-based file-level backups can’t directly access the cloud, they leverage mediators to get the data from your ONTAP system to the storage repository.
NDMP-based solutions first transfer data from the backup source to the media server in its raw format without storage efficiencies (deduplication and compression). Then it is moved from the media server to the backup destination.
There are a number of issues with the use of media gateways:
Block-level backups solve the problems inherent with file-based backups, and NetApp offers them with NetApp Cloud Backup.
When ONTAP stores data, whether it’s in a file system or any other storage format, it organizes that data into chunks of 4 KB in size. These 4 KB aggregations are referred to as “blocks.” A single file can contain many 4 KB blocks. Note that these ONTAP blocks are unrelated to the “block” in the similarly named block storage technology.
Cloud Backup leverages ONTAP 4 KB data block structure and NetApp Snapshot™ technology to implement block-level backup for file storage which makes back up and restore operations more efficient and much faster.
Cloud Backup leverages object storage to create backup copies that are stored in object storage housed either in the cloud or in on-prem NetApp StorageGRID® appliances.
Cloud Backup’s block-level backups can simplify your ONTAP backup operations with more agility and more reliability:
This high performance is possible thanks to a number of features that solve the problems that hamper file-level backups. Let’s take a look at them each in detail.
NetApp Cloud Backup is block-level.
Unlike file-level backups, Cloud Backup’s block-level incremental backup method only copies the data blocks that have changed after the initial copy is created.
This provides several advantages over traditional NDMP-based backup solutions that perform file-level incremental backups.
Cloud Backup is incremental forever.
Another unique advantage of using NetApp Cloud Backup is that after the one-time initial full backup is created, subsequent backups are incremental forever. This drastically minimizes the overall amount of data that needs to be transferred, contributing to its unmatched efficiency.
When there’s no need for periodic full backups, operations become much more efficient and there is less chance of missing a backup window.
Cloud Backup creates backups directly.
Another operational advantage is that Cloud Backup backs up and restores directly from source to destination while preserving ONTAP storage efficiencies end-to-end. This is not the case for traditional backup solutions which require a media server in between the source and destination.
NetApp Cloud Backup moves data directly from the ONTAP source to the object storage destination while preserving all of the existing ONTAP storage efficiencies.
The advantages to directly backing up with Cloud Backup include:
Cloud Backup is a hybrid and multicloud solution.
Cloud Backup gives users more flexibility about how they deploy their backup storage architecture, offering a way to leverage either entirely cloud-based, entirely on-prem, or hybrid and multicloud solutions.
Cloud Backup is also available in all the regions available in these clouds.
This kind of flexibility is unmatched and simply not possible using NDMP-based backup solutions. For ONTAP users still looking to implement their first cloud service, Cloud Backup seamlessly integrates existing NetApp systems with pay-as-you-go object storage on AWS, Azure, or Google Cloud. Read more about what makes backup the perfect test workload for the cloud.
Cloud Backup can even be of use in the most restrictive environments, where absolutely all internet connectivity is prohibited, such as those required by certain governmental and military organizations. Using the software-only option of BlueXP, Cloud Backup can be deployed in a dark-site mode that does not require any internet access. All backups are stored efficiently in on-premises object storage using NetApp StorageGRID appliances.
To give you an idea of how all of the above advantages translate into operational efficiency, here’s a comparison of a traditional NDMP-based backup solution with Cloud Backup.
Let’s take 100TB of ONTAP NAS data that needs to be backed up daily. We’ll make some rough assumptions about this data set for simplicity:
Using the file-level NDMP solution:
Over the weekend, there is a full backup, which moves 100 TB from the source to the media server and then 70 TB (deduped and compressed) from the media server to the destination. For the daily backups, the traditional NDMP solution moves 5 TB (5% of 100 TB) to the media server, and then 3.5 TB (5 TB with 30% deduped and compressed) to the backup destination.
The total backup traffic a week for traditional backup is (5 TB+3.5 TB) x 5 + 100 TB + 70 TB = 212.5 TB.
Using block-level Cloud Backup:
Once a day NetApp Cloud Backup moves 0.7 TB (20% of 5% of the 100 TB, with 30% deduped and compressed) from the ONTAP source to the backup destination.
The total traffic per week is 4.9 TB (0.7 TB x 7). In this scenario, Cloud Backup consumes 96.7% less network bandwidth than a traditional NDMP backup solution.
That level of efficiency means that data is backed up significantly faster with less risk of failure and less chance of network congestion that could interfere with production traffic.
As we’ve seen in this article, file-level backups can’t handle today’s demanding workload requirements. They simply can’t be created fast enough to ensure backup windows stay on target without data loss. Plus, file-level backups with the NDMP technology can’t leverage cloud storage and require media gateways that cost any of your existing storage efficiencies. The technology can’t keep up, and costs you more to maintain.
Block-based backups offer a superior experience, one that doesn’t risk losing data during backup operations. backups can fully leverage.
Cloud Backup gives users an easy way to create block storage backups on object storage service of your choice of public cloud or on a StorageGRID appliance on-prem. Besides the benefits of backing up data at the block level, Cloud Backup offers a number of additional benefits:
These various parts all come together to make Cloud Backup a faster and more secure enterprise-grade solution for backup and restore.