Why Microsoft Data Protection Manager Will Replace Your SharePoint Tape Backups

* This article was written in the context of System Center Data Protection Manager 2006 (SCDPM), a technology now considered deprecated with the introduction of System Center Data Protection Manager 2007. Variations may exist. *

Why Microsoft Data Protection Manager Will Replace Your SharePoint Tape Backups
Typically, within organizations it is common to have a backup strategy where your critical SharePoint data is backed up to tape, and either taken to secure on-site locations or to a designated off-site sheltered faculty. Tape backups have been a reliable way to backup SharePoint data for an extended period of time, however this type of disaster recovery, although typically reliable, tends to be slow for restoration of crucial business processes.
The Three Types of Backups Processes
There are three main types of backups that exist for SharePoint (there are obviously several others that can exist, however in the context of this particular article):
  • Disk-to-Tape (DtT)
  • Disk-to-Disk (DtD)
  • Disk-to-Disk-to-Tape (DtDtT)
The latter of the three is the most advanced, and relevant to a DPM implementation protecting a SharePoint environment. Although legacy networks are most familiar with DtT backups, this method alone is not advantageous to a SharePoint environment which needs a more agile disaster recovery framework so the business processes and the environment that information workers are used to can be ensured.
The second of the three, Disk-to-Disk backups, are much different that Disk-to-Tape backups for one overlying reason. Instead of populating backup material to a tape directly, it is copied to another server within your network, typically a network/file share. Similarly, within a Disk-to-Disk-to-Tape strategy, your SharePoint data is backed up into a network shared, and then pulled off that share onto a tape for offsite storage, while maintained on the file share for agile backups.
Why Combine Tapes with a Disk-To-Disk Strategy
Why are these two methods being combined anyways? It seems that in the long run, with a Disk-to-Disk-to-Tape strategy, there is a mixture of steps that could otherwise be handled with a simple Disk-to-Tape backup strategy. While this is true, one of the benefits of implementing Microsoft Data Protection Manager is that it allows automation of these steps in order to protect your SharePoint environment.
Picture first your SharePoint environment. Assume that you are involved with a medium sized company, around 5,000 employees each of which is heavily dependent on your SharePoint implementation for line of business applications and facilitating communications and collaborations within virtual teams in your organization. Your arbitrary SharePoint implementation is a medium server farm consisting of two front-end web servers, a separate server that facilitates indexing and job functions, and a backend SQL server. Within your SharePoint implementation are several file shares exposed as well which house certain content which don’t necessitate the need of revision controls which are provided by SharePoint such as .iso and .exe installation files (maintained in the blocked files list to protect the portal from malware). Within your SharePoint environment you also have 1 server dedicated to DPM processes that help to facilitate disaster recovery within your environment providing full fidelity backups for your 250 SharePoint site collections.
These site collections are critical for your business operations for multiple reasons, including however not limited to document repositories, revision controls, task management, and integration with a Team Foundation Server implementation providing your developers and program managers insight into your Software Development Lifecycle (SDLC) and work item tracking.
In the legacy backup strategy, your environment database files are placed on tape and moved off-site every morning at 2:00 a.m. in order to harvest the most recent data and not interfere with user activity.
Your CEO just uploaded a critical document to a document library whose subject is the quarterly fiscal budget, also including a PowerPoint presentation that is going to be shown to shareholders. Without these vital metrics, there will be less interest in the company and it is feasible that some of the shareholders may pull their funding and throw the company into a financial disarray.
And Then, a Catastrophe Occurs
Disaster strikes. Another user accidentally uploaded a document infected with a piece of malware that essentially turned your SharePoint server into a large paper weight, corrupting several pieces of functional SharePoint data and brining down your farm. Your CEO is in a state of panic because of the implications of not having the presentation and document available, and he is holding you responsible.
You tell him not to worry because as the SharePoint administrator you have rights to gain access to the tape backups. However, the CEO loaded the document at 9:00 a.m. this morning working on it feverishly all evening, making it not feasible for you to actually reload the document, so his work has been lost and now there is a possibility of shareholders not observing relevant metrics, and losing interest in the organization.
With DPM, this situation could be avoided. Using DPM, you can make a full backup of your SharePoint data (after export) and file stores so that if any relevant data is lost at anytime during the day, it can be restored, even in hourly increments. Once that data has been modified in coordination with the synchronization schedule, it will be pushed block by block into your backup files, ensuring that business critical data can immediately be pushed back into your environment.
This means that the CEO will be able to bring up the corporate portal during his meeting with shareholders, and even though his file was uploaded to the document library at 9:00 it can still be restored in enough time that he will have all of his relevant assets he needs to ensure his shareholders that they are making the right investment. Even better, since the CEO should have access to the relevant backups, he can even invoke the DPM UI and restore the backup himself. Other users can take advantage of this feature as well, depending on permissions that you set up. If the CEO didn’t have access, assuming he is not incredibly tech savvy and therefore his access is restricted to certain resources, you will most likely be responsible for restoring his relevant system status. This is easily done through the DPM UI, which is easy to facilitate through a Windows Explorer type snap-in, for both you as the administrator of the SharePoint environment as well as your users.
The Shrinking Window of Data Backups
Eliminating this 2:00 a.m. restoration process is eradicating the shrinking window of database backup. More and more data is needed to be backed up relating to your SharePoint environment, and there is less and less time during a 24 hour window for you to create these backups. The shrinking window isn’t large concern when you have an implementation of DPM since the data is constantly backed up for you to restore whenever problems may occur with your portal, which is quite useful for proper disaster recovery.
As described before, as the SharePoint administrator responsible or your network, you are responsible for proper disk allocations and how your backups are stored. Having space for multiple versions of large SharePoint environments might seem to be not advantageous for an environment based on disk-to-disk data storage, it would take up a fair amount of space if you have multiple SharePoint site collections with large content repositories!
Adaptive Copies Within Microsoft Data Protection Manager
DPM handles this type of allocation quite nicely by using adaptive copies, only moving the changes so that you can save disk space for an environment that can have incredibly large backups already pegged with network bandwidth allocations issues since users are typically relying heavily on SharePoint for virtual team environments. Even more relevant to SharePoint is that while users are currently hitting your portal environment backups can still be made of the file stores, which is crucial for a communications and collaborations platform which is typically under constant use.
Unhealthy Storage Limits Within A Disaster Recovery System
DPM will also warn you if you are exceeding an unhealthy storage limit, which by DPM standards is if you hit a threshold of 75%. This is an atypical situation, and should realistically cause two courses of actions.
1. What are my physical storage options, do I have proper disk allocation?
2. Would my DPM configurations be causing this issue?
DPM has several inherit calculations built into it that will help you as the SharePoint administrator. Using a disk-to-disk-to-tape backup solution further should emphasize why you should not be getting these types of messages, since your legacy data should eventually work its way off the disk-to-disk portion of the backup solution and should eventually move to a tape for off-site storage.
Errors Due To Lack of Space
Within a SharePoint environment, since the data is constantly changing, the cause of these types of errors is because within a platform that promotes virtual teams that data is changing constantly, and DPM upon initialization will make intelligent configuration options as to how fast your backup data will change. If the data changes over this threshold, the shadow copies of the data will grow to quickly and will cause DPM to become confused.
Solving this issue quickly is easy, by adding more space. The two options for adding more space are:
1. Add more disks
2. Increase the storage allocation of the DPM server

Introduction to Microsoft Data Protection Manager Integration With SharePoint

* This article was written in the context of System Center Data Protection Manager 2006 (SCDPM), a technology now considered deprecated with the introduction of System Center Data Protection Manager 2007. Variations may exist. *

Introduction to Microsoft Data Protection Manager Marriage with SharePoint
A proper SharePoint environment should encompass all aspects involved in a traditional networked computing infrastructure; particularly since SharePoint is or will become the chief repository for business information. One of the most overlooked aspects however of a SharePoint environment is that of disaster recovery and proper data restoration processes in case of an emergency to mitigate several levels of risks.
We don’t have a SharePoint disaster recovery plan, and aren’t really looking to spend any more additional funds on our SharePoint deployment, so would prefer to negate the requirement.
How many times has it been heard with enterprises implementing SharePoint?
SharePoint Disaster Recovery Isn’t an Option, It’s a Requirement   
Having a disaster recovery plan for your SharePoint deployment isn’t an option; it’s a necessity in order to protect precious enterprise data. Enterprises will expunge an unlimited amount of funds extending the rich functionality of SharePoint, however when it comes to actually setting up methods and procedures that are meant to enhance the security and disaster recovery of a portal, the benefits of it seem negligible.
This is one of the biggest fallacies that exist within implementing a communications and collaborations platform within a company. Not having mechanisms that facilitate recovery of your critical business data will not only cause your network and SharePoint administrators hesitation, but if any type of disaster occurs, you will only have remedial mechanisms to work with to bring line of business applications back to your information workers that need it.
There are three main things that we wish to gain out of a DPM implementation in relation to our SharePoint environment:
  1. Provide Uninterrupted and Constant Data Protection
  2. Provide Easy Mechanisms for Backup Restoration Intended for Both Users and Administrators
  3. Provide Mechanisms For Central Management For Data Protection Mechanisms
Provide Uninterrupted and Constant Data Protection  
With disk-to-tape backups, constant data protection is not possible since users are typically leveraging the portal at undetermined times and the amount of data that changes within a SharePoint portal happen at all times during the day, tapes are usually meant to run at arbitrary times within an enterprise. Exporting the data to a flat file and protecting it with DPM however a viable option is. Similarly, you can schedule the SQL backups through various clients or use the SharePoint backup utility to create scheduled backups that are stored on a file server which can then be protected with DPM.
Provide Easy Mechanisms for Backup Restoration Intended for Both Users and Administrators
DPM provides mechanisms that allow a user and administrator to easily restore backup files using a windows explorer like interface. These tools interact with the speed and reliability of using the DPM backup mechanisms, allowing backups to be granular restored depending on the permissions that you see fit.  Notifications and reports can also be sent to users that you deem are necessary to see such metrics.
Provide Mechanisms For Central Management For Data Protection Mechanisms
Interaction between DPM and Microsoft Operations Manager offer more granular control over your backup strategy and relevant servers (such as your backup file server and your DPM servers as a whole). There are inherit tools that allow you to generate DPM relevant reports, fine tune your DPM environment by examining backup metrics, and enable notifications for possible problems within your backup environment.
Assuming you are using SharePoint, it can also be assumed that you are also leveraging the Microsoft Operations Framework, which plays a pivotal functional within the management of aggregate IT assets and overall SharePoint operations.  It is important to realize the MOF is like the MSF (Microsoft Solutions Framework), in that it is an approach of best practices and approaches to your environment, and not an actual bundled piece of software. There are four main portions that exist within the Microsoft Operations Framework, optimizing, changing, supporting, and operating. In relation to the marriage of Data Protection Manager and SharePoint, we are concerned with two main quadrants of this, supporting and operating since we are concerned about supporting our line of business applications and communications and colorations environment and operating since we must provide our user with the environment which enables virtual teams so that process within the enterprises can remain optimal.
The SharePoint Backup and Restoration Process Using Data Protection Manager The DPM Backup Process 
The backup and restore process for protecting your SharePoint environment depends greatly on the data that you consider to have a low user tolerance for loss, and that which can be restored by using SharePoint media (such as SharePoint file stores). However, in an arbitrary backup process involving a backup of our SQL databases:
  1. SharePoint SQL files are exported to flat files and placed onto a protected share on the file server (support for SQL will be built in the second half of 2007)
  2. DPM will create a replica of these sources on the DPM server
  3. The changed data is sent back and forth between the file server and the DPM server
  4. DPM will also create shadow copies which allow revision control over point in time backups
This backup process will allow a user to choose which revision to restore either from the administrator or client console.
The DPM Restore Process
The restore process using Data Protection Manager can happen either from a user or as the DPM administrator.
  1. A SharePoint user or DPM administrator will choose a specified SQL backup to restore from a client tool that resembles the Windows Explorer interface
  2. DPM will restore the backup to the file server where it can be re-imported into the SQL database

Introduction to Microsoft Data Protection Manager

* This article was written in the context of System Center Data Protection Manager 2006 (SCDPM), a technology now considered deprecated with the introduction of System Center Data Protection Manager 2007. Variations may exist. *

Overlooked Aspects

A proper SharePoint environment should cover all aspects involved in a traditional computing environment, plus more since SharePoint can serve as the basic repository for all of your business information and business processes. One of the most overlooked aspects of a SharePoint environment however is that of disaster recovery and proper data transport planning and storage in case of an emergency, to mitigate several types of data loss risks.
Data Storage
In regards to data storage, there are variety of methods, tactics, and software appliances that network architects typically implement to ensure that their data integrity is sound and that in the rare case of any type of disaster, typical business operations can continue as planned. DPM can either be a new instance of this type of activity, or for an enterprise virgin to DR can be the primary player.
Purpose of DPM
So what is the purpose of DPM? It serves several purposes, integrating with other sister server platforms to encompass what Microsoft calls the Microsoft System Center. Other products that make up this category are Microsoft Operations Manager (MOM) and Microsoft Systems Manager Server (SMS), however are not necessary if you are solely interested in the data backup options of DPM. The main reason that DPM is becoming more commonplace within those environments that leverage SharePoint is because of the disaster recovery options that exist within it, protecting your investment in your collaborations platform and more importantly the data within your SharePoint repositories.
Cost of Ownership
As your SharePoint environment becomes larger and larger, aggregating more and more business information, performing a routine with tape backup can become a costly and arduous issue. The reason to introduce DPM into your SharePoint environment is to take your central data repository, and transport this data to a central host, simplifying what is typically a large headache for systems administrators.
Simplifying Things
DPM is a way of simplifying things. If you are using SharePoint, then you are familiar with process reengineering to take tasks that were formally larger manual and laborious (i.e. document management and control, creating dashboards, and implementing effective collaboration environments), and moving them to platforms that allow you to automate, and increase the speed of them.