Files and folders excluded from HFS Storage Protect backup

For a variety of reasons, some files are excluded from Storage Protect backup as part of our Acceptable Use Policy

Storage Protect will by default back up the data on your local hard drives and locally-attached drives.  Files excluded from backup as part of our Acceptable Use Policy fall roughly into the following categories:

  • Files holding temporary or transient data which cannot be restored in a meaningful or useful state.
  • Files that are themselves backups of data or that are automatically already backed up elsewhere.
  • Files held open by another application.
  • Files which cannot be restored due to operating system restrictions.

Generally, such files do not need to be backed up.  After a complete system failure, an operating system is best reinstalled rather than restored from backup; programs, similarly, are best reinstalled from original media/re-downloaded. Certain other exclusion rules deal with files that are difficult or even impossible to back up, such as virtual machines.  Individual user files, such as work and personal documents, are not affected by these exclusions.  The advantages of the exclusions are therefore as follows:

  • Backups are less likely to fail, as temporary and open files often cannot be backed up and thus can cause errors to occur.
  • Less data is sent during backup, using up fewer resources in terms of:
    • Backup duration.  Backups will run more quickly.
    • Quantity of data.  With less data sent, users are likely to run for a shorter time, and the Storage Protect server will need to store less data.

List of excluded files and folders

A summary of the excluded files is provided below.

The exclusion rules on all Windows systems can be found in the Storage Protect configuration file (dsm.opt) located in C:\Program Files\tivoli\tsm\baclient. The file contains editable text and configuration information for the backup-archive client.

The following are excluded by default from backup on all Windows systems:

  • Browser caches - temporary internet files from e.g. Internet Explorer, Firefox, Chrome or Opera.
  • Other temporary folders. Users who run programs such as Abaqus, which keeps its files in C:\temp, should change the relevant program's default directory setting to ensure that their files are backed up.
  • Backups, such as Windows File History and ARCserve ctf files
  • Microsoft SQL Server database files
  • The Recycle Bin
  • Virtual machines
  • Suspected 'infected' files quarantined by Sophos
  • Offline Spotify data
  • Shared network drives

To view the complete list of the default exclude rules for your Storage Protect node, you must first visit the HFS Backup Services Portal. After selecting your node name, navigate to the Configuration tab and click on the dsm.opt file. Please note that the default configuration files do not display any custom exclude rules.

The exclusion rules on all macOS systems can be found in the Storage Protect configuration file (dsm.sys) located in /Library/Preferences/Tivoli Storage Manager. The file contains editable text and configuration information for the backup-archive client.

The following are excluded by default from backup on all macOS systems:

  • Browser caches, temporary internet files from applications such as Safari, Firefox, Chrome or Opera
  • Some other temporary folders, such as /private/tmp
  • Backups, such as Time Machine
  • BBC iPlayer downloads
  • The Trash folder
  • Virtual machines

To view the complete list of the default exclude rules for your Storage Protect node, you must first visit the HFS Backup Services Portal. After selecting your node name, navigate to the Configuration tab and click on the dsm.sys file. Please note that the default configuration files do not display any custom exclude rules.

The exclusion rules on all Linux systems can be found in the Storage Protect configuration file (dsm.sys) located in /usr or /opt/tivoli/tsm/client/ba/bin. The file contains editable text and configuration information for the backup-archive client.

The following are excluded by default from backup on all Linux systems:

  • Browser caches - temporary internet files from e.g. Firefox, Chrome or Opera
  • Some other temporary folders
  • The Trash/Wastebasket folder
  • Virtual machines
  • a.out, /var/log/lastlog and core files

To view the complete list of the default exclude rules for your Storage Protect node, you must first visit the HFS Backup Services Portal. After selecting your node name, navigate to the Configuration tab and click on the dsm.sys file. Please note that the default configuration files do not display any custom exclude rules.

You can also view an up-to-date list of the exclusion rules from within the Storage Protect software by one of the two following methods.

  • Graphical interface: Click Edit, then Client Preferences and then the Include-Exclude tab
  • Command line interface:
dsmc query inclexcl

You might notice that the above 'dsmc query inclexcl' command will show you your current exclusion rules as well as the operating system exclusion rules.

You can also view which files are included and excluded for backup by browsing the Storage Protect graphical interface. Click Backup to open the backup window.  Browse through your files/folders found under Local on the left-hand side. Items marked with a barred red circle (no-entry sign) will not be backed up. Files which are visible without a red barred circle are those which can be backed up.

If you need to back up excluded files

Please note that it is entirely possible to back up any of the excluded files mentioned above, however, we strongly advise against removing any existing rules. If assistance is required, please contact hfs@ox.ac.uk. Additionally, instructions on creating exclude rules are available. These instructions can help you understand the existing exclude rules on your machine.

Related links

Get support

If you cannot find the solution you need here then we have other ways to get IT support

Get IT support

 

Submit a suggestion, compliment or complaint