---+ Grid Backup Policy A discussion on backing up important data from the Grid nodes. %TOC% ---++ Requirements The most important consideration is to make adequate back ups of all relevant log files. A requirement of the !GridPP [[http://www.gridpp.ac.uk/security/inchand/procedure.html][security incident handling policy]] is that all Grid related logs be available for 3 months and all ssh logs be available for 6 months. In addition, it is important that all server certificates are backed up, along with yaim configuration files. There are also specific considerations for different machines, depending on their role. PBS accounting data should be saved from CEs. The accounting database on the MONBox should also be saved. It is important to backup the DPM database from the storage nodes as well. ---++ Implementation The general strategy for backing up data is as follows: 1 The !MONBox will copy data from relevant nodes into the directory =epgmo1:/backup/=. This directory is NFS mounted from =epgsr1:/disk/f15d/=. 1 The directory structure in =epgmo1:/backup/<node>= should mirror the actual directory structure on the node. 1 Cfengine will be responsible for copying the relevant data from the nodes back to epgmo1. It is envisaged that a special cfrun should be made for the purposes of this task, as copying some data (eg !MySQL dumps) will take a long time. This task will be controlled by a cron job set to run at an appropriate time every day. 1 Most files can be copied "as is", ie straight from =<node>= to =epgmo1=. The !MySQL dumps will have to first be created, and then given an appropriate unique name. The action of dumping the !MySQL databases should be controlled via a cron job, initially distributed by cfengine. 1 The backup directories on =epgmo1= should be periodically rync'ed to BlueBEAR. This should again be controlled by a cron job on epgmo1, which in turn should be managed by cfengine. ---++ List of files currently backed up | *Machine* | *Files* | *Life Span* | | epgce1 ||| | epgce2 ||| | epgce3 ||| | epgce4 ||| | epgr01 ||| | epgr02 ||| | epgr03 ||| | epgr04 ||| | epgse1 ||| | epgsr1 ||| | epaf17 ||| | epgmo1 ||| | Twins ||| -- Main.ChristopherCurtis - 03 Feb 2010
This topic: Computing
>
GridBackup
Topic revision: r1 - 03 Feb 2010 - _47C_61UK_47O_61eScience_47OU_61Birmingham_47L_61ParticlePhysics_47CN_61christopher_32curtis
Copyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki?
Send feedback