How to backup the data on nodes in a Cluster Box to an external device

In the near future I will resume performing backups of the 1.3 TB of data stored on SSDs attached to the Cluster Box nodes. The nodes are part of a Ceph cluster with one OSD per node and run an NFS Server (Ganesha) to export this data to external hosts. Internal network traffic runs through the PCIe switch, external traffic through the GbE port on the Control Board.

Now I must find out how to transfer the data stored in the Ceph cluster to a backup device (possibly an LTO drive): I could connect such a device to one of the nodes via 2.5 GbE (for iSCSI) or USB-C (whereas there are no USB-based LTO drives, only RDX ones). This solution, however, would require all data to be read by the node in question and then transferred through 2.5 GbE resp. USB to the external drive.

So: Does anyone have a hint on how to attach a backup device to the Cluster Box without overwhelming the cluster with data, preferably one which runs well with Ceph?

Don’t attach the tape drive to one Cluster Box node; that forces every byte through that node and its 2.5GbE/USB path. Put the LTO drive on a separate backup host on the GbE side, mount the Ganesha export read-only, and stream it to tape (tar or your backup tool) with bandwidth throttling (cgroup/tc or the tool’s rate limit). For consistency, take a CephFS snapshot first and read from the export’s .snap/<name> path, then release it after the tape job. If the data is RBD rather than CephFS, snapshot the RBD and export that read-only instead.

1 Like