Convert Snapmirror DP relation to XDP in clustered Data ONTAP

With clustered Data ONTAP 8.2 snapvault (XDP) feature was introduced and the ability to convert existing snapmirror (DP) relations to snapvault (XDP) .

I had tested this feature long time ago, however, never used it in production environment. Recently i got a chance to implement this as a production volume with high change rate (snapshots involved) grew up to 60 TB (20 TB used by snapshots). Due to FAS 3250 in the cluster the max. volume size is 70 TB. After discussions with the customer it was decided to create a local snapvault copy of the production volume that would contain all existing snapshots and accumulate more in coming days until a new snapvault cluster is setup. The data in the volume is highly compressable so the snapvault destination would consume less space.

Overview of this process:

  1. Create a snapmirror DP relation
  2. Initialize the snapmirror DP relation
  3. Quiesce/Break/Delete the DP relation
  4. Resync the relation as snapmirror XDP
  5. Continue with vault updates

CREATE SOURCE VOLUME
snowy-mgmt::*> vol create -volume AU2004NP0062_vol001 -aggregate snowy01_hybdata_01 -space-guarantee none -size 1tb -junction-path /AU2004NP0066_vol001 -state online -junction-active true (volume create) [Job 85] Job succeeded: Successful snowy-mgmt::*> vol show -volume AU2004NP0062_vol001 -fields security-style (volume show) vserver volume security-style ------- ------------------- -------------- snowy AU2004NP0062_vol001 ntfs

CREATE DESTINATION VOLUME
snowy-mgmt::*> vol create -volume AU2004NP0062_vol001_sv -aggregate snowy02_hybdata_01 -space-guarantee none -size 3tb -type DP -state online (volume create) [Job 86] Job succeeded: Successful snowy-mgmt::*> vol show -volume AU2004NP0062_vol001* (volume show) Vserver Volume Aggregate State Type Size Available Used% --------- ------------ ------------ ---------- ---- ---------- ---------- ----- snowy AU2004NP0062_vol001 snowy01_hybdata_01 online RW 1TB 87.01GB 91% snowy AU2004NP0062_vol001_sv snowy02_hybdata_01 online DP 3TB 87.01GB 97% 2 entries were displayed.

CREATE SNAPMIRROR RELATION
snowy-mgmt::*> snapmirror create -source-path snowy:AU2004NP0062_vol001 -destination-path snowy:AU2004NP0062_vol001_sv -type DP -vserver snowy Operation succeeded: snapmirror create for the relationship with destination "snowy:AU2004NP0062_vol001_sv". snowy-mgmt::*> snapmirror show -type DP Progress Source Destination Mirror Relationship Total Last Path Type Path State Status Progress Healthy Updated ----------- ---- ------------ ------- -------------- --------- ------- -------- snowy:AU2004NP0062_vol001 DP snowy:AU2004NP0062_vol001_sv Uninitialized Idle - true -

INITIALIZE SNAPMIRROR
snowy-mgmt::*> snapmirror initialize -destination-path snowy:AU2004NP0062_vol001_sv Operation is queued: snapmirror initialize of destination "snowy:AU2004NP0062_vol001_sv".

CREATE SNAPSHOTS ON SOURCE VOLUME
snowy-mgmt::*> snap create -volume AU2004NP0062_vol001 -snapshot sas_snap_01 snowy-mgmt::*> snap create -volume AU2004NP0062_vol001 -snapshot sas_snap_02 snowy-mgmt::*> snap create -volume AU2004NP0062_vol001 -snapshot sas_snap_03 snowy-mgmt::*> snap create -volume AU2004NP0062_vol001 -snapshot sas_snap_04 snowy-mgmt::*> snap create -volume AU2004NP0062_vol001 -snapshot sas_snap_05 snowy-mgmt::*> snap create -volume AU2004NP0062_vol001 -snapshot sas_snap_06 snowy-mgmt::*> snap create -volume AU2004NP0062_vol001 -snapshot sas_snap_07 snowy-mgmt::*> snap create -volume AU2004NP0062_vol001 -snapshot sas_snap_08 snowy-mgmt::*> snap create -volume AU2004NP0062_vol001 -snapshot sas_snap_09 snowy-mgmt::*> snap create -volume AU2004NP0062_vol001 -snapshot sas_snap_00 snowy-mgmt::*> snapshot show -volume AU2004NP0062_vol001 ---Blocks--- Vserver Volume Snapshot State Size Total% Used% -------- ------- ------------------------------- -------- -------- ------ ----- snowy AU2004NP0062_vol001 hourly.2016-03-24_1005 valid 60KB 0% 27% snapmirror.6f937c3b-8f54-11e5-bd3f-123478563412_2147484677.2016-03-24_100529 valid 0% 33% 80KB sas_snap_01 valid 60KB 0% 27% sas_snap_02 valid 64KB 0% 29% sas_snap_03 valid 76KB 0% 32% sas_snap_04 valid 60KB 0% 27% sas_snap_05 valid 64KB 0% 29% sas_snap_06 valid 64KB 0% 29% sas_snap_07 valid 64KB 0% 29% sas_snap_08 valid 64KB 0% 29% sas_snap_09 valid 76KB 0% 32% sas_snap_00 valid 56KB 0% 26% 12 entries were displayed. snowy-mgmt::*> snapmirror show Progress Source Destination Mirror Relationship Total Last Path Type Path State Status Progress Healthy Updated ----------- ---- ------------ ------- -------------- --------- ------- -------- snowy:AU2004NP0062_vol001 DP snowy:AU2004NP0062_vol001_sv Snapmirrored Idle - true -

UPDATE SNAPMIRROR TO TRANSFER ALL SNAPSHOTS TO DESTINATION VOLUME
snowy-mgmt::*> snapmirror update -destination-path snowy:* Operation is queued: snapmirror update of destination "snowy:AU2004NP0062_vol001_sv". 1 entry was acted on.

SNAPSHOTS REACHED THE DESTINATION VOLUME
snowy-mgmt::*> snapshot show -volume AU2004NP0062_vol001_sv ---Blocks--- Vserver Volume Snapshot State Size Total% Used% -------- ------- ------------------------------- -------- -------- ------ ----- snowy AU2004NP0062_vol001_sv hourly.2016-03-24_1005 valid 60KB 0% 28% snapmirror.6f937c3b-8f54-11e5-bd3f-123478563412_2147484677.2016-03-24_100529 valid 0% 34% 80KB sas_snap_01 valid 60KB 0% 28% sas_snap_02 valid 64KB 0% 29% sas_snap_03 valid 76KB 0% 33% sas_snap_04 valid 60KB 0% 28% sas_snap_05 valid 64KB 0% 29% sas_snap_06 valid 64KB 0% 29% sas_snap_07 valid 64KB 0% 29% sas_snap_08 valid 64KB 0% 29% sas_snap_09 valid 76KB 0% 33% sas_snap_00 valid 72KB 0% 32% snapmirror.6f937c3b-8f54-11e5-bd3f-123478563412_2147484677.2016-03-24_100707 valid 0% 0% 0B 13 entries were displayed.

QUIESCE, BREAK AND DELETE SNAPMIRRORS
snowy-mgmt::*> snapmirror quiesce -destination-path snowy:AU2004NP0062_vol001_sv Operation succeeded: snapmirror quiesce for destination "snowy:AU2004NP0062_vol001_sv". snowy-mgmt::*> snapmirror break -destination-path snowy:AU2004NP0062_vol001_sv [Job 87] Job succeeded: SnapMirror Break Succeeded snowy-mgmt::*> snapmirror delete -destination-path snowy:AU2004NP0062_vol001_sv Operation succeeded: snapmirror delete for the relationship with destination "snowy:AU2004NP0062_vol001_sv". snowy-mgmt::*> snapmirror show This table is currently empty.

RESYNC SNAPMIRROR AS XDP RELATION
snowy-mgmt::*> snapmirror resync -source-path snowy:AU2004NP0062_vol001 -destination-path snowy:AU2004NP0062_vol001_sv -type XDP Warning: All data newer than Snapshot copy snapmirror.6f937c3b-8f54-11e5-bd3f-123478563412_2147484677.2016-03-24_100707 on volume snowy:AU2004NP0062_vol001_sv will be deleted. Verify there is no XDP relationship whose source volume is "snowy:AU2004NP0062_vol001_sv". If such a relationship exists then you are creating an unsupported XDP to XDP cascade. Do you want to continue? {y|n}: y [Job 88] Job succeeded: SnapMirror Resync Transfer Queued snowy-mgmt::*> snapmirror show Progress Source Destination Mirror Relationship Total Last Path Type Path State Status Progress Healthy Updated ----------- ---- ------------ ------- -------------- --------- ------- -------- snowy:AU2004NP0062_vol001 XDP snowy:AU2004NP0062_vol001_sv Snapmirrored Idle - true -

SNAPSHOTS EXIST ON BOTH SOURCE AND DESTINATION VOLUME AFTER RESYNC
snowy-mgmt::*> snapshot show -volume AU2004NP0062_vol001 ---Blocks--- Vserver Volume Snapshot State Size Total% Used% -------- ------- ------------------------------- -------- -------- ------ ----- snowy AU2004NP0062_vol001 hourly.2016-03-24_1005 valid 68KB 0% 29% sas_snap_01 valid 60KB 0% 27% sas_snap_02 valid 64KB 0% 28% sas_snap_03 valid 76KB 0% 32% sas_snap_04 valid 60KB 0% 27% sas_snap_05 valid 64KB 0% 28% sas_snap_06 valid 64KB 0% 28% sas_snap_07 valid 64KB 0% 28% sas_snap_08 valid 64KB 0% 28% sas_snap_09 valid 76KB 0% 32% sas_snap_00 valid 72KB 0% 31% snapmirror.6f937c3b-8f54-11e5-bd3f-123478563412_2147484677.2016-03-24_100707 valid 0% 31% 72KB 12 entries were displayed. snowy-mgmt::*> snapshot show -volume AU2004NP0062_vol001_sv ---Blocks--- Vserver Volume Snapshot State Size Total% Used% -------- ------- ------------------------------- -------- -------- ------ ----- snowy AU2004NP0062_vol001_sv hourly.2016-03-24_1005 valid 60KB 0% 28% snapmirror.6f937c3b-8f54-11e5-bd3f-123478563412_2147484677.2016-03-24_100529 valid 0% 34% 80KB sas_snap_01 valid 60KB 0% 28% sas_snap_02 valid 64KB 0% 29% sas_snap_03 valid 76KB 0% 33% sas_snap_04 valid 60KB 0% 28% sas_snap_05 valid 64KB 0% 29% sas_snap_06 valid 64KB 0% 29% sas_snap_07 valid 64KB 0% 29% sas_snap_08 valid 64KB 0% 29% sas_snap_09 valid 76KB 0% 33% sas_snap_00 valid 72KB 0% 32% snapmirror.6f937c3b-8f54-11e5-bd3f-123478563412_2147484677.2016-03-24_100707 valid 0% 33% 76KB 13 entries were displayed.

TURN ON VOLUME EFFICIENCY - DESTINATION VOLUME
snowy-mgmt::*> vol efficiency on -volume AU2004NP0062_vol001_sv (volume efficiency on) Efficiency for volume "AU2004NP0062_vol001_sv" of Vserver "snowy" is enabled. Already existing data could be processed by running "volume efficiency start -vserver snowy -volume AU2004NP0062_vol001_sv -scan-old-data true".

CRETE A CIFS SHARE ON SOURCE VOLUME AND COPY SOME DATA
snowy-mgmt::*> cifs share create -share-name sas_vol -path /AU2004NP0062_vol001 -share-properties oplocks,browsable,changenotify snowy-mgmt::*> vol show -volume AU2004NP0062_vol001 -fields used (volume show) vserver volume used ------- ------------------- ------ snowy AU2004NP0062_vol001 2.01GB

CREATE SNAPSHOT AND SNAPMIRROR POLICIES WITH SAME SNAPMIRROR LABLES
snowy-mgmt::*> cron show (job schedule cron show) Name Description ---------------- ----------------------------------------------------- 5min @:00,:05,:10,:15,:20,:25,:30,:35,:40,:45,:50,:55 8hour @2:15,10:15,18:15 daily @0:10 hourly @:05 weekly Sun@0:15 5 entries were displayed. snowy-mgmt::*> snapshot policy create -policy keep_more_snaps -enabled true -schedule1 5min -count1 5 -prefix1 sv -snapmirror-label1 mins -vserver snowy snowy-mgmt::*> snapmirror policy create -vserver snowy -policy XDP_POL snowy-mgmt::*> snapmirror policy add-rule -vserver snowy -policy XDP_POL -snapmirror-label mins -keep 50

APPLY SNAPSHOT POLICY TO SOURCE VOLUME
snowy-mgmt::*> volume modify -volume AU2004NP0062_vol001 -snapshot-policy keep_more_snaps Warning: You are changing the Snapshot policy on volume AU2004NP0062_vol001 to keep_more_snaps. Any Snapshot copies on this volume from the previous policy will not be deleted by this new Snapshot policy. Do you want to continue? {y|n}: y Volume modify successful on volume: AU2004NP0062_vol001

APPLY SNAPMIRROR POLICY TO DESTINATION VOLUME
snowy-mgmt::*> snapmirror modify -destination-path snowy:AU2004NP0062_vol001_sv -policy XDP_POL Operation succeeded: snapmirror modify for the relationship with destination "snowy:AU2004NP0062_vol001_sv". snowy-mgmt::*> vol show -volume AU2004NP0062_vol001 -fields snapshot-policy (volume show) vserver volume snapshot-policy ------- ------------------- --------------- snowy AU2004NP0062_vol001 keep_more_snaps snowy-mgmt::*> snapshot policy show keep_more_snaps -instance Vserver: snowy Snapshot Policy Name: keep_more_snaps Snapshot Policy Enabled: true Policy Owner: vserver-admin Comment: - Total Number of Schedules: 1 Schedule Count Prefix SnapMirror Label ---------------------- ----- --------------------- ------------------- 5min 5 sv mins

UPDATE SNAPMIRROR RELATIONSHIP (SNAPVAULT)
snowy-mgmt::*> snapmirror update -destination-path snowy:AU2004NP0062_vol001_sv Operation is queued: snapmirror update of destination "snowy:AU2004NP0062_vol001_sv". snowy-mgmt::*> snapmirror show Progress Source Destination Mirror Relationship Total Last Path Type Path State Status Progress Healthy Updated ----------- ---- ------------ ------- -------------- --------- ------- -------- snowy:AU2004NP0062_vol001 XDP snowy:AU2004NP0062_vol001_sv Snapmirrored Transferring 0B true 03/24 10:56:29

THE SIZE OF BOTH SOURCE AND DESTINATION VOLUME IS SAME
snowy-mgmt::*> vol show -volume AU* -fields used (volume show) vserver volume used ------- ------------------- ------ snowy AU2004NP0062_vol001 2.01GB snowy AU2004NP0062_vol001_sv 2.06GB 2 entries were displayed.

DEDUPE JOB IS RUNNING
snowy-mgmt::*> sis status Vserver Volume State Status Progress Policy ---------- ---------------- -------- ------------ ------------------ ---------- snowy AU2004NP0062_vol001_sv Enabled Active 539904 KB (25%) Done -

SIZE OF DESTINATION VOLUME AFTER DEDUPE JOB COMPLETED
snowy-mgmt::*> sis status Vserver Volume State Status Progress Policy ---------- ---------------- -------- ------------ ------------------ ---------- snowy AU2004NP0062_vol001_sv Enabled Idle Idle for 00:00:05 - snowy-mgmt::*> vol show -volume AU* -fields used (volume show) vserver volume used ------- ------------------- ------ snowy AU2004NP0062_vol001 2.01GB snowy AU2004NP0062_vol001_sv 274.9MB 2 entries were displayed.

START COMPRESSION JOB ON DESTINATION VOLUME BY SCANNING EXISTING DATA
snowy-mgmt::*> vol efficiency start -volume AU2004NP0062_vol001_sv -scan-old-data (volume efficiency start) Warning: This operation scans all of the data in volume "AU2004NP0062_vol001_sv" of Vserver "snowy". It may take a significant time, and may degrade performance during that time. Do you want to continue? {y|n}: y The efficiency operation for volume "AU2004NP0062_vol001_sv" of Vserver "snowy" has started.

SIZE OF DESTINATION VOLUME AFTER COMPRESSION JOB COMPLETED
snowy-mgmt::*> vol show -volume AU* -fields used (volume show) vserver volume used ------- ------------------- ------ snowy AU2004NP0062_vol001 2.01GB snowy AU2004NP0062_vol001_sv 49.76MB 2 entries were displayed.

Leave a Reply

Your email address will not be published. Required fields are marked *