Replication with Externally-Initiated backup provided by the user in DCT

This initial backup is provided by the user. To ensure that the staging database remains in sync with the source database, Delphix Continuous Data Engine sets up a MySQL native replication from the source database to the staging database. In this method, Delphix Continuous Data Engine creates a staging database using an initial backup from the source database. For more information, read Replication with Externally-Initiated backups provided by the user (binlog replication).

Prerequisites

Before you begin ingestion and creating a dSource, ensure that you meet the following requirements.

• The environment requirements are met by the source and staging environments as described in Requirements for MySQL source hosts and Requirements for MySQL staging/target hosts.

• The environment user must have the necessary permissions to access the MySQL commands.

• A default MySQL database installation must be available on the staging environment. For more information, refer to Requirements and Prerequisites. 

Procedure

To create a dSource using the Externally-Initiated single database backup ingestion.

1. Log in to DCT.

2. Add a source config against the discovered staging or target MySQL environment . For more information, read Create a source configuration for Connectors in DCT,

3. Go to Data>dSources tab and click +dSource.

4. On the Select Data Source page, select the MySQL dSource.

5. Once the MySQL dSource is selected, the following configuration settings will appear. Do the following: 

   1. Select Replication from the Ingestion Type dropdown, it’ll show all the fields relevant to the Replication ingestion mechanism.
      
   2. Staging DB Server ID: It is the Server ID for the dSource database. This server ID must be greater than the Source DB server ID for Replication Mode to work.

   3. Staging DB Port: It is the port number to be used by the staging dSource instance.

      Any other application or MySQL server should not use this port.

   4. Staging Initialization Password: It is the Password that the connector uses when it initializes the staging database MySQL instance. This password will be assigned to the 'root' user of the staging database. This password will be used only for the first time the staging database instance is initialized.

      Once replication starts, this password will be updated with Source DB’s root user password. 

   5. MySQL Base Directory: Provide the location of the MySQL installation directory. This generally has the location of /bin/mysql.

   6. Mount Location on Staging Host: It is the Delphix mount directory on the staging host.This location should be unique and unoccupied. Additionally, refer to Requirements for MySQL staging/target hosts to understand user privileges to create mount directories.

   7. IP Address of the Source DB Host: It is the IP address or FQDN of the source host.

   8. Source DB UserName: Delphix Continuous Data Engine database user on the source database. Delphix Continuous Data Engine will use this DB user to manage the dSource and other sync operations. 

   9. Source DB Password: It is the password for the source database user.

   10. Full path (including filename) to MySQL Backup: It is the full path, including the filename, to the full source database backup to use for dSource creation. 

   11. Provide different Replication users: It is the users can provide different replication user credentials by selecting this check box, as illustrated in the image below. Providing separate replication user credentials is optional. If this check box is not selected, the source database user provided above will be used for replication. 
       

   12. Replication UserName: User with replication privileges to configure replication from source to staging db. If this user is not provided, then the Delphix Continuous Data Engine uses the Source DB user for replication, as mentioned in steps g and h.

   13. Replication User’s Password: It is the password for the Replication UserName.

6. On the dSource Configuration screen, select the dataset group where the dSource will be placed and click Next.

7. Select the staging environment and the environment user on the Data Management screen.

   Select the Resynchronize dSource under the Snapshot Parameters section to initialize and refresh the MySQL staging database.

8. Click Next.

9. (Optional) On the Policies page, select the SnapSync and Retention policies if required for the dSource and click Next.

10. On the Hooks page, add any pre-sync and/or post-sync hooks as needed, and then click Next.

11. On the Summary screen, review the dSource configuration and click Submit. The Linking process has commenced. Wait for the snapshot to be created. From that snapshot, you can now provision a MySQL VDB.