Staging push

The Staging Push ingestion method transfers the responsibility of preparing the dSource to the end user. Unlike the Staging Pull model, where the Delphix Continuous Data Engine prepares the dSource, Staging Push lets you manually push source data into the mount path backed by Delphix storage. This offers an alternative approach when your backup or replication workflow is better managed externally.

The Staging Push ingestion method has been verified with the following mechanisms:

• Backups + Logs w/ pgBackRest

• Backups + Logs w/ pg_basebackup

• Logical Replication

• pg_dump and pg_restore

• Streaming Replication

Prerequisites

Ensure that you meet the following requirements before you begin creating a dSource.

• The environment requirements are met by the source and staging environments as described in Requirements for PostgreSQL Staging/Target environments.

• To use privilege elevation, you must meet the Privilege Elevation Requirements. 

For more information, refer to Requirements and Prerequisites. 

Procedure

Perform the following steps to create a dSource using the Staging Push ingestion method.

After you add an environment and create a source configuration, continue with the following method-specific steps in the Create and Link dSource wizard.

1. In the Source tab, do the following:

   1. In the NFS Mount Location field, provide a mount location on the staging environment.

   2. Select the Use Staging Push checkbox.

   3. Specify the Staging Instance Port Number. You must provide a port number that is available for the staging instance.

   4. Click Next. 

2. Provide a dSource name and then select a group for your dSource. Adding a dSource to a dataset group allows you to manage user permissions for that database and its objects, including snapshots. For more information, read Users and Groups.

3. Specify your staging environment, user, and snapshot parameters. Select the Resynchronize dSource checkbox if you want to resynchronize the dSource. This operation will force a non-incremental load of data from the source. This operation is similar to creating a new dSource, but prevents duplication of the storage requirements and maintains timeflow history. Click Next to proceed.

4. Apply policy details to the dSource if needed, then click Next.

5. Select a hook point and then click + to add a script you want to run at that hook point. You can define scripts to run at multiple hook points.

6. Review the configuration profile for your dSource and click Submit.

7. Click Submit. The Delphix Continuous Data Engine will initiate two jobs, DB_Link and DB_Sync, to create the dSource. Monitor the jobs by selecting Admin > Operations in the top menu bar. On successful completion of the DB_Link job, the database icon changes to a dSource icon under Data > Data Management > dSources.

   When staging push is opted, Postgres connector only mounts the Delphix storage on Staging host, it does not initialize a dummy PostgreSQL cluster