This ingestion method uses PostgreSQL streaming replication in combination with a backup initiated by the Delphix Continuous Data Engine, between the source and staging databases.

Prerequisites

Ensure that you meet the following requirements before you begin creating a dSource.

  • The environment requirements are met by the source and staging environments as described in  Requirements for PostgreSQL Staging/Target environments.

  • To use privilege elevation, you must meet the Sudo Privilege Requirements. 

  • The OS or privileged user must have the following permissions:

    • access to the Postgres commands

    • read+write+execute permissions on the unix_socket_directories configured in postgresql.conf file (The default directories are /var/run/postgresql & /tmp).

For more information, refer to Requirements and Prerequisites. 

Limitation

For PostgreSQL versions 9.4 and 9.5, the connector creates the staging instance as a warm standby. This instance is not accessible because it is always in recovery mode and does not allow any connection.

Procedure

After you add an environment and create a source configuration, continue with the following method-specific steps in the Create and Link dSource wizard.

  1. In the Source tab, do the following:

    1. In the NFS Mount Location field, provide a mount location on the staging environment.

    2. If using Privilege Elevation, provide the username of the Privileged OS Account.Once the dSource is created, you will not be able to update the privileged OS account. Recreating the dSource account is the only way to make changes.

  2. Select the Delphix Initiated Backup - Postgres Cluster Ingestion Flag checkbox to allow Delphix to initiate the physical backup on the source database.

  3. Click +Add next to the Delphix Initiated Backup/External Backup - Streaming Replication Parameters. Click +Add only once. The solution supports a single backup path; providing multiple paths will cause an error during linking.

  4. Provide the values in the following fields.

    1. Delphix Initiated Backup - Postgres Cluster Ingestion Flag: Must be selected to allow Delphix to initiate the physical backup.

    2. PostgresDB Replication User: Replication user on the source database.

    3. PostgresDB Replication User Password: Password for the replication user.

    4. Source Host Address: Hostname or IP address of the PostgreSQL source.

    5. Source Instance Port Number: Port on which the source PostgreSQL instance listens.

    6. Staging Instance Port Number: A port number that is free and unique on the staging instance.

  5. Optionally, define database configuration parameters in the Config Settings section as needed. You can configure parameters and their values in the postgresql.conf file using the Config Settings section. For example, to support replication slots, specify the primary_slot_name parameter and its value. To disable a parameter, specify the parameter name and select the Comment Property check box; this comments out the parameter in the configuration file.

  6. Click Next.

  7. Provide a dSource name and select a group for your dSource. Adding a dSource to a dataset group allows you to manage user permissions for that database and its objects, including snapshots.

  8. Specify your staging environment, user, and snapshot parameters. Select the Resynchronize dSource checkbox if you want to resynchronize the dSource. This operation will force a non-incremental load of data from the source. This operation is similar to creating a new dSource, but prevents duplication of the storage requirements and maintains timeflow history. Click Next to proceed.

  9. Apply policy details to the dSource if needed, and then click Next.

  10. Select a Hook Point and then click + to add a script that you want to run at that hook point. You can define scripts to run at multiple hook points.

  11. Review the configuration profile for your dSource and click Submit.

  12. The Delphix Continuous Data Engine will initiate two jobs, namely DB_Link and DB_Sync to create the dSource.

  13. Monitor the jobs by selecting Admin > Operations in the top menu bar. On successful completion of the DB_Link job, the database icon changes to a dSource icon under Data > Data Management > dSources. The dataset must not be disabled after failed or canceled RESYNC job. For more information, read the Best practices for the RESYNC job topic.

  14. After the dSource is created successfully, open the dSource Configuration tab to view details and make modifications to policies and permissions.

  15. In the Datasets panel, select the specific dSource and navigate to the Configuration tab to view source files, data management configuration, and hook operations.

In the case of a Delphix-initiated backup, the streaming replication process is continuously monitored by reading the PostgreSQL database logs every minute. If the streaming replication stops for any reason, a fault is generated and an error message is displayed under the Status tab. If the streaming replication encounters a fault and stops, the snapshot operation will also fail.

Last updated
Oct 9, 2026