Yugabyte linking operations

dSource creation via CLI

To create a dSource via CLI, you must create a source configuration first. For more information on creating a source configuration, refer to Add Source Config using CLI.

To create a dSource and perform operations via CLI, log in to the Delphix Continuous Data Engine using the admin user account.

ssh admin@dlpx-engine.delphix.com 

Set default linking parameters

Run the below commands to set the default linking parameters. The below example uses testscfg source config.

Example

database link 
set type=LinkParameters 
set linkData.type=AppDataStagedLinkData	 
set name=testds 
set group=Untitled 
set linkData.config=testscfg 
set linkData.environmentUser=yb-load-tgt1/delphix_os 
set linkData.stagingEnvironment=yb-load-tgt1 
set linkData.stagingEnvironmentUser=yb-load-tgt1/delphix_os 
set linkData.syncParameters.parameters={\"resync\":true} 

Link parameters for ingestion using Staging Pull

Run the below commands to link parameters:

AWS S3 Staging Pull example

set source.parameters="{ \ 
  \"dsource\":\"Staging Pull\", \ 
  \"mount_path\":\"/mnt/provision/testvdb\", \ 
  \"ip_addr\":\"yb-load-tgt2.dcol2.delphix.com\", \ 
  \"platform_address\":\"https://<YOUR_YA_URL>\", \ 
  \"platform_api_key\":\"<YOUR_API_KEY>\", \ 
  \"ssh_private_key_path\":\"/home/delphix_os/.ssh/yba_key.pem\", \
  \"universe_name\":\"test_universe\", \ 
  \"backup_storage_type\":\"S3\", \
  \"backup_location\":\"s3://<bucket>/univ-<id>\", \
  \"use_iam_instance_profile\":true, \
  \"aws_default_region\":\"us-east-1\", \
  \"database_names\":\"yb_demo\", \ 
  \"enable_authentication\":true, \ 
  \"authentication_details\":{ \ 
    \"password\":\"delphixpwd\" \ 
  }, \ 
  \"additional_nodes\":[ \ 
    { \ 
      \"host_ref\":\"yb-load-tgt2\", \ 
      \"user_ref\":\"yb-load-tgt2/delphix_os\", \ 
      \"ip_addr\":\"10.0.0.21\" \ 
    }, \ 
    { \ 
      \"host_ref\":\"yb-load-tgt3\", \ 
      \"user_ref\":\"yb-load-tgt3/delphix_os\", \ 
      \"ip_addr\":\"10.0.0.22\" \ 
    } \ 
  ], \ 
  \"tuning_params\":[ \ 
    { \ 
      \"server_type\":\"Master\", \ 
      \"parameter_name\":\"default_memory_limit_to_ram_ratio\", \ 
      \"parameter_value\":\"0.8\" \ 
    }, \ 
    { \ 
      \"server_type\":\"TServer\", \ 
      \"parameter_name\":\"default_memory_limit_to_ram_ratio\", \ 
      \"parameter_value\":\"0.8\" \ 
    } \ 
  ], \ 
  \"port_list\":{ \ 
    \"master_rpc_port\":7100, \ 
    \"tserver_rpc_port\":9100, \ 
    \"tserver_pgsql_port\":5433, \ 
    \"tserver_csql_port\":9042 \ 
  } \ 
}" 
commit 

Azure Staging Pull example

set source.parameters="{ \
          \"dsource\":\"Staging Pull\", \
          \"mount_path\":\"/mnt/provision/testvdb\", \
          \"ip_addr\":\"yb-stage.example.com\", \
          \"platform_address\":\"https://<YOUR_YA_URL>\", \
          \"platform_api_key\":\"<YOUR_API_KEY>\", \
          \"ssh_private_key_path\":\"/home/delphix_os/.ssh/yba_key.pem\", \
          \"universe_name\":\"test_universe\", \
          \"database_names\":\"yb_demo\", \
          \"backup_storage_type\":\"Azure\", \
          \"backup_location\":\"https://<account>.blob.core.windows.net/<container>/univ-<id>\", \
          \"azure_storage_sas_token\":\"<SAS_TOKEN>\", \
          \"enable_authentication\":false, \
          \"port_list\":{\"master_rpc_port\":7100,\"tserver_rpc_port\":9100,\"tserver_pgsql_port\":5433,\"tserver_csql_port\":9042}}"
      commit

Seed example

Seed does not use backup storage parameters. Load data into the empty universe after linking.

set source.parameters="{ \
        \"dsource\":\"Seed\", \
        \"mount_path\":\"/mnt/provision/testvdb\", \
        \"ip_addr\":\"yb-stage.example.com\", \
        \"ssh_private_key_path\":\"/home/delphix_os/.ssh/yba_key.pem\", \
        \"universe_name\":\"test_universe\", \
        \"database_names\":\"yb_demo\", \
        \"enable_authentication\":false, \
        \"additional_nodes\":[], \
        \"tuning_params\":[], \
        \"port_list\":{\"master_rpc_port\":7100,\"tserver_rpc_port\":9100,\"tserver_pgsql_port\":5433,\"tserver_csql_port\":9042}, \
        \"tls_management_mode\":\"Disabled\" \
      }"
      commit

Optional parameters include azure_storage_sas_token, use_iam_instance_profile, aws_access_key_id, aws_secret_access_key, aws_default_region, enable_authentication, authentication_details, additional_nodes, tuning_params, port_list, tls_management_mode, tls_cert_label, tls_root_cert_path, tls_root_key_path, tls_node_cert_path, tls_node_key_path, tls_client_cert_path, and tls_client_key_path.

Commit

Run the below command to commit the change:

commit;

Disable

Run the below command to disable the dSource.

Example

source 
select testdb 
disable 
commit 

Enable

Run the below command to enable the dSource.

Example

source 
select testdb 
enable 
commit