Control-M for GCP Data Fusion

Google Cloud Platform (GCP) Data Fusion is an extract, transform, and load (ETL) service that enables you to load data from multiple sources, visualize it, and publish it to the cloud.

Control-M for GCP Data Fusion enables you to do the following:

  • Connect to any GCP Data Fusion endpoint from a single computer with secure login, which eliminates the need to provide authentication.
  • Integrate GCP Data Fusion pipelines with other Control-M jobs into a single scheduling environment.
  • Execute single or Workflow Template GCP Data Fusion pipelines.
  • Abort a pipeline and receive logs.
  • Monitor the status, results, and output of GCP Data Fusion pipelines in the Monitoring domain.
  • Attach an SLA job to your GCP Data Fusion jobs.
  • Introduce all Control-M capabilities to Control-M for GCP Data Fusion, including advanced scheduling criteria, complex dependencies, Resource Pools, Lock Resources, and variables.
  • Run 50 GCP Data Fusion jobs simultaneously per Agent.

Setting Up Control-M for GCP Data Fusion

This procedure describes how to install the GCP Data Fusion plug-in, create a connection profile, and define a GCP Data Fusion job in Helix Control-M and Automation API.

Before You Begin

  • Verify that Automation API is installed, as described in Setting up the API.
  • Verify that Agent version 9.0.21.080 or later is installed.

Begin

  1. On the Agent host, set the Java environment variable by running one of the following commands through a command line:
    • Linux:
      • Bourne Shell/Bash: export BMC_INST_JAVA_HOME=<java_11_directory>
      • csh/tcsh: setenv BMC_INST_JAVA_HOME <java_11_directory>
    • Windows: set BMC_INST_JAVA_HOME="<java_11_directory>"
  2. Run one of the following API commands:
    • For a fresh installation, use the provision image command:
      • Linux: ctm provision image  GCP_Data_Fusion_plugin.Linux
      • Windows: ctm provision image GCP_Data_Fusion_plugin.Windows
    • To upgrade, use the following command:
      ctm provision agent::update
  3. Create a GCP Data Fusion connection profile in Helix Control-M or Automation API, as follows:
  4. Define a GCP Data Fusion job in Helix Control-M or Automation API, as follows:

Note

To remove this plug-in from an Agent, follow the instructions in Removing a Plug-in. The plug-in ID is GDU102023.

Was this page helpful? Yes No Submitting... Thank you

Comments