Skip to Content

Control-M for GCP Data Fusion

Google Cloud Platform (GCP) Data Fusion is an extract, transform, and load (ETL) service that enables you to load data from multiple sources, visualize it, and publish it to the cloud.

Control-M for GCP Data Fusion enables you to do the following:

  • Execute single or Workflow Template GCP Data Fusion pipelines, abort a pipeline, and get third-party job logs.
  • Manage GCP Data Fusion credentials in a secure connection profile.
  • Connect to any GCP Data Fusion endpoint.
  • Integrate GCP Data Fusion pipelines with other Control-M jobs into a single scheduling environment.
  • Monitor the status, results, and output of GCP Data Fusion pipelines in the Monitoring domain.
  • Attach an SLA job to your GCP Data Fusion jobs.
  • Introduce all Control-M capabilities to Control-M for GCP Data Fusion, including advanced scheduling criteria, complex dependencies, Resource Pools, Lock Resources, and variables.
  • Run 50 GCP Data Fusion jobs simultaneously per Agent.

Control-M for GCP Data Fusion Compatibility

The following table lists the Control-M for GCP Data Fusion plug-in prerequisites, each with its minimum required version.

Component

Version

Control-M/EM

9.0.21.100

Control-M/Agent

9.0.21.100

Control-M Application Integrator

9.0.21.100

Control-M Automation API

9.0.21.125

Control-M for GCP Data Fusion is supported on Control-M Web and Control-M Automation API, but not on Control-M client.

To download the required installation files for each prerequisite, see Obtaining-Control-M-Installation-Files.

Setting Up Control-M for GCP Data Fusion

This procedure describes how to deploy the GCP Data Fusion plug-in, create a connection profile, and define a GCP Data Fusion job in Control-M Web and Automation API.

Warning

Note

Integration plug-ins released by BMC require an Application Integrator installation. However, these plug-ins are not editable, and you cannot import them into Application Integrator. To deploy these integrations to your Control-M environment, must import them directly into Control-M using Control-M Automation API.

Before You Begin

Verify that Automation API is installed, as described in Automation API Installation.

Begin

  1. Create a temporary directory to save the downloaded files.
  2. Download the GCP Data Fusion plug-in from the Control-M for GCP Data Fusion download page in the EPD site.
  3. Install the GCP Data Fusion plug-in using the Automation API Provision service:
    1. Log in to the Control-M/EM Server machine as an Administrator and store the downloaded zip file in the one of the following locations (within several minutes, the job type appears in Control-M Web):
      • Linux: $HOME/ctm_em/AUTO_DEPLOY
      • Windows: <EM_HOME>\AUTO_DEPLOY
    2. Log in to the Control-M/Agent machine and run the provision image command, as follows:
      • Linux: ctm provision image GCP_Data_Fusion_plugin.Linux
      • Windows: ctm provision image GCP_Data_Fusion_plugin.Windows
  4. Create a GCP Data Fusion connection profile in Control-M Web or Automation API, as follows:
  5. Define a GCP Data Fusion job in Control-M Web or Automation API, as follows:
Warning

Note

To remove this plug-in from an Agent, see Removing a Plug-in. The plug-in ID is GDU102023.

 

Tip: For faster searching, add an asterisk to the end of your partial query. Example: cert*

Control-M