Job types


The following series of sections provide details about the available types of jobs that you can define and the parameters that you use to define each type of job. 

Job:Command

The following example shows how to use the Job:Command to run operating system commands.

"JobName": {
"Type" : "Job:Command",
   "Command" : "echo hello",
       "PreCommand": "echo before running main command",
       "PostCommand": "echo after running main command",
   "Host" : "myhost.mycomp.com",
   "RunAs" : "user1"  
}

Host

Defines the name of the host machine where the job runs. A Control-M/Agent must be installed on this host. Optionally, you can define a host group instead of a host machine.

NOTE : If this parameter is left blank, the job is submitted for execution on the Control-M Scheduling Server host.

RunAs

Identifies the operating system user that will run the job.

PreCommand

(Optional) A command to execute before the job is executed.

PostCommand

(Optional) A command to execute after the job is executed.

Back to top

Job:Script

 The following example shows how to use Job:Script to run a script from a specified script file.

    "JobWithPreAndPost": {
       "Type" : "Job:Script",
       "FileName" : "task1123.sh",
       "FilePath" : "/home/user1/scripts",
       "PreCommand": "echo before running script",
       "PostCommand": "echo after running script",
       "Host" : "myhost.mycomp.com",
       "RunAs" : "user1",
"Arguments":[
"arg1",
       "arg2"
]  
   }

FileName together with FilePath

Indicates the location of the script. 

NOTE: Due to JSON character escaping, each backslash in a Windows file system path must be doubled. For example, "c:\\tmp\\scripts".

PreCommand

(Optional) A command to execute before the job is executed.

PostCommand

(Optional) A command to execute after the job is executed.

Host

Defines the name of the host machine where the job runs. A Control-M/Agent must be installed on this host. Optionally, you can define a host group instead of a host machine. 

NOTE : If this parameter is left blank, the job is submitted for execution on the Control-M Scheduling Server host.

RunAs

Identifies the operating systems user that will run the job.

Arguments

(Optional) An array of strings that are passed to the script.

Back to top

Job:EmbeddedScript

The following example shows how to use Job:EmbeddedScript to run a script that you include in the JSON code. Control-M deploys this script to the Agent host during job submission. This eliminates the need to deploy scripts as part of your application stack.

    "EmbeddedScriptJob":{
       "Type":"Job:EmbeddedScript",
       "Script":"#!/bin/bash\\necho \"Hello world\"",
       "Host":"myhost.mycomp.com",
       "RunAs":"user1",
       "FileName":"myscript.sh",
       "PreCommand": "echo before running script",
       "PostCommand": "echo after running script"
   }

Script

Full content of the script, up to 64 kilobytes.

Host

Defines the name of the host machine where the job runs. A Control-M/Agent must be installed on this host. Optionally, you can define a host group instead of a host machine.

NOTE : If this parameter is left blank, the job is submitted for execution on the Control-M Scheduling Server host.

RunAs

Identifies the operating systems user that will run the job.

FileName

Name of a script file. This property is used for the following purposes:

  • The file extension provides an indication of how to interpret the script. If this is the only purpose of this property, the file does not have to exist.
  • If you specify an alternative script override using the OverridePath job property, the FileName property indicates the name of the alternative script file.

PreCommand

(Optional) A command to execute before the job is executed.

PostCommand

(Optional) A command to execute after the job is executed.

Back to top

Job:FileTransfer

The following example shows a Job:FileTransfer for a file transfer from a local filesystem to an SFTP server:

{
 "FileTransferFolder" :
 {
"Type" : "Folder",
"Application" : "aft",
"TransferFromLocalToSFTP" :
{
"Type" : "Job:FileTransfer",
"ConnectionProfileSrc" : "LocalConn",
"ConnectionProfileDest" : "SftpConn",
       "NumberOfRetries": "3",
"Host": "AgentHost",
"FileTransfers" :
[
{
"Src" : "/home/controlm/file1",
"Dest" : "/home/controlm/file2",
"TransferType": "Binary",
"TransferOption": "SrcToDest"
},
{
"Src" : "/home/controlm/otherFile1",
"Dest" : "/home/controlm/otherFile2",
"TransferOption": "DestToSrc"
}
]
}
 }
}

Here is another example for a file transfer from an S3 storage service to a local filesystem:

{
"MyS3AftFolder": {
  "Type": "Folder",
  "Application": "aft",
  "TransferFromS3toLocal":
  {
     "Type": "Job:FileTransfer",
     "ConnectionProfileSrc": "amazonConn",
     "ConnectionProfileDest": "LocalConn",
     "NumberOfRetries": "4",
     "S3BucketName": "bucket1",
     "Host": "agentHost",
     "FileTransfers": [
        {
"Src" : "folder/sub_folder/file1",
"Dest" : "folder/sub_folder/file2"
        }
      ]
  }
}
}

Here is another example for a file transfer from an S3 storage service to another S3 storage service:

{
"MyS3AftFolder": {
  "Type": "Folder",
  "Application": "aft",
  "TransferFromS3toS3":
  {
     "Type": "Job:FileTransfer",
     "ConnectionProfileSrc": "amazonConn",
     "ConnectionProfileDest": "amazon2Conn",
     "NumberOfRetries": "6",
     "S3BucketNameSrc": "bucket1",
     "S3BucketNameDest": "bucket2",
     "Host": "agentHost",
     "FileTransfers": [
        {
"Src" : "folder/sub_folder/file1",
"Dest" : "folder/sub_folder/file2"
        }
      ]
  }
}
}

And here is another example for a file transfer from a local filesystem to an AS2 server.

Note: File transfers that use the AS2 protocol are supported only in one direction — from a local filesystem to an AS2 server.

{
 "MyAs2AftFolder": {
   "Type": "Folder",
   "Application": "AFT",
   "MyAftJob_AS2":
   {
     "Type": "Job:FileTransfer",
     "ConnectionProfileSrc": "localAConn",
     "ConnectionProfileDest": "as2Conn",
     "NumberOfRetries": "Default",
     "Host": "agentHost",
     "FileTransfers": [
       {
         "Src": "/dev",
         "Dest": "/home/controlm/",
         "As2Subject": "Override subject",
         "As2Message": "Override conntent type"
       }
      ]
   }
 }
}

The following parameters were used in the examples above:

Parameter

Description

Host

Defines the name of the host machine where the job runs. A Control-M/Agent must be installed on this host.
In addition, Control-M File Transfer plug-in version 8.0.00 or later must be installed.

ConnectionProfileSrc

The connection profile to use as the source

ConnectionProfileDest

The connection profile to use as the destination

ConnectionProfileDualEndpoint

If you need to use a dual-endpoint connection profile that you have set up, specify the name of the dual-endpoint connection profile instead of ConnectionProfileSrc and ConnectionProfileDest.

A dual-endpoint connection profile can be used for FTP, SFTP, and Local filesystem transfers. For more information about dual-endpoint connection profiles, see ConnectionProfile:FileTransfer:DualEndPoint.

NumberOfRetries

Number of connection attempts after a connection failure

Range of values: 0–99 or "Default" (to inherit the default)

Default: 5 attempts

S3BucketName

For file transfers between a local filesystem and an Amazon S3 or S3-compatible storage service: The name of the S3 bucket

S3BucketNameSrc

For file transfers between two Amazon S3 or S3-compatible storage services: The name of the S3 bucket at the source

S3BucketNameDest

For file transfers between two Amazon S3 or S3-compatible storage services: The name of the S3 bucket at the destination

FileTransfers

A list of file transfers to perform during job execution, each with the following properties:

   Src

Full path to the source file

   Dest

Full path to the destination file

   TransferType

(Optional) FTP transfer mode, either Ascii (for a text file) or Binary (non-textual data file).

Ascii mode handles the conversion of line endings within the file, while Binary mode creates a byte-for-byte identical copy of the transferred file.

Default: "Binary"

   TransferOption

(Optional) The following is a list of the transfer options:

  • SrcToDest - transfer file from source to destination
  • DestToSrc - transfer file from destination to source
  • SrcToDestFileWatcher - watch the file on the source and transfer to destination only when all criteria is met
  • DestToSrcFileWatcher - watch the file on the destination and transfer to source only when all criteria is met
  • FileWatcher - watch a file, and if successful, the succeeding job will run.
  • 9.0.20.000

     DirectoryListing– list the source and destination files

  • 9.0.20.000

     SyncSrcToDest– scan source and destination, transfer only new or modified files from source to destination, and delete destination files that do not exist on the source

  • 9.0.20.000

     SyncDestToSrc– scan source and destination, transfer only new or modified files from destination to source, and delete source files that do not exist on the destination

Default: "SrcToDest"

   As2Subject

Optional for AS2 file transfer: A text to use to override the subject of the AS2 message.

   As2Message

Optional for AS2 file transfer: A text to use to override the content type in the AS2 message.

The following example presents a File Transfer job in which the transferred file is watched using the File Watcher utility:

{
 "FileTransferFolder" :
 {
"Type" : "Folder",
"Application" : "aft",
"TransferFromLocalToSFTPBasedOnEvent" :
{
"Type" : "Job:FileTransfer",
"Host" : "AgentHost",
"ConnectionProfileSrc" : "LocalConn",
"ConnectionProfileDest" : "SftpConn",
       "NumberOfRetries": "3",
"FileTransfers" :
[
{
"Src" : "/home/sftp/file1",
"Dest" : "/home/sftp/file2",
"TransferType": "Binary",
"TransferOption" : "SrcToDestFileWatcher",
"PreCommandDest" :
{
"action" : "rm",
"arg1" : "/home/sftp/file2"
},
"PostCommandDest" :
{
"action" : "chmod",
"arg1" : "700",
"arg2" : "/home/sftp/file2"
},
"FileWatcherOptions":
{
"MinDetectedSizeInBytes" : "200",
"TimeLimitPolicy" : "WaitUntil",
"TimeLimitValue" : "2000",
"MinFileAge" : "3Min",
"MaxFileAge" : "10Min",
"AssignFileNameToVariable" : "FileNameEvent",
"TransferAllMatchingFiles" : true
}
}
]
}
 }
}

This example contains the following additional optional parameters: 

PreCommandSrc

PreCommandDest

PostCommandSrc

PostCommandDest

Defines commands that occur before and after job execution.
Each command can run only one action at a time.

Action

Description

chmod

Change file access permission:

arg1: mode

arg2: file name

mkdir

Create a new directory

arg1: directory name

rename

Rename a file/directory

arg1: current file name

arg2: new file name

rm

Delete a file

arg1: file name

rmdir

Delete a directory

arg1: directory name

FileWatcherOptions

Additional options for watching the transferred file using the File Watcher utility:

    MinDetectedSizeInBytes

Defines the minimum number of bytes transferred before checking if the file size is static

    TimeLimitPolicy/
    TimeLimitValue

Defines the time limit to watch a file:
TimeLimitPolicy options:”WaitUntil”, "MinutesToWait"

TimeLimitValue: If TimeLimitPolicy: WaitUntil, the TimeLimitValue is the specific time to wait, for example 04:22 would be 4:22 AM.
If TimeLimitPolicy: MinutesToWait, the TimeLimitValue is the number of minutes to wait.

    MinFileAge

Defines the minimum number of years, months, days, hours, and/or minutes that must have passed since the watched file was last modified

Valid values: 9999Y9999M9999d9999h9999Min

For example: 2y3d7h

    MaxFileAge

Defines the maximum number of years, months, days, hours, and/or minutes that can pass since the watched file was last modified

Valid values: 9999Y9999M9999d9999h9999Min

For example: 2y3d7h

    AssignFileNameToVariable

Defines the variable name that contains the detected file name

    TransferAllMatchingFiles

Whether to transfer all matching files (value of true) or only the first matching file (value of false) after waiting until the watching criteria is met.

Valid values: true | false
Default value: false

Back to top

Job:FileWatcher

A File Watcher job enables you to detect the successful completion of a file transfer activity that creates or deletes a file. The following example shows how to manage File Watcher jobs using Job:FileWatcher:Create and Job:FileWatcher:Delete

    "FWJobCreate" : {
   "Type" : "Job:FileWatcher:Create",
"RunAs":"controlm",
    "Path" : "C:/path*.txt",
   "SearchInterval" : "45",
   "TimeLimit" : "22",
   "StartTime" : "201705041535",
   "StopTime" : "201805041535",
   "MinimumSize" : "10B",
   "WildCard" : true,
   "MinimalAge" : "1Y",
   "MaximalAge" : "1D2H4MIN"
   },
   "FWJobDelete" : {
       "Type" : "Job:FileWatcher:Delete",
       "RunAs":"controlm",
       "Path" : "C:/path.txt",
       "SearchInterval" : "45",
       "TimeLimit" : "22",
       "StartTime" : "201805041535",
       "StopTime" : "201905041535"
   }

This example contains the following parameters:

Path

Path of the file to be detected by the File Watcher

You can include wildcards in the path — * for any number of characters, and ? for any single character.

SearchInterval

Interval (in seconds) between successive attempts to detect the creation/deletion of a file

TimeLimit

Maximum time (in minutes) to run the process without detecting the file at its minimum size (for Job:FileWatcher:Create) or detecting its deletion (for Job:FileWatcher:Delete). If the file is not detected/deleted in this specified time frame, the process terminates with an error return code.

Default: 0 (no time limit)

StartTime

The time at which to start watching the file

The format is yyyymmddHHMM. For example, 201805041535 means that the File Watcher will start watching the file on May 4, 2018 at 3:35 PM.
Alternatively, to specify a time on the current date, use the HHMM format.

StopTime

The time at which to stop watching the file.

Format: yyyymmddHHMM or HHMM (for the current date)

MinimumSize

Minimum file size to monitor for, when watching a created file

Follow the specified number with the unit: B for bytes, KB for kilobytes, MB for megabyes, or GB for gigabytes.

If the file name (specified by the Path parameter) contains wildcards, minimum file size is monitored only if you set the Wildcard parameter to true.

Wildcard

Whether to monitor minimum file size of a created file if the file name (specified by the Path parameter) contains wildcards

Values: true | false
Default: false

MinimalAge

(Optional) The minimum number of years, months, days, hours, and/or minutes that must have passed since the created file was last modified. 

For example: 2Y10M3D5H means that 2years, 10 months, 3 days, and 5 hours must pass before the file will be watched. 2H10Min means that 2 hours and 10 minutes must pass before the file will be watched.

MaximalAge

(Optional) The maximum number of years, months, days, hours, and/or minutes that can pass since the created file was last modified.

For example: 2Y10M3D5H means that after 2years, 10 months, 3 days, and 5 hours have passed, the file will no longer be watched. 2H10Min means that after 2 hours and 10 minutes have passed, the file will no longer be watched.

Back to top

Job:Database

The following types of database jobs are available:

Job:Database:EmbeddedQuery

The following example shows how to create a database job that runs an embedded query.

{
    "PostgresDBFolder": {  
"Type": "Folder",
        "EmbeddedQueryJobName": {
          "Type": "Job:Database:EmbeddedQuery",
          "ConnectionProfile": "POSTGRESQL_CONNECTION_PROFILE",
          "Query": "SELECT %%firstParamName AS VAR1 \\n FROM DUMMY \\n ORDER BY \\t VAR1 DESC",
          "Host": "${agentName}",
          "RunAs": "PostgressCP",
          "Variables": [
             {
   "firstParamName": "firstParamValue"
             }
          ],
  "Autocommit": "N",
  "OutputExecutionLog": "Y",
  "OutputSQLOutput": "Y",
  "SQLOutputFormat": "XML"
     }
}

This example contains the following parameters:

Host

Defines the name of the host machine where the job runs. A Control-M/Agent must be installed on this host, as well as Control-M Databases plug-in version 9.0.00 or later.

Optionally, you can define a host group instead of a host machine.  

NOTE: If this parameter is left blank, the job is submitted for execution on the Control-M Scheduling Server host.

Query

The embedded SQL query that you want to run.

The SQL query can contain auto edit variables. During job run, these variables are replaced by the values that you specify in Variables parameter (next row).

For long queries, you can specify delimiters using \\n (new line) and \\t (tab).

Variables

Variables are pairs of name and value. Every name that appears in the embedded script will be replaced by its value pair.

The maximum length of a variable name is 38 alphanumeric characters and it is case-sensitive.
The variable name cannot begin with a number and must not contain blank spaces or any of the following special characters:
< > [ ] { } ( ) = ; ` ~ | : ? . + - * / & ^ # @ ! , " '

The following optional parameters are also available for all types of database jobs:

Autocommit

(Optional) Commits statements to the database that completes successfully

Default: N

OutputExecutionLog

(Optional) Shows the execution log in the job output

Default: Y

OutputSQLOutput

(Optional) Shows the SQL sysout in the job output

Default: N

SQLOutputFormat

(Optional) Defines the output format as either Text, XML, CSV, or HTML

Default: Text

Job:Database:SQLScript

The following example shows how to create a database job that runs a SQL script from a file system.

{
"OracleDBFolder": {
"Type": "Folder",
"testOracle": {
"Type": "Job:Database:SQLScript",
"Host": "AgentHost",
"SQLScript": "/home/controlm/sqlscripts/selectOrclParm.sql",
"ConnectionProfile": "ORACLE_CONNECTION_PROFILE",
"Parameters": [
{"firstParamName": "firstParamValue"},
{"secondParamName": "secondParamValue"}
]
}
}
}

This example contains the following parameters:

Host

Defines the name of the host machine where the job runs. A Control-M/Agent must be installed on this host, as well as Control-M Databases plug-in version 9.0.00 or later.

Optionally, you can define a host group instead of a host machine. 

NOTE: If this parameter is left blank, the job is submitted for execution on the Control-M Scheduling Server host.

Parameters

Parameters are pairs of name and value. Every name that appears in the SQL script will be replaced by its value pair.

For additional optional parameters, see above.

Another example:

{
"OracleDBFolder": {
"Type": "Folder",
"testOracle": {
"Type": "Job:Database:SQLScript",
"Host": "app-redhat",
"SQLScript": "/home/controlm/sqlscripts/selectOrclParm.sql",
"ConnectionProfile": "ORACLE_CONNECTION_PROFILE"
}
}
}

Job:Database:StoredProcedure

The following example shows how to create a database job that runs a program that is stored on the database.

{
"storeFolder": {
"Type": "Folder",
"jobStoredProcedure": {
"Type": "Job:Database:StoredProcedure",
"Host": "myhost.mycomp.com",
"StoredProcedure": "myProcedure",
"Parameters": [ "value1","variable1",["value2","variable2"]],
"ReturnValue":"RV",
"Schema": "public",
"ConnectionProfile": "DB-PG-CON"
}
}
}

This example contains the following parameters:

Host

Defines the name of the host machine where the job runs. A Control-M/Agent must be installed on this host, as well as Control-M Databases plug-in version 9.0.00 or later.

Optionally, you can define a host group instead of a host machine.  

NOTE: If this parameter is left blank, the job is submitted for execution on the Control-M Scheduling Server host.

StoredProcedure

Name of stored procedure that the job runs

Parameters

A comma-separated list of values and variables for all parameters in the procedure, in the order of their appearance in the procedure.

The value that you specify for any specific parameter in the procedure depends on the type of parameter:

  • For an In parameter, specify an input value.
  • For an Out parameter, specify an output variable.
  • For an In/Out parameter, specify a pair of input value + output variable, enclosed in brackets: [value,variable]

In the example above, three parameters are listed, in the following order: [In,Out,Inout]

ReturnValue

A variable for the Return parameter (if the procedure contains such a parameter)

Schema

The database schema where the stored procedure resides

Package

(Oracle only) Name of a package in the database where the stored procedure resides

The default is "*", that is, any package in the database.

ConnectionProfile

Name of a connection profile that contains the details of the connection to the database

For additional optional parameters, see above.

Job:Database:MSSQL:AgentJob

9.0.19.210 The following example shows how to create an MSSQL Agent job, for management of a job defined in the SQL server.

{
   "MSSQLFolder": {
       "Type": "Folder",
       "ControlmServer": "LocalControlM",
       "MSSQLAgentJob": {
           "Type": "Job:Database:MSSQL:AgentJob",
           "ConnectionProfile": "MSSQL-WE-EXAMPLE",
           "Host": "agentHost",
           "JobName": "get_version",
           "Category": "Data Collector"
       }
   }
}

This example contains the following parameters:

Host

Defines the name of the host machine where the job runs. A Control-M/Agent must be installed on this host, as well as Control-M Databases plug-in version 9.0.00 or later.

Optionally, you can define a host group instead of a host machine.  

NOTE: If this parameter is left blank, the job is submitted for execution on the Control-M Scheduling Server host.

JobName

The name of the job defined in the SQL server

Category

The category of the job, as defined in the SQL server

For additional optional parameters, see above.

Job:Database:MSSQL:SSIS

9.0.19.220 The following example shows how to create SSIS Package jobs for execution of SQL Server Integration Services (SSIS) packages:

{
  "MSSQLFolder": {
      "Type": "Folder",
      "ControlmServer": "LocalControlM",
      "SSISCatalog": {
           "Type": "Job:Database:MSSQL:SSIS",
           "ConnectionProfile": "MSSQL-CP-NAME",
           "Host": "agentHost",
           "PackageSource": "SSIS Catalog",
           "PackageName": "\\Data Collector\\SqlTraceCollect",
           "CatalogEnv": "ENV_NAME",
           "ConfigFiles": [
               "C:\\Users\\dbauser\\Desktop\\test.dtsConfig",
               "C:\\Users\\dbauser\\Desktop\\test2.dtsConfig"
            ],
           "Properties": [
               {
                   "PropertyName": "PropertyValue"
               },
               {
                   "PropertyName2": "PropertyValue2"
               }
            ]
       },
       "SSISPackageStore": {
           "Type": "Job:Database:MSSQL:SSIS",
           "ConnectionProfile": "MSSQL-CP-NAME",
           "Host": "agentHost",
           "PackageSource": "SSIS Package Store",
           "PackageName": "\\Data Collector\\SqlTraceCollect",
           "ConfigFiles": [
               "C:\\Users\\dbauser\\Desktop\\test.dtsConfig",
               "C:\\Users\\dbauser\\Desktop\\test2.dtsConfig"
            ],
           "Properties": [
               {
                   "PropertyName": "PropertyValue"
               },
               {
                   "PropertyName2": "PropertyValue2"
               }
            ]
       }    
   }
} 

This example contains the following parameters:

Host

Defines the name of the host machine where the job runs. A Control-M/Agent must be installed on this host, as well as Control-M Databases plug-in version 9.0.00 or later.

Optionally, you can define a host group instead of a host machine. 

NOTE: If this parameter is left blank, the job is submitted for execution on the Control-M Scheduling Server host.

PackageSource

The source of the SSIS package, one of the following:

  • SQL Server — Package stored on an MSSQL database.
  • File System — Package stored on the Control-M/Agent's local file system.
  • SSIS Package Store — Package stored on a file system that is managed by an SSIS service.
  • SSIS Catalog — Package stored on a file system that is managed by an SSIS Catalog service.

PackageName

The name of the SSIS package.

CatalogEnv

If PackageSource is 'SSIS Catalog': The name of the environment on which to run the package.

Use this optional parameter if you want to run the package on a different environment from the one that you are currently using.

ConfigFiles

(Optional) Names of configuration files that contain specific data that you want to apply to the SSIS package

Properties

(Optional) Pairs of names and values for properties defined in the SSIS package.

Each property name is replaced by its defined value during SSIS package execution.

For additional optional parameters, see above.

Back to top

Job:Hadoop

Various types of Hadoop jobs are available for you to define using the Job:Hadoop objects:

Job:Hadoop:Spark:Python

The following example shows how to use Job:Hadoop:Spark:Python to run a Spark Python program.

    "ProcessData": {
       "Type": "Job:Hadoop:Spark:Python",
       "Host" : "edgenode",
       "ConnectionProfile": "DEV_CLUSTER",

       "SparkScript": "/home/user/processData.py"
   }

ConnectionProfile

Host

Defines the name of the host machine where the job runs. A Control-M/Agent must be installed on this host. Optionally, you can define a host group instead of a host machine. 

NOTE : If this parameter is left blank, the job is submitted for execution on the Control-M Scheduling Server host.

Optional parameters:

 "ProcessData1": {
   "Type": "Job:Hadoop:Spark:Python",
   "Host" : "edgenode",
   "ConnectionProfile": "DEV_CLUSTER",
   "SparkScript": "/home/user/processData.py",            
   "Arguments": [
       "1000",
       "120"
    ],            
   "PreCommands": {
       "FailJobOnCommandFailure" :false,
       "Commands" : [
           {"get" : "hdfs://nn.example.com/user/hadoop/file localfile"},
           {"rm"  : "hdfs://nn.example.com/file /user/hadoop/emptydir"}
        ]
   },
   "PostCommands": {
       "FailJobOnCommandFailure" :true,
       "Commands" : [
           {"put" : "localfile hdfs://nn.example.com/user/hadoop/file"}
        ]
   },
   "SparkOptions": [
       {"--master": "yarn"},
       {"--num":"-executors 50"}
    ]
}

PreCommands and PostCommands

Allows you to define HDFS commands to perform before and after running the job. For example, you can use them for preparation and cleanup.

FailJobOnCommandFailure

This parameter is used to ignore failure in the pre- or post- commands.

The default for PreCommands is true , that is, the job will fail if any pre-command fails.

The default for PostCommands is falsethat is, the job will complete successfully even if any post-command fails.

Back to top

Job:Hadoop:Spark:ScalaJava

The following example shows how to use Job:Hadoop:Spark:ScalaJava to run a Spark Java or Scala program.

 "ProcessData": {
 "Type": "Job:Hadoop:Spark:ScalaJava",
   "Host" : "edgenode",
   "ConnectionProfile": "DEV_CLUSTER",
   "ProgramJar": "/home/user/ScalaProgram.jar",
"MainClass" : "com.mycomp.sparkScalaProgramName.mainClassName" 
}

ConnectionProfile

Host

Defines the name of the host machine where the job runs. A Control-M/Agent must be installed on this host. Optionally, you can define a host group instead of a host machine. 

NOTE : If this parameter is left blank, the job is submitted for execution on the Control-M Scheduling Server host.

Optional parameters:

 "ProcessData1": {
 "Type": "Job:Hadoop:Spark:ScalaJava",
   "Host" : "edgenode",
   "ConnectionProfile": "DEV_CLUSTER",
   "ProgramJar": "/home/user/ScalaProgram.jar"
"MainClass" : "com.mycomp.sparkScalaProgramName.mainClassName",
   "Arguments": [
       "1000",
       "120"
    ],            
   "PreCommands": {
       "FailJobOnCommandFailure" :false,
       "Commands" : [
           {"get" : "hdfs://nn.example.com/user/hadoop/file localfile"},
           {"rm"  : "hdfs://nn.example.com/file /user/hadoop/emptydir"}
        ]
   },
   "PostCommands": {
       "FailJobOnCommandFailure" :true,
       "Commands" : [
           {"put" : "localfile hdfs://nn.example.com/user/hadoop/file"}
        ]
   },
   "SparkOptions": [
       {"--master": "yarn"},
       {"--num":"-executors 50"}
    ]
}

PreCommands and PostCommands

Allows you to define HDFS commands to perform before and after running the job. For example, you can use them for preparation and cleanup.

FailJobOnCommandFailure

This parameter is used to ignore failure in the pre- or post- commands.

The default for PreCommands is true , that is, the job will fail if any pre-command fails.

The default for PostCommands is falsethat is, the job will complete successfully even if any post-command fails.

Back to top

Job:Hadoop:Pig

The following example shows how to use Job:Hadoop:Pig to run a Pig script.

"ProcessDataPig": {
   "Type" : "Job:Hadoop:Pig",
   "Host" : "edgenode",
   "ConnectionProfile": "DEV_CLUSTER",
   "PigScript" : "/home/user/script.pig" 
}

ConnectionProfile

Host

Defines the name of the host machine where the job runs. A Control-M/Agent must be installed on this host. Optionally, you can define a host group instead of a host machine. 

NOTE : If this parameter is left blank, the job is submitted for execution on the Control-M Scheduling Server host.

Optional parameters:

    "ProcessDataPig1": {
       "Type" : "Job:Hadoop:Pig",
       "ConnectionProfile": "DEV_CLUSTER",
       "PigScript" : "/home/user/script.pig",            
       "Host" : "edgenode",
       "Parameters" : [
           {"amount":"1000"},
           {"volume":"120"}
        ],            
       "PreCommands": {
           "FailJobOnCommandFailure" :false,
           "Commands" : [
               {"get" : "hdfs://nn.example.com/user/hadoop/file localfile"},
               {"rm"  : "hdfs://nn.example.com/file /user/hadoop/emptydir"}
            ]
       },
       "PostCommands": {
           "FailJobOnCommandFailure" :true,
           "Commands" : [
               {"put" : "localfile hdfs://nn.example.com/user/hadoop/file"}
            ]
       }
   }

PreCommands and PostCommands

Allows you to define HDFS commands to perform before and after running the job. For example, you can use them for preparation and cleanup.

FailJobOnCommandFailure

This parameter is used to ignore failure in the pre- or post- commands.

The default for PreCommands is true , that is, the job will fail if any pre-command fails.

The default for PostCommands is falsethat is, the job will complete successfully even if any post-command fails.

Back to top

Job:Hadoop:Sqoop

The following example shows how to use Job:Hadoop:Sqoop to run a Sqoop job.

    "LoadDataSqoop":
    {
     "Type" : "Job:Hadoop:Sqoop",
 "Host" : "edgenode",
     "ConnectionProfile" : "SQOOP_CONNECTION_PROFILE",
     "SqoopCommand" : "import --table foo --target-dir /dest_dir" 
    }

 

ConnectionProfile

Host

Defines the name of the host machine where the job runs. A Control-M/Agent must be installed on this host. Optionally, you can define a host group instead of a host machine. 

NOTE : If this parameter is left blank, the job is submitted for execution on the Control-M Scheduling Server host.

Optional parameters:

    "LoadDataSqoop1" :
    {
       "Type" : "Job:Hadoop:Sqoop",
       "Host" : "edgenode",
       "ConnectionProfile" : "SQOOP_CONNECTION_PROFILE",
       "SqoopCommand" : "import --table foo",
"SqoopOptions" : [
{"--warehouse-dir":"/shared"},
{"--default-character-set":"latin1"}
],
       "SqoopArchives" : "",
       "SqoopFiles": "",
       "PreCommands": {
           "FailJobOnCommandFailure" :false,
           "Commands" : [
                {"get" : "hdfs://nn.example.com/user/hadoop/file localfile"},
                {"rm"  : "hdfs://nn.example.com/file /user/hadoop/emptydir"}
            ]
        },
       "PostCommands": {
           "FailJobOnCommandFailure" :true,
           "Commands" : [
                {"put" : "localfile hdfs://nn.example.com/user/hadoop/file"}
            ]
        }
    }

PreCommands and PostCommands

Allows you to define HDFS commands to perform before and after running the job. For example, you can use them for preparation and cleanup.

FailJobOnCommandFailure

This parameter is used to ignore failure in the pre- or post- commands.

The default for PreCommands is true , that is, the job will fail if any pre-command fails.

The default for PostCommands is falsethat is, the job will complete successfully even if any post-command fails.

SqoopOptions

These are passed as the specific sqoop tool args

SqoopArchives

Indicates the location of the Hadoop archives.

SqoopFiles

Indicates the location of the Sqoop files.

Back to top

Job:Hadoop:Hive

The following example shows how to use Job:Hadoop:Hive to run a Hive beeline job.

    "ProcessHive":
   {
     "Type" : "Job:Hadoop:Hive",
     "Host" : "edgenode",
     "ConnectionProfile" : "HIVE_CONNECTION_PROFILE",
     "HiveScript" : "/home/user1/hive.script"
   }

 

ConnectionProfile

Host

Defines the name of the host machine where the job runs. A Control-M/Agent must be installed on this host. Optionally, you can define a host group instead of a host machine.

NOTE : If this parameter is left blank, the job is submitted for execution on the Control-M Scheduling Server host.

Optional parameters:

   "ProcessHive1" :
   {
       "Type" : "Job:Hadoop:Hive",
       "Host" : "edgenode",
       "ConnectionProfile" : "HIVE_CONNECTION_PROFILE",
       "HiveScript" : "/home/user1/hive.script", 
       "Parameters" : [
           {"ammount": "1000"},
           {"topic": "food"}
        ],
       "HiveArchives" : "",
       "HiveFiles": "",
       "HiveOptions" : [
           {"hive.root.logger": "INFO,console"}
        ],
       "PreCommands": {
           "FailJobOnCommandFailure" :false,
           "Commands" : [
               {"get" : "hdfs://nn.example.com/user/hadoop/file localfile"},
               {"rm"  : "hdfs://nn.example.com/file /user/hadoop/emptydir"}
            ]
       },
       "PostCommands": {
           "FailJobOnCommandFailure" :true,
           "Commands" : [
               {"put" : "localfile hdfs://nn.example.com/user/hadoop/file"}
            ]
       }
   }

PreCommands and PostCommands

Allows you to define HDFS commands to perform before and after running the job. For example, you can use them for preparation and cleanup.

FailJobOnCommandFailure

This parameter is used to ignore failure in the pre- or post- commands.

The default for PreCommands is true , that is, the job will fail if any pre-command fails.

The default for PostCommands is falsethat is, the job will complete successfully even if any post-command fails.

HiveSciptParameters

Passed to beeline as --hivevar “name”=”value”.

HiveProperties

Passed to beeline as --hiveconf “key”=”value”.

HiveArchives

Passed to beeline as --hiveconf mapred.cache.archives=”value”.

HiveFiles

Passed to beeline as --hiveconf mapred.cache.files=”value”.

Back to top

Job:Hadoop:DistCp

The following example shows how to use Job:Hadoop:DistCp to run a DistCp job.  DistCp (distributed copy) is a tool used for large inter/intra-cluster copying.

        "DistCpJob" :
       {
           "Type" : "Job:Hadoop:DistCp",
           "Host" : "edgenode",
           "ConnectionProfile": "DEV_CLUSTER",
           "TargetPath" : "hdfs://nns2:8020/foo/bar",
           "SourcePaths" :
            [
               "hdfs://nn1:8020/foo/a"
            ]
       }  

ConnectionProfile

Host

Defines the name of the host machine where the job runs. A Control-M/Agent must be installed on this host. Optionally, you can define a host group instead of a host machine .

NOTE : If this parameter is left blank, the job is submitted for execution on the Control-M Scheduling Server host.

Optional parameters:

    "DistCpJob" :
   {
       "Type" : "Job:Hadoop:DistCp",
       "Host" : "edgenode",
       "ConnectionProfile" : "HADOOP_CONNECTION_PROFILE",
       "TargetPath" : "hdfs://nns2:8020/foo/bar",
       "SourcePaths" :
        [
           "hdfs://nn1:8020/foo/a",
           "hdfs://nn1:8020/foo/b"
        ],
       "DistcpOptions" : [
           {"-m":"3"},
           {"-filelimit ":"100"}
        ]
   }

TargetPath, SourcePaths and DistcpOptions

Passed to the distcp tool in the following way: distcp <Options> <TargetPath> <SourcePaths>.

Back to top

Job:Hadoop:HDFSCommands

The following example shows how to use Job:Hadoop:HDFSCommands to run a job that executes one or more HDFS commands.

        "HdfsJob":
       {
           "Type" : "Job:Hadoop:HDFSCommands",
           "Host" : "edgenode",
           "ConnectionProfile": "DEV_CLUSTER",
           "Commands": [
               {"get": "hdfs://nn.example.com/user/hadoop/file localfile"},
               {"rm": "hdfs://nn.example.com/file /user/hadoop/emptydir"}
            ]
       }

ConnectionProfile

Host

Defines the name of the host machine where the job runs. A Control-M/Agent must be installed on this host. Optionally, you can define a host group instead of a host machine.

NOTE : If this parameter is left blank, the job is submitted for execution on the Control-M Scheduling Server host.

Back to top

Job:Hadoop:HDFSFileWatcher

The following example shows how to use Job:Hadoop:HDFSFileWatcher to run a job that waits for HDFS file arrival.

    "HdfsFileWatcherJob" :
   {
       "Type" : "Job:Hadoop:HDFSFileWatcher",
       "Host" : "edgenode",
       "ConnectionProfile" : "DEV_CLUSTER",
       "HdfsFilePath" : "/inputs/filename",
       "MinDetecedSize" : "1",
       "MaxWaitTime" : "2"
   }

ConnectionProfile

Host

Defines the name of the host machine where the job runs. A Control-M/Agent must be installed on this host. Optionally, you can define a host group instead of a host machine. 

NOTE : If this parameter is left blank, the job is submitted for execution on the Control-M Scheduling Server host.

HdfsFilePath

Specifies the full path of the file being watched.

MinDetecedSize

Defines the minimum file size in bytes to meet the criteria and finish the job as OK. If the file arrives, but the size is not met, the job continues to watch the file.

MaxWaitTime

Defines the maximum number of minutes to wait for the file to meet the watching criteria. If criteria are not met (file did not arrive, or minimum size was not reached) the job fails after this maximum number of minutes.

Back to top

Job:Hadoop:Oozie

The following example shows how to use Job:Hadoop:Oozie to run a job that submits an Oozie workflow.

    "OozieJob": {
       "Type" : "Job:Hadoop:Oozie",
       "Host" : "edgenode",
       "ConnectionProfile": "DEV_CLUSTER",
       "JobPropertiesFile" : "/home/user/job.properties",
       "OozieOptions" : [
         {"inputDir":"/usr/tucu/inputdir"},
         {"outputDir":"/usr/tucu/outputdir"}
        ]
   }

ConnectionProfile

Host

Defines the name of the host machine where the job runs. A Control-M/Agent must be installed on this host. Optionally, you can define a host group instead of a host machine. 

NOTE : If this parameter is left blank, the job is submitted for execution on the Control-M Scheduling Server host.

JobPropertiesFile

The path to the job properties file.

Optional parameters:

PreCommands and PostCommands

Allows you to define HDFS commands to perform before and after running the job. For example, you can use them for preparation and cleanup.

FailJobOnCommandFailure

This parameter is used to ignore failure in the pre- or post- commands.

The default for PreCommands is true , that is, the job will fail if any pre-command fails.

The default for PostCommands is false , that is, the job will complete successfully even if any post-command fails.

OozieOptions

Set or override values for given job property.

Back to top

Job:Hadoop:MapReduce

 The following example shows how to use Job:Hadoop:MapReduce to execute a Hadoop MapReduce job.

    "MapReduceJob" :
   {
      "Type" : "Job:Hadoop:MapReduce",
       "Host" : "edgenode",
       "ConnectionProfile": "DEV_CLUSTER",
       "ProgramJar" : "/home/user1/hadoop-jobs/hadoop-mapreduce-examples.jar",
       "MainClass" : "pi",
       "Arguments" :[
           "1",
           "2"]
   }

ConnectionProfile

Host

Defines the name of the host machine where the job runs. A Control-M/Agent must be installed on this host. Optionally, you can define a host group instead of a host machine. 

NOTE : If this parameter is left blank, the job is submitted for execution on the Control-M Scheduling Server host.

Optional parameters:

   "MapReduceJob1" :
   {
       "Type" : "Job:Hadoop:MapReduce",
       "Host" : "edgenode",
       "ConnectionProfile": "DEV_CLUSTER",
       "ProgramJar" : "/home/user1/hadoop-jobs/hadoop-mapreduce-examples.jar",
       "MainClass" : "pi",
       "Arguments" :[
           "1",
           "2"
        ],
       "PreCommands": {
           "FailJobOnCommandFailure" :false,
           "Commands" : [
               {"get" : "hdfs://nn.example.com/user/hadoop/file localfile"},
               {"rm"  : "hdfs://nn.example.com/file /user/hadoop/emptydir"}
            ]
       },
       "PostCommands": {
           "FailJobOnCommandFailure" :true,
           "Commands" : [
               {"put" : "localfile hdfs://nn.example.com/user/hadoop/file"}
            ]
       }    
   }

PreCommands and PostCommands

Allows you to define HDFS commands to perform before and after running the job. For example, you can use them for preparation and cleanup.

FailJobOnCommandFailure

This parameter is used to ignore failure in the pre- or post- commands.

The default for PreCommands is true , that is, the job will fail if any pre-command fails.

The default for PostCommands is falsethat is, the job will complete successfully even if any post-command fails.

Back to top

Job:Hadoop:MapredStreaming

The following example shows how to use Job:Hadoop:MapredStreaming to execute a Hadoop MapReduce Streaming job.

     "MapredStreamingJob1": {
       "Type": "Job:Hadoop:MapredStreaming",
       "Host" : "edgenode",
       "ConnectionProfile": "DEV_CLUSTER",
       "InputPath": "/user/robot/input/*",
       "OutputPath": "/tmp/output",
       "MapperCommand": "mapper.py",
       "ReducerCommand": "reducer.py",
       "GeneralOptions": [
           {"-D": "fs.permissions.umask-mode=000"},
           {"-files": "/home/user/hadoop-streaming/mapper.py,/home/user/hadoop-streaming/reducer.py"}              
        ]
   }

ConnectionProfile

Host

Defines the name of the host machine where the job runs. A Control-M/Agent must be installed on this host. Optionally, you can define a host group instead of a host machine. 

NOTE : If this parameter is left blank, the job is submitted for execution on the Control-M Scheduling Server host.

Optional parameters:

PreCommands and PostCommands

Allows you to define HDFS commands to perform before and after running the job. For example, you can use them for preparation and cleanup.

FailJobOnCommandFailure

This parameter is used to ignore failure in the pre- or post- commands.

The default for PreCommands is true , that is, the job will fail if any pre-command fails.

The default for PostCommands is falsethat is, the job will complete successfully even if any post-command fails.

GeneralOptions

Additional Hadoop command options passed to the hadoop-streaming.jar, including generic options and streaming options.

Back to top

Job:Hadoop:Tajo:InputFile

The following example shows how to execute a Hadoop Tajo job based on an input file.

    "HadoopTajo_InputFile_Job" :
   {
       "Type" : "Job:Hadoop:Tajo:InputFile",
       "ConnectionProfile" : "TAJO_CONNECTION_PROFILE",
       "Host" : "edgenode",
       "FullFilePath" : "/home/user/tajo_command.sh",
       "Parameters" : [
           {"amount":"1000"},
           {"volume":"120"}
        ]
   } 

ConnectionProfile

Host

Defines the name of the host machine where the job runs. A Control-M/Agent must be installed on this host. Optionally, you can define a host group instead of a host machine. 

NOTE : If this parameter is left blank, the job is submitted for execution on the Control-M Scheduling Server host.

FullFilePath

The full path to the input file used as the Tajo command source

Parameters

Optional parameters for the script, expressed as name:value pairs

Additional optional parameters:

PreCommands and PostCommands

Allows you to define HDFS commands to perform before and after running the job. For example, you can use them for preparation and cleanup.

FailJobOnCommandFailure

This parameter is used to ignore failure in the pre- or post- commands.

The default for PreCommands is true , that is, the job will fail if any pre-command fails.

The default for PostCommands is falsethat is, the job will complete successfully even if any post-command fails.

Back to top

Job:Hadoop:Tajo:Query

The following example shows how to execute a Hadoop Tajo job based on a query.

    "HadoopTajo_Query_Job" :
   {
       "Type" : "Job:Hadoop:Tajo:Query",
       "ConnectionProfile" : "TAJO_CONNECTION_PROFILE",
       "Host" : "edgenode",
       "OpenQuery" : "SELECT %%firstParamName AS VAR1 \\n FROM DUMMY \\n ORDER BY \\t VAR1 DESC",
   } 

ConnectionProfile

Host

Defines the name of the host machine where the job runs. A Control-M/Agent must be installed on this host. Optionally, you can define a host group instead of a host machine. 

NOTE : If this parameter is left blank, the job is submitted for execution on the Control-M Scheduling Server host.

OpenQuery

An ad-hoc query to the Apache Tajo warehouse system

Additional optional parameters:

PreCommands and PostCommands

Allows you to define HDFS commands to perform before and after running the job. For example, you can use them for preparation and cleanup.

FailJobOnCommandFailure

This parameter is used to ignore failure in the pre- or post- commands.

The default for PreCommands is true , that is, the job will fail if any pre-command fails.

The default for PostCommands is falsethat is, the job will complete successfully even if any post-command fails.

Back to top

Job:SAP

SAP-type jobs enable you to manage SAP processes through the Control-M environment. To manage SAP-type jobs, you must have the Control-M for SAP plug-in installed in your Control-M environment.

The following JSON objects are available for creating SAP-type jobs:

  • Job:SAP:BW:InfoPackage — Defines a job to run and monitor SAP InfoPackage that is pre-defined in SAP Business Warehouse (SAP BW)

Job:SAP:R3:CREATE

This job type enables you to create a new SAP R3 job.

The following example is a simple job that relies mostly on default settings and contains one step that executes an external command. 

    "SAPR3_external_command": {
     "Type": "Job:SAP:R3:CREATE",
     "ConnectionProfile": "SAPCP",
     "SapJobName": "SAP_job",
     "CreatedBy": "user1",
     "Steps": [
       {
         "StepType": "ExternalCommand",
         "UserName": "user01",
         "TargetHost": "host01",
         "ProgramName": "PING"
       }
      ],
     "SpoolListRecipient": {
       "ReciptNoForwarding": false
     }
   }

The following example is a more complex job that contains two steps that run ABAP programs. Each of the ABAP steps has an associated variant that contains variable definitions.

  "SapR3CreateComplete": {
     "Type": "Job:SAP:R3:CREATE",
     "ConnectionProfile": "SAPCP",
     "SapJobName": "SAP_job2",
     "StartCondition": "Immediate",
     "RerunFromStep": "3",
     "Target": "controlmserver",
     "CreatedBy": "user1",
     "Steps": [
       {
         "StepType": "ABAP",
         "TimeToPrint": "PrintLater",
         "CoverPrintPage": true,
         "OutputDevice": "prt",
         "UserName": "user",
         "SpoolAuthorization": "Auth",
         "CoverDepartment": "dpt",
         "SpoolListName": "spoolname",
         "OutputNumberRows": "62",
         "NumberOfCopies": "5",
         "NewSpoolRequest": false,
         "PrintArchiveMode": "PrintAndArchive",
         "CoverPage": "Print",
         "ArchiveObjectType": "objtype",
         "SpoolListTitles": "titles",
         "OutputLayout": "layout",
         "CoverSheet": "Print",
         "ProgramName": "ABAP_PROGRAM",
         "Language": "e",
         "ArchiveInformationField": "inf",
         "DeleteAfterPrint": true,
         "PrintExpiration": "3",
         "OutputNumberColumns": "88",
         "ArchiveDocumentType": "doctype",
         "CoverRecipient": "recipient",
         "VariantName": "NameOfVariant",
         "VariantParameters": [
           {
             "Type": "Range",
             "High": "2",
             "Sign": "I",
             "Option": "BT",
             "Low": "1",
             "Name": "var1",
             "Modify": false
           },
           {
             "Low": "5",
             "Type": "Range",
             "Option": "BT",
             "Sign": "I",
             "Modify": true,
             "High": "6",
             "Name": "var3"
           }
          ]
       },
       {
         "StepType": "ABAP",
         "PrintArchiveMode": "Print",
         "ProgramName": "ABAP_PROGRAM2",
         "VariantName": "Myvar_with_temp",
         "TemporaryVariantParameters": [
           {
             "Type": "Simple",
             "Name": "var",
             "Value": "P11"
           },
           {
             "Type": "Simple",
             "Name": "var2",
             "Value": "P11"
           }
          ]
       }
      ],
     "PostJobAction": {
       "JobLog": "CopyToFile",
       "JobCompletionStatusWillDependOnApplicationStatus": true,
       "SpoolSaveToPDF": true,
       "JobLogFile": "fileToCopy.txt"
     },
     "SpoolListRecipient": {
       "ReciptNoForwarding": false
     }
   }

The following table lists the parameters that can be used in SAP jobs of this type:

ConnectionProfile

Name of the SAP connection profile to use for the connection

SapJobName

Name of SAP job to be monitored or submitted

Exec

Type of execution target where the SAP job will run, one of the following:

  • Server — an SAP application server (the default)
  • Group — an SAP group

Target

The name of the SAP application server or SAP group (depending on the value specified in the previous parameter)

JobClass

Job submission priority in SAP, one of the following options:

  • A — high priority 
  • B — medium priority
  • C — low priority

StartCondition

Specifies when the job should run, one of the following:

  • ASAP — Job runs as soon as a background work process is available for it in SAP (the default). If the job cannot start immediately, it is transformed in SAP into a time-based job.
  • Immediate — Job runs immediately. If there are no work processes available to run it, the job fails.
  • AfterEvent — Job waits for an event that you specify (in the next two parameters) to be triggered.

AfterEvent

The name of the SAP event that the job waits for (if you set StartCondition to AfterEvent)

AfterEventParameters

Parameters in the SAP event to watch for.

Use space characters to separate multiple parameters.

RerunFromPointOfFailure

Whether to rerun the SAP R/3 job from its point of failure, either true of false (the default)

Note: If RerunFromPointOfFailure is set to false, use the CopyFromStep parameter to set a specific step from which to rerun.

CopyFromStep

The number of a specific step in the SAP R/3 job from which to rerun

The default is step 1 (that is, the beginning of the job).

Note: If RerunFromPointOfFailure is set to true, the CopyFromStep parameter is ignored.

Steps

An object that groups together the definitions of SAP R/3 job steps

StepType

The type of program to execute in this step, one of the following options:

  • ABAP (the default)
  • ExternalCommand
  • ExternalProgram

ProgramName

The name of the program or command

UserName

The authorized owner of the step

Description

A textual description or comment for the step


Further parameters for each individual step depend on the type of program that is executed in the step. These parameters are listed in separate tables:

PostJobAction

This object groups together several parameters that control post-job actions for the SAP R/3 job.

Spool

How to manage spool output, one of the following options:

  • DoNotCopy (the default)
  • CopyToOutput
  • CopyToFile

SpoolFile

The file to which to copy the job's spool output (if Spool is set to CopyToFile)

SpoolSaveToPDF

Whether to save the job's spool output in PDF format (if Spool is set to CopyToFile)

JobLog

How to manage job log output, one of the following options:

  • DoNotCopy
  • CopyToOutput (the default)
  • CopyToFile

JobLogFile

The file to which to copy the job's log output (if JobLog is set to CopyToFile)

JobCompletionStatusWillDependOnApplicationStatus

Whether job completion status depends on SAP application status, either true or false (the default)

DetectSpawnedJob

This object groups together several parameters that you specify if you want to detect and monitor jobs that are spawned by the current SAP job

DetectAndCreate

How to determine the properties of detected spawned jobs:

  • CurrentJobDefinition — Properties of detected spawned jobs are identical to the current (parent) job properties (the default)
  • SpecificJobDefinition — Properties of detected spawned jobs are derived from a different job that you specify

JobName

Name of an SAP-type job to use for setting properties in spawned jobs of the current job (if DetectAndCreate is set to SpecificJobDefinition)

Note: The specified job must exist in the same folder as the current job, and the connection profile should be the same. BMC recommends that it should have the same Application and Sub Application values.

StartSpawnedJob

Whether to start spawned jobs that have a status of Scheduled (either true or false, where false is the default)

JobEndInControlMOnlyAftreChildJobsCompleteOnSap

Whether to allow the job to end in Control-M only after all child jobs complete in the SAP environment (either true or false, where false is the default)

JobCompletionStatusDependsOnChildJobsStatus

Whether Control-M should wait for all child jobs to complete (either true or false, where false is the default)

When set to true, the parent job does not end OK if any child job fails.

This parameter is relevant only if JobEndInControlMOnlyAftreChildJobsCompleteOnSap is set to true.

SpoolListRecipient

This object groups together several parameters that define recipients of Print jobs

RecipientType

Type of recipient of the print job, one of the following:

  • ExternalAddress
  • SapUserName (the default)
  • SharedDistributionList
  • PrivateDistributionList
  • FaxNumber
  • TelexNumber
  • InternetAddress
  • X400Address
  • RemoteMailAddress

RecipientName

Recipient of the print job (of the type defined by the previous parameter)

RecipientCopy

Whether this recipient is a copied (CC) recipient, either true or false (the default)

RecipientBlindCopy

Whether this recipient is a blind copied (BCC) recipient, either true or false (the default)

RecipientExpress

For a CC or BCC recipient: Whether to send in express mode, either true or false (the default)

ReciptNoForwarding

For a CC or BCC recipient: Whether to set the recipient to "No Forwarding", either true or false (the default)

The following additional parameters are available f or steps that involve the execution of an ABAP program. Most of these parameters are optional.

Language

SAP internal one-character language code for the ABAP step

For example, German is D and Serbian (using the Latin alphabet) is d.

For the full list of available language codes, see SAP Knowledge Base Article 2633548.

VariantName

The name of a variant for the specified ABAP program or Archiving Object

VariantDescription

A textual description or comment for the variant

VariantParameters

This object groups together the variables defined in the variant. For each variable, you can set the following parameters:

  • Name — name of the variable
  • Modify — whether to modify the variable value when the job executes, either true (the default) or false
  • Type — type of variable, one of the following: Simple (the default), Selection, Range
  • Value — value to set for a Simple variable or a Selection variable
  • Low — lowest value in a Range variable
  • High — highest value in a Range variable
  • Option — operator to use in a range or selection
    For a Range: either BT (between) or NB (not between)
    For a Selection: one of the following:
    • EQ: Single value
    • NE: Not Equal to
    • GT: Greater than
    • LT: Less than
    • GE: Greater than or Equal to
    • LE: Less than or Equal to
    • CP: Include pattern
    • NP: Exclude pattern
  • Sign — whether to include or exclude the Range or Selection — either I (the default) or E

TemporaryVariantParameters

This object groups together the variables defined in a temporary variant.

For each variable, you can set the same parameters listed above, except for Modify (which is not supported by a temporary variant).

OutputDevice

The logical name of the designated printer

NumberOfCopies

Number of copies to be printed

The default is 1.

PrintArchiveMode

Whether the spool of the step is printed to an output device, to the archive, or both.

Choose from the following available values:

  • Print (the default)
  • Archive
  • PrintAndArchive

TimeToPrint

When to print the job output, one of the following options:

  • PrintLater
  • PrintImmediately
  • SendToSAPSpooler (the default)

PrintExpiration

Number of days until a print job expires

Valid values are single-digit numbers:

  • 1–8 days
  • 9 — no expiration

The default is 8 days.

NewSpoolRequest

Whether to request a new spool, either true (the default) or false

DeleteAfterPrint

Whether to delete the report after printing, either true or false (the default)

OutputLayout

Print layout format

OutputNumberRows

(Mandatory) Maximum number of rows per page

Valid values:

  • Any integer between 1 and 90
  • -1 — use ABAP program default (the default)

OutputNumberColumns

(Mandatory) Maximum number of characters in an output line

Valid values:

  • Any integer between 1 and 255
  • -1 — use ABAP program default (the default)

CoverRecipient

Name of the recipient of the job output on the cover sheet

The name can be up to 12 characters.

CoverDepartment

Name of the spool department on the cover sheet

The department name can be up to 12 characters.

CoverPage

Type of cover page for output, one of the following options:

  • DefaultSetting — use the default setting from SAP (the default)
  • Print — print the cover page
  • DoNotPrint — do not print the cover page

CoverSheet

Type of cover sheet for output, one of the following options:

  • DefaultSetting — use the default setting from SAP (the default)
  • Print — print the cover page
  • DoNotPrint — do not print the cover page

CoverPrintPage

Whether to use a cover page, either true or false

The default is false.

SpoolListName

Name of the spool list

The name can be up to 12 characters.

SpoolListTitles

The spool list titles

SpoolAuthorization

Name of a user with print authorization

The name can be up to 12 characters.

ArchiveId

SAP ArchiveLink Storage system ID

Values are two carachters long. The default is ZZ.

Note that Archive parameters are relevant only when you set PrintArchiveMode to Archive or PrintAndArchive.

ArchiveText

Free text description of the archive location, up to 40 characters

ArchiveObjectType

Archive object type

Valid values are up to 10 characters.

ArchiveDocumentType

Archive object document type

Valid values are up to 10 characters.

ArchiveInformationField

Archive information

Values can be 1–3 characters.

The following additional parameters are available for steps that involve the execution of an external program or an external command:

TargetHost

Host computer on which the program or command runs

OperatingSystem

Operating system on which the external command runs

The default is ANYOS.

WaitExternalTermination

Whether SAP waits for the external program or external command to end before starting the next step, or before exiting.

Values are either true (the default) or false.

LogExternalOutput

Whether SAP logs external output in the joblog

Values are either true (the default) or false.

LogExternalErrors

Whether SAP logs external errors in the joblog

Values are either true (the default) or false.

ActiveTrace

Whether SAP activates traces for the external program or external command

Values are either true or false (the default).

Job:SAP:R3:COPY

This job type enables you to create a new SAP R3 job by duplicating an existing job. The following example shows how to use Job:SAP:R3:COPY:

"JobSapR3Copy" : {
   "Type" : "Job:SAP:R3:COPY",
   "ConnectionProfile":"SAP-CON",
   "SapJobName" : "CHILD_1",
   "Exec": "Server",
   "Target" : "Server-name",
   "JobCount" : "SpecificJob",
   "JobCountSpecificName" : "sap-job-1234",
   "NewJobName" : "My-New-Sap-Job",
   "StartCondition" : "AfterEvent",
   "AfterEvent" : "HOLA",
   "AfterEventParameters" : "parm1 parm2",
   "RerunFromPointOfFailure": true,
   "CopyFromStep" : "4",
   "PostJobAction" : {
       "Spool" : "CopyToFile",
       "SpoolFile": "spoolfile.log",
       "SpoolSaveToPDF" : true,
       "JobLog" : "CopyToFile",
       "JobLogFile": "Log.txt",
       "JobCompletionStatusWillDependOnApplicationStatus" : true
    },
   "DetectSpawnedJob" : {
       "DetectAndCreate": "SpecificJobDefinition",
       "JobName" : "Specific-Job-123",
       "StartSpawnedJob" : true,
       "JobEndInControlMOnlyAftreChildJobsCompleteOnSap" : true,
       "JobCompletionStatusDependsOnChildJobsStatus" : true
    }
}

This SAP job object uses the following parameters:

ConnectionProfile

Name of the SAP connection profile to use for the connection

SapJobName

Name of SAP job to copy

Exec

Type of execution target where the SAP job will run, one of the following:

  • Server — an SAP application server (the default)
  • Group — an SAP group

Target

The name of the SAP application server or SAP group (depending on the value specified in the previous parameter)

JobCount

How to define a unique ID number for the SAP job, one of the following options:

  • FirstScheduled (the default)
  • LastScheduled
  • First
  • Last
  • SpecificJob

If you specify SpecificJob, you must provide the next parameter.

JobCountSpecificName

A unique SAP job ID number for a specific job (that is, for when JobCount is set to SpecificJob)

NewJobName

Name of the newly created job

StartCondition

Specifies when the job should run, one of the following:

  • ASAP — Job runs as soon as a background work process is available for it in SAP (the default). If the job cannot start immediately, it is transformed in SAP into a time-based job.
  • Immediate — Job runs immediately. If there are no work processes available to run it, the job fails.
  • AfterEvent — Job waits for an event that you specify (in the next two parameters) to be triggered.

AfterEvent

The name of the SAP event that the job waits for (if you set StartCondition to AfterEvent)

AfterEventParameters

Parameters in the SAP event to watch for.

Use space characters to separate multiple parameters.

RerunFromPointOfFailure

Whether to rerun the SAP R/3 job from its point of failure, either true of false (the default)

Note: If RerunFromPointOfFailure is set to false, use the CopyFromStep parameter to set a specific step from which to rerun.

CopyFromStep

The number of a specific step in the SAP R/3 job from which to rerun or copy

The default is step 1 (that is, the beginning of the job).

Note: If RerunFromPointOfFailure is set to true, the CopyFromStep parameter is ignored.

PostJobAction

This object groups together several parameters that control post-job actions for the SAP R/3 job.

Spool

How to manage spool output, one of the following options:

  • DoNotCopy (the default)
  • CopyToOutput
  • CopyToFile

SpoolFile

The file to which to copy the job's spool output (if Spool is set to CopyToFile)

SpoolSaveToPDF

Whether to save the job's spool output in PDF format (if Spool is set to CopyToFile)

JobLog

How to manage job log output, one of the following options:

  • DoNotCopy
  • CopyToOutput (the default)
  • CopyToFile

JobLogFile

The file to which to copy the job's log output (if JobLog is set to CopyToFile)

JobCompletionStatusWillDependOnApplicationStatus

Whether job completion status depends on SAP application status, either true or false (the default)

DetectSpawnedJob

This object groups together several parameters that you specify if you want to detect and monitor jobs that are spawned by the current SAP job

DetectAndCreate

How to determine the properties of detected spawned jobs:

  • CurrentJobDefinition — Properties of detected spawned jobs are identical to the current (parent) job properties (the default)
  • SpecificJobDefinition — Properties of detected spawned jobs are derived from a different job that you specify

JobName

Name of an SAP-type job to use for setting properties in spawned jobs of the current job (if DetectAndCreate is set to SpecificJobDefinition)

Note: The specified job must exist in the same folder as the current job, and the connection profile should be the same. BMC recommends that it should have the same Application and Sub Application values.

StartSpawnedJob

Whether to start spawned jobs that have a status of Scheduled (either true or false, where false is the default)

JobEndInControlMOnlyAftreChildJobsCompleteOnSap

Whether to allow the job to end in Control-M only after all child jobs complete in the SAP environment (either true or false, where false is the default)

JobCompletionStatusDependsOnChildJobsStatus

Whether Control-M should wait for all child jobs to complete (either true or false, where false is the default)

When set to true, the parent job does not end OK if any child job fails.

This parameter is relevant only if JobEndInControlMOnlyAftreChildJobsCompleteOnSap is set to true.

Job:SAP:BW:ProcessChain

This job type runs and monitors a Process Chain in SAP Business Warehouse (SAP BW).

NOTE: For the job that you define through Control-M Automation API to work properly, ensure that the Process Chain defined in the SAP BW system has Start Using Meta Chain or API as the start condition for the trigger process (Start Process) of the Process Chain. To configure this parameter, from the SAP transaction RSPC, right-click the trigger process and select Maintain Variant.

The following example shows how to use Job:SAP:BW:ProcessChain:

"JobSapBW": {
   "Type": "Job:SAP:BW:ProcessChain",
   "ConnectionProfile": "PI4-BW",
   "ProcessChainDescription": "SAP BW Process Chain",
   "Id": "123456",
   "RerunOption": "RestartFromFailiurePoint",
   "EnablePeridoicJob": true,
   "ConsiderOnlyOverallChainStatus": true,
   "RetrieveLog": false,
   "DetectSpawnedJob": {
       "DetectAndCreate": "SpecificJobDefinition",
       "JobName": "ChildJob",
       "StartSpawnedJob": false,
       "JobEndInControlMOnlyAftreChildJobsCompleteOnSap": false,
       "JobCompletionStatusDependsOnChildJobsStatus": false
       }
   }

This SAP job object uses the following parameters:

ConnectionProfile

Name of the SAP connection profile to use for the connection.

ProcessChainDescription

The description of the Process Chain that you want to run and monitor, as defined in SAP BW.

Maximum length of the textual description: 60 characters

Id

ID of the Process Chain that you want to run and monitor.

RerunOption

The rerun policy to apply to the job after job failure, one of the following values:

  • RestartFromFailiurePoint — Restart the job from the point of failure (the default)
  • RerunFromStart — Rerun the job from the beginning

EnablePeridoicJob

Whether the first run of the Process Chain prepares for the next run and is useful for reruns when big Process Chains are scheduled.

Values are either true (the default) or false.

ConsiderOnlyOverallChainStatus

Whether to view only the status of the overall Process Chain.

Values are either true or false (the default) .

RetrieveLog

Whether to add the Process Chain logs to the job output.

Values are either true (the default) or false.

DetectSpawnedJob

This object groups together several parameters that you specify if you want to detect and monitor jobs that are spawned by the current SAP job

    DetectAndCreate

How to determine the properties of detected spawned jobs:

  • CurrentJobDefinition — Properties of detected spawned jobs are identical to the current (parent) job properties (the default).
  • SpecificJobDefinition — Properties of detected spawned jobs are derived from a different job that you specify.

    JobName

Name of an SAP-type job to use for setting properties in spawned jobs of the current job (if DetectAndCreate is set to SpecificJobDefinition)

Note: The specified job must exist in the same folder as the current job, and the connection profile should be the same. BMC recommends that it should have the same Application and Sub Application values.

    StartSpawnedJob

Whether to start spawned jobs that have a status of Scheduled (either true or false, where false is the default)

    JobEndInControlMOnlyAftreChildJobsCompleteOnSap

Whether to allow the job to end in Control-M only after all child jobs complete in the SAP environment (either true or false, where false is the default)

    JobCompletionStatusDependsOnChildJobsStatus

Whether Control-M should wait for all child jobs to complete (either true or false, where false is the default)

When set to true, the parent job does not end OK if any child job fails.

This parameter is relevant only if JobEndInControlMOnlyAftreChildJobsCompleteOnSap is set to true.

  Job:SAP:BW:InfoPackage

This job type runs and monitors an InfoPackage that is pre-defined in SAP Business Warehouse (SAP BW).

The following example shows how to use Job:SAP:BW:InfoPackage

"JobSapBW": {
"Type": "Job:SAP:BW:InfoPackage",
"ConnectionProfile": "PI4-BW",
"CreatedBy": "emuser1",
"Description": "description of the job",
"RunAs": "ProductionUser",
"InfoPackage": {
"BackgroundJobName": "Background job name",
"Description": "description of the InfoPackage",
"TechName": "LGXT565_TGHBNS453BGHJ784"
}
}

This SAP job object uses the following parameters:

ConnectionProfile

Defines the name of the SAP connection profile to use for the job.

1-30 characters. Case sensitive. No blanks.

CreatedBy

Defines the name of the user that creates the job.

Description

(Optional) Describes the job.

RunAs

(Optional) Defines a  Run  as user—an account that is used to log in to the host.

InfoPackage

An object that groups together the parameters that describe the InfoPackage.

    BackgroundJobName

Defines the InfoPackage background job name. 1-25 characters.

    Description

(Optional) Describes the InfoPackage.

    TechName

Defines a unique SAP BW generated InfoPackage ID.

Back to top

Job:PeopleSoft

PeopleSoft-type jobs enable you to manage PeopleSoft jobs and processes through the Control-M environment. To manage PeopleSoft-type jobs, you must have the Control-M for PeopleSoft plug-in installed in your Control-M environment.

The following example shows the JSON code used to define a PeopleSoft job.

"PeopleSoft_job": {
    "Type": "Job:PeopleSoft",
    "ConnectionProfile": "PS_CONNECT",
    "User": "PS_User3",
    "ControlId": "ControlId",
    "ServerName": "ServerName",
    "ProcessType": "ProcessType",
    "ProcessName": "ProcessName",
    "AppendToOutput": false,
    "BindVariables": ["value1","value2"],
    "RunAs": "controlm"
}

This PeopleSoft job object uses the following parameters:

ConnectionProfile

Name of the PeopleSoft connection profil e to use for the connection

User

A PeopleSoft user ID that exists in the PeopleSoft Environment

ControlId

Run Control ID for access to run controls at runtime

ServerName

The name of the server on which to run the PeopleSoft job or process

ProcessType

A PeopleSoft process type that the user is authorized to perform

ProcessName

The name of the PeopleSoft process to run

AppendToOutput

Whether to include PeopleSoft job output in the Control-M job output, either true or false

The default is false.

BindVariables

Values of up to 20 USERDEF variables for sharing data between Control-M and the PeopleSoft job or process

Back to top

Job:Airflow

The Airflow job enables you to monitor and manage DAG workflows. To manage Airflow-type jobs, you must have the Control-M for Airflow plug-in installed in your Control-M environment.

The following example shows the JSON code used to define an Airflow job.

"AirflowJob": {
  "Type": "Job:Airflow",
  "Host": "AgentHost",
  "ConnectionProfile": "AIRFLOW_CONNECTION_PROFILE",
  "DagId": "example_bash_operator",
  "ConfigurationJson": "\{\"key1\":1, \"key2\":2, \"key3\":\"value3\"\}",
  "OutputDetails": "FAILED_TASKS"
}

The Airflow job object uses the following parameters:

ConnectionProfile

Name of the Airflow connection profile to use for the connection

DagId

Defines the unique identifier of a DAG.

ConfigurationJson

(Optional) Defines the JSON object, which describes additional configuration parameters (key:value pairs).

OutputDetails

Determines whether to include Airflow DAG task logs in the Control-M job output, as follows:

  • NO_TASKSNo task logs
  • FAILED_TASKSInclude failing task logs
  • ALL_TASKSInclude all task logs

Default: FAILED_TASKS

Back to top

Job:ApplicationIntegrator

Use Job:ApplicationIntegrator:<JobType> to define a job of a custom type using the Control-M Application Integrator designer. For information about designing job types, see Application Integrator.

The following example shows the JSON code used to define a job type named AI Monitor Remote Job:

"JobFromAI" : {
   "Type": "Job:ApplicationIntegrator:AI Monitor Remote Job",
   "ConnectionProfile": "AI_CONNECTION_PROFILE",
   "AI-Host": "Host1",
   "AI-Port": "5180",
   "AI-User Name": "admin",
   "AI-Password": "*******",
   "AI-Remote Job to Monitor": "remoteJob5",
   "RunAs": "controlm"
}

In this example, the ConnectionProfile and RunAs properties are standard job properties used in Control-M Automation API jobs. The other job properties will be created in the Control-M Application Integrator, and they must be prefixed with "AI-" in the .json code.

The following images show the corresponding settings in the Control-M Application Integrator, for reference purposes.

Click here to expand...
  • The name of the job type appears in the Name field in the job type details.
    AIjobDetails2.png
  • Job properties appear in the Job Type Designer, in the Connection Profile View and the Job Properties View.
    When defining these properties through the .json code, you prefix them with "AI-", except for the property that specifies the name of the connection profile.
    AIdesigner2.png


Back to top

Job:Informatica

Informatica-type jobs enable you to automate Informatica workflows through the Control-M environment. To manage Informatica-type jobs, you must have the Control-M for Informatica plug-in installed in your Control-M environment.

The following example shows the JSON code used to define an Informatica job.

"InformaticaApiJob": {
   "Type": "Job:Informatica",
   "ConnectionProfile": "INFORMATICA_CONNECTION",
   "RepositoryFolder": "POC",
   "Workflow": "WF_Test",
   "InstanceName": "MyInstamce",
   "OsProfile": "MyOSProfile",
   "WorkflowExecutionMode": "RunSingleTask",
   "RunSingleTask": "s_MapTest_Success",
   "WorkflowRestartMode": "ForceRestartFromSpecificTask",
   "RestartFromTask": "s_MapTest_Success",
   "WorkflowParametersFile": "/opt/wf1.prop"
}

This Informatica job object uses the following parameters:

ConnectionProfile

Name of the Informatica connection profile to use for the connection

RepositoryFolder

The Repository folder that contains the workflow that you want to run

Workflow

The workflow that you want to run in Control-M for Informatica

InstanceName

(Optional) The specific instance of the workflow that you want to run

OsProfile

(Optional) The operating system profile in Informatica

WorkflowExecutionMode

The mode for executing the workflow, one of the following:

  • RunWholeWorkflow — run the whole workflow
  • StartFromTask — start running the workflow from a specific task, as specified by the StartFromTask parameter
  • RunSingleTask — run a single task in the workflow, as specified by the RunSingleTask parameter

  StartFromTask

The task from which to start running the workflow

This parameter is required only if you set WorkflowExecutionMode to StartFromTask.

  RunSingleTask

The workflow task that you want to run

This parameter is required only if you set WorkflowExecutionMode to RunSingleTask.

Depth

The number of levels within the workflow task hierarchy for the selection of workflow tasks

Default: 10 levels

EnableOutput

Whether to include the workflow events log in the job output (either true or false)

Default: true

EnableErrorDetails

Whether to include a detailed error log for a workflow that failed (either true or false)

Default: true

WorkflowRestartMode

The operation to execute when the workflow is in a suspended satus, one of the following:

  • Recover — recover the suspended workflow
  • ForceRestart — force a restart of the suspended workflow
  • ForceRestartFromSpecificTask — force a restart of the suspended workflow from a specific task, as specified by the RestartFromTask parameter

  RestartFromTask

The task from which to restart a suspended workflow

This parameter is required only if you set WorkflowRestartMode to ForceRestartFromSpecificTask

WorkflowParametersFile

(Optional) The path and name of the workflow parameters file

This enables you to use the same workflow for different actions.

Back to top

Job: Informatica CS

Informatica Cloud Services (CS) jobs enable you to automate your Informatica workflows for multi-cloud and on-premises data integration through the Control-M environment.

To deploy and run an Informatica CS job, ensure that you have the Control-M Application Integrator plug-in installed and have deployed the Informatica CS integration using the deploy jobtype command.

The following example shows the JSON code used to define an Informatica CS job:

"InformaticaCloudCSJob": {
   "Type": "Job:Informatica CS",
   "ConnectionProfile": "INFORMATICA_CS_CONNECTION",
   "Task Type": "Synchronization task",
   "Task Name": "Synchronization Task1",
   "Call Back URL": "",
   "Verification Poll Interval (in seconds)": "10"
 }

The following example shows the JSON code used to define an Informatica CS job for a taskflow:

"InformaticaCloudCSJob": {
   "Type": "Job:Informatica CS",
   "ConnectionProfile": "INFORMATICA_CS_CONNECTION",
   "Task Type": "Taskflow",  
   "TaskFlow URL": "https://xxx.dm-xx.informaticacloud.com/active-bpel/rt/xyz",
   "Input Fields": "input1=val1&input2=val2&input3=val3",
   "Call Back URL": "",
   "Verification Poll Interval (in seconds)": "10"
 }

This Informatica CS job object uses the following parameters:

ConnectionProfile

Name of the Informatica CS connection profile to use for the connection to Informatica Cloud

Task Type

Determines one of the following task types to run on Informatica Cloud:

  • Mapping Task: A set of instructions that defines how data is transformed and moved from its source to its target system.
  • Masking Task: A data security technique that enables you to protect sensitive data while allowing it to be used for non-production purposes.
  • PowerCenter Task: A data integration tool that enables you to extract, transform, and load data from different sources into a unified target system.
  • Replication Task: A data replication solution that enables you to replicate and synchronize data across different systems and databases in real-time.
  • Synchronization Task: A data integration solution that enables you to synchronize data between different systems and databases, ensuring that data is consistent and up-to-date across all systems.
  • Linear Taskflow: A workflow automation feature that enables you to create and automate a sequence of tasks that are executed in a specific order, which helps streamline data integration and processing tasks.
  • Taskflow: A workflow automation feature that enables you to create complex workflows that orchestrate and automate data integration and processing tasks across multiple systems and platforms

Task Name

Defines the name of the task to execute on Informatica Cloud

This parameter is not relevant for a taskflow.

TaskFlow URL

(For taskflow) Defines the Service URL of the taskflow to execute on Informatica Cloud.

In Informatica Data Integration, you can obtain this Service URL through the Properties Detail option of the taskflow.

Input Fields

(For taskflow) Defines input fields for a taskflow, expressed as input=value pairs separated by the & character

Call Back URL

(Optional) Defines a publicly available URL to which to post the job status.

Verification Poll Interval (in seconds)

Determines the number of seconds between polls for job status verification

Back to top

Job:AWS

AWS-type jobs enable you to automate a select list of AWS services through Control-M Automation API. To manage AWS-type jobs, you must have the Control-M for AWS plug-in installed in your Control-M environment.

The following JSON objects are available for creating AWS-type jobs:

An additional Job:AWS Glue job type is provided for the AWS Glue service. To support this job type, you must have the Control-M Application Integrator plug-in installed and you must deploy the AWS Glue integration using the deploy jobtype command.

Job:AWS:Lambda

The following example shows how to define a job that executes an AWS Lambda service on an AWS server.

"AwsLambdaJob": {
   "Type": "Job:AWS:Lambda",
   "ConnectionProfile": "AWS_CONNECTION",
   "FunctionName": "LambdaFunction",
   "Version": "1",
   "Payload" : "{\"myVar\" :\"value1\" \\n\"myOtherVar\" : \"value2\"}"
   "AppendLog": true
}

This AWS job object uses the following parameters :

FunctionName

The Lambda function to execute

Version

(Optional) The Lambda function version

The default is $LATEST (the latest version).

Payload

(Optional) The Lambda function payload, in JSON format

Escape all special characters.

AppendLog

Whether to add the log to the job’s output, either true (the default) or false

Job:AWS:StepFunction

The following example shows how to define a job that executes an AWS Step Function service on an AWS server.

"AwsLambdaJob": {
   "Type": "Job:AWS:StepFunction",
   "ConnectionProfile": "AWS_CONNECTION",
   "StateMachine": "StateMachine1",
   "ExecutionName": "Execution1",
   "Input": ""{\"myVar\" :\"value1\" \\n\"myOtherVar\" : \"value2\"}" ",
   "AppendLog": true
}

This AWS job object uses the following parameters :

StateMachine

The State Machine to use

ExecutionName

A name for the execution

Input

The Step Function input in JSON format

Escape all special characters.

AppendLog

Whether to add the log to the job’s output, either true (the default) or false

Job:AWS:Batch

The following example shows how to define a job that executes an AWS Batch service on an AWS server.

"AwsLambdaJob": {
   "Type": "Job:AWS:Batch",
   "ConnectionProfile": "AWS_CONNECTION",
   "JobName": "batchjob1",
   "JobDefinition": "jobDef1",
   "JobDefinitionRevision": "3",
   "JobQueue": "queue1",
   "AWSJobType": "Array",
   "ArraySize": "100",
   "DependsOn": {
       "DependencyType": "Standard",
       "JobDependsOn": "job5"
       },
   "Command": [ "ffmpeg", "-i" ],
   "Memory": "10",
   "vCPUs": "2",
   "JobAttempts": "5",
   "ExecutionTimeout": "60",
   "AppendLog": false
}

This AWS job object uses the following parameters :

JobName

The name of the batch job

JobDefinition

The job definition to use

JobDefinitionRevision

The job definition revision

JobQueue

The queue to which the job is submitted

AWSJobType

The type of job, either Array or Single

ArraySize

(For a job of type ArrayThe size of the array (that is, the number of items in the array)

Valid values: 2–10000

DependsOn

Parameters that determine a job dependency

    DependencyType

(For a job of type ArrayType of dependency, one of the following values:

  • Standard
  • Sequential
  • N-to-N

   JobDependsOn

The JobID upon which the Batch job depends

This parameter is mandatory for a Standard or N-to-N dependency, and optional for a Sequential dependency.

Command

A command to send to the container that overrides the default command from the Docker image or the job definition

Memory

The number of megabytes of memory reserved for the job

Minimum value: 4 megabytes

vCPUs

The number of vCPUs to reserve for the container

JobAttempts

The number of retry attempts

Valid values: 1–10

ExecutionTimeout

The timeout duration in seconds

AppendLog

Whether to add the log to the job’s output, either true (the default) or false

Job:AWS Glue

The following example shows how to define a job that executes Amazon Web Services (AWS) Glue, a serverless data integration service.

To deploy and run an AWS Glue job, ensure that you have the Control-M Application Integrator plug-in installed and have deployed the AWS Glue integration using the deploy jobtype command.

"AwsGlueJob": {
 "Type": "Job:AWS Glue",
 "ConnectionProfile": "GLUECONNECTION",
 "Glue Job Name": "AwsGlueJobName",
 "Glue Job Arguments": "checked",
 "Arguments": "{\"--myArg1\": \"myVal1\", \"--myArg2\": \"myVal2\"}",
 "Status Polling Frequency": "20"
}

The AWS Glue job object uses the following parameters :

ConnectionProfile

Name of a connection profile to use to connect to the AWS Glue service

Glue Job Name

The name of the AWS Glue job that you want to execute. 

Glue Job Arguments

Whether to enable specification of arguments to be passed when running the AWS Glue job (see next property).

Values are checked or unchecked. The default is unchecked.

Arguments

(Optional) Specific arguments to pass when running the AWS Glue job

Format: {\"--myArg1\": \"myVal1\", \"--myArg2\": \"myVal2\"}

For more information about the available arguments, see Special Parameters Used by AWS Glue in the AWS documentation.

Status Polling Frequency

(Optional) Number of seconds to wait before checking the status of the job.

Default: 30

Back to top

Job:Azure

9.0.19.220 The Azure job type enables you to automate workflows that include a select list of Azure services. To manage Azure-type jobs, you must have the Control-M for Azure plug-in installed in your Control-M environment.

The following JSON objects are available for creating Azure-type jobs:

Additional job types are provided for the following Azure services. To support these job types, you must have each of the relevant Control-M Application Integrator plug-ins installed and you must deploy each integration using the deploy jobtype command.

Job:Azure:Function

The following example shows how to define a job that executes an Azure function service.

"AzureFunctionJob": {
 "Type": "Job:Azure:Function",
 "ConnectionProfile": "AZURE_CONNECTION",
 "AppendLog": false,
 "Function": "AzureFunction",
 "FunctionApp": "AzureFunctionApp",
 "Parameters": [
     {"firstParamName": "firstParamValue"},
 {"secondParamName": "secondParamValue"}
  ]
}

This Azure job object uses the following parameters :

Function

The name of the Azure function to execute

FunctionApp

The name of the Azure function app

Parameters

(Optional) Function parameters defined as pairs of name and value. 

AppendLog

(Optional) Whether to add the log to the job’s output, either true (the default) or false

Job:Azure:LogicApps

The following example shows how to define a job that executes an Azure Logic App service.

"AzureLogicAppJob": {
 "Type": "Job:Azure:LogicApps",
 "ConnectionProfile": "AZURE_CONNECTION",
  "LogicAppName": "MyLogicApp",
 "RequestBody": "{\\n  \"name\": \"BMC\"\\n}",
 "AppendLog": false
}

This Azure job object uses the following parameters :

LogicAppName

The name of the Azure Logic App

RequestBody

(Optional) The JSON for the expected payload

AppendLog

(Optional) Whether to add the log to the job’s output, either true (the default) or false

Job:Azure:BatchAccount

The following example shows how to define a job that executes an Azure Batch Accounts service.

"AzureBatchJob": {
 "Type": "Job:Azure:BatchAccount",
 "ConnectionProfile": "AZURE_CONNECTION",
 "JobId": "AzureJob1",
 "CommandLine": "echo \"Hello\"",
 "AppendLog": false,
 "Wallclock": {
   "Time": "770",
   "Unit": "Minutes"
 },
 "MaxTries": {
   "Count": "6",
   "Option": "Custom"
 },
 "Retention": {
   "Time": "1",
   "Unit": "Hours"
 }
}

This Azure job object uses the following parameters :

JobId

The ID of the batch job

CommandLine

A command line that the batch job runs

AppendLog

(Optional) Whether to add the log to the job’s output, either true (the default) or false

Wallclock

(Optional) Maximum limit for the job's run time

If you do not include this parameter, the default is unlimited run time.

Use this parameter to set a custom time limit. Include the following next-level parameters:

  • Time — number (of the specified time unit), 0 or higher
  • Unit — time unit, one of the following: Seconds, Minutes, Hours, Days

MaxTries

(Optional) The number of times to retry running a failed task

If you do not include this parameter, the default is none (no retries).

Use this parameter to choose between the following options:

  • Unlimited number of retries. For this option, include the following next-level parameter:
    "Option""Unlimited"
  • Custom number of retries, 1 or higher. For this option, include the following next-level parameters:
    • "Count": number
    • "Option": "Custom"

Retention

(Optional) File retention period for the batch job

If you do not include this parameter, the default is an unlimited retention period.

Use this parameter to set a custom time limit for retention. Include the following next-level parameters:

  • Time — number (of the specified time unit), 0 or higher
  • Unit — time unit, one of the following: Seconds, Minutes, Hours, Days

Job:ADF

The following example shows how to define a job that executes an Azure Data Factory (ADF) service, a cloud-based ETL and data integration service that allows you to create data-driven workflows to automate the movement and transformation of data.

To deploy and run an ADF job, ensure that you have the Control-M Application Integrator plug-in installed and have deployed the ADF integration using the deploy jobtype command.

"AzureDataFactoryJob": {
     "Type": "Job:ADF",
     "ConnectionProfile": "DataFactoryConnection",
     "Resource Group Name": "AzureResourceGroupName",
     "Data Factory Name": "AzureDataFactoryName",
     "Pipeline Name": "AzureDataFactoryPipelineName",
     "Parameters": "{\"myVar\":\"value1\", \"myOtherVar\": \"value2\"}",
     "Status Polling Frequency": "20"
}

The ADF job object uses the following parameters :

ConnectionProfile

Name of a connection profile to use to connect to Azure Data Factory

Resource Group Name


The Azure Resource Group that is associated with a specific data factory pipeline. A resource group is a container that holds related resources for an Azure solution. The resource group can include all the resources for the solution, or only those resources that you want to manage as a group.

Data Factory Name

The Azure Data Factory Resource to use to execute the pipeline

Pipeline Name

The data pipeline to run when the job is executed

Parameters

Specific parameters to pass when the Data Pipeline runs, defined as pairs of name and value

Format: {\"var1\":\"value1\", \"var2\":\"value2\"}

Status Polling Frequency

(Optional) Number of seconds to wait before checking the status of the job.

Default: 30

Job:Azure Databricks

The following example shows how to define a job that executes the Azure Databricks service, a cloud-based data analytics platform that enables you to process large workloads of data.

To deploy and run an Azure Databricks job, ensure that you have the Control-M Application Integrator plug-in installed and have deployed the Azure Databricks integration using the deploy jobtype command.

"Azure Databricks notebook": {
     "Type": "Job:Azure Databricks",
     "ConnectionProfile": "AZURE_DATABRICKS",
     "Databricks Job ID: "65",
      "
Parameters": "\"notebook_params\":{\"param1\":\"val1\", \"param2\":\"val2\"}",
      "
Status Polling Frequency": "30"
}

The Azure Databricks job object uses the following parameters :

ConnectionProfile

Name of a connection profile to use to connect to the Azure Databricks workspace

Databricks Job ID

The job ID created in your Databricks workspace

Parameters

Task parameters to override when the job runs, according to the Databricks convention. The list of parameters must begin with the name of the parameter type. For example:

  • "notebook_params":{"param1":"val1", "param2":"val2"}
  •  "jar_params": ["param1", "param2"]

For more information about the parameter types, review the properties of RunParameters in the OpenAPI specification provided through the Azure Databricks documentation.

For no parameters, specify a value of "params": {}. For example:
"Parameters": "params": {}

Status Polling Frequency

(Optional) Number of seconds to wait before checking the status of the job.

Default: 30

Job:AzureFunctions

The following example shows how to define a job that executes a cloud-based Azure Function for serverless application development.

To deploy and run an Azure Functions job, ensure that you have the Control-M Application Integrator plug-in installed and have deployed the Azure Functions integration using the deploy jobtype command.

"AzureFunction": {
     "Type": "Job:AzureFunction",
     "ConnectionProfile": "AZUREFUNCTIONS",
     "Function App": "new-function",
     "Function Name": "Hello",
     "Optional Input Parameters": "\"{\"param1\":\"val1\", \"param2\":\"val2\"}\"",  
}

The Azure Functions job object uses the following parameters :

ConnectionProfile

Name of a connection profile to use to connect to the Azure Functions workspace

Function App

The name of function application that contains your function 

Function Name

The name of the function that you want to run

Optional Input Parameters

Specific parameters to pass when the function runs, defined as pairs of name and value

Format: {\"param1\":\"val1\", \"param2\":\"val2\"}

For no parameters, specify {}.

Job:Azure Batch Accounts

The following example shows how to define a job that executes cloud-based Azure Batch Accounts for large-scale compute-intensive tasks.

To deploy and run an Azure Batch Accounts job, ensure that you have the Control-M Application Integrator plug-in installed and have deployed the Azure Batch Accounts integration using the deploy jobtype command.

"Azure Batch Accounts_Job_2": {
 "Type": "Job:Azure Batch Accounts",
 "ConnectionProfile": "AZURE_BATCH",
 "Batch Job ID": "abc-jobid",
 Task ID Prefix: "ctm",
 "Task Command Line": "cmd /c echo hello from Control-M",
 "Max Wall Clock Time": "Custom",
 "Max Wall Time Digits": "3",
 "Max Wall Time Unit": "Minutes",
 "Max Task Retry Count": "Custom",
 "Retry Number": "3",
 "Retention Time": "Custom",
 "Retention Time Digits": "4",
 "Retention Time Unit": "Days",
 "Append Log to Output": "checked",
 "Status Polling Interval": "20"
 }

The Azure Batch Accounts job object uses the following parameters :

ConnectionProfile

Determines which connection profile to use to connect to Azure Batch.

Batch Job ID

Defines the name of the Batch Account Job created in Azure Portal.

Task ID Prefix

Defines a prefix string to append to the task ID.

Task Command Line

Defines the command line that runs your application or script on the compute node. The task is added to the job at runtime.

Max Wall Clock Time

Defines a maximum time limit for the job run, with the following possible values:

  • Unlimited
  • Custom

Default: Unlimited

Max Wall Time Digits

Defines the number (of the specified time unit) for a custom maximum time limit.

Default: 1

Max Wall Time Unit

Defines one of the following time units for a custom maximum time limit:

  • Seconds
  • Minutes
  • Hours
  • Days

Default: Minutes

Max Task Retry Count

Defines a maximum number of times to retry running a failed task, with the following possible values:

  • Unlimited
  • Custom
  • None

Default: None

Retry Number

Defines the number of retries for a custom task retry count.

Default: 1

Retention Time

Defines a minimum period of time for retention of the Task directory of the batch job, with the following possible values:

  • Unlimited — according to the Azure default (7 days, unless the compute node is removed or the job is deleted)
  • Custom

Default: Unlimited

Retention Time Digits

Defines the number (of the specified time unit) for a custom retention period.

Default: 1

Retention Time Unit

Defines one of the following time units for a custom retention period:

  • Seconds
  • Minutes
  • Hours
  • Days

Default: Hours

Append Log to Output

Whether to add task stdout.txt content to the plugin job output.

Values: checked|unchecked

Default: checked

Status Polling Interval

Number of seconds to wait before checking the status of the job.

Default: 20

Back to top

Job:WebServices

9.0.20.220The following examples shows how to define a Web Services job for execution of standard web services, servlets, or RESTful web services. To manage Web Services jobs, you must have the Control-M for Web Services, Java, and Messaging (Control-M for WJM) plug-in installed in your Control-M environment.

The following example presents a Web Services job that receives input for a calculator service and outputs the result of a simple calculation:

"WebServices_Job": {
  
"Type": "Job:WebServices",
  
"Location": http://www.dneonline.com/calculator.asmx?WSDL,
  
"SoapHeaderFile": "c:\\myheader.txt",
  
"Service": "Calculator(Port:CalculatorSoap)",
  
"Operation": "Add",
  
"RequestType": "Parameter",
  
"OverrideUrlEndpoint": http://myoverridehost.com,
  
"OverrideContentType": "*/*",
  
"HttpConnectionTimeout": "2345",
  
"PreemptiveHttpAuthentication": abc@bmc.com,
  
"IncludeTitleInOutput": true,
  
"ExcludeJobOutput": false,
  
"ConnectionProfile": "CALCULATOR",
  
"Host": "host1",
  
"OutputParameters": [
{
  "Element": "AddResponse.AddResult",
  "HttpCode": "*",
  "Destination": "testResultAdd",
  "Type": "string"
}
 ],
  
"InputParameters": [
{
  "Name": "Add.intA",
  "Value": "97",
  "Type": "string"
},
{
  "Name": "Add.intB",
  "Value": "345",
  "Type": "string"
}
 ],
}

The following example presents a Web Services job that receives all input through a SOAP request to a calculator service and outputs the result of a simple calculation:

"WSSoapRequest": {
  "Type": "Job:WebServices",
  "SoapHeaderFile": "c:\\myheader.txt",
  "Location": http://www.dneonline.com/calculator.asmx?WSDL,
  "Service": "Calculator(Port:CalculatorSoap)",
  "Operation": "Add",
  "RequestType": "FreeText",
  "OverrideUrlEndpoint": http://myoverridehost.com,
  "OverrideContentType": "*/*",
  "HttpConnectionTimeout": "2345",
  "PreemptiveHttpAuthentication": abc@bmc.com,
  "IncludeTitleInOutput": true,
  "ExcludeJobOutput": false,
  "ConnectionProfile": "CALCULATOR",
  "Host": "host1",
  "OutputParameters": [
{
  "Element": "AddResponse.AddResult",
  "HttpCode": "*",
  "Destination": "testResultAdd",
  "Type": "string"
}
  ],
  "Request": [
"<soapenv:Envelope xmlns:soapenv=http://schemas.xmlsoap.org/soap/envelope/ xmlns:tem=http://tempuri.org/>
  <soapenv:Header/>
  <soapenv:Body>
 <tem:Add>
<tem:intA>98978</tem:intA>
<tem:intB>75675</tem:intB>
 </tem:Add>
  </soapenv:Body>
</soapenv:Envelope>"
  ],
}

The following example presents a Web Services job that receives a SOAP request thorugh an input file. It then uses the input file to submit a SOAP request to a calculator service, and outputs the result of a simple calculation:

"WSSoapRequest_InputFile": {
  
"Type": "Job:WebServices",
  
"SoapHeaderFile": "c:\\myheader.txt",
  
"Location": http://www.dneonline.com/calculator.asmx?WSDL,
  
"Service": "Calculator(Port:CalculatorSoap)",
  
"Operation": "Add",
  
"RequestType": "InputFile",
  
"OverrideUrlEndpoint": http://myoverridehost.com,
  
"OverrideContentType": "*/*",
  
"HttpConnectionTimeout": "2345",
  
"PreemptiveHttpAuthentication": abc@bmc.com,
  
"IncludeTitleInOutput": true,
  
"ExcludeJobOutput": false,
  
"ConnectionProfile": "CALCULATOR",
  
"Host": "host1",
  
"OutputParameters": [
{
  "Element": "AddResponse.AddResult",
  "HttpCode": "*",
  "Destination": "testResultAdd",
  "Type": "string"
}
 ],
  
"InputFile": "/home/usr/soap.xml"
}

The following example presents a job that receives input for a calculator REST service and outputs the result of a simple calculation:

"REST_Service_Job": {
  
"Type": "Job:WebServices",
  
"Location": "http://www.dneonline.com",
  
"Service": "/restAPI/calculator.asmx",
  
"Operation": "PUT",
  
"RequestType": "Parameter",
  
"OverrideContentType": "*/*",
  
"HttpConnectionTimeout": "2345",
  
"PreemptiveHttpAuthentication": abc@bmc.com,
  
"IncludeTitleInOutput": true,
  
"ExcludeJobOutput": false,
  
"ConnectionProfile": "CALCULATOR_REST",
  
"Host": "host1",
  
"OutputParameters": [
{
  "Element": "$AddResponse.AddResult",
  "HttpCode": "*",
  "Destination": "testResultAdd",
  "Type": "string"
}
 ],
  
"InputParameters": [
{
  "Name": "intA",
  "Value": "97",
  "Type": "string"
},
{
  "Name": "intB",
  "Value": "345",
  "Type": "string"
},
{
  "Name": "accept-encoding",
  "Value": "*/*",
  "Type": "header"
}
 ],
}

The Web Services job object uses the following parameters :

ConnectionProfile

Name of a connection profile to use to connect to the web service.

SoapHeaderFile

Web service only: The path to a file that contains a predefined SOAP Header to add to the invocation of the target web service SOAP message.

Location

A URL (for either web service or REST service) or fully qualified filename (for a web service) that points to the WSDL of the web service.

Service

A service provided by the company or business.

For a Local File System, this means any service specified in the WSDL file.

For a Web Service URL, this means any service specified in the WSDL URL.

For a REST service, this means the path to the specific REST API.

Operation

For a Web service: An operation available for the specified service.

For a REST service: The HTTP method for REST job execution (GET, POST, PUT, DELETE, HEAD, or OPTIONS)

RequestType

The source of the payload request to submit. The payload can be either a SOAP request (in the case of a web service) or a JSON/XML string (in the case of a REST service). The source can be one of the following:

  • FreeText - Complete request entered in free text. See the Request parameter below.
  • Parameter - Request parameters (for a web service) or query parameters (for a REST service) provided through the InputParameters parameter.
  • InputFile - Complete request provided through a local file. See the InputFile parameter below.

OverrideUrlEndpoint

Web service only: The URL endpoint at the job definition level.

Upon job submission Control-M for Web Services uses the job definition's Endpoint URL, rather than the address location in the WSDL.

OverrideContentType

A preferred HTTP header Content-Type to be used to execute the job.

HttpConnectionTimeout

The maximum number of seconds to wait for the web service to respond, before disconnecting

PreemptiveHttpAuthentication

HTTP Basic Authentication information in the format of <user>@<realm>

This information must match the HTTP Basic Authentication information defined through the connection profile (not including the password).

IncludeTitleInOutput

Whether an Output banner is written to the Output at the end of job execution.

Values are true or false. The default is true.

ExcludeJobOutput

Whether to exclude information about job output from the Output at the end of job execution.

Values are true or false. The default is false.

OutputParameters

Details of the outcome of selected output parameters. For each output parameter, define the following subparameters:

  • Element - An element in the job output response, specified by its name or using an XPath or JSONPath expression.
  • HttpCode - HTTP code of the job response. Capture of the element to the destination is performed only for the specified HTTP code.
  • Destination - A fully qualified path in URI format or an AutoEdit variable to be assigned to the element.
  • Type - Format type of the element value (for example, string or integer)

InputParameters

Details of the input parameters required by the web service.

For each input parameter, define the following subparameters:

  • Name
  • Value
  • Type - Format type of the parameter value. For an HTTP header, enter header. For any other type, enter the type name that you defined (such as string or i nteger).

Request

Free-text request to submit to the service, one of the following:

  • For a web service: Full SOAP request
  • For a RESTful web service: JSON or XML string

This parameter is relevant only if RequestType is set to FreeText.

InputFile

The fully qualified path to an input file that contains a complete request to submit to the service — either a full SOAP request (for a web service), or a JSON or XML string (for a RESTful service).

This parameter is relevant only if RequestType is set to InputFile.

Back to top

Job:SLAManagement

SLA Management jobs enable you to identify a chain of jobs that comprise a critical service and must complete by a certain time. The SLA Management job is always defined as the last job in the chain of jobs.

To manage SLA Management jobs, you must have the SLA Management add-on (previously known as Control-M Batch Impact Manager) installed in your Control-M environment.

The following example shows the JSON code of a simple chain of jobs that ends with an SLA Management job. In this chain of jobs:

  • The first job is a Command job that prints Hello and then adds an event named Hello-TO-SLA_Job_for_SLA-GOOD.
  • The second (and last) job is an SLA Management job for a critical service named SLA-GOOD. This job waits for the event added by the first job and then deletes it.
{
 "SLARobotTestFolder_Good": {
   "Type": "SimpleFolder",
   "ControlmServer": "LocalControlM",
   "Hello": {
     "Type": "Job:Command",
     "CreatedBy": "emuser",
     "RunAs": "controlm",
     "Command": "echo \"Hello\"",
     "eventsToAdd": {
       "Type": "AddEvents",
       "Events": [
         {
           "Event": "Hello-TO-SLA_Job_for_SLA-GOOD"
         }
        ]
     }
   },
   "SLA": {
     "Type": "Job:SLAManagement",
     "ServiceName": "SLA-GOOD",
     "ServicePriority": "1",
     "CreatedBy": "emuser",
     "RunAs": "DUMMYUSR",
     "JobRunsDeviationsTolerance": "2",
     "CompleteIn": {
       "Time": "00:01"
     },
     "eventsToWaitFor": {
       "Type": "WaitForEvents",
       "Events": [
         {
           "Event": "Hello-TO-SLA_Job_for_SLA-GOOD"
         }
        ]
     },
     "eventsToDelete": {
       "Type": "DeleteEvents",
       "Events": [
         {
           "Event": "Hello-TO-SLA_Job_for_SLA-GOOD"
         }
        ]
     }
   }
 }
}

The following table lists the parameters that can be included in an SLA Management job:

Parameter

Description

ServiceName

A logical name, from a user or business perspective, for the critical service. BMC recommends that the service name be unique.

Names can contain up to 64 alphanumeric characters.

ServicePriority

The priority level of this service, from a user or business perspective.

Values range from 1 (highest priority) to 5 (lowest priority).

Default: 3

CreatedBy

The Control‑M/EM user who defined the job.

RunAs

The operating system user that will run the job.

JobRunsDeviationsTolerance

Extent of tolerated deviation from the average completion time for a job in the service, expressed as a number of standard deviations based on percentile ranges.

If the run time falls within the tolerance set, it is considered on time, otherwise it has run too long or ended too early.

Select one of the following values:

  • 2 — 95.5% (highest confidence in the completion time)
  • 3 — 99.73%
  • 4 — 99.99% (lowest confidence)

Note: The JobRunsDeviationsTolerance parameter and the AverageRunTimeTolerance parameter are mutually exclusive. Specify only one of these two parameters.

AverageRunTimeTolerance

Extent of tolerated deviation from the average completion time for a job in the service, expressed as a percentage of the average time or as the number of minutes that the job can be early or late.

If the run time falls within the tolerance set, it is considered on time, otherwise it has run too long or ended too early.

The following example demonstrates how to set this parameter based on a percentage of the average run time:

      "AverageRunTimeTolerance": {
       "Units": "Percentage",
       "AverageRunTime": "94"

The following example demonstrates how to set this parameter based on a number of minutes:

      "AverageRunTimeTolerance": {
       "Units": "Minutes",
       "AverageRunTime": "10"

Note: The AverageRunTimeTolerance parameter and the JobRunsDeviationsTolerance parameter are mutually exclusive. Specify only one of these two parameters.

CompleteBy

Defines by what time (in HH:MM) and within how many days the critical service must be completed to be considered on time.

In the following example, the critical service must complete by 11:51 PM, 3 days since it began running.

     "CompleteBy": {
      "Time": "23:51",
      "Days": "3"
    }

The default number of days is 0 (that is, on the same day).

Note: The CompleteBy parameter and the CompleteIn parameter are mutually exclusive. Specify only one of these two parameters.

CompleteIn

Defines the number of hours and minutes for the critical service to complete and be considered on time, as in the following example:

      "CompleteIn": {
       "Time": "15:21"
     }

Note: The CompleteIn parameter and the CompleteBy parameter are mutually exclusive. Specify only one of these two parameters.

ServiceActions

Defines automatic interventions (actions, such as rerunning a job or extending the service due time) in response to specific occurrences (If statements, such as a job finished too quickly or a service finished late).

For more information, see Service Actions.

Service Actions

The following example demonstrates a series of Service Actions that are triggered in response to specific occurrences (If statements). Note that this example includes only a select group of If statements and a select group of actions; for the full list, see the tables that follow.

      "ServiceActions": {
       "If:SLA:ServiceIsLate_0": {
         "Type": "If:SLA:ServiceIsLate",
         "Action:SLA:Notify_0": {
           "Type": "Action:SLA:Notify",
           "Severity": "Regular",            
           "Message": "this is a message"    
          },
         "Action:SLA:Mail_1": {
           "Type": "Action:SLA:Mail",
           "Email": "email@okmail.com",       
           "Subject": "this is a subject",   
           "Message": "this is a message"    
        },
       "If:SLA:JobFailureOnServicePath_1": {
         "Type": "If:SLA:JobFailureOnServicePath",
         "Action:SLA:Order_0": {
           "Type": "Action:SLA:Order",       
           "Server": "LocalControlM",        
           "Folder": "folder",               
           "Job": "job",                     
           "Date": "OrderDate",              
           "Library": "library"              
          }
        },
       "If:SLA:ServiceEndedNotOK_5": {
         "Type": "If:SLA:ServiceEndedNotOK",
         "Action:SLA:Set_0": {
           "Type": "Action:SLA:Set",
           "Variable": "varname",            
           "Value": "varvalue"               
          },
         "Action:SLA:Increase_2": {
           "Type": "Action:SLA:Increase",
           "Time": "04:03"                  
          }
        },
       "If:SLA:ServiceLatePastDeadline_6": {
         "Type": "If:SLA:ServiceLatePastDeadline",
         "Action:SLA:Event:Add_0": {
           "Type": "Action:SLA:Event:Add",
           "Server": "LocalControlM",        
           "Name": "addddd",                 
           "Date": "AnyDate"          
        }

The following If statements can be used to define occurrences for which you want to take action:

If statement

Description

If:SLA:ServiceIsLate

The service will be late according to SLA Management calculations.

If:SLA:JobFailureOnServicePath

One or more of the jobs in the service failed and caused a delay in the service.

An SLA Management service is considered OK even if one of its jobs fails, provided that another job, with an Or relationship to the failed job, runs successfully.

If:SLA:JobRanTooLong

One of the jobs in the critical service is late. Lateness is calculated according to the average run time and Job Runtime Tolerance settings.

A service is considered on time even if one of its jobs is late, provided that the service itself is not late.

If:SLA:JobFinishedTooQuickly

One of the jobs in the critical service is early. The end time is calculated according to the average run time and Job Runtime Tolerance settings.

A service is considered on time even if one of its jobs is early.

If:SLA:ServiceEndedOK

The service ended OK.

If:SLA:ServiceEndedNotOK

The service ended late, after the deadline.

If:SLA:ServiceLatePastDeadline

The service is late, and passed its deadline.

For each If statement, you define one or more actions to be triggered. The following table lists the available Service Actions:

Action

Description

Sub-parameters

Action:SLA:Notify

Send notification to the Alerts Window

  • Severity — (optional) severity level: Regular (default), Urgent, or VeryUrgent
  • Message — notification text
    You can include any of the following variables in your message:
    • %%PROBLEMATIC_JOBS
    • %%SERVICE_DUE_TIME
    • %%SERVICE_EXPECTED_END_TIME
    • %%SERVICE_NAME
    • %%SERVICE_PRIORITY

Action:SLA:Mail

Send an email to a specific email recipient.

  • Email — email address
  • Subject — subject line
  • Message — (optional) message body text
    You can include any of the following variables in your message:
    • %%PROBLEMATIC_JOBS
    • %%SERVICE_DUE_TIME
    • %%SERVICE_EXPECTED_END_TIME
    • %%SERVICE_NAME
    • %%SERVICE_PRIORITY

Action:SLA:Remedy

Open a ticket in the Remedy Help Desk.

  • Urgency — (optional) urgency level: Low (default), Medium, High, or Urgent
  • Summary — summary line
  • Message — message body text
    You can include any of the following variables in your message:
    • %%PROBLEMATIC_JOBS
    • %%SERVICE_DUE_TIME
    • %%SERVICE_EXPECTED_END_TIME
    • %%SERVICE_NAME
    • %%SERVICE_PRIORITY

Action:SLA:Order

Run a job, regardless of its scheduling criteria.

  • Server — Control-M/Server
  • Folder — name of folder that contains the job
  • Job — name of job
  • Date — (optional) when to run, one of the following:
    NextOrderDate
    , PrevOrderDate, NoDate, OrderDate  (default), AnyDate, or a specific date in mm/dd format
  • Library — (z/OS job only) name of the z/OS library that contains the job

Action:SLA:SetToOK

Set the job's completion status to OK, regardless of its actual completion status.

  • Server — Control-M/Server
  • Folder — name of folder that contains the job
  • Job — name of job
  • Date — (optional) schedule for setting to OK, one of the following:
    NextOrderDate
    , PrevOrderDate, NoDate, OrderDate  (default), AnyDate, or a specific date in mm/dd format

Action:SLA:SetToOK:ProblematicJob

Set the completion status to OK for a job that is not running on time and will impact the service.

No parameters

Action:SLA:Rerun

Rerun the job, regardless of its scheduling criteria

  • Server — Control-M/Server
  • Folder — name of folder that contains the job
  • Job — name of job
  • Date — (optional) when to rerun, one of the following:
    NextOrderDate
    , PrevOrderDate, NoDate, OrderDate  (default), AnyDate, or a specific date in mm/dd format

Action:SLA:Rerun:ProblematicJob

Rerun a job that is not running on time and will impact the service.

No parameters

Action:SLA:Kill

Kill a job while it is still executing.

  • Server — Control-M/Server
  • Folder — name of folder that contains the job
  • Job — name of job
  • Date — (optional) when to kill the job, one of the following:
    NextOrderDate
    , PrevOrderDate, NoDate, OrderDate  (default), AnyDate, or a specific date in mm/dd format

Action:SLA:Kill:ProblematicJob

Kill a problematic job (a job that is not running on time in the service) while it is still executing.

No parameters

Action:SLA:Set

Assign a value to a variable for use in a rerun of the job.

  • Variable — name of variable
  • Value — value to assign to the variable

Action:SLA:SIM

Send early warning notification regarding the critical service to BMC Service Impact Manager.

  • ConnectTo — target ProactiveNet Server/Cell, defined as hostname[:port]
    The default port is 1828.
  • Message — notification text, up to 211 characters.
    You can include any of the following variables in your message:
    • %%PROBLEMATIC_JOBS
    • %%SERVICE_DUE_TIME
    • %%SERVICE_EXPECTED_END_TIME
    • %%SERVICE_NAME
    • %%SERVICE_PRIORITY

Action:SLA:Increase

Allow the job or critical service to continue running by extending (by hours and/or minutes) the deadline until which the job or service can run and still be considered on time.

  • Time — amount of time to add to the service, in HH:MM format


Action:SLA:Event:Add

Add an event.

  • Server — Control-M/Server
  • Name — name of the event
  • Date — (optional) when to kill the job, one of the following:
    NextOrderDate
    , PrevOrderDate, NoDate, OrderDate  (default), AnyDate, or a specific date in mm/dd format

Action:SLA:Event:Delete

Delete an event.

  • Server — Control-M/Server
  • Name — name of the event
  • Date — (optional) when to kill the job, one of the following:
    NextOrderDate
    , PrevOrderDate, NoDate, OrderDate  (default), AnyDate, or a specific date in mm/dd format

Back to top

Job:UI Path

The following example shows how to define a UiPath job, which performs robotic process automation (RPA).

To deploy and run a UiPath job, ensure that you have the Control-M Application Integrator plug-in installed and have deployed the UiPath integration using the deploy jobtype command.

"UI Path_Job": {
 "Type": "Job:UI Path",
 "ConnectionProfile": "UIPATH_Connect",
 "Folder Name": "Default",
 "Folder Id": "374999",
 "Process Name": "control-m-process",
 "packagekey": "209c467e-1704-4b6y-b613-6c5a2c9acbea",
 "Robot Name": "abc-ctm-bot",
 "Robot Id": "153999",
 "Optional Input Parameters": "{
     "
parm1": "Value1",
     "
parm2": "Value2",
     "
parm3": "Value3"
     }"
,
 "Status Polling Frequency": "30",
 "Host": "host1"
 }

The UiPath job object uses the following parameters :

ConnectionProfile

Name of a connection profile to use to connect to the UiPath Robot service

Folder Name

Name of the UiPath folder where UiPath projects are stored

Folder Id

Identification number for the UiPath folder

Process Name

Name of a UiPath process associated with the UiPath folder

packagekey

UiPath package published from the UiPath Studio to the UiPath Orchestrator

Robot Name

UiPath Robot name

Robot Id

UiPath Robot identification number

Optional Input Parameters

( Optional ) Input parameters to be passed on to job execution, in the following format:
{"parm1": "val1", "parm2": "val2", "parm3": "val3"}

Status Polling Frequency

(Optional) Number of seconds to wait before checking the status of the job.

Default: 15

Host

Name of the host machine where the job runs. A Control-M/Agent must be installed on this host. Optionally, you can define a host group instead of a host machine.

NOTE : If this parameter is left blank, the job is submitted for execution on the Control-M Scheduling Server host.

Back to top

Job:GCP DataFlow

The following example shows how to define a Google Cloud Platform (GCP) Dataflow job, which performs cloud-based  data processing for batch and real-time data streaming applications .

To deploy and run a GCP Dataflow job, ensure that you have the Control-M Application Integrator plug-in installed and have deployed the GCP Dataflow integration using the deploy jobtype command.

"GCP DataFlow_Job_1": {
 "Type": "Job:GCP DataFlow",
 "ConnectionProfile": "GCPDATAFLOW",
 "Project ID": "applied-lattice-11111",
 "Location": "us-central1",
 "Template Type": "Classic Template",
 "Template Location (gs://)": "gs://dataflow-templates-us-central1/latest/Word_Count",
 "Parameters (JSON Format)": {
   "jobName": "wordcount",
   "parameters": {
       "inputFile": "gs://dataflow-samples/shakespeare/kinglear.txt",
       "output": "gs://controlmbucket/counts"
       }
   }
 "Verification Poll Interval (in seconds)": "10",
 "output Level": "INFO",
 "Host": "host1"
}

The GCP Dataflow job object uses the following parameters :

ConnectionProfile

Defines the name of a connection profile to use to connect to Google Cloud Platform.

Project ID

Defines the project ID for your Google Cloud project.

Location

Defines the Google Compute Engine region to create the job.

Template Type

Defines one of the following types of GCP Dataflow templates:

  • Classic Template - Developers run the pipeline and create a template. The Apache Beam SDK stages files in Cloud Storage, creates a template file (similar to job request), and saves the template file in Cloud Storage.
  • Flex Template - Developers package the pipeline into a Docker image and then use the Google Cloud CLI to build and save the Flex Template spec file in Cloud Storage.

Template Location (gs://)

Defines the path for temporary files. This must be a valid Google Cloud Storage URL that begins with gs://.

The pipeline option tempLocation is used as the default value, if it has been set.

Parameters (JSON Format)

Defines input parameters to be passed on to job execution, in JSON format (name:value pairs).

This JSON must include the jobname and parameters elements.

Verification Poll Interval (in seconds)

(Optional) Determines the number of seconds to wait before checking the status of the job.

Default: 10

output Level

Determines one of the following levels of details to retrieve from the GCP outputs in the case of job failure:

  • TRACE
  • DEBUG
  • INFO
  • WARN
  • ERROR

Host

Defines the name of the host machine where the job runs. A Control-M/Agent must be installed on this host. Optionally, you can define a host group instead of a host machine.

NOTE : If this parameter is left blank, the job is submitted for execution on the Control-M Scheduling Server host.


Back to top

Job:GCP Dataproc

The following examples show how to define a Google Cloud Platform (GCP) Dataproc job, which performs cloud-based big data processing and machine learning.

To deploy and run a GCP Dataproc job, ensure that you have the Control-M Application Integrator plug-in installed and have deployed the GCP Dataproc integration using the deploy jobtype command.

The following example shows a job for a Dataproc task of type Workflow Template:

"GCP Dataproc_Job": {  
 "Type": "Job:GCP Dataproc",
 "ConnectionProfile": "GCPDATAPROC",
 "Project ID": "gcp_projectID",
 "Account Region": "us-central1",
 "Dataproc task type": "Workflow Template",
 "Workflow Template": "Template2",
 "Verification Poll Interval (in seconds)": "20",
 "Tolerance": "2"
}

The following example shows a job for a Dataproc task of type Job:

"GCP Dataproc_Job": {
     "Type": "Job:GCP Dataproc",
     "ConnectionProfile": "GCPDATAPROC",
     "Project ID": "gcp_projectID",
     "Account Region": "us-central1",  
     "Dataproc task type": "Job",
     "Parameters (JSON Format)": {
"job": {
 "placement": {},
 "statusHistory": [],
 "reference": {
 "jobId": "job-e241f6be",
 "projectId": "gcp_projectID"
  },
 "labels": {
           "goog-dataproc-workflow-instance-id": "44f2b59b-a303-4e57-82e5-e1838019a812",
           "goog-dataproc-workflow-template-id": "template-d0a7c"
          },
         "sparkJob": {
           "mainClass": "org.apache.spark.examples.SparkPi",
           "properties": {},
           "jarFileUris": [
              "file:///usr/lib/spark/examples/jars/spark-examples.jar"
            ],
           "args": [
              "1000"
            ]
         }
      }
  }
  "Verification Poll Interval (in seconds)": "20",
  "Tolerance": "2"
} 

The GCP Dataproc job object uses the following parameters :

ConnectionProfile

Defines the name of a connection profile to use to connect to Google Cloud Platform.

Project ID

Defines the project ID for your Google Cloud project.

Account Region

Defines the Google Compute Engine region to create the job.

Dataproc task type

Defines one of the following Dataproc task types to execute:

  • Workflow Template - a reusable workflow configuration that defines a graph of jobs with information on where to run those jobs
  • Job - a single Dataproc job 

Workflow Template

(For a Workflow Template task type)  Defines the ID of a Workflow Template.

Parameters (JSON Format)

(For a Job task type) Defines input parameters to be passed on to job execution, in JSON format. 

You retrieve this JSON content from the GCP Dataproc UI, using the  EQUIVALENT REST  option in job settings.

Verification Poll Interval (in seconds)

(Optional) Determines the number of seconds to wait before checking the status of the job.

Default: 20

Tolerance

Defines the number of call retries during the status check phase.

Default:  2 times


Back to top

Job:Boomi

The following example shows how to define a Boomi job, which enables the integration of Boomi processes with your existing Control-M workflows.

To deploy and run a Boomi job, ensure that you have the Control-M Application Integrator plug-in installed and have deployed the Boomi integration using the deploy jobtype command.

"Boomi_Job_2": {
 "Type": "Job:Boomi",
 "ConnectionProfile": "BOOMI_CCP",
 "Atom Name": "Atom1",
 "Process Name": "New Process",
 "Polling Intervals": "20",
 "Tolerance": "3"
}

The Boomi job object uses the following parameters:

ConnectionProfile

Defines the name of a connection profile to use to connect to the Boomi endpoint.

Atom Name

Defines the name of a Boomi Atom associated with the Boomi process.

Process Name

Defines the name of a Boomi process associated with the Boomi Atom.

Polling Intervals

(Optional) Number of seconds to wait before checking the status of the job.

Default: 20 seconds

Tolerance

Defines the number of API call retries during the status check phase. If the API call that checks the status fails due to the Boomi limitation of a maximum of 5 calls per second, it will retry again according to the number in the Tolerance field.

Default: 3 times

Back to top

Job:Databricks

The following example shows how to define a Databricksjob, which enables the integration of jobs created in the Databricks environment with your existing Control-M workflows.

To deploy and run a Databricks job, ensure that you have the Control-M Application Integrator plug-in installed and have deployed the Databricks integration using the deploy jobtype command.

"Databricks_Job": {
 "Type": "Job:Databricks",
 "ConnectionProfile": "DATABRICKS",
 "Databricks Job ID": "91",
 "Parameters": "\"notebook_params\":{\"param1\":\"val1\", \"param2\":\"val2\"}",
 "Status Polling Frequency": "30"
}

The Databricks job object uses the following parameters:

ConnectionProfile

Determines which connection profile to use to connect to the Databricks workspace.

Databricks Job ID

Determines the job ID created in your Databricks workspace.

Parameters

Defines task parameters to override when the job runs, according to the Databricks convention. The list of parameters must begin with the name of the parameter type. For example:

  • "notebook_params":{"param1":"val1", "param2":"val2"}
  •  "jar_params": ["param1", "param2"]

For more information about the parameter types, review the properties of RunParameters in the OpenAPI specification provided through the Azure Databricks documentation.

For no parameters, specify a value of "params": {}. For example:
"Parameters": "params": {}

Status Polling Frequency

(Optional) Determines the number of seconds to wait before checking the status of the job.

Default: 30


Back to top

Job:Microsoft Power BI

The following examples show how to define a Power BI job, which enables integration of Power BI workflows with your existing Control-M workflows.

To deploy and run a Power BI job, ensure that you have the Control-M Application Integrator plug-in installed and have deployed the Power BI integration using the deploy jobtype command.

The following example shows a job for refreshing a dataset in Power BI:

"Microsoft Power BI_Job_2": {
 "Type": "Job:Microsoft Power BI",
 "ConnectionProfile": "POWERBI",
 "Dataset Refresh/ Pipeline Deployment": "Dataset Refresh",
 "Group Name": "Demo",
 "Group ID": "a7989345-8cfe-44e7-851d-81560e67973f",
 "Dataset Name": "Demo_Dataset",
 "Parameters": "{\"type\":\"Full\",\"commitMode\":\"transactional\",\"maxParallelism\":20,\"retryCount\":2}"
}

The following example shows a job for deploying a Power BI Pipeline from dev to test to production:

"Microsoft Power BI_Job_2": {
 "Type": "Job:Microsoft Power BI",
 "ConnectionProfile": "POWERBI",
 "Dataset Refresh/ Pipeline Deployment": "Pipeline Deployment",
 "Pipeline ID": "83f36385-4e38-43g4-8263-10aa12e3175c"
}

The Power BI job object uses the following parameters:

ConnectionProfile

Defines the name of a connection profile to use to connect to the Power BI endpoint.

Dataset Refresh/ Pipeline Deployment

Determines one of the following options for execution in Power BI: 

  • Dataset Refresh
  • Pipeline Deployment 

Group Name

(For Dataset) Defines a Power BI workspace where you want to refresh data.

Group ID

(For Dataset) Defines the ID for the specified Power BI workspace (defined in Group Name).

Dataset Name

Defines a Power BI data set that you want to refresh under the specified workspace.

Parameters

(For Dataset) Defines specific parameters to pass when the job runs, defined as JSON pairs of parameter name and value.

To specify parameters, the dataset must be in Premium group.

Format: {"param1":"value1", "param2":"value2"}

For no parameters, specify {}.

Pipeline ID

Defines the ID of a Power BI pipeline that you want to deploy from dev to test and then to production. 


Back to top

Job:Talend Data Management

The following examples show how to define a Talend Data Management job, which enables the integration of data management and data integration tasks or plans from Talend with your existing Control-M workflows.

To deploy and run a Talend Data Management job, ensure that you have the Control-M Application Integrator plug-in installed and have deployed the Talend Data Management integration using the deploy jobtype command.

The following example shows a job for a Talend task:

"Talend Data Management": {
 "Type": "Job: Talend Data Management",
 "ConnectionProfile": "TALENDDATAM",
 "Task/Plan Execution": "Execute Task",
 "Task Name": "GetWeather job",
 "Parameters": "{"parameter_city":"London","parameter_appid":"43be3fea88g092d9226eb7ca"}"
 "Log Level": "Information",
 "Bring logs to output": "checked",
 "Task Polling Intervals" : "10"
}

The following example shows a job for a Talend plan:

"Talend Data Management": {
 "Type": "Job: Talend Data Management",
 "ConnectionProfile": "TALENDDATAM",
 "Task/Plan Execution": "Execute Plan",
 "Plan Name": "Sales Operation Plan",
 "Plan Polling Intervals" : "10"
}

The Talend Data Management job object uses the following parameters:

ConnectionProfile

Determines which connection profile to use to connect to the Talend Data Management Platform.

Task/Plan Execution

Determines one of the following options for execution in Talend: 

  • Execute Task
  • Execute Plan

Task Name /
Plan Name

Defines the name of the Talend task or plan to execute, as defined in the Tasks and Plans page in the Talend Management Console.

Parameters

(For a task) Defines specific parameters to pass when the Talend job runs, defined as JSON pairs of parameter name and value. All parameter names must contain the parameter_ prefix.

Format: {"parameter_param1":"value1", "parameter_param2":"value2"}

For no parameters, specify {}.

Log Level

(For a task) Determines one of the following levels of detail in log messages for the triggered task in the Talend Management Console:

  • Information — All logs available
  • Warning — Only warning logs
  • Error — Only Error logs
  • Off — No logs

Bring logs to output

(For a task) Determines whether to show Talend log messages in the job output.

Values: checked|unchecked

Default: unchecked

Task Polling Intervals /
Plan Polling Intervals

Determines the number of seconds to wait before checking the status of the triggered task or plan.

Default: 10 second


Back to top

Job:Dummy

The following example shows how to use Job:Dummy to define a job that always ends successfully without running any commands. 

"DummyJob" : {
  "Type" : "Job:Dummy"
}

Job:zOS:Member

The following example shows how to use Job:zOS:Member to run jobs on a z/OS system.

Note: Current support is for unique z/OS Job names only.

{
 "ZF_DOCS" : {
   "Type" : "Folder",
   "ControlmServer" : "M2MTROLM",
   "FolderLibrary" : "IOAA.CCIDM2.CTM.OPR.SCHEDULE",
   "RunAs" : "emuser",
   "CreatedBy" : "emuser",
   "When" : {
     "RuleBasedCalendars" : {
       "Included" : [ "EVERYDAY" ],
       "EVERYDAY" : {
         "Type" : "Calendar:RuleBased",
         "When" : {
           "DaysRelation" : "OR",
           "WeekDays" : [ "NONE" ],
           "MonthDays" : [ "ALL" ]
          }
        }
      }
    },
   "ZJ_DATA" : {
     "Type" : "Job:zOS:Member",
     "SystemAffinity" : "ABCD",
     "SchedulingEnvironment" : "PLEX8ALL",
     "ControlDCategory" : "SEQL_FILE",
     "PreventNCT2" : "Yes",
     "MemberLibrary" : "IOA.WORK.JCL",
     "SAC" : "Prev",
     "CreatedBy" : "emuser",
     "RequestNJENode" : "NODE3",
     "RunAs" : "emuser",
 "StatisticsCalendar": "CALPERIO",
     "TaskInformation" : {
       "EmergencyJob" : true,
"RunAsStartedTask" : true,
"Cyclic": true,
      },
     "OutputHandling" : {
   "Operation" : "Copy"
       "FromClass" : "X",
       "Destination" : "NODE3",
      },
     "History" : {
"RetentionDays": "05",
       "RetentionGenerations" : "07"
      },
     "Archiving" : {
       "JobRunsToRetainData" : "4",
       "DaysToRetainData" : "1",
       "ArchiveSysData" : true
      },
     "Scheduling" : {
       "MinimumNumberOfTracks" : "5",
       "PartitionDataSet" : "fgf"
      },
     "RerunLimit" : {
       "RerunMember" : "JOBRETRY",
       "Units" : "Minutes",
       "Every" : "7"
      },
 "MustEnd" : {
 "Minutes" : "16",
 "Hours" : "17",
 "Days" : "0"
  },
     "When" : {
       "WeekDays" : [ "NONE" ],
       "Months" : [ "NONE" ],
       "MonthDays" : [ "NONE" ],
       "DaysRelation" : "OR"
      },
     "CRS" : {
       "Type" : "Resource:Lock",
       "IfFail" : "Keep",
       "LockType" : "Shared"
      },
     "QRS" : {
       "Type" : "Resource:Pool",
       "IfFail" : "Keep",
       "IfOk" : "Discard",
       "Quantity" : "1"
      },
     "Demo" : {
       "Type" : "StepRange",
       "FromProgram" : "STEP1",
       "FromProcedure" : "SMPIOA",
       "ToProgram" : "STEP8",
       "ToProcedure" : "CTBTROLB"
      },
     "IfCollection:zOS_0" : {
       "Type" : "IfCollection:zOS",
       "Ifs" : [ {
         "Type" : "If:zOS:AnyProgramStep",
         "ReturnCodes" : [ "OK" ],
         "Procedure" : "SMPIOA"
        }, "OR", {
         "Type" : "If:zOS:EveryProgramStep",
         "ReturnCodes" : [ "*$EJ", ">S002" ],
         "Procedure" : "SMPIOA"
        } ],
       "CtbRuleData_2" : {
         "Type" : "Action:ControlMAnalyzerRule",
         "Name" : "RULEDEMO",
         "Arg" : "3"
        }
      },
     "IfCollection:zOS_1" : {
       "Type" : "IfCollection:zOS",
       "Ifs" : [ {
         "Type" : "If:zOS:SpecificProgramStep",
         "Program" : "Demo",
         "ReturnCodes" : [ "*****" ],
         "Procedure" : "SMPIOA"
        }, "OR", {
         "Type" : "If:zOS:SpecificProgramStep",
         "Program" : "STEP5",
         "ReturnCodes" : [ ">U0002" ],
         "Procedure" : "SMPIOA"
        } ],
       "IfRerun_2" : {
         "Type" : "Action:Restart",
         "FromProgram" : "STEP1",
         "FromProcedure" : "SMPIOA",
 "ToProgram" : "STEP5",
     "ToProcedure" : "CTBTROLB"
      "Confirm" : false,          
        }
      }
    }
  }
}

FolderLibrary

Defines the location of the Member that contains the job folder.

Rules:

  • 1 - 44 characters
  • Built of qualifiers: 1-8 characters in length separated by '.' (min 1 character, cannot begin with a digit character).
  • Invalid characters: Non-English characters or begin with "."
  • Valid characters: A-Z, 0-9, @, #, $

SystemAffinity

Defines the identity of the system in which the Job must be initiated and executed (in JES2).

Rules:

  • 1 - 5 alpha-numeric characters
  • The alpha-numeric characters can be proceeded by a "/". "/" as a first character indicates NOT in JES3.
  • Invalid characters: Non-English characters

SchedulingEnvironment

Defines the JES2 workload management scheduling environment that is to be associated with the Job.

Rules:

  • 1 -16 characters
  • Case Sensitive
  • Invalid Characters: Non-English characters, blanks

ControlDCategory

Defines the name of the Control-D Report Decollating Mission Category. If specified, the report decollating mission is scheduled whenever the Job is scheduled under Control-M.

Rules:

  • 1 - 20 characters
  • Invalid characters: blanks

PreventNCT2

Determines whether to perform data set cleanup before the original job runs.

Values: yes | no

MemberLibrary

Defines the location of the Member that contains the JCL, started task procedure, or warning message.

Rules:

  • 1 - 44 characters
  • Built of qualifiers: 1-8 characters in length separated by '.' (min 1 character, cannot begin with a digit character).
  • Invalid characters: Non-English characters
  • Valid characters: A-Z, 0-9, @, #, $

SAC

(Optional) Determines whether to adjust the logical date for a job converted from a scheduling product other than Control‑M.

Valid values:

  • Blank: No adjustment is made. The SMART folder and its jobs are scheduled according to the regular criteria. This is the default.
  • Prev:
    • SMART folder: The SMART folder is scheduled on the day indicated by the regular scheduling criteria and the preceding day.
    • Job: The job is scheduled on the day that precedes the day indicated by the regular scheduling criteria.
  • Next:
    • SMART folder: The SMART folder is scheduled on the day indicated by the regular scheduling criteria and the following day.
    • Job: The job is scheduled on the day that follows the day indicated by the regular scheduling criteria.

RequestNJENode

Defines the node in the JES network where the Job executes

Rules:

  • 1 - 8 characters
  • Invalid Characters: Single quotation marks,"$", "/", "*", "?", " "

StatisticsCalendar

(Optional) Defines the Control-M periodic calendar used to collect statistics relating to the job. This provides more precise statistical information about the job execution. If the StatisticsCalendar parameter is not defined, the statistics are based on all run times of the job.

Rules:

  • 1 - 8 alphanumeric characters
  • Case sensitive
  • Invalid Characters: Blanks and non-English characters

TaskInformation

Defines additional optional settings for the job.

  EmergencyJob

Determines whether to run the job as an emergency job.

Values: true | false

  RunAsStartedTask

Determines whether to run the job as a started task.

Values: true | false

  Cyclic

Determines if the job is run as a cyclic job.

Values: true | false

Default is false

OutputHandling

Defines how the job output is handled.

  Operation

Defines the output handling action.

Valid values:

  • None: Default
  • Delete: Deletes the output
  • Copy: Copies the output to a selected filename
  • Move: Moves the output to a new selected path
  • ChangeJobClass: Changes the class of the job output

  FromClass

Defines the previous class name.

  Destination

Defines the output name and full path to move the output.

Note: Do not use an internal Control-M directory or subdirectory.

Mandatory if the value for Operation is Copy, Move, or ChangeJobClass.

An asterisk (*) indicates the original MSGCLASS for the job output.

History

(Optional) Determines how long to retain the job in the History Jobs file

Note: Retention Days and Retention Generations are mutually exclusive. A value can be specified for either, but not both.

  RetentionDays

Number of days 

Valid values: 001 - 999

  RetentionGenerations

Number of generations

Valid values: 000 - 999

Archiving

Determines how long Control-M Workload Archiving retains the job output

  JobRunsToRetainData

Determines the number of times the job run data is retained in the job output

  DaysToRetainData

Determines the number of days the job run data is retained in the job output

  ArchiveSysData

Determines whether to archive the job SYSDATA.

Values: true | false

Scheduling

Defines the scheduling parameters when or how often the job is scheduled for submission

  MinimumNumberOfTracks

Determines the minimum number of free partitioned data set tracks required by the library specified for the PartitionDataSet parameter.

  PartitionDataSet

Defines the name of a partitioned data set to check for free space. If PartitionDataSet has fewer than the minimum number of required free tracks specified in the MinimumNumberOfTracks parameter, the job executes.

RerunLimit

Determines the maximum number of reruns that can be performed for the job. 

When a z/OS job reruns, the job status is set to NOTOK, even if it was previously specified as OK.

  RerunMember

Defines the name of the JCL member to use when the job automatically reruns. 

Rules:

  • 1 - 8 characters
  • Case sensitive
  • Invalid Characters: Blanks and non-English characters

  Units

Defines the unit of measurement to wait between reruns.

Valid values:

  • Seconds
  • Minutes
  • Hours

  Every

Determines the number of Units to wait between reruns.

MustEnd

Defines the time of day and days offset when the folder must finish executing.

  Hours

Hour of the day

Format: HH

Valid values: 00 - 23

  Minutes

Minutes of the hour

Format: MM

Valid values: 00 - 59

  Days

Number of days

Format: DDD

Valid values: 000 - 120

LockType

Determines whether a lock resource is shared or exclusive. For more information, see Resources.

IfFail

Determines what happens to the lock or pool resource if the job fails to use the resource. For more information, see Resources.

Valid values:

Release | Keep

IfOk

Determines what happens to a pool resource if the job successfully uses the resource. For more information, see Resources.

Valid values:

Discard | Release

Quantity

Determines the number of lock or pool resources to allocate to the job. For more information, see Resources.

StepRange

Determines the job steps to execute during restart of a job.

Parameters:

  • FromProgram: First program step within the job stream
  • FromProcedure: First procedure step in the range
  • ToProgram: Last program step within the job stream
  • ToProcedure: Last procedure step in the range

Parameter rules:

  • 1 - 8 characters
  • Invalid Characters: Blanks and non-English characters

IfCollection:zOS - Ifs

The following unique If objects apply to a z/OS job:

  • If:zOS:AnyProgramStep:  Indicates that the Do Statements must be performed if the specified codes are found in any program step.
    • Procedure: Defines the name of the procedure step
    • ReturnCodes: Assigns a completion code for the entire job that are based on the steps completion codes. Enter more than one ReturnCode in an array separated by commas. For example: [ "<value1", "value2" ] . Valid completion codes are as follows:
      • *****: Job ended
      • OK: Job ended OK 
      • NOTOK: Job ended not OK 
      • Cnnnn: Condition return code (may be preceded by: < > = !)
      • Sxxx: System abend code  (may be preceded by: < > = !)
      • Unnnn: User abend code (may be preceded by: < > = !)
      • $EJ: Job queued for execution
      • *NCT2: File allocation problem 
      • *REC0: Maximum reruns number reached 
      • *TERM: Job terminated by CMEM 
      • *UNKW: Unknown error occurred 
      • FLUSH: Step not executed 
      • FORCE: Job was Forced OK 
      • JFAIL: Job failed due to JCL error
      • JNSUB: Job not submitted 
      • JSECU: Job failed due to security requirements 
      • JLOST: Job output was lost 
      • JNRUN: Job was cancelled during execution 
  • If:zOS:EveryProgramStep:  Indicates that the Do Statements must be performed if the specified codes are found in any program step.
  • If:zOS:NumberOfFailures: Determines whether the accompanying DO statements are performed if the job's number of failures is satisfied.
    • NumberOfFailures: Determines the number of times a job can fail before an action is taken.
  • If:zOS:SpecificRangeName: Specifies a range of steps in the steps of an PGMST statement.
    • Program: Defines the name of a specific program step
  • If:zOS:SpecificProgramStep:  Name of a specific program step. If a specific program step is specified, only program steps from the invoked program are checked to see if they satisfy the code criteria. Program steps directly from the job are not checked.
    • Program: Defines the name of a specific program step
  • If:zOS:JOBRCCodes: Assigns a completion code for the entire job based on the completion codes of its steps. 
  • If:zOS:OutputPattern: Indicates that the DO statements must be performed if the specified pattern is found in the output. 
    • OutputPattern: Defines a string in the  output. 1-40 characters
    • FromColumn: Defines the first column to look for the pattern. 3 digit number.
    • ToColumn: Defines the last column to look for the pattern. 3 digit number.

IfCollection:zOS - Actions

The following unique Action objects apply to a z/OS job:

  • Action:Restart: An object that determines whether to restart the job automatically if the job fails, the step to start from, and the step to end at. 
    • Confirm: Determines if the job restarts automatically. Values: true | false (The default is false)
  • Action:ControlMAnalyzerRule: An object that defines the Control‑M/Analyzer rule that Control-M executes.
    • Name: Defines the name of the Control‑M/Analyzer rule or mission. Mandatory.
    • Arg: Defines the arguments to be passed to the Control‑M/Analyzer step. Optional.

Job:zOS:InStreamJCL

The following example shows how to create an in-stream JCL job which runs an embedded script on a z/OS system:

{
 "ZF_ROBOT" : {
   "Type" : "SimpleFolder",
   "ControlmServer" : "R2MTROLM",
   "FolderLibrary" : "CTMP.V900.SCHEDULE",
   "OrderMethod" : "Manual",
   "Z_R1" : {
     "Type" : "Job:zOS:InStreamJCL",
 "JCL" : "//ROASMCL JOB ,ASM,CLASS=A,REGION=0M\\n//JCLLIB ORDER=IOAP.V900.PROCLIB\\n//INCLUDE MEMBER=IOASET\\n//S1 EXEC IOATEST,PARM='TERM=C0000'\\n//S2 EXEC IOATEST,PARM='TERM=C0000'",
     "CreatedBy" : "emuser",
     "RunAs" : "emuser",
     "When" : {
       "WeekDays" : [ "NONE" ],
       "MonthDays" : [ "ALL" ],
       "DaysRelation" : "OR"
      },
     "Archiving" : {
       "ArchiveSysData" : true
      }
    }
  }
}

For descriptions of parameters, see the list of parameters available for Job:zOS:Member (except for MemberLibrary, which is not relevant here).

The following additional parameter is required for an in-stream JCL job:

JCL

Defines a script as it would be specified in a terminal for the specific computer and is part of the job definition. Each line begins with // and ends with \\n

Other Job Types

The following job types can also be deployed by Control-M Automation API.

Tandem and VMware jobs are not supported on Control-M Web. Mapping and OS2200 jobs are not supported at all.

Note: These job types are currently available to enable migration of any job type across environments with minimal efforts using Deploy API commands, and are not intended for creating new jobs. BMC is continuously developing these job types to enable the creation of all job types using API. If you have specific requirements, contact Support or BMC Community so we can prioritize development.

Job Type

Description

Job:Messaging:FreeText

Enables you to send or receive a JMS or IBM WebSphereMQ Series messages to the message queue of another application with a free text message.

Job:Messaging:WaitForReply

Enables you to wait and consume a message from the reply queue/topic, according to the Connection Profile.

Job:Messaging:PreDefined

Enables you to send or receive a JMS or IBM WebSphereMQ Series messages to the message queue of another application with a predefined message.

Job:SAP:BW:InfoPackage

Enables you to run pre-defined SAP Process Chains  or SAP Infopackages, and monitor their completion status.

Job:SAP:DataArchiving

Enables you to automate Data   Archiving  sessions. There are 3 data archiving job types:

  • Job:SAP:DataArchiving:Write:  Spawns  Delete jobs in the SAP system that then spawn  Store jobs.
  • Job:SAP:DataArchiving:Delete:  The  Delete jobs that were created by the  Write job in SAP are ordered automatically into Control-M by the Extractor process.
  • Job:SAP:DataArchiving:Store: The  Store jobs that were created by the  Delete jobs in SAP are ordered automatically into Control-M by the Extractor process.

Job:SAP:R3:PredefinedSapJob

Enables you to copy an existing SAP R3 job.

Job:SAP:R3:MonitorSapJob

Enables you to monitor a SAP R3 job.

Job:SAP:R3:BatchInputSession

Enables you to run a SAP R3 job from a specific Batch Input Session.

Job:SAP:R3:SapProfile:Activate

Enables you to activate SAP profiles.

Job:SAP:R3:SapProfile:Deactivate

Enables you to deactivate SAP profiles.

Job:SAP:R3:TriggerSapEvent

Enables you to trigger a SAP event.

Job:SAP:R3:WatchSapEvent

Enables you to watch a SAP event.

Job:OEBS

Enables you to introduce all Control-M capabilities to Oracle E-Business Suite.

Job:IBMDataStage

Enables you to monitor or create a DataStage job.

Job:Java

Enables you to schedule a Java class or a J2EE Enterprise Java Beans (EJBs) running on a J2EE application server, such as IBM WebSphere, BEA WebLogic, JBoss, and SAP NetWeaver.

Job:IBMCognos

Enables you to automate report and job generation for pre-defined IBM Cognos reports and jobs.

Job:NetBackup

Enables you to monitor or create a NetBackup job.

Job:Tandem:TACLScript

Enables you to run TACL scripts on an HPE NonStop (AKA Guardian) operating system.

Job:Tandem:Program

Enables you to execute a program on an HPE NonStop (AKA Guardian) operating system.

Job:Tandem:Command

Enables you to run a command on an HPE NonStop (AKA Guardian) operating system.

Job:Tandem:EmbeddedTACLScript

Enables you to run TACL script, exactly as it is specified in a terminal for the specific computer, on an HPE NonStop (AKA Guardian) operating system.

Job:Tandem:ExternalProcess

Enables you to attach an external process to a Control-M Active job on an HPE NonStop (AKA Guardian) operating system.

Job:VMware:Snapshot:Take

Enables you to create a snapshot a virtual machine (VM).

Job:VMware:Snapshot:Revert

Enables you to change the execution state of a VM to the state of the selected snapshot.

Job:VMware:Snapshot:RevertToCurrent

Enables you to change the execution state of a VM to the state of the current snapshot.

Job:VMware:Snapshot:Remove

Enables you to remove a snapshot of a VM.

Job:VMware:Snapshot:RemoveAll

Enables you to remove all snapshots that are associated with a VM.

Job:VMware:Power:On

Enables you to start up a VM.

Job:VMware:Power:Off

Enables you to shut down a VM.

Job:VMware:Power:Suspend

Enables you to suspend execution capabilities on a VM

Job:VMware:Power:Reset

Enables you to reset a VM.

Job:VMware:Power:Reboot

Enables you to restart a VM.

Job:VMware:Power:Shutdown

Enables you to shut down a guest VM.

Job:VMware:Power:Standby

Enables you to switch a guest VM to standby state.

Job:VMware:Configuration:CloneVirtualMachine

Enables you to clone a VM.

Job:VMware:Configuration:DeployTemplate

Enables you to create a VM from a selected template.

Job:VMware:Configuration:ReconfigureVirtualMachine

Enables you to edit the settings of a VM.

Job:VMware:Configuration:MigrateVirtualMachine

Enables you to migrate a VM's execution to a specific resource pool or host.

Job:OS400:MultipleCommands

Enables you to execute multiple commands in a single job on OS/400 using the Control-M Command line interpreter. Creating multiple commands eliminates the need to use pre and post commands and enables an easier conversion from the ROBOT job schedulers.

Job:OS400:VirtualTerminal

Enables you to define and execute Virtual Terminal types of jobs on OS/400. A Virtual Terminal job emulates an operator's activities on a physical terminal, while playing the recorded activity as a batch process, with the ability to inject input keystrokes onto the screens as well as validate the screen output.

Job:OS400:ExternalJob

Enables you to monitor an external job that is submitted to OS/400 by another job scheduler or process.

Job:OS400:ExternalSubSystem

Enables you to monitor an external subsytem that is submitted to OS/400 by another job scheduler or process.

Job:OS400:Full:ScriptFile

Enables you to create a job that executes a Script file  in a native OS/400, QShell or S/38  environment

Job:OS400:Full:CommandLine

Enables you to execute a Script file  in a native OS/400, QShell or S/38  environment

Job:OS400:Full:SubSystem

Enables you to create a job that starts a subsystem and monitor the active subsystem until it completes.

Job:OS400:Full:DescriptionJob

Enables you to create a job that starts a Job description and monitor it until it completes.

Job:OS400:Full:RestrictedStateAction

Enables you to execute a job while setting the OS/400 system into restricted state.

Job:OS400:Full:Program

Enables you to define and execute an IBM i (AS/400) native program in a library, S/38 program or QShell program.

Job:OS400:Full:MultipleCommands

Enables you to execute multiple commands in a single job on OS/400 using the Control-M Command line interpreter. Creating multiple commands eliminates the need to use pre and post commands and enables an easier conversion from the ROBOT job schedulers.

Job:OS400:Full:VirtualTerminal

Enables you to define and execute Virtual Terminal types of jobs on OS/400. A Virtual Terminal job emulates an operator's activities on a physical terminal, while playing the recorded activity as a batch process, with the ability to inject input keystrokes onto the screens as well as validate the screen output.

Job:OS400:Full:ExternalJob

Enables you to monitor an external job that is submitted to OS/400 by another job scheduler or process.

Job:OS400:Full:ExternalSubSystem

Enables you to monitor an external subsytem that is submitted to OS/400 by another job scheduler or process.

Back to top

 

Tip: For faster searching, add an asterisk to the end of your partial query. Example: cert*