Managing ETL and System tasks
Tasks are TrueSight Capacity Optimization activities that can be run manually or scheduled for automatic execution.
All tasks are grouped in two macro categories, System tasks and ETL tasks. You can access these tasks by navigating to Administration > ETL & SYSTEM TASKS. In the main page for each category, tasks are summarized in a table that shows the status of all the tasks in that category.
The following sections in this topic describe interface functions common to the System tasks and ETL tasks pages:
Understanding the task summary table
The main component of the System tasks and ETL tasks pages is the task status summary table, which lists all configured tasks and their execution results.
You can filter the list of tasks by Task group and Deploy status.
In TrueSight Capacity Optimization, a task can be configured to be executed in the Test or in the Production environment. When a task is created and a Run configuration has been assigned to it, the task will appear in all of the environments for which a Run configuration exists.
For each task, the summary table shows the following details:
A unique identification number
The unique name defined for the task
The current status of the task, which can be one of the following:
The result of the latest execution of the task, which can be one of the following:
Indicates whether the task has already been scheduled for automatic execution, either no or the scheduled execution time
Last exec time
The date and time of the latest execution of the task
Next exec time
The date and time of the next execution (if scheduled)
Active run configuration
The run configuration associated with the task
The name of the scheduler that manages the task
To improve the effectiveness of the summary and to easily spot issues, the task's Last exit determines the color of the task row:
- Green: The latest execution of the task was successful.
- Yellow: The latest execution of the task terminated, but minor errors occurred.
- Red: The task failed, was killed, or was aborted.
- Blue: The task or service (for service ETLs) is currently running.
- White The task has never run.
To see or edit task details, click the name of a task. You can edit the task properties and configuration and perform task-specific actions as described under The task detail page.
To see a log of a task's activities, click the Task execution logs.icon corresponding to the task; for details, see
Task execution logs
To closely inspect the execution of a specific task by viewing its log, clickcorresponding to the task.
Task log page
Each log is composed of one or more rows that detail that task execution; for each row, the following is displayed:
- Timestamp: When the message was recorded
- Type: The message type
- Message: The content of the log message
Under the list of messages, you can navigate through the log, clicking the forward and backward arrows, and you can configure the Page Size.
To update the log messages for a task that is running, click Refresh.
The log page automatically highlights table rows using different colors to easily spot errors and warnings.
ETL tasks can be configured to log their execution at different levels of detail.
Viewing the task details page
To view the details of a task, click the task name in the main summary table (or click Task details on the task log page). A similar page is displayed for system tasks and ETL tasks. The only difference is that a link for Lookup tables is displayed on an ETL task detail page.
You can use the options available in the yellow command bar at the top of the task detail page to execute commands; for a detailed description of the available actions, see Task management.
This section discusses how you can manage system and ETL tasks.
Editing a task
To edit the properties of a task, click its name in the task summary table. The task detail page is displayed. Click one of the following to edit the task:
- Edit: You can modify the General configuration of the task, such as the task name and description, and its scheduling properties.
- Edit this run configurationRun configuration, which is the task's specific properties, and are determined by the task type. in the Run configurations table: You can modify the task's
- The You can manually edit ETL properties from this page link at the bottom of the Run configuration tab (for TrueSight Capacity Optimization administrators and expert users only): You can add or remove customized configuration properties to better suit your needs (for example, when creating custom ETL tasks). For details, see Custom properties.
After you create a task or modify its scheduling, you must manually reschedule it.
You can edit the run configuration of an ETL even if it is running or is scheduled to run.
You can edit the following properties for any type of task on the Edit task page:
A unique name for the task
Because you can configure more than one ETL task based on the same ETL module, define a unique name for each ETL task. For example, you can name one ETL task London VMware vCenter Servers and another Paris VMware vCenter Servers, with both based on the VMware Extractor Service ETL module.
A description of the task
The type of frequency to schedule task execution (Predefined or Custom).
(For ETL and service ETL tasks only) The task group to which the task is assigned. You can assign tasks to groups and restrict user access according to task group for security reasons.
Running on scheduler
The scheduler to which the task is assigned. There are two options: Generic Scheduler and Primary Scheduler.
A task is defined by properties that define the parameters of the task's execution. All properties defined for a task and their corresponding values are displayed on a run configuration tab for a task. Basic properties are displayed by default; to edit a task's optional properties, click Advanced at the bottom of the tab. To hide advanced properties, click Basic.
For information about what is displayed on a run configuration tab for a task chain, see Task chains.
To create, add or delete custom task properties, or to manually edit their values, click the You can manually edit ETL properties from this page link at the bottom of the Run configuration tab.
You create, add, or delete custom task properties, and manually edit their values, when you create custom tasks with properties unavailable on the Run configuration tab. BMC recommends that only BMC TrueSight Capacity Optimization administrators with a deep understanding of the system create, add, delete, or edit custom task properties.
Adding, editing, and deleting custom properties
To change or define a value for an existing task property
- Do one of the following:
- Change or type a new value for each property that you are modifying.
- If the value requires more space:
- Click ....
- In the Editing property window, change or type a value for the property.
- Click Save.
- Click Save.
To remove a property
- Click Delete corresponding to the property you are removing.
- Click OK.
- Click Save.
To create or add a property
- At Add new property at the bottom of the page, type the name of the new property.
- Click Add.
- Locate the new property in the list of properties, and then type a value.
- Click Save.
To copy a task's properties
- To view a textual representation of all the task properties, click Export.
- Copy the text.
- One way to debug an ETL task is by copying a task's properties into a text file and then manually loading it through a command line interface.
- Also, when you contact BMC Customer Support regarding an ETL task, you may be asked to provide this information.
Task chains execute a list of other tasks, in parallel or serial order, according to properties that you define. A task of the type ChainController is a task chain, and task chains can be defined for both ETL tasks and System tasks.
When you click Edit this run configurationin the Run configurations table, you can modify the following task chain properties:
A unique name for the task chain
Select if the task should be executed in the Test or Production environment.
A description of the task
Select tasks from Available tasks and click >> to add them to Tasks included in chain. You can reorder the tasks.
Type the number of tasks that can be executed simultaneously. This can be set per process or available cores.
Continue on error
Select if you want to ETL task to continue or stop execution when an error is encountered.
Hour mask (leave empty for no mask)
Select the time of the day when the task is scheduled to run.
Day of week mask (leave empty for no mask)
Select the days of the week to schedule the task.
Day of month mask (leave empty for no mask)
Select the days of the month to schedule the task.
Apply mask validation
Select if you want to mask the validation or not.
Execute after time
Specify the time period after which the scheduler task must be executed.
Select if you want the task to be enqueued if other tasks are being executed.
Click Save to add the task chain to Run configurations and it will be set to Active.
You can run this configuration using . The task executions are displayed in Run History with Date, Last exit state, number of warnings, number of errors, number of failures, and run time details.
You can delete a task chain using Delete button.
Two unique task chains are the Daily activity and Maintenance activity system tasks. Daily activity regulates the execution of the daily import activities, while Maintenance activity controls the tasks that perform regular filesystem and data warehouse cleaning.
The Daily activity task chain regulates the execution of all tasks and task chains that are run every night. Therefore, plan carefully any change to this chain.