Scheduling the ETL task to run automatically


To keep the data in the BMC Helix Continuous Optimization Data Warehouse up-to-date, you should schedule the ETL task to run on a regular basis.


To schedule the ETL task to run automatically:

Related topic

Using

Reference

  1. On the Run Configuration panel, click Edit task.
  2. On the Edit task panel:
    1. (Optional) In the Description field, add a description.
    2. In the Maximum execution time before warning field, select hours.
    3. In the Frequency field, select Predefined.
    4. In the Predefined frequency field, select Each Day.
    5. In the Start timestamp field, select the starting hour and minute.
    6. In the Running on scheduler field, verify the task is scheduled to run on the remote ETL server where the mainframe ETL was deployed.

    7. (Optional) In Task Group, select the task group.

      image2022-9-2_12-54-18.png

      The scheduling frequency and start time for the ETL task should correspond to your data center operations schedule and Capacity Database Web Services database loading schedule. For example, if SMF records are dumped from SYS1.MANx data sets every day at 1 A.M., then:




        • UIE can be scheduled for 2 A.M.
        • Capacity Database Web Services database population can be scheduled for 3 A.M.
        • The ETL task can be scheduled for 4 A.M.

However, if all weekend data (Saturday and Sunday) is dumped at 1 A.M. Monday, the ETL task that runs on Monday will process only one day out of two. To handle this type of schedule, you can schedule the ETL task to run every 12 hours. On weekdays, the second run will find no new data and will end with a warning, which can be ignored. On Monday, the second run will process Sunday's data.

 

Tip: For faster searching, add an asterisk to the end of your partial query. Example: cert*