Running the ETL task for the first time



To create the initial lastcounter parameter in BMC Helix Continuous Optimization, you must manually run the BMC Helix Continuous Optimization for Mainframes ETL task with the created run configuration once. By default, this run will process previous day's data (that is, if your run configuration was newly created and not copied from an existing run configuration).

Related topic


  1. On the Run Configuration panel, click Run active configuration, and then click Show log to open the task log.
    image2022-9-2_12-46-58.png(Click on the image to expand)
  2. Scroll to the bottom of the task log and click Refresh several times until the task ends.
    If yesterday's data is not yet available in Capacity Database Web Services database, the log shows no record counts for all data sets.
    image2022-9-2_12-49-29.png
  3. Click Taskdetails to return to the Run Configuration panel.
  4. Click Lastcounter to edit the last counter value.
    You can set the lastcounter value to the date, time, and time zone offset from which you want to start loading data from Capacity Database Web Services database to BMC Helix Continuous Optimization.

    The format of the lastcounter parameter is:
    YYYY-MM-DD hh:mm:ss [+/-hhmm]

    image2022-9-2_12-51-5.png

  5. Click Save to return to the Run Configuration panel.
    Each time this task executes with this run configuration, the ETL attempts to extract data from Capacity Database Web Services database starting with the current date and time of the lastcounter parameter. The ETL attempts to extract as many days as specified in the Custom Parameters tab of the run configuration definition.
    After each successful execution of the task, the lastcounter parameter is updated automatically with the date and time of the most recently extracted data. The next execution starts extracting data based on the updated date and time.

    Important

    You can edit the following aspects of the task:

    • To edit the run configuration, click the edit icon next to the Active field.
    • To edit ETL task properties that are not part of the run configuration (such as scheduling frequency and start time), click Edit on the top left corner.

 

Tip: For faster searching, add an asterisk to the end of your partial query. Example: cert*