Running ETL using an NSH script
You can run ETL from the command line using the run_etl.nsh script.
When you run the run_etl.nsh script, it executes the scenarios in the specified property file and runs them in the background. By default, run_etl.nsh executes scenarios for all report data groups in parallel sequence (using the default RunETL.properties file) if the database resources allow. However, you can execute scenarios for individual report data groups. The script is located in the etl/bin directory.
The run_etl command has a property file argument that enables you to run an individual scenario that corresponds to one of the report data groups. Using the property file argument, you specify a property file that includes the appropriate individual scenario and any parent scenarios that are required to properly execute that scenario. The property files enable you to customize your reports warehouse updates.
If you limit the number of scenarios that can run in parallel, using the -p property file argument, and the script must execute more scenarios than the limit, it executes scenarios sequentially in groups based on the limit.
For descriptions of the scenarios, their execution dependencies, and property files, see Understanding-data-transfer-scenarios.
You can run the run_etl command on a schedule by using platform-specific OS scheduling or you can run it on demand from the command line.
You can set up schedules to run the run_etl command by using your operating system scheduler (refer to your operating system documentation). You can also schedule
runs for multiple sites. For more information, see Scheduling-ETL-for-multiple-sites.To execute scenarios using run_etl.nsh from the command line
Start the Network Shell and enter the following command:
In this command, the following arguments are mandatory:
- <siteID> is the site ID. This should be a valid site ID from the BL_SITE table.
You can determine the site ID by using the show site command. For details, see Report-Administration-Utility-commands. - <blVersion> is the version number of from which data is to be transferred.
Do not include periods in the version number.
For information about the versions that work with , see BMC-Server-Automation-requirements.
The following arguments are optional:
- <logLevel> indicates the log (or debug) level, which can be a value of 1 to 5, with 1 indicating the lowest logging level (minimal logging) and 5 indicating the highest logging level (detailed logging).
If you do not specify a level, the default level 3 is used. - <parallelismLevel> indicates the number of scenarios to run in parallel. The value can be any number from 1 to 20. It usually depends on system settings and underlying hardware load limits.
If you do not specify a level, the default level 20 is used. - <propertyFile> indicates the property file to run (for a list of the property files representing specific scenarios for report data groups see Property-files).
If you do not specify a property file, the default RunETL.properties file is used. This file includes all scenarios. - <1>|<0> overrides the locking mechanism for the reports data model.
If you do not specify a value, the default setting of 0 is used.