ETL development API constructs

You can develop an ETL by writing one of the following modules:

  • An extractor module: If you need to extract data from a database or from any other source that provides a connect, query, or disconnect paradigm to extract data. For this, you'll need to implement the extract method. For more information, see Developing-a-custom-extractor-module.
  • A parser module: If you want to extract data from a set of files, or from any other source that provides a file-oriented data format, that must be parsed to extract KPIs. For this, you'll need to implement the parse method. For more information, see Developing-a-custom-parser-module.

Related topics

Developing-custom-ETLs

Understanding-data-modeling-to-develop-custom-ETLs 

Extractors and parsers access ETL configuration using the Conf object. This object includes various methods that enable you to perform different operations. Examples of some common operations are:

  • Create an instance of the Conf object that contains the current ETL configuration —

    DBConf cnf = (DBConf)this.getConf();

  • Read the configuration property —

    String val = conf.getProperty(<propertyname>);

  • Read the log level —

    Conf.PROP_LOGLEV

For more information about the ETL development constructs, see the following topics:

 

Tip: For faster searching, add an asterisk to the end of your partial query. Example: cert*