Page tree
Skip to end of metadata
Go to start of metadata

You can develop an ETL by writing one of the following modules:

  • An extractor module: If you need to extract data from a database or from any other source that provides a connect, query, or disconnect paradigm to extract data. For this, you'll need to implement the extract method. For more information, see Developing a custom extractor module.
  • parser module: If you want to extract data from a set of files, or from any other source that provides a file-oriented data format, that must be parsed to extract KPIs. For this, you'll need to implement the parse method. For more information, see Developing a custom parser module.

Extractors and parsers access ETL configuration using the ETL::Conf object. This object includes various methods that enable you to perform different operations. Examples of some common operations are:

  • Create an instance of the ETL::Conf object that contains the current ETL configuration —

    my $conf = $self->getConf();
    
  • Read the configuration property —

    my $val = $conf->getProperty(<propertyname>);
    
  • Read the log level —

    ETL::Conf::PROP_LOGLEV

For more information about the ETL development constructs, see the following topics: