ETL development API constructs
You can develop an ETL by writing one of the following modules:
- An extractor module: If you need to extract data from a database or from any other source that provides a connect, query, or disconnect paradigm to extract data. For this, you'll need to implement the
extractmethod. For more information, see Developing a custom extractor module.
- A parser module: If you want to extract data from a set of files, or from any other source that provides a file-oriented data format, that must be parsed to extract KPIs. For this, you'll need to implement the
parsemethod. For more information, see Developing a custom parser module.
Extractors and parsers access ETL configuration using the
Conf object. This object includes various methods that enable you to perform different operations. Examples of some common operations are:
Create an instance of the
Confobject that contains the current ETL configuration —
DBConf cnf = (DBConf)this.getConf();
Read the configuration property —
String val = conf.getProperty(<propertyname>);
Read the log level —
For more information about the ETL development constructs, see the following topics: