After you implement the abstract
parse method, the parser receives the full name (of the file to parse) as the first parameter and returns a
DataSetList object containing data that has been extracted.
The parser does not find and select files to parse. The ETL framework does this task in advance as per the configuration present during the creation of the ETL.
For example: The ETL is configured to access a Secure File Transfer Protocol (SFTP) folder and select files that match a certain pattern. The ETL framework will copy the selected files via SFTP to the local ETL engine disk and then, it will sequentially call the
parse method of the defined custom parser for each file. This means that the ETL will:
parsemethod for the first file.
parsemethod for the second file.
Consider the following example:
Here you can download the full code of the example presented: MyParserP.pm.