Updating the data ingest process


This section describes how to update to Java based data ingestion, which involves training and real-time streaming.


Related topic

Follow these steps to update to the latest data ingestion process:

  1. From BMCSAMP data set, copy the AMISMFRH, AMICREAT, and AMIUNTAR members to the UBMCSAMP data set.
  2. Configure the AMISMFRH JCL in UBMCSAMP to set the AMIINST parameter with your BMC AMI Ops Insight installation path.
  3. Copy AMISMFRH JCL member to your system PROCLIB.
  4. Configure and submit the AMICREAT JCL member in UBMCSAMP with the following parameters to create your realtime streaming data directory:

    Information
    AMIINST=’/<AMI Ops Insight installation path>’
    INSTANCE=’srhinst’
    TEMPLATE=’smfrh/tmpl’
  5. In the custom.properties file in the <BMC AMI Ops Insight install path>/aoidata/srhinst directory, set the following properties:

    Information
    • stream.port=
      The port number that you specified in the AMIJCL port parameter.
    • server.port=
      A new port number assigned to the AMISMFRH started task.
  6. Update your existing AMITCJCL member in the PROCLIB, add the following environment variables to the STDENV DD statement. The datasets specified in BMCLINK and BMCLIB environment variables must be APF authorized.

    Informationexport GENERIC_INGEST_HOME=&AMIINST/aoihome/geningest

    export BMCLINK= < BMCLINK or XXLINK of AMIJCL started task>

    export BMCLIB= < BMCLIB or XXLIB of AMIJCL started task>    
                  

  7. In your existing amipdt.properties file in the <AMI Ops Insight install path>/aoidata/aoiinst directory, add the following property:

    Information

    SMF_RECORD_HANDLER_URL= http://localhost: <same port number as server.port>

  8. If you reserved the port numbers assigned to server.port and stream.port in TCP/IP in step 5, assign the same ports to the AMISMFRH started task.
  1. Set file owner of BMC AMI Ops Insight JAVA 17 home directory symbolic link to BPXROOT.
    The AMIUNTAR job for JAVA1764 TAR file sets the file owner to BPXROOT. You must run this job with userID having super user permission (uid=0).

    The Generic Ingest calls BMCSORT from JAVA to sort SMF records. As BMCSORT need to run in supervisor mode, you must set the JAVA path file owner to BPXROOT according to IBM's requirement to prevent SEC6 abend.

 

Tip: For faster searching, add an asterisk to the end of your partial query. Example: cert*

BMC AMI Ops Insight 2.5