Updating the data ingest process

Follow these steps to update to the latest data ingestion process:

1. From BMCSAMP data set, copy the AMISMFRH, AMICREAT, and AMIUNTAR members to the UBMCSAMP data set.
2. Configure the AMISMFRH JCL in UBMCSAMP to set the AMIINST parameter with your BMC AMI Ops Insight installation path.
3. Copy AMISMFRH JCL member to your system PROCLIB.

4. Configure and submit the AMICREAT JCL member in UBMCSAMP with the following parameters to create your realtime streaming data directory:

   InformationAMIINST=’/<AMI Ops Insight installation path>’

   INSTANCE=’srhinst’

   TEMPLATE=’smfrh/tmpl’

   
   

5. In the custom.properties file in the <BMC AMI Ops Insight install path>/aoidata/srhinst directory, set the following properties:

   Information

   • stream.port=
     The port number that you specified in the AMIJCL port parameter.
   • server.port=
     A new port number assigned to the AMISMFRH started task.

   
   

6. Update your existing AMITCJCL member in the PROCLIB, add the following environment variables to the STDENV DD statement. The datasets specified in BMCLINK and BMCLIB environment variables must be APF authorized.

   Informationexport GENERIC_INGEST_HOME=&AMIINST/aoihome/geningest

   export BMCLINK= < BMCLINK or XXLINK of AMIJCL started task>

   export BMCLIB= < BMCLIB or XXLIB of AMIJCL started task>    

                 

7. In your existing amipdt.properties file in the <AMI Ops Insight install path>/aoidata/aoiinst directory, add the following property:

   InformationSMF_RECORD_HANDLER_URL= http://localhost: <same port number as server.port>
   

8. If you reserved the port numbers assigned to server.port and stream.port in TCP/IP in step 5, assign the same ports to the AMISMFRH started task.

1. Set file owner of BMC AMI Ops Insight JAVA 8 home directory symbolic link to BPXROOT.
   The AMIUNTAR job for JAVA8 and JAVA864 TAR files sets the file owner to BPXROOT. You must run this job with userID having super user permission (uid=0).
   The Generic Ingest calls BMCSORT from JAVA to sort SMF records. As BMCSORT need to run in supervisor mode, you must set the JAVA path file owner to BPXROOT according to IBM's requirement to prevent SEC6 abend.

To initiate LISTEN JCL parameter

Previously, the BMC AMI Ops Insight Data Preparation Address space  was responsible for ingesting the SMF records from Datastream. With SPE2204, this processing has moved to the SMF handler, AMISMFRH. 

To implement this change, a new JCL parameter LISTEN=YES/NO is added with default set to NO. The LISTEN=YES/NO JCL parameter determines whether a listener should be initiated or not in the BMC AMI Ops Insight Data Preparation Address space to receive the SMF data from Datastream.

If instructed by support, you can set the the LISTEN parameter in one of the following ways:

• LISTEN=YES—Creates a listener in BMC AMI Ops Insight Data Preparation Address space to receive the SMF data from Datastream. 
  Set LISTEN=YES only if the SMF handler AMISMFRH is disabled.

• LISTEN=NO—Does not receive SMF data from Datastream.
  The following PDTIP0152W message notifies the users that the BMC AMI Ops Insight Data Preparation Address space is not receiving SMF data from Datastream.
  

  InformationPDTIP0152W: LISTEN=NO specified. No BMC AMI Datastream listener attached.