Tracking and generating chatbot usage reports

BMC Helix Virtual Agent customers can track events such as successful transfer of chat to a live agent and generate reports. To learn about the out-of-the-box-events that can be tracked, see BMC Helix Virtual Agent usage reports.

This document describes the process for tracking custom events and generating reports for these events. 

BMC Helix ITSM: Smart Reporting licensing and access

As an application business analyst, you generate the chatbot usage metrics reports in BMC Helix ITSM: Smart Reporting after the administrator has assigned the Event Report Access Role in BMC Helix Innovation Studio. The Event Report Access Role enables access to the BMC Helix ITSM: Smart Reporting dashboard. For more information, see  Enabling access to BMC Helix ITSM: Smart Reporting .

Before you begin

• Ensure that you have access to the IBM Watson AssistantSkill.

• Ensure that you have the BMC Helix Innovation Suite license.

• To view the reports, ensure that the administrator has enabled access to the usage reports. For more information, see Enabling access to BMC Helix ITSM: Smart Reporting .

The following table describes the tasks in the process for generating usage reports for a chatbot or a custom application:

Task 1: To create an event definition

1. Log in to BMC Helix Innovation Studio.
2. On the Workspace tab, perform one of the following steps:
   
   1. If you want to create an event definition for BMC Helix Virtual Agent, click BMC Chatbot.
   2. If you want to create an event definition for your chatbot application, select the application in which you have created a chatbot.
   3. If you want to create an event definition for a custom application, select the application.  
3. Click Events > New. 

4. On the Event Properties tab, in the Name field, enter the name of the event. 
   For example, the Knowledge search event. 

   Note

   You cannot rename an event.

5. (Optional) If you want to disable the event for tracking, click the toggle key. 
6. (Optional) If you want to add event attributes, click New Attribute. 
   By default, all events have the UserName (login name of the user) and CreatedDate (time stamp of the event) attributes. You cannot modify or delete these attributes. 
7. Select the type of attribute. 

8. On the Event Attribute Properties tab, enter the attribute name without adding spaces.

   Note

   You cannot rename an event attribute.

9. Click Save.

Task 2: To create the event statistics definition

1. Log in to BMC Helix Innovation Studio.
2. On the Workspace tab, perform one of the following steps:
   
   1. If you want to create an event statistics definition for BMC Helix Virtual Agent, click BMC Chatbot.
   2. If you want to create an event statistics definition for your chatbot application, select the application in which you have created a chatbot. 
   3. If you want to create an event statistics definition for a custom application, select the application.
3. Click Events Statistics > New.

4. On the Event Properties tab, in Name, enter a name for the event statistics definition. 

   For example, for the Knowledge search event, you can add the Knowledge usage statistics.

   Note

   You cannot rename an Event Statistics definition.

5. From the Event list, select the event for which you want to create the event statistics definition. 
   For example, select the Knowledge search event.
6. (Optional) If you do not want to collect these statistics for this event, click the toggle key.

7. (Optional) In the REPORTING section, if you do not want to include the number of event occurrences in the statistics, click the Count Events check box. 
   

8. To group the attributes so that data is consolidated as a single usage metrics, in the Group by Attributes section, click Add Attribute to Group By and select the attributes from the list.
   
   

   Note

   You can group attributes of only integer, text, or boolean data types.

   For example, for the Knowledge Search event and the Knowledge usage statistics, you can group the attributes by Article ID so that the count, average hits, maximum hits, and minimum hits for that article are derived as a single usage metrics report for the Knowledge search event.

9. In Report By, select the frequency at which you want BMC Helix Virtual Agent to report the usage metrics. 

10. Click Save. 

 Task 4: To generate reports

1. Log in to BMC Helix Innovation Studio.
2. On the Workspace tab, click Reports. 
   You are redirected to the reporting dashboard. 
3. Select Browse > Browse All. 
4. In By Folder, click Chatbot Reports and select the report that you want to generate. 
   For example, click the out-of-the-box report Failed transfer to agent. 
5. (Optional) To export the reports, click . 
   
   

 (Optional) To disable event tracking

1. Log in to BMC Helix Innovation Studio.
2. On the Workspace tab, perform one of the following steps:
   
   1. If you want to disable an event for BMC Helix Virtual Agent, click BMC Chatbot.
   2. If you want to disable an event for your chatbot application, select the application in which you have created a chatbot. 
   3. If you want to disable an event for a custom application, select the application.
3. Click Events. 
4. Click the event definition that you want to disable. 
5. On the Event Properties tab, click Enabledin the toggle key.
6. Click Save. 

Troubleshooting report generation or viewing issues

The following table provides the troubleshooting steps if users are unable to generate or view reports:

Related topics 

Tracking application events to generate usage reports

Enabling integration with BMC Helix Digital Workplace Advanced and BMC Helix Business Workflows

Customizing the chatbot actions

Viewing BMC Helix Virtual Agent reporting dashboard

Creating reports for raw events in the Telemetry service

BMC Helix Virtual Agent usage reports