Provisioning and setting up the generative AI provider for your application

 
BMC Software uses the Retrieval Augmented Generation (RAG) framework to provide generative AI capabilities. In RAG, the answers are targeted and based on an automatically determined set of knowledge articles derived from the following sources:

• BMC Helix Digital Workplace
• BMC Helix Knowledge Management by ComAround
• BMC Helix ITSM: Knowledge Management
• BMC Helix Business Workflows: Knowledge Management

Before you begin

• Make sure you have the HelixGPT Administrator role to provision your AI provider.
• Specify the API endpoint URL and API key of the generative AI provider that you want to use.
• We recommend that you setthe Tokens Per Minute (TPM) in your third-party GenAI provider console to at least 100,000 TPM. You can review and adjust this setting based on your usage patterns.
• (For version 23.3.02 and version 23.3.03) Set the Content Filter for the model to Default.

Process for setting up BMC HelixGPT

The following image shows the process of setting up BMC HelixGPT and the current step that you are on:

To add an AI model

1. Log in to BMC Helix Innovation Studio.

2. On the Workspace tab, from the Application launcher, select BMC HelixGPT Manager.
3. In HelixGPT Manager, click Settings.
4. On the Settings page, select HelixGPT > Connections > AI service providers.
   The details of the AI service provider models that are supported by default are displayed in the card format.
   Use the toggle button to switch from Card View to Table View.
5. 
6. To add a new model, click Add.
   The Add model window opens.
   
7. In the Add model window, specify the following details:

   Field	Description
   Vendor	Name of the AI model vendor
   Name	Name of the AI model to be added
   Authentication type	Authentication method that you want to set up for your application
   	API Key	Specify the following fields for this authentication type: Authentication type: API key Version for the AI model API endpoint URL API key
   	OAuth2	Specify the following fields for this authentication type: Authentication type: OAuth2 Version API endpoint URL Auth URL Auth client ID Auth grant type: Password: Authentication user name Password Client credentials: Client secret Authentication scopes
   Version	A version of the AI model
   API endpoint URL	URL of the API
   Max prompt token	Maximum number of tokens (words or parts of words) allowed in the input prompt
   Default config	The additional configurations required for the specified vendor

8. (For Azure OpenAI and OpenAI models with API type authentication) After specifying all the required fields, click Test Connection
   to test the AI service provider settings.
   If the connection test fails, verify that you have entered the correct details.
9. Click Save.

To add Auth headers

Perform the following steps to add the Auth Headers in the OAuth2 authentication method:

1. Log in to BMC Helix Innovation Studio.
2. In Workspace, go to HelixGPT Manager.
3. Select Model and click Edit data.
   The Data Editor (Model) page opens.
4. On the Data editor page, select the record for which you want to add the auth headers.
   The Edit record window opens.
5. In the edit record window, select the OAuth2 authentication type and add the auth headers.
   
6. Click Save.

To edit a model

Perform the following steps to edit the out-of-the-box AI service provider connection in the HelixGPT Manager:

1. Log in to BMC Helix Innovation Studio.
2. On  Workspace tab, from the Application launcher, select BMC HelixGPT Manager.
3. In HelixGPT Manager, click Settings.
4. On the Settings page, select HelixGPT > Connections > AI service providers.
   In the card view, click the name of the model you want to edit; if you have the list view, select the model you want to update and click Edit.
   The Edit model window opens.
5. Make changes in the required fields.
6. (For Azure OpenAI and OpenAI models with API type authentication) After specifying all the required fields, click Test Connection
   to test the AI service provider settings.
   If the connection test fails, verify that you have entered the correct details.
7. Click Save.

Where to go from here

Related topics

Licensing and pricing for BMC HelixGPT

Setting up and going live