Deploying BMC AMI AI Services on your Azure virtual machine


This topic describes how to run Ansible playbooks to deploy BMC AMI AI Serviceson your Azure virtual machine.

To deploy BMC AMI AI Services on Azure virtual machine

  1. Connect to the newly acquired Azure virtual machine via SSH. Make sure that the login credentials have admin access.
  2. Deploy the application. BMC AMI AI Services deployment is divided into these steps:
    1. Step 1 – BMC AMI Platform services deployment
      1. Run the following commands to deploy AMI AI Platform Services: 

        chmod +x BMC-AMI-AI-Platform.sh
        sed -i -e 's/\r$//' BMC-AMI-AI-Platform.sh
        ./BMC-AMI-AI-Platform.sh
      2. When prompted, enter your EPD portal's username and password.
    2. Step 2 – Model Deployment
      1. Based on the selected configuration, you must run the command. Do not run all model commands. 

        LLM

        command

        Mixtral8x7B-instruct Quantized

        chmod +x BMC-AMI-AI-Mixtral.sh
        sed -i -e 's/\r$//' BMC-AMI-AI-Mixtral.sh
        ./BMC-AMI-AI-Mixtral.sh

        Meta-Llama-3-8B-instruct 4K Quantized (GPU)

        chmod +x BMC-AMI-AI-Llama-GPU.sh
        sed -i -e 's/\r$//' BMC-AMI-AI-Llama-GPU.sh
        ./BMC-AMI-AI-Llama-GPU.sh

        Meta-Llama-3-8B-instruct 4K Quantized (CPU)

        chmod +x BMC-AMI-AI-Llama.sh
        sed -i -e 's/\r$//' BMC-AMI-AI-Llama.sh
        ./BMC-AMI-AI-Llama.sh
      2. When prompted, enter your EPD portal's username and password.

Where to go from here

See Verifying-the-BMC-AMI-AI-Services-on-Azure-virtual-machine.


 

Tip: For faster searching, add an asterisk to the end of your partial query. Example: cert*