Deploying BMC AMI AI Services on Amazon EC2 instance

To deploy BMC AMI AI Services on Amazon EC2 instance

1. Connect to the newly acquired EC2 instance via SSH. Make sure that the login credentials have admin access.
2. Install Python and its dependency on the EC2 instance.

   1. Verify whether Python is already installed by entering the python3 command. If Python is not installed, then run the following commands: 

      sudo apt update
      sudo apt install python3

   2. Install pip by using the following commands: 

      sudo apt update
      sudo apt-get -y install python3-pip
3. Deploy the application. BMC AMI AI Services deployment is divided into these steps:
   1. Step 1 – BMC AMI Platform services deployment

      1. Run the following commands to deploy AMI AI Platform Services: 

         chmod +x BMC-AMI-AI-Platform.sh
         sed -i -e 's/\r$//' BMC-AMI-AI-Platform.sh
         ./BMC-AMI-AI-Platform.sh
      2. When prompted, enter your EPD portal's username and password.
   2. Step 2 – Model Deployment

      1. Based on the selected configuration, you must run the command. Do not run all model commands. 

         LLM	command
         Mixtral8x7B-instruct Quantized	chmod +x BMC-AMI-AI-Mixtral.sh sed -i -e 's/\r$//' BMC-AMI-AI-Mixtral.sh ./BMC-AMI-AI-Mixtral.sh
         Meta-Llama-3-8B-instruct 4K Quantized (GPU)	chmod +x BMC-AMI-AI-Llama-GPU.sh sed -i -e 's/\r$//' BMC-AMI-AI-Llama-GPU.sh ./BMC-AMI-AI-Llama-GPU.sh
         Meta-Llama-3-8B-instruct 4K Quantized (CPU)	chmod +x BMC-AMI-AI-Llama.sh sed -i -e 's/\r$//' BMC-AMI-AI-Llama.sh ./BMC-AMI-AI-Llama.sh

      2. When prompted, enter your EPD portal's username and password.

Where to go from here

See Verify the deployment of BMC AMI AI Services on Amazon EC2.