To enable disaster recovery

Perform the following tasks after upgrading the primary site:

1. If you have enabled disaster recovery, you will be prompted to re-enable it.
   Type y to enable disaster recovery.
   Wait for the first backup to be complete.
2. After the first backup is complete, scale up the standby site

   If you have scaled down the standby site, perform the following steps to scale it up:

   1. Navigate to helix-on-prem-deployment-manager/utilities/disaster-recovery/dr-scale

   2. Run the following command:

       ./product_scale.sh  up 

      This scales up both application and data lake services.

3. Upgrade the standby site 

   1. In the new_working_directory/ configs/deployment.config file, update the following values:
      1. Set the values of the following services to yes.
         • _INFRA
         • _PTPOSTGRES
         • _KAFKA
         • _REDISCLUSTER
         • _RSSO
         • _VICTORIAMETRICS
         • _ELASTICSEARCH
         • _MINIO
      2. For all the BMC Helix ITOM applications for which you are licensed, set the value to yes; for all other services, set the value to no.
         For example, if you are only licensed to use BMC Helix Operations Management and BMC Helix Continuous Optimization:
         • To use BMC Helix Operations Management, set the value of MONITOR to yes. 
           Optionally,
           • To use AIOps, set AIOPS_SERVICES to yes .
           • To use Log Analytics, set LOG_ANALYTICS_SERVICES  to  yes.

         • To use BMC Helix Continuous Optimization, set the value of OPTIMIZE to yes. 

           Best practice
           To see your licensed product services, navigate to the configs/deployment.config file in the previously deployed version of BMC Helix ITOM.

   2. From the new working directory ( new_working_directory ), run the deployment manager to upgrade BMC Helix IT Operations Management:

      ./deployment-manager.sh

      After the upgrade, you will get the following message:
      Completed Helix On-prem Installation.

   3. (Optional) To view the logs during the upgrade, run the following command:

      tail -f logs/deployment.log
4. (Optional) Scale down the standby site 

   After configuring disaster recovery,  you can  scale  down  the application pods and keep  only  the data lake components running on the standby  site  to save resources. 

   Perform the following steps:

   1. Navigate to helix-on-prem-deployment-manager/utilities/disaster-recovery/dr-scale

   2. Run the following command:

      ./product_scale.sh  down

      Important

      • Data from the primary site MinIO continues to be replicated onto the standby site MinIO but the applications will not run.
      • To scale down the data lake components also, use DOWN-ALL  or  down-all. Example: ./product_scale.sh  down-all. This stops all services except MinIO, Postgres, and external  Elasticsearch, Fluentd, and Kibana (EFK)  stacks.

      • Do not run the scale down or down all script repeatedly.

To change the namespace pod security admission to restricted

After the upgrade, the namespace pod security admission must be changed to restricted .

To change the cluster-level pod security admission, run the following command:

Replace <namespace> with the namespace where you deployed BMC Helix IT Operations Management .

Uninstall the EFK deployment

Starting from 25.1 release, BMC Helix IT Operations Management supports external EFK integration and the log streaming from internal EFK and from the log shipper binary are disabled. To remove the EFK deployed in the internal namespace, perform the following steps:

1. Export logs from Kibana UI to csv for reference. See Viewing logs on Kibana.

2. Remove EFK using below commands by replacing the namespace.
   

   helm delete -n <namespace> efk-elasticsearch efk-fluent-bit   
   kubectl -n <namespace> delete pvc data-efk-elasticsearch-data-0 data-efk-elasticsearch-data-1 data-efk-elasticsearch-master-0 data-efk-elasticsearch-master-1

(Optional) To switch to enterprise F5 NGINX Plus Ingress Controller

Starting with BMC Helix IT Operations Management (BMC Helix ITOM)   version 24.3, we support the enterprise edition of the F5 NGINX Plus Ingress Controller.

You can use either the enterprise edition of the F5 NGINX Plus Ingress Controller or the open-source version.

To switch to the enterprise edition of F5 NGINX Plus Ingress Controller, see Switching-to-enterprise-F5-NGINX-Plus-Ingress-Controller.

To learn more about the F5 NGINX Plus Ingress Controller, see NGINX Ingress Controller.