Deploying and configuring the Microsoft Azure - Azure API extractor


This topic explains how to configure the Microsoft Azure - Azure API extractor ETL from the TrueSight Capacity Optimization console for extracting data from the Microsoft Azure cloud deployments. 

This topic covers the following information:


Prerequisites

Depending on the Azure model, complete the following prerequisite steps: 

Azure Resource Manager Model

Azure Classic Model

  • Obtain a subscription ID: The subscription ID is a GUID that uniquely identifies your subscription to use Azure services.
  • Upload the management certificate to the Microsoft Azure Classic portal: A management certificate is an SSL certificate that is a small data file that digitally binds a cryptographic key to an organization's details. This certificate is associated with your subscription and is required to authenticate your API calls. Create the management certificate and upload it in the Azure portal.

    The [expand] macro is a standalone macro and it cannot be used inline. Click on this message for details.

Configuring the ETL module

To integrate TrueSight Capacity Optimization with the extractor, complete the following steps:

  1. In the TrueSight Capacity Optimization console, navigate to Administration ETL & SYSTEM TASKS > ETL tasks.
  2. In the ETL tasks page, under the Last run tab, click Add > Add ETL.
    The Add ETL page is displayed.
  3. In the Run configuration tab, for the ETL module property, select Microsoft Azure - Azure API Extractor.
  4. Specify values for the properties under each expandable tab. For details about the common properties, see ETL-common-configuration-properties. The following table lists the properties that are specific to this ETL module under the Microsoft Azure configuration tab:

    Note

    By default, the most common, basic properties that you can set for an ETL are displayed in the Add ETL page. You can accept these default selections.

    azure_gov_cloud_config.png

    The [confluence_table-plus] macro is a standalone macro and it cannot be used inline. Click on this message for details.

  5. Click Save.
    You return to the Last run tab under the ETL tasks page.
  6. In simulation mode, validate the results: In the ETL tasks table under ETL tasks > Last run, locate your ETL (ETL task name), click Run run_etl.png to run the ETL.
    After you run the ETL, the Last exit column in the ETL tasks table will display one of the following values:
    • OK: The ETL executed without any error in simulation mode.
    • WARNING: The ETL execution returned some warnings in simulation mode. Check the ETL log.
    • ERROR: The ETL execution returned errors and was unsuccessful. Edit the active Run configuration and try again.
  7. After you verify that the ETL is running correctly, switch the ETL to production mode:
    1. In the ETL tasks table under ETL tasks > Last run, click the ETL name under the Name column.
    2. In the Run configurations table in the ETL details page, click Edit edit icon.png to edit the active run configuration.
    3. In the Edit run configuration page, navigate to the Run configuration expandable tab and set Execute in simulation mode to No.
    4. Click Save.
  8. Locate the ETL in the ETL tasks table and either schedule an ETL run or click Run run_etl.png to run it now.
    After you run the ETL, or schedule the ETL for a run, it will extract the data from the source and transfer it to the TrueSight Capacity Optimization database. 
    In the left pane of Workspace, the following hierarchy of entities is displayed:

Resource Manager deployment mode

Classic deployment mode

 etl_msazure_hierarchy_arm.png

 etl_msazure_hierarchy.png

Collecting data for additional instance type configuration metrics

An out-of-the-box JSON file contains the mapping for configuration metrics collected by the extractor. This file is stored on the ETL Engine server. You can configure this file to modify the existing instance type configuration or to add new configuration metrics. For example, you can add the BY_BENCHMARK_VALUE metric in the following format:

{
"instanceTypeConfiguration": {
"standard_a10":{
   "REQUESTED_INSTANCE_TYPE": "Standard_A10",
       "CPU_MODEL":"Sparc",         
"BYBENCHMARK_VALUE":{
            "SPECINT2006":"2006",    
"SPECINT2008":"2008"
}
},
"standard_a11":{
"REQUESTED_INSTANCE_TYPE": "Standard_A11"
}
}
}

To upload and then use a JSON file for collecting additional instance type configuration metrics:

  1. Download the  attached JSON file and update the file for existing and additional metrics.
  2. Name the JSON file appropriately, such as msazure-metric-conf.json, and save it to your local machine.
  3. Upload the file to a folder on the ETL Engine server.
  4. To use the file, include it when you create the ETL:
    1. In the Add ETL page, after you select Microsoft Azure - Azure extractor as the ETL, click Advanced and navigate to the Microsoft Azure configuration tab.
    2. Type the file path in Instance type definition JSON file path.
    3. Click Save.
      For detailed procedure, see Integration steps

 

 

Tip: For faster searching, add an asterisk to the end of your partial query. Example: cert*