Collecting data for custom structure tables

Some content is unavailable due to permissions.

supports custom structure tables for versatile data hosting. These tables are also referred to as buffer tables and are designed to accommodate generic records with custom attributes. As these tables are custom-defined, they can be used to import and enrich a wide range of data without the need for predefined metrics. Use these tables in a custom view or report to review and analyze the custom structure data. 

The example use cases of custom structure table include:

  • Simplifying the CMDB integration by importing raw data from CMDB sources without burdening the target database with complex queries.
  • Storing data that can be later processed and imported by using SQL extractors to extract metrics and create relations. 
  • Importing any non-time series data with generic details, such as host name, OS version, data center, facility, and other hardware inventory. 

Related topics

Datamart-API-endpoints

Managing-data-marts

Supported data types

Custom structure tables support the following data types:  


    • NUMERIC 
      • NUMERIC
      • NUMERIC(precision) 
      • NUMERIC(precision, scale) 
        • where precision is 1-1000, and scale is 1-precision
    • VARCHAR
      • VARCHAR
        • limited to 4096 
      • VARCHAR(limit)
        • where limit is 1- 4096
    • DATE
      The following formats are accepted while setting column data by using the ETL:
      • dd/MM/yy
      • dd/MM/yyyy
      • yyyyMMdd
    • TIME
      • TIME
      • TIME(precision)
        • where precision is 0-6

The HH:mm:ss format is accepted while setting column data by using the ETL.


    • TIMESTAMP:
      • TIMESTAMP
      • TIMESTAMP(precision)
        • where precision is 0-6

The following formats are accepted while setting column data by using the ETL:




        • yyyy-MM-dd HH:mm:ss
        • dd/MM/yyyy HH:mm:ss
        • dd/MM/yy HH:mm:ss
        • dd/MM/yyyy HH:mm
    • UUID
    • JSON
      • where limit is 4096 bytes


Database limits for custom structure tables

The custom structure tables have the following database-related limits:

  • Number of buffer tables: 100 
  • Number of columns: 100
  • Number of rows in a table: 1000000


To import data into the custom structure table

Perform the following tasks to create a custom structure table and import data into the table according to your requirements:

buffer_table_flow.png


  1. Define and manage a custom structure table schema by using the Datamart API endpoints. 
    • Use the POST method (cst-datamart-controller) to create a custom structure table instance. For details, see Datamart-API-endpoints. 
    • View this custom structure table in the data marts list with the Type as Custom structure table. BUF_ is prefixed to the identifier of custom structure tables to help distinguish these tables from other data marts. For details, see Managing-data-marts. 
    • The custom structure table will be empty until you import the data. 
  2. Import data into the custom structure table by using ETLs. 
  3. Use the custom structure table in a custom view to view the data.
    You can use it in the SQL data mart by writing additional SQL queries. For details, see Managing-data-marts. 



 

Tip: For faster searching, add an asterisk to the end of your partial query. Example: cert*