Google Cloud Dataflow

Related topics
Product name
Publisher page
  • [Google|Google]
Category
Data Access, Analysis, and Delivery Software
Release
TKU 2019-Dec-1
Publisher link

Product Description


Dataflow is a fully managed streaming analytics service that minimizes latency, processing time, and cost through autoscaling and batch processing.

Triggers

PatternTrigger NodeAttributeConditionArgument
InferBigQueryDatasetsDiscoveredCloudAPIResultList

'discovery_method'

matches'Google.Dataflow.Jobs.List'
UpdateFailureTimeDiscoveredCloudAPIResultList

'discovery_method'

matches'Google.Dataflow.Jobs.List'

'and'

'failure_reason exists'

REST APIs

RestAPIsComments
Google.Dataflow.Jobs.ListList Google Cloud Dataflow Jobs
Google.Dataflow.Jobs.GetGet Google Cloud Dataflow Job's status and add tags for it

Attributes 

Patterns models 'dataflow' Cloud Service for each Cloud Region where the Google Cloud Dataflow Jobs instances were found.

NodeKindAttributeDefault value/Comments
CloudServicetypeData Analytics

codedataflow

name

Cloud Dataflow (<region.location>) : %<region.project_name>

An example of BMC Helix Discovery view of the scanned results for CloudService is the following:

Pattern models CloudResource node for each Google Cloud Dataflow Jobs as follows:

NodeKindAttributeDefault value/Comments
CloudResoursetype'Google Cloud Dataflow Job'
keytext.lower(<result.id>)
name'Google Cloud Dataflow Job <result.name>'
projectdiscovery_access.project
project_namefrom function gcp.getProjectName(discovery_access)
cloudboolean(true)
idtext.lower(<result.id>)
stateresult.currentState
job_typeresult.type
sdk_versionresult['jobMetadata'].sdkVersion.version
sdk_nameresult['jobMetadata'].sdkVersion.versionDisplayName
cloud_id<discovery_access.project>/<result.id>
tags[ <tag_key> <value> ]
tag_settable(<tags>)

An example of BMC Helix Discovery view of the scanned results for CloudResource is the following:


Was this page helpful? Yes No Submitting... Thank you

Comments