Fivetran¶
About¶
Fivetran generates structured log events from connectors, dashboard user actions, and Fivetran API calls. These logs provide an internal view of the operations happening with each of your connectors.
Product Details¶
Vendor URL: Fivetran
Product Type: Cloud Data Movement Platform
Product Tier: Tier III
Integration Method: webhook
Integration URL: Webhook - Cyderes Documentation
Log Guide: Fivetran log guide
Parser Details¶
Log Format: JSON
Expected Normalization Rate: 100%
Data Label: FIVETRAN
UDM Fields (list of all UDM fields leveraged in the Parser):
| Log File Field | UDM Field |
|---|---|
| _id | metadata.product_log_id |
| attributes.connector_id | security_result.category_details |
| attributes.connector_name | additional.fields |
| attributes.connector_type | additional.fields |
| attributes.data.deleteCondition | target.resource.attribute.labels |
| attributes.data.message | security_result.summary |
| attributes.data.method | network.http.method |
| attributes.data.name | target.resource.name |
| attributes.data.operationType | security_result.action_details |
| attributes.data.query | target.resource.attribute.labels |
| attributes.data.schema | target.resource.attribute.labels |
| attributes.data.table | target.resource.attribute.labels |
| attributes.data.type | metadata.description |
| attributes.data.uri | target.resource.name |
| attributes.event | metadata.product_event_type |
| attributes.sync_id | principal.process.product_specific_process_id |
| host | principal.hostname |
| status | security_result.severity_details |
| tags | security_result.about.labels |
Product Event Types¶
| Event | UDM Event Classification |
|---|---|
| api_call | RESOURCE_READ |
| Generic | GENERIC_EVENT |
Log Sample¶
{"_id":"ABCDEFG123456","attributes":{"connector_id":"captors_surgery","connector_name":"lattice","connector_type":"lattice","created":"2024-02-01T18:01:17.587Z","data":{"method":"GET","uri":"https://api.lattice.com"},"event":"api_call","hostname":"fivetran_hostname","service":"fivetran","status":"Info","sync_id":"abcdef-1234-abcd-1234-abcd1234"},"date":"2024-02-01T18:01:21.358Z","host":"fivetran_hostname","service":"fivetran","source":"fivetran","status":"info","tags":["source:fivetran","datadog.submission_auth:private_api_key"]}
Sample Parsing¶
additional.fields["connector_name"] = "lattice"
additional.fields["connector_type"] = "lattice"
metadata.event_type = "RESOURCE_READ"
metadata.product_event_type = "api_call"
metadata.product_log_id = "ABCDEFG123456"
network.http.method = "GET"
principal.hostname = "fivetran_hostname"
principal.process.product_specific_process_id = "sync_id: abcdef-1234-abcd-1234-abcd1234"
principal.user.userid = "fivetran_hostname"
security_result.about.labels.key = "tags"
security_result.about.labels.value = "source:fivetran"
security_result.about.labels.key = "tags"
security_result.about.labels.value = "datadog.submission_auth:private_api_key"
security_result.category_details = "captors_surgery"
security_result.severity = "INFORMATIONAL"
security_result.severity_details = "info"
target.resource.name = "https://api.lattice.com"