Pub/Sub

Overview

Cyderes can ingest logs into the CNAP data ingestion pipeline via Google Pub/Sub.

Available Data Types

• Pub/Sub collection is performed generically and is therefore capable of receiving logs of any data type.
• Logs are expected to be utf-8 encoded (i.e. not leveraging a Pub/Sub schema or using binary-encoded structures like Protobuf).

Responsibilities and Configuration

1. The customer is responsible for creating and owning the Pub/Sub topic that logs will be sent to. Steps for this can be found in Google's documentation.
2. After creating the Pub/Sub topic, the fully qualified topic name will need to be sent to Cyderes (name format: projects/my-project-id/topics/my-topic-id).
3. The customer is responsible for granting a Cyderes-provided GCP principal permission to attach Pub/Sub subscriptions to that topic.
   1. In the Google Cloud console, go to the Pub/Sub Topics list.
   2. Select the newly created topic.
   3. If the info panel is hidden, click Show info panel.
   4. In the Permissions tab, click Add principal.
   5. Enter cyderes-ci@cyderes-prod.iam.gserviceaccount.com as your service principal.
   6. In the Select a role list, select the Pub/Sub Subscriber role.
   7. Click Save.