Stream logs to Google Cloud Storage

DataStream 2 supports sending log files to Google Cloud Storage. Google Cloud Storage is a cloud-based storage that lets you store unlimited amounts of data with low latency, high durability and worldwide accessibility.

Before you begin

To use Google Cloud Storage as a destination for your logs, you need to:

How to

  1. In Destination, select Google Cloud Storage.
  2. In Display name, enter a human-readable name description for the destination. The name can’t be longer than 255 characters.
  3. In Bucket, enter the name of the storage bucket you created in your Google Cloud account. See Bucket naming conventions for Google Cloud Storage.
  4. In Project ID, enter the unique ID of your Google Cloud project.
  5. Optionally, set the Path to the folder within your Google Cloud bucket where you want to store logs. You can use Dynamic time variables in the path.
    Note: In Google Cloud Storage, paths work as object names. When you enter a custom path, such as akamai/logs/{%Y}, Google Cloud Storage doesn’t create new akamai, logs, and {%Y} folders in the bucket. Instead, the objects are stored in one bucket and named akamai/logs/{%Y}/filename. See Object naming guidelines for details.
  6. In Service account name, enter the name of the service account with the storage.object.create permission or Storage Object Creator role.
  7. In Private key, enter the contents of the private key you generated and downloaded from your Google Cloud Storage account in the PEM format.
  8. Click Validate & Save to validate the connection to this destination, and save the details you provided.
    As part of this validation process, the system uses the provided access key identifier and secret to create a verification file in your GCS bucket, with a timestamp in the filename in the Akamai_access_verification_<TimeStamp>.txt format. You can only see this file if the validation process is successful, and you have access to the Google Cloud Storage bucket that you are trying to send logs to.