September 2024

Audit Log Support in Storage Data Service (SDS)

2min

Date: September 9, 2024

We're excited to announce the latest updates to our SDS service. In accordance with GDPR and other compliance standards, we have introduced a new audit logging feature for the SDS data API core/api/v1/sds/data to ensure traceability of data access and modifications. This update aims to enhance compliance, security, and data traceability.

Supported Features

  • Audit Logging
    • All API requests to the SDS data API will now be automatically recorded in the audit log stream.
    • The logs will capture critical information, including the AAA user ID, user name, and application ID from the x-coreos-user-info header.
  • Handling the x-coreos-user-info Header:
    • When Present: If the x-coreos-user-info header is included in the API request, it must be forwarded unchanged to ensure audit data integrity.
    • When Absent: If the x-coreos-user-info header is not provided, it will be automatically populated by the service mesh layer of the OS1 platform.
  • Storage and Access
    • Audit logs will be stored as Parquet files in S3.
    • Logs can be queried via Amazon Athena, with access available at the tenant level or for individual SDS resources.
  • Data Access Requests
    • The PSI team will provide audit log data dumps upon request. Ensure to provide adequate justification when requesting sensitive audit information.

Reference Documentation

For detailed information on how to use Audit Logs, refer to the Audit Logging developer guide.