Skip to content
This repository has been archived by the owner on Jun 23, 2023. It is now read-only.

Latest commit

 

History

History
27 lines (19 loc) · 1.13 KB

analytics-aae-exporter.md

File metadata and controls

27 lines (19 loc) · 1.13 KB

Daily Analytics to Advanced Analytics Environment (AAE) Exporter

API Pattern: Exporter

HTTP Request and Response

  • Endpoint: HTTPS PUT https://<FQDN>/c19appdata/<filename>.parquet

Parameters

  • FQDN: Target-Environment specific CNAME of the Advanced Analytics Environment
  • Authorization:
    • Mutual TLS authentication (TLS client cert & keystore credentials in SecretsManager)
    • Subscription key (subscription key in SecretsManger)
  • Request Headers:
    • Content-Type: application/json
    • Ocp-Apim-Subscription-Key: SUBSCRIPTION_KEY

Scenario

Metrics submitted to the analytics submission API will be stored and then exported to AAE.

AAE Export Payload

The request payload is a binary parquet file which needs to follow these rules:

  • We MUST NOT remove columns from future parquet files to ensure compatibility with AAE
  • We MUST APPEND new columns to future parquet files (last entry in the GlueCatalog) to ensure compatibility with AAE
  • Additional columns MUST be optional (column can contain NULL value - to ensure backwards compatibility with old app versions)