GRC Store

Search / finos-ccc/ccc.etl.cp / v2026.06-rc4

Release · v2026.06-rc4

FINOS-CCC/CCC.ETL.CP Capability Catalog

FINOS-CCC/CCC.ETL.CP

Capabilities for ETL technologies, as defined by the FINOS Common Cloud Controls project.

Published by FINOS Common Cloud Controls

Install

OCI v1.1
$grcli unpack --repository finos-ccc/ccc.etl.cp --tag v2026.06-rc4
Coordinate
oci.grc.store/finos-ccc/ccc.etl.cp:v2026.06-rc4
Manifest digest
sha256:604d2956751df6d016f2562f8f335fda18fda29e23ec14ed29fb153e38e886d5

Provenance

1 layer
Digest Media type Size
94c9c21d1b2a… application/vnd.gemara.artifact.v1+yaml 5.9 KiB
Bundle config blob 
{
  "bundle-version": "1.0",
  "gemara-version": "v1.2.0",
  "metadata": {
    "provenance": {
      "buildDefinition": {
        "buildType": "https://grc.store/grcli/buildtype/v0",
        "externalParameters": {
          "artifact": {
            "id": "CCC.ETL.CP",
            "type": "CapabilityCatalog"
          },
          "target": {
            "registry": "oci.grc.store",
            "repository": "finos-ccc/ccc.etl.cp",
            "tag": "v2026.06-rc4"
          }
        },
        "internalParameters": {
          "CI": "true",
          "GITHUB_ACTIONS": "true",
          "GITHUB_ACTOR": "eddie-knight",
          "GITHUB_REF": "refs/heads/main",
          "GITHUB_REPOSITORY": "eddie-knight/common-cloud-controls",
          "GITHUB_RUN_ATTEMPT": "1",
          "GITHUB_RUN_ID": "26770748733",
          "GITHUB_SHA": "2b6dab4c1307a0ac67d90c99829f6c1825154c84",
          "GITHUB_WORKFLOW": "Batch Release All Catalogs",
          "RUNNER_OS": "Linux"
        },
        "resolvedDependencies": [
          {
            "name": "artifacts/orchestration/etl/capabilities.yaml",
            "uri": "file://artifacts/orchestration/etl/capabilities.yaml",
            "digest": {
              "sha256": "94c9c21d1b2a2232a393214ef5a1865db6e94e25b959e10ece4526e912b1eaf9"
            }
          },
          {
            "name": "source",
            "uri": "git+https://github.com/eddie-knight/common-cloud-controls@2b6dab4c1307a0ac67d90c99829f6c1825154c84",
            "digest": {
              "gitCommit": "2b6dab4c1307a0ac67d90c99829f6c1825154c84"
            }
          }
        ]
      },
      "runDetails": {
        "builder": {
          "id": "https://github.com/eddie-knight/common-cloud-controls/actions/runs/26770748733",
          "version": {
            "go": "go1.25.0",
            "go-arch": "amd64",
            "go-os": "linux",
            "grcli": "v0.2.2"
          }
        },
        "metadata": {
          "invocationId": "26770748733-1",
          "startedOn": "2026-06-01T17:30:31.565830258Z",
          "finishedOn": "2026-06-01T17:30:31.78748271Z"
        },
        "byproducts": [
          {
            "name": "capabilities.yaml",
            "digest": {
              "sha256": "94c9c21d1b2a2232a393214ef5a1865db6e94e25b959e10ece4526e912b1eaf9"
            }
          }
        ]
      }
    }
  },
  "artifacts": [
    {
      "name": "capabilities.yaml",
      "type": "CapabilityCatalog",
      "id": "CCC.ETL.CP",
      "role": "artifact"
    }
  ]
}

CCC ETL Capabilities

Capabilities for ETL technologies, as defined by the FINOS Common Cloud Controls project.

ID
CCC.ETL.CP
Version
v2026.06-rc4
Gemara version
v1.2.0
Author
FINOS Common Cloud Controls

Data Processing

The Data Processing group covers entries related to transforming, enriching, and moving data through pipelines. This includes ETL/ELT, stream and batch processing, data lineage, schema evolution, and workflow orchestration for data workloads.

  1. CCC.ETL.CP01 Batch Processing

    Supports the processing of bounded (batch) data sources using a consistent programming model or engine.

  2. CCC.ETL.CP02 Stream Processing

    Supports the processing of unbounded (streaming) data sources using a consistent programming model or engine.

  3. CCC.ETL.CP03 Schema Evolution

    Automatically detects source data structures and manages changes in schema (e.g., column additions) over time without pipeline failure.

  4. CCC.ETL.CP04 Distributed Data Shuffling

    Provides an internal service to re-partition and group data across distributed workers for complex operations like joins and aggregations.

  5. CCC.ETL.CP05 Windowing and Event-Time Processing

    Enables grouping of data based on time attributes, supporting tumbling, hopping, and session windows with late-data handling (watermarking).

  6. CCC.ETL.CP08 Job Bookmarks

    Persists the state of a processing job (e.g., checkpointing or bookmarks) to ensure exactly-once processing and fault tolerance.

  7. CCC.ETL.CP09 Pushdown Optimization

    The ability to translate transformation logic into the native language of the source or sink (e.g., SQL) to minimize data movement.

  8. CCC.ETL.CP11 Data Lineage & Metadata Tracking

    Captures and exports metadata regarding the data sources, the transformation steps, and the final destination (sink), showing the flow from source to destination for compliance and debugging.

  9. CCC.ETL.CP12 User-Defined Function (UDF) Support

    Allows developers to inject custom logic (Python, Java, SQL) into the managed processing pipeline for complex transformations.

Ingestion

The Ingestion group covers entries related to how a service receives or retrieves data, inputs, or commands for processing. This includes both active (pull-based) and passive (push-based) ingestion patterns.

  1. CCC.ETL.CP06 Change Data Capture (CDC) Integration

    Supports incremental data ingestion by tracking changes in source transaction logs rather than full table scans.

  2. CCC.ETL.CP07 Connectivity and Connector Library

    Provides pre-built, managed connectors for a variety of sources and sinks (e.g., Object Storage, RDBMS, NoSQL, Pub/Sub).

Orchestration

The Orchestration group covers entries related to coordinating and managing workloads across distributed systems. This includes container orchestration, job scheduling, CI/CD pipelines, build automation, and service mesh management.

  1. CCC.ETL.CP10 Visual Orchestration

    Provides a graphical interface to define dependencies between extraction, transformation, and loading tasks.

  2. CCC.ETL.CP13 Time-Based Job Triggering

    Supports time-based (cron) mechanisms to initiate data processing workflows.

  3. CCC.ETL.CP14 Event Based Job Triggering

    Supports event-based (file arrival) mechanisms to initiate data processing workflows.