The Control Plane
The Control Plane
At the heart of Ascend's data pipeline automation is a DataAware™ control plane with intelligence to detect and propagate change across your ecosystem.
What Is The Control Plane?
This Is DataAware™
A powerful SHA (secure hashing algorithm) mechanism in the control plane creates a unique “fingerprint” for every set of data that arrives in the system. It also fingerprints every snippet of code that users provide to define the transformation steps in the data pipelines. The control plane links them into DAGs (directed acyclic graphs) to lock in their dependencies. This results in a lightweight immutable web, enriched with unique metadata to drive the autonomous orchestration processes.
The autonomous control plane compares all the SHA fingerprints to detect change as soon as it is introduced. For each change, the control plane follows the lineage in the code to identify the dependencies in the downstream transformations and linked pipelines. It then automatically generates a plan from these dependencies to propagate the change.
The control plane propagates all changes autonomously through the pipelines end-to-end. It does this by sending discrete workloads for each transformation step to the connected data clouds where the data is stored. If any one operation breaks because of errors in the code, the platform pauses for a fix by the user. It then resumes from the point of breakage with the latest data sets, without reprocessing any workloads. DataAware™ intelligence guarantees integrity of the change from source to sink.
Learn More About DataAware™
The control plane implements a sophisticated, massively scalable computing paradigm. Based on proven computer science concepts, the technology uniquely guarantees reliability, recoverability, and integrity of large-scale data networks.
Intelligent Orchestration: Data's Missing Link
In this session, Sean Knapp, CEO & founder of Ascend, discusses what led us to essentially rearchitect pipeline orchestration from the ground up.
Automating Data Workloads for Success
Is your automation architecture data aware? Discover the answer with Jon Osborn, Field CTO at Ascend.