Ascend fits easily into your existing data ecosystem, whether you are just starting your pipeline journey, or have thousands already running. Quickly connect to any system to start building. Autonomous data pipelines directly fuel downstream applications, analytics, and machine learning models.
Product Overview
More Architecting, Less Plumbing.
The Ascend Unified Data Engineering Platform gives data teams 10x faster build velocity and automated maintenance for modern data pipelines. Generate autonomous data pipelines that dynamically adapt to any changes in data, code or environment. Evolve beyond traditional ETL and data orchestration tools to ingest, build, run, integrate, and govern advanced data pipelines with 95% less code.
Ascend’s DataAware™ intelligence observes and maintains detailed records of data movement and processing, code changes and user activity, enabling data pipelines to run at optimal efficiency with integrated lineage tracking, auditability and governance.
Deploy Ascend on top of existing Apache Spark clusters, or as a fully managed solution.
One platform to get from prototype to production
Ascend Ingest
Tap into your data sources with little to no code from any data lake, warehouse, database, stream or API, simply by describing the inputs. Ascend automatically monitors for new data, format conversions, data profiling, and incremental processing.
Any Data, Anywhere, Any Format
Connect to any lake, queue, warehouse, database, or API. Choose from a large library of connectors, or create your own with just a few lines of code.
Automated Change Detection
Automated Data Profiling
Automatically profile every piece of data. Analyze the mins and maxes of every column, of every partition of data. See how values change over time, and keep an eye on things like data anomalies.
Automated Data Reformatting
Not all data comes in ready for big data processing. Whether it is too many small files that need to be aggregated, too few large files that should be partitioned, or simply GZIP’ed CSVs that should be converted to Snappy compressed Parquet files, we have you covered.
Ascend Build
Architect data pipelines using 95% less code with Declarative Pipeline Definitions written in SQL, Python, Scala, and Java. Ascend’s Interactive Pipeline Builder visually connects code and data with data exploration, rapid prototyping, and lineage navigation.
Declarative Data Pipelines
Design your pipelines with declarative definitions that require 95% less code and result in far less maintenance. Specify inputs, outputs, and data logic in SQL, Python, Scala, and Java specs.
Interactive Pipeline Builder
Queryable Pipelines
Treat any stage, of any data pipeline, as a queryable table. Quickly prototype new pipeline stages, or run ad-hoc queries against existing pipeline stages, all in a matter of seconds. Ascend’s DataAware will notify you when the underlying data has changed, and makes converting your queries to pipelines in just a few clicks.
Git & CICD Integration
Ascend Run
Leveraging the Autonomous Pipeline Engine, data teams can optimize data pipelines and infrastructure with Adaptive Spark Cluster Management, dynamic resourcing, proactive data persistence, and automatic backfills.
Intelligent Persistence
Data & Job Deduplication
Dynamic Partitioning
Automated Backfill
Automated Spark Management
Ascend Integrate
Connect to data pipelines at any stage of the data lifecycle. Ascend’s Structured Data Lake enables notebooks and big data tools to directly access pipeline optimized files, while Ascend’s connectors ensure data connectivity and consistency to any downstream data system.
Notebook Connectors
Connect Jupyter, Zeppelin, and more directly to Ascend for fast, efficient access to data as it moves through your data pipelines.
BI & Data Visualization
Feed data directly from Ascend to your BI and Data Visualization tools via Ascend’s High Performance Records API.
File-based Access
Get direct access to Ascend’s internal storage (.snappy.parquet) files for efficient processing by other big data systems. Ascend’s File-based Access offers fully transaction reads across multiple files, and guarantees that the data available is always linked directly to an active data pipeline.
Record APIs & SDKs
Read records from any stage of any data pipeline via Ascend’s high throughput records API. Connect Ascend directly to your applications, BI, and Viz tools with one easy API.
Ascend Govern
With a suite of tracking, reporting, and security capabilities, Ascend records and permanently maintains an in-depth understanding of the linkages between code, data and users, with a level of visibility and auditability never before possible.
