Whitepaper: An Assessment of Pipeline Orchestration Approaches
Learn why task-centric workflow automation becomes unmanageable over time and why data pipeline automation is the key to speed, efficiency, and operational scale.
Webinar: Intelligent Orchestration - The Key to Declarative Data Pipelines
In this webinar, we explore how applying the declarative approach to data pipelines results in 95% less code, 10x faster build times, automated maintenance, and more efficient pipelines… oh, and much happier data engineers.
Podcast: Shining A Light on Shadow IT In Data And Analytics
In this episode, founder of Ascend.io, Sean Knapp, and Co-Founder of Zonehaven, Charlie Crocker, share their experiences of working in and with companies that have dealt with shadow IT projects and the importance of enabling and empowering the use and exploration of data and analytics.
Scroll to read our latest white papers, reports, and case studies.
The current standard for pipeline orchestration relies on engineers to manually translate high-level specs into a set of tasks to be executed on a pre-defined schedule. In advancing orchestration, Ascend opted for a different approach. Taking a page from compilers and...
Scroll to watch our latest webinars and tech talks on demand.
Today we’re excited to announce the general availability of our JDBC/ODBC Dataflow connector. This feature leverages the same intelligent persistence layer that backs Queryable Dataflows and Structured Data Lakes, and joins it (pun intended) with the SparkSQL Thrift JDBC/ODBC Server to provide the ability to directly access and query your Dataflows from your favorite environment, whether it is a BI tool like Looker, or your favorite SQL workbench.
This How-to will provide you with an overview of how to ingest data into Redshift by building a production pipeline that automatically keeps data up to date, retries failures, and notifies upon any irrecoverable issues.
Today we’re excited to formally announce support for Scala & Java transforms. Not only does this expand our support to two of the most popular languages amongst data engineers, but marries this capability with the advanced orchestration and optimizations provided by Ascend.
Scroll to listen to our latest podcasts.
Reposted from: As data engineers the health of our pipelines is our highest priority. Unfortunately, there are countless ways that our dataflows can break or degrade that have nothing to do with the business logic or data transformations that we write and maintain....