The Evolution of Data Engineering
Everyone is Feeling the Pain
An Interesting Pattern Emerges
Data execs (VPs and Directors) are 2x more likely to indicate that their teams are overloaded than the team leads and individuals contributors themselves, signaling a huge backlog in demand by the business.
When asked which team was the most backlogged, teams were 3.5x more likely to identify their own team over other teams.
When asked what impeeded their work most, nearly half (48%) of data scientists cited access to data and systems.
Meanwhile, more than half (54%) of data engineers cited maintenance of existing systems—the very ones providing data access to the rest of the organization.
Survey respondents indicated that they are 1.5x more likely to invest in automation technology than hiring more staff to solve for bandwidth issues.
Modern data engineering solutions provide the intelligence to automatically optimize and orchestrate data pipelines, allowing data engineerings to focus on the data itself and truly accelerate digital transformation.