The Spring 2025 release introduces major product innovations across the DataOps Suite, enhancing productivity for data engineers, QA teams, and analysts alike. This update focuses on intelligent automation, expanded BI platform coverage, and improved data quality monitoring.
Letโs take a closer look at the enhancements we bring in ETL Validator, BI Validator, and Data Quality Monitoring.
Key Takeaways
- Plain-English SQL generation eliminates manual scripting โ the embedded LLM (supporting both OpenAI and Azure AI) converts natural-language prompts into SQL queries securely within the userโs environment.
- Databricks Unity Catalog integration enables cloud-native profiling โ connecting and profiling structured datasets directly while maintaining consistent governance and oversight.
- New lineage and profiling features improve root-cause analysis โ table/column-level lineage visualizes data flow across systems, while the Profiling segment detects anomalies like missing values, distribution changes, and cardinality issues.
- Quick Flow Pipelines cut setup time โ enabling rapid pipeline creation without complex dependency mapping, alongside AI-assisted validation for schema mismatches and business rule enforcement.
1. ETL Validator: Smarter Testing Starts Here
AI-Generated Queries with Embedded LLMs
Eliminate the complexities of SQL scripting with our feature that intelligently generates SQL queries from plain English prompts, delivered securely within your environment using an embedded LLM. This accelerates workflow creation, enhances productivity with contextual AI support, and maintains data security supporting both OpenAI and Azure AI.
Auto-Generated Descriptions for Tables & Columns
Make your data models self-explanatory. Automatically enrich tables and columns with meaningful descriptions, which is great for documentation, governance, and smoother onboarding.
SQL Formatter
This feature makes the written SQL query more structured and readable. Just one click allows users to clean up queries, reduce review overhead, and standardize development practices across teams.
2. BI Validator: Robust Testing for Modern BI
Stress Testing for Power BI & Tableau
The updated Stress Test Plan for Tableau and Power BI, now fully integrated into the Datagaps DataOps Suite, simulates high-load scenarios to ensure reports perform reliably under heavy user activity. This feature allows teams to benchmark report performance at scale.
Filter Dataset Testing (Enhanced)
This feature enables thorough validation of business logic across different user views, increasing regression testing coverage and reducing filter-related issues.
BI Analyzer for Tableau
The BI Analyzer provides in-depth insights into Tableau reports and metrics, helping to identify inefficiencies such as unused fields, design flaws, and other issues. This enables users to discover opportunities for optimization and make precise improvements by setting user-defined thresholds.
3. Data Quality: Lineage Meets Intelligence
Unity Catalog Support (Databricks)
Datagaps DataOps Suite now directly integrates with DatabricksUnityCatalog, enabling seamless connection and profiling of cloud-native structured datasets. By leveraging Unity Catalog, teams can efficiently track and manage data quality, ensuring consistent governance and improved oversight of their cloud data environment.
Data Lineage Visualization
This Lineage capability helps teams to understand the flow of data across systems. Visualizing transformations at both table and column level, this feature supports root-cause analysis and improves governance transparency
Profiling for Data Model Tables
The new Profiling segment analyzes the structure and content of data models to detect anomalies, trends, and quality gaps, such as missing values, distribution changes, and cardinality issues.
Coming Soon: Whatโs Next in Product Excellence
Quick Flow Pipelines
Quick Flow Pipelines enable the rapid creation of streamlined data pipelines without the need for complex dependency mapping, significantly reducing setup time. This feature allows users to build fully functional pipelines in minutes, making it ideal for test runs and supporting agile development cycles with greater speed and flexibility.
Stress Test Plan for Oracle Analytics
Validate Oracle Analytics dashboards under heavy loads, ensuring scalability, reliability, and optimal performance in large-scale enterprise environments.
Cognos & Sigma Computing Support
The new BI integrations expand your testing universe by increasing compatibility across various analytics platforms. This facilitates broader test coverage and seamless integration with additional BI solutions, enhancing enterprise value by supporting a wider range of use cases.
AI - Driven Mapping Manager
Mapping Manager streamlines the management of field-level mappings across datasets by intelligently extracting mappings from ETL documentation and automatically generating validation logic and test cases
Why It Matters?
This release marks a turning point for enterprises demanding intelligent, scalable, and AI-augmented testing. Whether youโre building a new data model or validating performance under heavy loads, these tools are designed to move you from โgood enoughโ to โexcellence by default.โ
Want to see how it works?
Try our product today and experience the difference firsthand.
Frequently Asked Questions
1) Whatโs new in the DataOps Suite Spring 2025 feature update?
It adds plain-English-to-SQL generation via embedded LLM, Databricks Unity Catalog integration, table/column-level data lineage visualization, a new Data Profiling segment, and Quick Flow Pipelines for faster pipeline setup.
2) How does the natural-language SQL generation feature work?
It uses an embedded LLM (supporting OpenAI or Azure AI) to convert plain-English prompts into SQL queries securely within the userโs own environment, removing the need for manual SQL scripting.
3) Does DataOps Suite integrate with Databricks Unity Catalog?
Yes. This release adds direct integration with Databricks Unity Catalog, allowing teams to connect and profile cloud-native structured datasets while maintaining consistent governance.
4) What does the new Data Profiling segment in DataOps Suite detect?
It analyzes data model structure and content to detect anomalies, trends, and quality gaps such as missing values, distribution changes, and cardinality issues.
Anshul Agarwal
Director, Marketing, Datagaps
Director of Marketing at Datagaps. Brings hands-on experience across the data industry and data products to how Datagaps positions DataOps and validation.
