Solutions
Advanced Rules
As data ecosystems evolve, most enterprises have a need to graduate from basic data checks to advanced business logic checks. Asserting business logic at point of data ingress / egress is crucial to ensure that critical business processes are intact.
Qualytics enables users to author advanced logic directly as data quality checks, significantly reducing complexity typically associated with such rules.
Time Series Anomaly Detection
Aggregation Comparison
There are often use cases where users need to compare results of two disparate queries from two tables (from one or two databases) to each other. A simple example would be to compare counts from a bronze to silver layer of medallion architecture in order to ensure that data pipelines have executed correctly. A more complex example would be to run SQL queries joining multiple tables to produce a calculation for business logic equivalence across databases. Using Aggregation Comparison checks, you can easily plug in any SQL query on either side of the desired aggregations and run comparisons.
Lookups
Referential Integrity is a major pain in data quality. We don’t mean just for keys – users want the ability to utilize reference tables, often in other databases, to ensure a value is acceptable against or unique compared to the reference values. Exists In and Not Exists In checks enable users to run referential integrity and uniqueness checks across databases.