4 projectsData Comparison
A Python library that facilitates the comparison of two DataFrames in Pandas, Polars, Spark and more. The library goes beyond basic equality checks by providing detailed insights into discrepancies at both row and column levels.
PythonApache License 2.0active
Data Validation Tool compares data from source and target tables to ensure that they match. It provides column validation, row validation, schema validation, custom query validation, and ad hoc SQL exploration.
PythonApache License 2.0active
Python SDK that dispatches parallel web-research agents across table rows, synthesizing multi-agent findings into structured columns.
PythonMIT Licenseactive
A high-performance Python library for comparing large datasets (CSV, Parquet) locally using Rust and Polars. It features zero-copy streaming to prevent OOM errors and generates interactive HTML data quality reports.
PythonMIT Licensesteady
Back to Awesome DataEngineeringSearch Awesome DataEngineering →