aws AWS What's New ·

AWS Glue Data Quality Adds Distribution Statistics for Data Profiling

dataawsgaengineeraws-s3aws-sagemaker
feature

AWS Glue Data Quality now includes a Distribution Analyzer for generating frequency distribution profiles. This feature helps users understand data patterns, identify outliers, and reduce the need for custom code in data pipelines. It integrates with existing rulesets and stores statistics in Amazon S3 for querying via services like Athena or visualization in SageMaker Studio. The functionality is available in all commercial and GovCloud regions.

  • New Distribution Analyzer for Data Quality
  • Simplified Data Pattern Identification
  • Integration and Data Storage
  • Availability
Features (1)
  • New Distribution Analyzer for Data Quality

    AWS Glue Data Quality now offers a Distribution Analyzer that generates frequency distribution profiles, including histograms for numeric columns and value distributions for categorical, date, and boolean columns. This feature supports custom bin counts, allowing for granular exploration of data patterns.

Enhancements (2)
  • Simplified Data Pattern Identification

    Distribution statistics help identify data skewness, outliers, and unexpected patterns without requiring custom code. This capability integrates directly into existing DQDL rulesets, enabling distribution profiling alongside current data quality checks within a single evaluation run.

  • Integration and Data Storage

    Generated distribution statistics are stored in Amazon S3 for future querying via services like Amazon Athena. They are also accessible through APIs, facilitating integration into monitoring workflows and visualization tools, such as SageMaker Unified Studio.

Notes (1)
  • Availability

    AWS Glue Data Quality distribution statistics are now available in all AWS commercial regions and AWS GovCloud (US) regions.

Read the original announcement →

https://aws.amazon.com/about-aws/whats-new/2026/07/aws-glue-data-quality-distribution-profiling

Related releases