Profiling

The profiling modules uses ydata-profiling to generate HTML reports tracks the profiling run history and can store the results in S3.

ydata-profiling is suitable only for small to medium sized tables, though Spark execution engine will be enabled in the future.