AWS Data Wrangler 0.1.0

Enhancements

• Read Parquet tables from Glue Catalog directly to Pandas DataFrame
• Read Athena's results to Pandas DataFrame via CTAS (Blazing fast 🚀)
• Redshift's results to S3 as Parquet
• Read Redshift's results to Pandas DataFrame via Parquet export (Blazing fast 🚀)

P.S. Lambda Layer's bundle and Glue's wheel/egg are available below. Just upload it and run!

AWS Data Wrangler 0.0.25

Enhancements

• Read parquet data from s3 directly to Pandas DataFrame #73

Bugfixes

• Fix Pandas.read_sql_athena() usage with the Session() default s3_output

P.S. Lambda Layer's bundle and Glue's wheel/egg are available below. Just upload it and run!

AWS Data Wrangler 0.0.24

Enhancements

• Add support for Decimal data type #58
• Add more Athena's settings in Session() (defaults)
• Add PyArrow's toggle option for EMR.create_cluster()

Bugfixes

• Fix Pandas.read_sql_athena() issues with arrays data types #72

P.S. Lambda Layer's bundle and Glue's wheel/egg are available below. It's just upload and run!

AWS Data Wrangler 0.0.23

Enhancements

• Improving cast for date columns

P.S. Lambda Layer's bundle and Glue's wheel/egg are available below. It's just upload and run!

AWS Data Wrangler 0.0.22

Bugfixes

• Setting null date values as None for pandas.read_sql_athena() #69

P.S. Lambda Layer's bundle and Glue's wheel/egg are available below. It's just upload and run!

AWS Data Wrangler 0.0.21

Bugfixes

• Fix bug for boolean type on spark.to_redshift()

P.S. Lambda Layer's bundle and Glue's wheel/egg are available below. It's just upload and run!

AWS Data Wrangler 0.0.20

Enhancements

• Updating all dependencies #65

Bugfixes

• Fix cast for nan values #66

P.S. Lambda Layer's bundle and Glue's wheel/egg are available below. It's just upload and run!

AWS Data Wrangler 0.0.19

Bugfixes

• Fix issues for partitions with a single raw #62

P.S. Lambda Layer's bundle and Glue's wheel/egg are available below. It's just upload and run!

AWS Data Wrangler 0.0.18

Bugfixes

• Fix cast issues for partition columns #59 #60

P.S. Lambda Layer's bundle and Glue's wheel/egg are available below. It's just upload and run!

AWS Data Wrangler 0.0.17

Enhancements

• Pandas.read_sql_athena() now also accept bool columns with null values.

P.S. Lambda Layer's bundle and Glue's wheel/egg are available below. It's just upload and run!