bug fixer all day

v1.9.3

Update pyproject.toml

bug bug fix fix

didn't update poetry

bug fix

when tables had partitions, it was incorrectly calling read_sql_query instead of start_query_execution_and_wait

v1.9.0

Added:

• Create database if doesn't already exist in GlueTable.generate_from_meta method.

Add JSON and YAML read from S3

Added:

• Metadata.from_json(): Classmethod will now determine if the JSON file is stored in S3, and read in as necessary.
• Metadata.from_yaml(): Classmethod will now determine if the YAML file is stored in S3, and read in as necessary.

Metadata.merge

The Metadata class now has a merge method to combine two existing Metadata instances.

includes column_names_to_lower and upper methods

Metadata class now has two new methods, Metadata.columns_names_to_lower() and Metadata.column_names_to_upper() to make all column names either lower or upper case.

msck fix

fixes an issue with msck repair tables.
Note: this means that tables with hyphens in the name are not supported

glue_table generate_to_meta

Glue table gen to meta (#70)

* upver

* make generate_to_meta in GlueTable

* added test

* update toml

* black format

* weird bracket linting

* make glue to mojap better

* lint

* change default timestamp to seconds

* expanded tests to include complex type

* linting

* Update __init__.py (#71)

* line too long

* Update mojap_metadata/converters/glue_converter/__init__.py

Co-authored-by: Matt <38562764+LavMatt@users.noreply.github.com>

* Update mojap_metadata/converters/glue_converter/__init__.py

Co-authored-by: Matt <38562764+LavMatt@users.noreply.github.com>

Co-authored-by: Matt <38562764+LavMatt@users.noreply.github.com>

Postgres converter

added ability to convert postgres connection to list of metadata objects