Skip to content

Commit

Permalink
Generic Metadata DDL Utility (#1059)
Browse files Browse the repository at this point in the history
* Generic DDL Migration Utility Draft V1

* Added the generic code feature for Oracle and Mssql

* Added generic code for snowflake utility

* Added the Code structure fix

* Updated codebase with testing

* Updated Oracle Code base

* Updated DDL_Extractor Module

* Updated the code base and fixed the issues

* Updated the README.md files and arguments

* Updated the code base structure and filename

* Updated the README.md files

* Updated the utils module

* Updated the DDL_Extraction Module
  • Loading branch information
tshashankrock authored Aug 16, 2023
1 parent e79c75a commit 2f187cf
Show file tree
Hide file tree
Showing 23 changed files with 2,057 additions and 1 deletion.
4 changes: 4 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -87,6 +87,10 @@ them to fit your particular use case.
BigQuery query and returns the output as an XML string.
* [BigQuery Translation Validator](examples/bigquery-translation-validator-utility) - A python utility to compare 2 SQL Files and point basic differences like column names,
table names, joins, function names, is-Null and query syntax.
* [BigQuery Generic DDL Migration Utility](examples/bigquery-generic-ddl-migration-utility) -
Generic DDL Migration Utility to migrate the tables schema (DDL) from Database(Oracle, Snowflake, MSSQL, Vertica, Neteeza) DB to BigQuery.
The utility leverages BigQuery Translation API and offers additional features
such as adding partitioning, clustering, metadata columns and prefixes to table names.
* [Bigtable Dataflow Cryptocurrencies Exchange RealTime Example](examples/cryptorealtime) -
Apache Beam example that reads from the Crypto Exchanges WebSocket API as
Google Cloud Dataflow pipeline and saves the feed in Google Cloud Bigtable.
Expand Down
Loading

0 comments on commit 2f187cf

Please sign in to comment.