Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CLI sync S3 end to end integration test #3001

Merged
merged 18 commits into from
Dec 5, 2024

Conversation

alishakawaguchi
Copy link
Contributor

@alishakawaguchi alishakawaguchi commented Dec 2, 2024

completes NEOS-1653

@alishakawaguchi alishakawaguchi added Devex Created by Linear-GitHub Sync CLI Created by Linear-GitHub Sync labels Dec 2, 2024
@alishakawaguchi alishakawaguchi self-assigned this Dec 2, 2024
Copy link

vercel bot commented Dec 2, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Skipped Deployment
Name Status Preview Comments Updated (UTC)
neosync-docs ⬜️ Ignored (Inspect) Visit Preview Dec 4, 2024 7:00pm

Copy link

codecov bot commented Dec 2, 2024

Codecov Report

Attention: Patch coverage is 9.33333% with 204 lines in your changes missing coverage. Please review.

Project coverage is 35.95%. Comparing base (ef70005) to head (20bd317).
Report is 2 commits behind head on main.

Files with missing lines Patch % Lines
worker/pkg/integration-test/datasync_workflow.go 0.00% 109 Missing ⚠️
internal/testutil/utils.go 0.00% 25 Missing ⚠️
internal/testutil/testcontainers/mysql/mysql.go 0.00% 23 Missing ⚠️
...ernal/testutil/testcontainers/postgres/postgres.go 0.00% 23 Missing ⚠️
...kend/pkg/integration-test/integration-test-util.go 0.00% 21 Missing ⚠️
...ws/datasync/activities/post-table-sync/activity.go 40.00% 2 Missing and 1 partial ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #3001      +/-   ##
==========================================
- Coverage   36.10%   35.95%   -0.15%     
==========================================
  Files         344      345       +1     
  Lines       39476    39700     +224     
==========================================
+ Hits        14252    14275      +23     
- Misses      23560    23762     +202     
+ Partials     1664     1663       -1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@@ -0,0 +1,362 @@
package main
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

copied from worker integration tests. Will eventually remove the worker one in favor of this one

@@ -135,7 +134,7 @@ INSERT INTO alltypes.all_postgres_types (
DEFAULT,
32767, -- smallint_col
2147483647, -- integer_col
9223372036854775807, -- bigint_col
922337203685477580, -- bigint_col
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Max postgres bigint is 9223372036854775807 but when written to S3 and then synced to postgres causes the number to be too large. Need to investigate further

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm, I don't like this.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yeah same

Copy link

linear bot commented Dec 4, 2024

Copy link
Member

@nickzelei nickzelei left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:shipit:

"go.temporal.io/sdk/testsuite"
)

type Option func(*TestWorkflowEnv)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fancy

@alishakawaguchi alishakawaguchi merged commit 7157f84 into main Dec 5, 2024
8 of 10 checks passed
@alishakawaguchi alishakawaguchi deleted the alisha/cli-s3-sync-int-test branch December 5, 2024 00:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLI Created by Linear-GitHub Sync Devex Created by Linear-GitHub Sync
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants