Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clone dataset schema #1278

Merged
merged 2 commits into from
Dec 5, 2024
Merged

Clone dataset schema #1278

merged 2 commits into from
Dec 5, 2024

Conversation

hinthornw
Copy link
Collaborator

No description provided.

@@ -3283,6 +3284,8 @@ def clone_public_dataset(
dataset_name=dataset_name,
description=ds.description,
data_type=ds.data_type or ls_schemas.DataType.kv,
inputs_schema=ds.inputs_schema,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can we set transformations as well here?

The description of the dataset.
data_type : DataType or None, default=DataType.kv
data_type : ls_schemas.DataType, default=ls_schemas.DataType.kv
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

note to self to mark this as deprecated

@@ -171,6 +171,22 @@ class Config:
frozen = True


DatasetTransformationType = Literal[
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Any thoughts on not making this a literal so it's easier to add new ones server side?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think since I union with str it at least won't be blocked if you try to say a new one

@hinthornw hinthornw merged commit 59a8c09 into main Dec 5, 2024
8 of 9 checks passed
@hinthornw hinthornw deleted the wfh/clone_schema branch December 5, 2024 17:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants