-
Notifications
You must be signed in to change notification settings - Fork 59
Create a Data Job through the Jupyter UI
Stanislav edited this page Nov 20, 2023
·
2 revisions
Time Commitment: About 5-10 minutes.
If you are not using an already configured environment, before you start with the creation, please ensure you have the following:
Installed Software and Services
- (Optional) Control Service: Essential for orchestrating the execution of Data Jobs.
- vdk-jupyterlab-extension: This extension integrates VDK with JupyterLab.
- vdk-notebook: Allows the execution of VDK jobs with notebooks.
- vdk-ipython: Loads VDK functionalities into IPython environments, allowing enhanced interaction.
- Select 'Create' option from the
VDK
section in the menu at the top.
![create-menu](https://private-user-images.githubusercontent.com/87015481/275788395-f36aec4f-ab6c-46f4-b2c2-80d996e93c81.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkzNDgyMjksIm5iZiI6MTczOTM0NzkyOSwicGF0aCI6Ii84NzAxNTQ4MS8yNzU3ODgzOTUtZjM2YWVjNGYtYWI2Yy00NmY0LWIyYzItODBkOTk2ZTkzYzgxLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjEyVDA4MTIwOVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTRhY2IwNTI2YTY2ZjZkMGY4NzNjNzU4YjMxMmJjYmFlYjg2YTYwYzlkNjVlY2ZjZGFmMDcxOWRhNDI5MjUwOGImWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.N7TDsEJQgI4hE_qoAn7bO6c8GvjeViD_jyc98-4VvWc)
- Click 'Create' to open a dialog box.
- Fill in the job name and job team as appropriate.
- Specify Job Path by inputting the relative Jupyter path to the job directory, using the
parent/child/job
pattern. If no path is specified, the job will be created in the root directory. - Once all details are filled in, click 'OK' to continue. The job will be created both locally and in the cloud (if available).
![create-dialog](https://private-user-images.githubusercontent.com/87015481/275788196-bc3843fd-310f-46a4-a488-78de8db89ccf.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkzNDgyMjksIm5iZiI6MTczOTM0NzkyOSwicGF0aCI6Ii84NzAxNTQ4MS8yNzU3ODgxOTYtYmMzODQzZmQtMzEwZi00NmE0LWE0ODgtNzhkZThkYjg5Y2NmLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjEyVDA4MTIwOVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWUzNWE3YzA1ZTlmM2FhM2RhY2U4NTIxOTIyYWIwNzcwOWYzMGI1NDk4ZTk1ZmJiNmEzNmVmYzQyYmQ0MTBmNWUmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.1ByrK9fNidONzmydIcguKEUIpD6UJ3hEY9H7L3lUmU0)
- Wait for a status update on the job creation operation.
![create-status-update](https://private-user-images.githubusercontent.com/87015481/275788534-4411b26d-6c0f-43d7-8be5-06a6fe5f3a2d.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkzNDgyMjksIm5iZiI6MTczOTM0NzkyOSwicGF0aCI6Ii84NzAxNTQ4MS8yNzU3ODg1MzQtNDQxMWIyNmQtNmMwZi00M2Q3LThiZTUtMDZhNmZlNWYzYTJkLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjEyVDA4MTIwOVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWU0YjdkNWIxOTM2NWVlODc1NDMxNWVhN2QxNDk2OWY1ZGFlMTMwMDZjOWU4Yzg1NTA4NWNhOGE0ZTkzMTBkN2ImWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.jlXtQTiF_iAzm73lCzE7nMMihVfvT6T_dtlu4vmLoB0)
- Once the creation operation is complete, a dialog box will inform you of the operation's result.
![create-success](https://private-user-images.githubusercontent.com/87015481/275788613-e9b07397-c225-42b9-bca1-21b3ff43e8d5.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkzNDgyMjksIm5iZiI6MTczOTM0NzkyOSwicGF0aCI6Ii84NzAxNTQ4MS8yNzU3ODg2MTMtZTliMDczOTctYzIyNS00MmI5LWJjYTEtMjFiM2ZmNDNlOGQ1LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjEyVDA4MTIwOVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTk5ZGMwOTAyMWRkYjA3NGViMGRhYThhZTBhMjc0NzJlMTNjOTk4MmViN2EwNzhiYzBlMGUwZDAxYjk4NGI1YmMmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.H1Y6r8RDdaAwNyyY43PLtA56RT-8CxXPyRQQLk3helk)
- Navigate to the data job directory to view your newly created job.
Well done! You've successfully navigated through the process and created your first Data Job using Jupyter! This is a significant step in your journey with the Versatile Data Kit, and we hope it was insightful.
If you're just starting out, don’t stop here! Proceed to Develop a Job from Jupyter Guide to continue developing your newly created job!
Explore further with the VDK Examples list.
SDK - Develop Data Jobs
SDK Key Concepts
Control Service - Deploy Data Jobs
Control Service Key Concepts
- Scheduling a Data Job for automatic execution
- Deployment
- Execution
- Production
- Properties and Secrets
Operations UI
Community
Contacts