We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Dynamic job descriptions can help tracking which table the current running Pramen job is processing
Allow setting Spark job descriptions at runtime with the current job.
pramen.job.description.template = "Running ingestion of @metastoreTable..."
or
pramen.job.description.template = "Pramen - running @pipeline, job @jobName"
spark.sparkContext.setJobDescription(s)
The text was updated successfully, but these errors were encountered:
#498 Implement the setting of the Spark Application description.
91c6702
f91e130
d2fd7e0
No branches or pull requests
Background
Dynamic job descriptions can help tracking which table the current running Pramen job is processing
Feature
Allow setting Spark job descriptions at runtime with the current job.
Example [Optional]
or
Proposed Solution [Optional]
The text was updated successfully, but these errors were encountered: