add upload_store as prepare parameter

[Kenneth-Schroeder]

Hi all,
this will add upload_store as parameter to the prepare function to make it possible to specify this yaml entry through the step's .py file.

Example:

valohai.prepare(
    step="training-step",
    image="docker.io/myorg/training:1.0",
    default_inputs=default_inputs,
    default_parameters=default_parameters,
    upload_store="abc123de-f456-7890-ghij-klmnopqrstuv"  # UUID of your upload store
)

You will need to bump the version as well and set it in valohai-cli.

Flow

1. Entry Point: valohai.prepare(upload_store="...")

   • Initial value is provided as a parameter to prepare()
   • This is the user's entry point for configuration

2. Global State Storage: global_state.py

   • The value is stored in global_state.upload_store
   • Acts as a temporary storage during the execution

3. AST Processing: PrepareParser.process_valohai_prepare_call()

   • Parses the Python code using AST (Abstract Syntax Tree)
   • Identifies the upload_store parameter in the prepare() call
   • Extracts its value using ast.literal_eval()

4. Parse Result Creation: ParseResult namedtuple

   • Packages the parsed information into a structured format
   • Includes upload_store alongside other configuration values like step name, parameters, etc.

5. Config Source Parsing: parse_config_from_source()

   • Receives the ParseResult from the previous step
   • Extracts the upload_store value for config generation

6. Config Generation: generate_config()

   • Takes upload_store as a parameter
   • Prepares it for step generation
   • Coordinates the overall config creation process

7. Step Generation: generate_step()

   • Receives upload_store value from generate_config
   • Uses it in Step object creation
   • Handles other step configuration details

8. Step Class Storage: Step class

   • Stores upload_store as an instance variable
   • Manages it alongside other step properties

9. Serialization: Step.serialize()

   • Converts Python-style upload_store to YAML-style upload-store
   • Prepares the value for YAML output
   • Follows YAML conventions for naming

10. Final Output: YAML file

    • Contains the final upload-store field with hyphenated name

Addition:

Please also update the documentation for visibility of this feature or point me to the docs repo (I couldn't find a public one).

Also, please mention in the documentation how to specify parameter descriptions. This is not well documented yet either.
Example:

default_params = {
    "parameter_name": {
        "default": "default_value",
        "description": "helpful description here",
        "optional": True,
        "type": "string"
    },
    ...
}

[akx]

Looks straightforward enough. Thanks!

[akx]

Oop, actually: tests & lint is failing