refreshEnvironment does not return the latest details of the conda environment

[DonJayamanne]

Based on discussions with @brettcannon
Such an API will be provided that allows Jupyter ext to install Python into an empty conda env

Here's what is happening

• Jupyter installs python into the conda env
• Jupyter ext uses the resolveEnviornment API to get the latest conda env info
• Unfortunately the latest conda env info is not yet returned by the Python extension (Python Ext returns the old info which leads one to believe that Python is not installed into the conda env)

[brettcannon]

Added to the iteration plan.

[DonJayamanne]

As part of this API call please can we ensure the Conda environment is updated
I.e. ensure the change event is triggered to update the conda env information, such as updating the Pytohn version, Uri (path to the executable etc)

Today I have a PR that installs Python into the conda environment from within the Jupyter extension (via custom code), however refreshing the Conda env takes more than 1 minute, hence that approach is not the best

i.e. i will need the Python Extension api to

• Provide a way to install Python into a conda env
• As well as update the conda env properties after the installation (so that environments contains the right information for this conda env)

[brettcannon]

ensure the change event is triggered to update the conda env information, such as updating the Pytohn version, Uri (path to the executable etc)

Today I have a PR that installs Python into the conda environment from within the Jupyter extension (via custom code), however refreshing the Conda env takes more than 1 minute, hence that approach is not the best

We can trigger an update immediately after the install, but I don't know if it will necessarily lead to a faster outcome since conda chooses what Python version to install.

[DonJayamanne]

faster outcome since conda chooses what Python version to install.

sorry, what I meant was the update of the environment information (environment info in api) would be faster if python extension updated the information for that specific conda env immediately
As opposed to Jupyter extension calling the refresh api (which takes more than a minute for me on my Mac)

[brettcannon]

sorry, what I meant was the update of the environment information (environment info in api) would be faster if python extension updated the information for that specific conda env immediately

Ah, so you're asking to just make sure that a changed event fires with the updated information once conda can provide that info to us instead of you having to to a manual trigger?

[DonJayamanne]

Yes thats correct, thanks

[brettcannon]

We were talking about this API in stand-up today, and we were wondering if you are calling conda install ipykernel? If you are then does conda itself not automatically trigger the Python installation as a dependency for ipykernel since conda supports multiple programming languages? If that's the case then would it be better to let conda handle the installation of Python implicitly as part of your installation call so it can make sure that a version of Python that's compatible with ipykernel gets installed?

If conda doesn't trigger an installation of Python then we should file a bug on conda to fix this. And if you're not running any installation command then this idea doesn't work. 😅

[DonJayamanne]

Will try that out and let you know

[DonJayamanne]

@brettcannon Yes that works, there is no need of an API to install Python into a conda env from the Python extension.
However I would would like a quick way to get the conda information updated.

Right now running the refresh api and waiting for the env change event to get fired takes around 60s, and that is way too slow. Thats after installing python into conda.

I can hack this as I know Python is installed, but that's just going around the issue and implementing a hack.
Can we have the Python extension refresh the conda info, if i request the env details for the conda env (either the same API or a new parameter on the same API).

I'm referring to the following

        /**
         * Returns details for the given environment, or `undefined` if the env is invalid.
         * @param environment : Full path to environment folder or python executable for the environment. Can also pass
         * the environment itself.
         */
        resolveEnvironment(
            environment: Environment | EnvironmentPath | string
        ): Promise<ResolvedEnvironment | undefined>;

[brettcannon]

Yes that works, there is no need of an API to install Python into a conda env from the Python extension.

Great!

Can we have the Python extension refresh the conda info, if i request the env details for the conda env (either the same API or a new parameter on the same API).

Seems reasonable. I have updated the title of the issue to reflect what I think your ask is.

[karrtikr]

@DonJayamanne resolveEnvironment should return the latest details for the conda env, is that not the case? If it does return updated details, I suggest you use in to update the env list quickly.

Right now the refresh API does not take additional parameters (like refresh only conda envs) to keep it simple.

[karrtikr]

resolveEnvironment should return the latest details for the conda env, is that not the case?

Ah, that was when IDs of conda envs after install were different, nevermind.

[DonJayamanne]

resolveEnvironment should return the latest details for the conda env, is that not the case? If it does return updated details, I suggest you use in to update the env list quickly.

No resolveEnvironment does not return the latest details.

If it does return updated details, I suggest you use in to update the env list quickly.

We have a similar issue where the removed event gets fired and the resolve env returns details of the env. meaning somthing is off with this method.
I would prefer to get this fixed or get a specific api instead of a work around.

Also as mentioned here, a work around doesn't provide the best UX (it is slow) #20634 (comment)

I think we should either close this issue and create a new one to indicate the fact that resolveEnvionrment does not return the latest details, or just update the title of this issue

[karrtikr]

No resolveEnvironment does not return the latest details.

Yes, I indicated in the follow up comment I guess you missed that. #20634 (comment)

[DonJayamanne]

@karrtikr should we just create a new issue? Or just hide the other comments and just leave the first issue comment and the last two comments open.
Else it might get a little confusing going forward, e.g. for someone like Brett or anyone looking at this issue (even you or me)

[brettcannon]

should we just create a new issue? Or just hide the other comments and just leave the first issue comment and the last two comments open.
Else it might get a little confusing going forward, e.g. for someone like Brett or anyone looking at this issue (even you or me)

Did either of these things happen?

[DonJayamanne]

Since @karrtikr didn't reply, I assumed this was fine as is

[karrtikr]

Thanks for the reminder, created #20765.