GitHub Packages | Support for python packages

[TarunavBA]

Right now you could only upload to pypi or leave it like that. I want to upload my packages to GitHub packages just like docker, npm, gradle, maven etc. It would be awesome if you could release it in the public beta where users can simply go to feature preview and enable it.

[DannyVarod]

This has been a request for a few years now:
https://github.community/t/pypi-compatible-github-package-registry/14615
Still no commitment to this though:
https://github.com/orgs/github/projects/4247/views/1?filterQuery=pypi

[rwaal]

This is really disappointing. Given how popular Python has become, this decision is pretty surprising. Looks like we'll need to consider alternatives like Artifactory.

[bodograumann]

Agreed. Especially seeing how simple the pypi repo api is.
From what I remember, when looking into this, you only need a static http server.
Cf. https://bartbroere.eu/2020/04/07/running-pypi-registry-windows-github-actions/
The main difficulty would be authentication with a private registry, which I didn't find any existing solution for.

Alternatively it is possible to install packages directly through git access:
Cf. https://www.freecodecamp.org/news/how-to-use-github-as-a-pypi-server-1c3b0d07db2/

[jstafford5380]

Or... prepare for amusement... Azure Artifacts. It has supported PyPi forever.

[chicco785]

This is no longer planned due to a change in our strategic priorities and the allocation of our resources towards higher-priority initiatives.

Come on... did they really come up with such a sentence? Such a corporate cliché...

[lukasz-mitka]

Hey guys, don't shoot the messenger 😆

[ashrafguitoni]

It's really unfortunate that such a helpful feature is still not scheduled for development yet. Really hoping to see this in GitHub Beta in the near future!

[davidkhala]

This has been added to roadmap

[ashrafguitoni]

@davidkhala I think it's been in Future for nearly 2 years. Any chance it'll be moved to one of the other boards?

[pulkitaggarwl]

I agree this is a great value add to the product, we do have this on our roadmap and we will try to get to near future. Unfortunately no ETA at the moment.

[luwangshell]

Our company is also requiring this feature as priority.

[td43]

my company too

[hgad]

Really important to have this one for all the Python shops out there.

[timmypidashev]

Would love this feature so much <3

[xqi-aviatrix]

Python packages would be very helpful

[csmizzle]

would love this feature so much!

[Clean-Cole]

GitLab has had this available for at least a year already. Would be nice to see in GitHub as well.

[vinicius-roc]

this feature would so much amazing! We need too!

[hannesdelbeke]

can't wait :)

[leovanzella]

Would be great having this feature!

[gerardsimons]

Please, please add this !

[danielnyari]

It's on the public roadmap. There is no date for it though. Please make this happen 🙏

[ashrafguitoni]

I don't know if this post (given its age) is being monitored by anyone from the Github team ...

[timmypidashev]

It really should be given the fact that packaging Python packages has become so common and standard in many projects. Providing a proper, official way to do this will boost Github's packaging support 👍> I don't know if this post (given its age) is being monitored by anyone from the Github team ...

[codebydant]

This a superb idea, this will help my organization to not depend on external services such as JFROG and keep all our artifacts in one place.

[codebydant]

Hi folks,

I have contacted GitHub Support asking for this open discussion and this was the formal response.

[ashrafguitoni]

Thank you for taking the time to do this. It's unfortunate that this won't be happening soon. Maybe in 2024 ...

[alberto-corrales]

Maybe in 2025.... :(

[mohas556]

This is a fundamentally critical piece that is preventing a lot of companies from migrating away from GitLab, which has an excellent implementation of this. Quite shocking that Engineering is so blasé about it .

[oh54]

Couldn't agree more.
Especially given the fast pace of developments in data science and machine learning, where Python is the de facto standard.

Microsoft, this is a must have for many data science teams before moving their codebase to GitHub!

[RempelOliveira]

Does anyone know if it's possible to dockerize a python package and import it into another project?

I ask this because, there is a container registry for pushing dockerized images in the github packages resource.

Is this a possible easy way to do this?

[lukasz-mitka]

Not directly related to your question, but I'll add it just in case.

You can install pip packages directly from the git repo https://pip.pypa.io/en/stable/topics/vcs-support/

[noirbizarre]

Only works for source-only packages. If you need to build anything, it means you need to have a toolchain where you install which is not very safe in production, not very scalable and error prone.

[BenjaminYde]

1. Create an azure vm with a docker compose using devpi, nginx and certbot
2. Build and upload packages to devpi
3. In dockerfile, install your python package from devpi instead of pypi (Make sure to login to devpi using devpi-tokens)

[sourceful-karlson]

https://github.com/astariul/github-hosted-pypi
https://github.com/astariul/github-hosted-pypi

[12rambau]

Don't you think it's a bit aggressive to send it 8 times? 😅

[sourceful-karlson]

edited!

[abrichr]

@sourceful-karlson does this solve the problem of not having anything listed under "Packages" in a Github repo that publishes to PyPi?

[RakeshNagarajan]

Any update on this request?

[umm0n]

Unbelievable this isn't available yet...

[RyanGuild-us-ignite]

Hi, I'm just another GitHub user—maybe even a zealot. I need GitHub to support something that allows me to separate sources from compiled artifacts in Earth's second most popular programming language. Thank you

[mikeball]

I also need to host internal python packages and would really like to use github actions for ci/cd. Surely would be nice to just use the same platform that I'm already using for docker containers and npm packages. How on earth can this not a like a top priority for the most popular language?

[BenjaminYde]

They are collaborating with JFrog (Artifactory) so I don't think this will be ever a thing.
See the blogpost: https://github.blog/2024-05-29-github-and-jfrog/
This is a feature that gitlab, azure devops, ... has, why not Github? Python is one of the most common used languages.

[ei-grad]

github/roadmap#94

This is no longer planned due to a change in our strategic priorities and the allocation of our resources towards higher-priority initiatives.

Should our higher-priority initiative be to move our repos, CI jobs and bills to Gitlab?..

[trazola]

Ehhh :/. it's time to use azure or gitlab

[dhvcc]

Use GitLab for enterprise, it's very good

[Viibrant]

How is this not a thing? Why isn't this high priority?

I can't believe GitHub doesn't do this, surely this functionality is a given. Maybe I'm naive and Python is just a small toy language that is scarcely used anywhere, or maybe GitHub knows something we don't 👀

[PageotD]

..or GitLab and Azure know something GitHub doesn't...

[Viibrant]

..or GitLab and Azure know something GitHub doesn't...

True, GitHub small indie company

[jpablos11]

Unbelievable how this conversation and opinions have been ignored for so long, I agree Python packages is a simple and important feature.

I think I am better off looking for alternatives considering the time this thread has been active with no action, disappointed on GitHub and its "strategic direction" response, which indeed sounds to come from corporate minds out of touch with the development space.

[lukasz-mitka]

[...] corporate minds out of touch with the development space

You've put it perfectly.

However, I'm wondering, how many paying clients have actually chosen different service because of that particular deficiency?

[psirenny]

GitLab is often chosen over GitHub for on-premise deployments because you get so many things out of the box such as Python package management. Our organization's tool of choice is GitHub, but these missing features make it a tougher sell to partners we work with that want an easy way to stand everything up.

[datalogics-kam]

We've had to resort to using CodeArtifact on AWS, which is non-ideal. Logins last 12 hours max, and are per-project, so once per work day, a developer's build will fail, and they have to remember to run the command to log into CodeArtifact.

[umm0n]

We're in the same boat @datalogics-kam. And considering how little love AWS is showing their Code* suite, I'm not thrilled about this dependency.

[SciMind2460]

When is this going to be implemented? According to the TIOBE index, Python is the most popular language, with a 20.17% usage rate. I do not comprehend why GitHub does not implement a package system for Python. This is very disappointing and must be resolved. I expected that GitHub would have better integration with Python.

[jstafford5380]

I think the main issue is that GitHub has something else coming for packages to replace the current implementation.

[nearlythere]

Seems like GitHub has signalled they aren't going to develop their GitHub Packages solution - they have a partnership with JFrog https://github.blog/news-insights/product-news/github-and-jfrog/

[SciMind2460]

Very interesting. I am however a bit uncomfortable with a third-party solution. I would prefer if GitHub Packages was updated. And also, could anyone please explain it to me? It's not explained very well in the article.

[SciMind2460]

Also, surprisingly GitHub has not taken any action in this respect, and JFrog integration with packages still appears to not exist. Any action in the near future?

[varadinov]

I checked this few years ago and I was disappointed. Now I had the good felling that this feature will be there but now I'm even more disappointed...

[maksimu]

Same here.... :(

[dhvcc]

This is just sad