Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve build speed with poetry export #3577

Closed
jaredlockhart opened this issue Sep 28, 2020 · 0 comments
Closed

Improve build speed with poetry export #3577

jaredlockhart opened this issue Sep 28, 2020 · 0 comments
Assignees
@jaredlockhart
Labels
Docker 🐳 Pull requests that update Docker code Task https://mozilla.github.io/task-defect-enhancement/index.html

Comments

@jaredlockhart
Copy link
Collaborator

jaredlockhart commented Sep 28, 2020 •
edited by data-sync-user
Loading

poetry install is noticeably slower than pip install, on my local machine for Experimenter it comes out to:

poetry install: 3m
pip install: 50s

So I as just reading through python-poetry/poetry#338 and someone suggested doing

poetry export -f requirements.txt --dev | pip install -r /dev/stdin

See: python-poetry/poetry#338 (comment)

So let's do that until their new parallel installer:

python-poetry/poetry#2595

is released.

┆Issue is synchronized with this Jira Task
┆Issue Number: EXP-361
@jaredlockhart jaredlockhart self-assigned this Sep 28, 2020
@jaredlockhart jaredlockhart added Docker 🐳 Pull requests that update Docker code Task https://mozilla.github.io/task-defect-enhancement/index.html labels Sep 28, 2020
jaredlockhart added a commit that referenced this issue Sep 28, 2020
@jaredlockhart
fix #3577 chore: Use pip installer to speed up build times
0bb591c 
Because

* poetry install takes significantly longer to install python packages

This commit

* Uses poetry to generate a requirements file and then uses pip to actually install everything
* I made a node that we should revert this when the new parallel poetry installer comes out
@earshinov earshinov mentioned this issue Mar 20, 2021
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jaredlockhart jaredlockhart

Labels
Docker 🐳 Pull requests that update Docker code Task https://mozilla.github.io/task-defect-enhancement/index.html
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@jaredlockhart