Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix CircleCI issues #172

Open
wants to merge 2 commits into
base: masterr
Choose a base branch
from

Conversation

ManuelAlvarezC
Copy link

@ManuelAlvarezC ManuelAlvarezC commented Oct 13, 2020

Hi!

This is WIP. Please don't merge nor dismiss. READ BELOW

I was checking the CircleCI errors here.

Install dependencies

ERROR: matplotlib 3.3.2 has requirement certifi>=2020.06.20, but you'll have certifi 2019.9.11 which is incompatible.
ERROR: wandb 0.10.4 has requirement six>=1.13.0, but you'll have six 1.12.0 which is incompatible.
ERROR: google-api-core 1.22.4 has requirement six>=1.13.0, but you'll have six 1.12.0 which is incompatible.
ERROR: google-cloud-bigquery 2.0.0 has requirement six<2.0.0dev,>=1.13.0, but you'll have six 1.12.0 which is incompatible.
ERROR: torchvision 0.6.1 has requirement torch==1.5.1, but you'll have torch 1.6.0 which is incompatible.

Decoder tests

  File "/home/circleci/repo/flood_forecast/gcp_integration/basic_utils.py", line 2, in <module>
    from google.cloud import storage

  ...

  File "/usr/local/lib/python3.7/site-packages/google/cloud/_http.py", line 23, in <module>
    from six.moves import collections_abc
ImportError: cannot import name 'collections_abc' from 'six.moves' (unknown location)

I think that the issue is caused by the wrong dependency versions (in this case six package on a google.cloud third dependency, but others could arise later on), and/or by the new pip resolution method[1][2] combined with a requirements file without the versions pinned down.

So I pinned down the versions to the requirements that caused the issue and I could make it work on a clean virtualenv running with python3.7.

If when I open PR and this branch runs on CircleCI, everything is fine, then I will pin down all the other requirements and that will be the end of it, it that's not the case I will check using a different image with the circleCI setup file.

UPDATE

The installation errors are gone, yet the build still crashed, this time caused by a test that requires user input.

From the CircleCI logs:

wandb: (1) Create a W&B account
wandb: (2) Use an existing W&B account
wandb: (3) Don't visualize my results
wandb: Enter your choice: Traceback (most recent call last):


File "/home/circleci/repo/flood_forecast/time_model.py", line 42, in __init__
    self.wandb = self.wandb_init()
  File "/home/circleci/repo/flood_forecast/time_model.py", line 89, in wandb_init
    tags=self.params["wandb"]["tags"])
  File "/usr/local/lib/python3.7/site-packages/wandb/sdk/wandb_init.py", line 500, in init
    six.raise_from(Exception("problem"), error_seen)
  File "<string>", line 3, in raise_from
Exception: problem
...

You can run the same comand on your local machine and see how the prompt pops out:.

python flood_forecast/trainer.py -p tests/transformer_bottleneck.json

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant