Skip to content
This repository has been archived by the owner on Aug 30, 2024. It is now read-only.

Use Azure Pipelines and upload to anaconda #78

Merged
merged 11 commits into from
Apr 22, 2020
Merged

Conversation

mattip
Copy link
Contributor

@mattip mattip commented Apr 14, 2020

Copy the pandas-wheels approach of using Azure and uploading to anaconda

This was referenced Apr 14, 2020
@mattip mattip changed the title Set up CI with Azure Pipelines Use Azure Pipelines and upload to anaconda Apr 14, 2020
@mattip mattip force-pushed the azure-pipelines2 branch 2 times, most recently from 7b64dbb to 3f87a6f Compare April 14, 2020 10:18
@mattip mattip force-pushed the azure-pipelines2 branch from 3f87a6f to 585ffa1 Compare April 14, 2020 10:20
@mattip mattip force-pushed the azure-pipelines2 branch 12 times, most recently from 39d9347 to 7f0076a Compare April 14, 2020 15:40
@charris
Copy link
Contributor

charris commented Apr 14, 2020

Progress!

@charris
Copy link
Contributor

charris commented Apr 14, 2020

The windows wheels seem to be 1.18.2?

@mattip
Copy link
Contributor Author

mattip commented Apr 14, 2020

Yes, since the build tag is 1.18.2
Still todo:

  • fix the openblas windows linking
  • use tokens to upload to anaconda

@mattip mattip force-pushed the azure-pipelines2 branch from f5044dc to 74d5f79 Compare April 20, 2020 12:55
@mattip mattip force-pushed the azure-pipelines2 branch 3 times, most recently from 53f5c47 to 85c4276 Compare April 20, 2020 20:52
@mattip
Copy link
Contributor Author

mattip commented Apr 21, 2020

@tylerjereddy thanks. I added a NUMPY_STAGING_UPLOAD_TOKEN secret to this repo, which I got from the multibuild-wheels-staging group, but anaconda upload is failing. Any ideas? Is there a way to get more info from the anaconda client?

log of the upload
numpy/dist/numpy-1.19.0.dev0+9eb7560-cp36-cp36m-win_amd64.whl
Using Anaconda API: https://api.anaconda.org
Using "multibuild-wheels-staging" as upload username
Processing 'numpy/dist/numpy-1.19.0.dev0+9eb7560-cp36-cp36m-win_amd64.whl'
Detecting file type...
File type is "pypi"
Extracting python package attributes for upload
Creating package "numpy"

##[error]Bash exited with code '1'.

@mattip
Copy link
Contributor Author

mattip commented Apr 21, 2020

I can run anaconda -t $SECRET upload -u multibuild-wheels-staging numpy/dist/numpy*.whl from the command line, so something must be off with the script I copied from pandas-wheels. Adding some debug in c0a3da2

@mattip
Copy link
Contributor Author

mattip commented Apr 21, 2020

Hah, the $TOKEN starts with "$(N", not the contents of the secret.

@mattip
Copy link
Contributor Author

mattip commented Apr 21, 2020

Maybe the problem is I added the secrets to the repo, not the azure pipeline.

@mattip mattip force-pushed the azure-pipelines2 branch from c0a3da2 to 18cbffe Compare April 21, 2020 07:32
@mattip
Copy link
Contributor Author

mattip commented Apr 21, 2020

Success!!!. Let's see if I can get 1.18.3 releases onto that site, and I will remove the 1.19 pre-releases, they belong in the https://anaconda.org/scipy-wheels-nightly/ directory

@mattip mattip force-pushed the azure-pipelines2 branch from 7bd9b9a to cb4b80f Compare April 21, 2020 08:38
@mattip mattip force-pushed the azure-pipelines2 branch from cb4b80f to 3b74aa4 Compare April 21, 2020 08:48
@mattip
Copy link
Contributor Author

mattip commented Apr 21, 2020

Making one more commit, that I will back out, to test the nightly cron job and that linux32 passes on master HEAD.

@mattip mattip force-pushed the azure-pipelines2 branch from 4e16bab to 8c67a24 Compare April 21, 2020 18:08
@charris
Copy link
Contributor

charris commented Apr 22, 2020

@mattip are you sure this should be merged? There are still the 32bit linux failures which look like failure it install OpenBLAS

@mattip
Copy link
Contributor Author

mattip commented Apr 22, 2020

There are still the 32bit linux failures

Those are due to the v1.18.3 tag and some incompatibility with the uname Azure reports for the 32-bit build here vs. the uname it reports on numpy/numpy. The openblas_support.py is more robust on the master branch so it all passes, as you can see at both the https://anaconda.org/multibuild-wheels-staging (which are the pre-release wheels) and the https://anaconda.org/scipy-wheels-nightly/numpy/files (which are the weekly wheels built off HEAD).

@charris charris merged commit bdc98f8 into master Apr 22, 2020
@charris
Copy link
Contributor

charris commented Apr 22, 2020

Thanks Matti.

@charris
Copy link
Contributor

charris commented Apr 22, 2020

.appveyor.yml still exists, should it be removed?

@mattip
Copy link
Contributor Author

mattip commented Apr 23, 2020

Unlike travis, appveyor errors out if there is no .appveyor.yml so I had to add an empty one.

@charris
Copy link
Contributor

charris commented Apr 23, 2020

The appveyor hook can be disabled in the settings, I'll do that.

@charris
Copy link
Contributor

charris commented Apr 23, 2020

I've disabled all the webhooks for appveyor and travis.

@charris
Copy link
Contributor

charris commented Apr 23, 2020

There were three for appveyor and I deleted the failing one, which is probably the one I should have kept. Oh well...

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants