Skip to content

[WIP] Add scripts to build Linux and MacOS wheels - #314

Closed
danielsuo wants to merge 127 commits into
brainiak:masterfrom
danielsuo:wheels
Closed

danielsuo wants to merge 127 commits into
brainiak:masterfrom
danielsuo:wheels

Conversation

@danielsuo

@danielsuo danielsuo commented Dec 13, 2017 •

Copy link
Copy Markdown
Member

Very early work in progress, but we have successfully built wheels that install on fresh machines with no other dependencies. Many other issues to work through:

  • How to handle the MPI dependencies (right now we package up an MPI wheel as well, but should include better logic for using existing MPI or mpi4py installations)
  • Where and how to upload wheels (probably want to do this via travis when we release a new tag)
  • End-to-end testing
  • How do these wheels play with existing package / python installations

@buildbot-princeton

Copy link
Copy Markdown
Collaborator

Can one of the admins verify this patch?

1 similar comment
@buildbot-princeton

Copy link
Copy Markdown
Collaborator

Can one of the admins verify this patch?

@danielsuo

Copy link
Copy Markdown
Member Author

I think there are two easy next steps:

  1. Decide what we want the deployment flow to be and what the resulting user flow should be
  2. Use a simple .travis.yml that only deals with building wheels to test everything

@danielsuo danielsuo self-assigned this Dec 13, 2017
@danielsuo
danielsuo requested review from TuKo and mihaic December 13, 2017 02:38
@mihaic

mihaic commented Dec 13, 2017

Copy link
Copy Markdown
Member

Jenkins, OK to test.

@mihaic

mihaic commented Dec 13, 2017

Copy link
Copy Markdown
Member

We can test on Conda using Jenkins. We need to make Jenkins wait for the wheels from Travis.

@danielsuo

danielsuo commented Dec 13, 2017 via email

Copy link
Copy Markdown
Member Author

@mihaic

mihaic commented Dec 13, 2017

Copy link
Copy Markdown
Member

Because Jenkins runs on infrastructure that we want to support: Conda, Slurm, Intel MPI.

@danielsuo

danielsuo commented Dec 13, 2017 via email

Copy link
Copy Markdown
Member Author

@danielsuo

danielsuo commented Feb 1, 2018 •

Copy link
Copy Markdown
Member Author

Closing this thread, but leaving the branch alive since there are a lot of useful tidbits related to building wheels, managing Travis more programmatically, automating deployment / uploads, etc.

@danielsuo danielsuo closed this Feb 1, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants