Skip to content

Add a Dockerfile container description #31

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 4 commits into
base: master
Choose a base branch
from
Open

Add a Dockerfile container description #31

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
1a19ca6
Describe the runtime environment in a Dockerfile.
rillian Aug 31, 2021
0abbb35
container: Bump xgboost to 0.90.
rillian Aug 31, 2021
520c5ec
container: Bump scikit-learn to 0.20.2
rillian Aug 31, 2021
fd52239
Document current scikit-learn and xgboost versions.
rillian Aug 31, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
36 changes: 36 additions & 0 deletions Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
FROM ubuntu:18.04

RUN apt-get update && apt-get -y upgrade
RUN apt-get install -y python3 python3-dev python3-pip
RUN DEBIAN_FRONTEND=noninteractive apt-get install -y \
python3-requests python3-numpy python3-pandas

# Some tools are in perl or java
RUN apt-get install -y perl default-jre-headless

# Use pip to install less-stable dependencies
RUN pip3 install --no-cache-dir scikit-learn==0.20.2

# xgboost build requires cmake
RUN apt-get install -y cmake
RUN pip3 install --no-cache-dir xgboost==0.90

RUN pip3 install joblib depedit

WORKDIR /usr/src/coptic-nlp

COPY . .

# Additional non-python dependencies
RUN apt-get install -y foma-bin
RUN ln -s /usr/bin/flookup bin/foma/
RUN apt-get install -y wget
RUN echo '456548f7cc7b84aec6b639826d9a3ca76ad72b310247bf744780b8f6a28c1aee maltparser-1.8.tar.gz' > bin/maltparser-1.8.sha2
RUN cd bin && wget http://maltparser.org/dist/maltparser-1.8.tar.gz
RUN cd bin && shasum -c maltparser-1.8.sha2
RUN cd bin && tar xf maltparser-1.8.tar.gz
RUN cp bin/coptic.mco bin/maltparser-1.8/coptic.mco

RUN python3 run_tests.py

CMD [ "python3", "coptic_nlp.py" ]
5 changes: 3 additions & 2 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,9 +22,10 @@ The NLP pipeline will run on Python 2.7+ or Python 3.5+ (2.6 and lower are not s
* requests
* numpy
* pandas
* scikit-learn==0.19.0
* scikit-learn==0.20.2
* xgboost==0.90

You should be able to install these manually via pip if necessary (i.e. `pip install scikit-learn==0.19.0`).
You should be able to install these manually via pip if necessary (i.e. `pip install scikit-learn==0.20.2`).

Note that some versions of Python + Windows do not install numpy correctly from pip, in which case you can download compiled binaries for your version of Python + Windows here: https://www.lfd.uci.edu/~gohlke/pythonlibs/, then run for example:

Expand Down
6 changes: 3 additions & 3 deletions requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
requests
pandas
scikit-learn==0.19.0
xgboost
scikit-learn==0.20.2
xgboost==0.90
joblib
depedit
depedit