Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GraphDB storage POC #2

Draft
wants to merge 42 commits into
base: master
Choose a base branch
from
Draft
Changes from 1 commit
Commits
Show all changes
42 commits
Select commit Hold shift + click to select a range
79ada91
Added mock cbs node
dsmits May 25, 2020
80834be
Initial commit for vantage client module, hasn't been tested yet
dsmits May 25, 2020
5db6865
Print api keys after creating nodes
dsmits May 26, 2020
440c1e7
Added local docker registry to docker-compose
dsmits May 26, 2020
7c1efc2
Task input is now received by server
dsmits May 27, 2020
4cf2a98
Separate registry
dsmits May 27, 2020
d8c90eb
Updated readme
dsmits May 27, 2020
20767b4
Setup is working now
dsmits May 28, 2020
f526a90
Cleanup of run_task
dsmits May 28, 2020
0361fe2
Update README.MD
dsmits Jun 2, 2020
83dbef4
Added more realistic dataset
dsmits Jun 2, 2020
9168467
Merge branch 'master' of github.com:dsmits/vantage6-local-setup
dsmits Jun 2, 2020
870e877
Switched back to using most up to date node image from official registry
dsmits Jun 2, 2020
f9fd159
Clearer instructions in readme
dsmits Jun 3, 2020
cbf852d
Fixed database path for mumc node
dsmits Jun 3, 2020
ee00b35
Added option to run master algorithm
dsmits Jun 9, 2020
f0f0168
Removed unused load_mumc_data.py
dsmits Jun 9, 2020
3f3eb66
Added another node
dsmits Jun 9, 2020
0eb8bb5
Every node will be in a separate organization
dsmits Jun 9, 2020
4d01f71
DIfferent ids
dsmits Jun 10, 2020
08dd59e
Load initial configuration from sql dump
dsmits Jun 11, 2020
99a87ec
Updated readme
dsmits Jun 11, 2020
602b08c
Added sample data from FAIRhealth project
dsmits Jun 2, 2020
1da87bb
Setup now has two nodes with vertically partitioned data
dsmits Jun 2, 2020
16472d9
Created script to add a new node with a specified name
dsmits Jun 11, 2020
f5acb39
Created cbs node and added it to the database dump
dsmits Jun 11, 2020
e1255b5
Assigned every node its own shared volume
dsmits Jun 15, 2020
dcc9717
Moved all node specific data to nodes dir
dsmits Jun 15, 2020
bba5dc4
Made add_new_node.py more flexible
dsmits Jun 15, 2020
12b336e
Added escience master node
dsmits Jun 15, 2020
7359b99
Added node to escience organization
dsmits Jun 15, 2020
b66e5d5
Pretty print pandas DataFrames
dsmits Jun 18, 2020
cdc92a5
Replace csv with bostom sample linked data for escience data
svenvanderburg Jun 19, 2020
7d5fdd4
Keep only the escience data station with example .ttl data, run get_p…
svenvanderburg Jun 19, 2020
6ecfd98
Convert run_task.py into command line client
svenvanderburg Jun 22, 2020
4880502
Add comment for --master/--rpc option
svenvanderburg Jun 23, 2020
cead982
Fix num_retries bug, changed num_retries into num_tries
svenvanderburg Jun 23, 2020
0573e0a
Merge pull request #3 from CARRIER-project/run_task_cli
dsmits Jun 23, 2020
4d40671
Merge branch 'master' of github.com:CARRIER-project/vantage6-local-se…
svenvanderburg Jun 23, 2020
e77022d
Setup graphdb and populate with sample data
svenvanderburg Jun 24, 2020
4c67812
Correctly configure docker-compose so the node container can access t…
svenvanderburg Jun 24, 2020
262c3cb
Add run_task command for POC algorithm to readme
svenvanderburg Jun 24, 2020
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Added escience master node
  • Loading branch information
dsmits committed Jun 15, 2020
commit 12b336ea5352e632d4ded50df8319d69c118e2ef
14 changes: 14 additions & 0 deletions docker-compose.yml
Original file line number Diff line number Diff line change
@@ -68,6 +68,18 @@ services:
- DATA_VOLUME_NAME=cbs-shared-volume
- DATABASE_URI=/mnt/database/database.csv

escience:
container_name: vantage6-escience-user
image: "harbor.vantage6.ai/infrastructure/node:latest"
command: "vnode-local start -c /mnt/config/cbs.yml --dockerized"
volumes:
- ./nodes/escience/escience-node-config.yml:/mnt/config/cbs.yml
- /var/run/docker.sock:/var/run/docker.sock
- escience-shared-volume:/mnt/data
environment:
- DATA_VOLUME_NAME=escience-shared-volume
- DATABASE_URI=/mnt/database/database.csv


volumes:
cbs-shared-volume:
@@ -76,6 +88,8 @@ volumes:
name: umcutrecht-shared-volume
mumc-shared-volume:
name: mumc-shared-volume
escience-shared-volume:
name: escience-shared-volume

#
# registry:
2 changes: 1 addition & 1 deletion nodes/escience/escience-node-config.yml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
application:
api_key: "37281654-abf3-11ea-9579-0242c0a84004"
api_key: "56b97dd2-aefa-11ea-a535-0242ac130005"
api_path: /api
databases:
default: /mnt/database/database.csv