This repository has been archived by the owner on Mar 24, 2022. It is now read-only.

Spaces phase 1 & 2 #245

Closed

mhuangpivotal wants to merge 35 commits into master from spaces

Contributor

mhuangpivotal commented Jan 24, 2018

(continuation of #244)

fixes concourse/concourse#1764
fixes concourse/concourse#1765

mhuangpivotal added 30 commits

January 24, 2018 11:26


          Add resource_spaces

53c4d1f

This is a revert of a revert 232945e.

concourse/concourse#1764

Signed-off-by: Topher Bullock <cbullock@pivotal.io>


          Add migration to create job_resource_space_combinations table

d39dcea

Signed-off-by: Rui Yang <ryang@pivotal.io>


          Compute all job resource space combinations and persist them in the s…

b3e797f

…cheduler

Signed-off-by: Rui Yang <ryang@pivotal.io>


          Add job combination id and resource space id to input configs

1e885a3

Signed-off-by: Rui Yang <ryang@pivotal.io>


          Save an empty job_resource_space_combination when there are no combin…

…ations

Signed-off-by: Gabriel Dumitrescu <gdumitrescu@pivotal.io>


          Start migrating build operations from jobs to job combinations

0e18fb0

Signed-off-by: Gabriel Dumitrescu <gdumitrescu@pivotal.io>


          SaveNextInputMapping operates on job combinations

e26a765

Signed-off-by: Gabriel Dumitrescu <gdumitrescu@pivotal.io>


          Change table structure to avoid storing the hash of the combinations …

0ae4ce8

…and instead use an ID as the identifier

WIP

46c8abe

Migrate jobs to job_combinations and job_combinations_resource_spaces

TODO: determine which resource should be saved in job_combinations_resource_spaces when the same resource is duplicated

Signed-off-by: Joris Melchior <jmelchior@pivotal.io>


          Update job_combinations and job_combinations_resource_spaces migrations

834ff34

Signed-off-by: Mark Huang <mhuang@pivotal.io>


          Add unique indexes on job_combinations and job_combinations_resource_…

…spaces

Signed-off-by: Mark Huang <mhuang@pivotal.io>


          Add Spaces on JobConfig

007659d

Currently it returns "default" space for all resources

Signed-off-by: Mark Huang <mhuang@pivotal.io>


          Rename job_id to job_combination_id in the builds table

ee04a10

Signed-off-by: Mark Huang <mhuang@pivotal.io>


          Rename migrations

3774f50

Signed-off-by: Mark Huang <mhuang@pivotal.io>


          Migrate existing jobs to job combinations

631279c

Signed-off-by: Rui Yang <ryang@pivotal.io>


          Change job_id to job_combination_id in the builds table

da595fe

Signed-off-by: Rui Yang <ryang@pivotal.io>


          Add down migration for job_combinations

585fdd3

Signed-off-by: Mark Huang <mhuang@pivotal.io>


          Split out migration to rename builds job_id to job_combination_id

3a9256f

Signed-off-by: Mark Huang <mhuang@pivotal.io>


          Add migration to rename independent_build_inputs job_id to job_combin…

83f0cd4

…ation_id

Signed-off-by: Mark Huang <mhuang@pivotal.io>


          Add migration to rename next_build_inputs job_id to job_combination_id

96b3634

Signed-off-by: Mark Huang <mhuang@pivotal.io>


          Remove funcations on jobs that are now on job combinations

5cf6522

Signed-off-by: Rui Yang <ryang@pivotal.io>


          Rename job_id to job_combination_id in the worker_task_caches table

619fdbf

Also remove inputs_determined from jobs table

Signed-off-by: Rui Yang <ryang@pivotal.io>


          Update algorithm test data to use job combiations

ae404ed

Signed-off-by: Rui Yang <ryang@pivotal.io>


          Fix remaining tests

0b04b30

Signed-off-by: Rui Yang <ryang@pivotal.io>


          Start builds per job combination in scheduler

e75b53f

Signed-off-by: Rui Yang <ryang@pivotal.io>


          Sync job combinations when configuring a pipeline

a26bf13

APIs also default to use the latest job combination

Signed-off-by: Joris Melchior <jmelchior@pivotal.io>


          Fixes to make 'Around' work with job combinations

93bd78e


          Revert premature references to job combinations for containers

e496833

Signed-off-by: Mark Huang <mhuang@pivotal.io>


          Rename TryStartPendingBuildsForJob to

f02164b

TryStartPendingBuildsForJobCombination

Signed-off-by: Mark Huang <mhuang@pivotal.io>


          Reference resource spaces instead of resources in algorithm and sched…

7294d14

…uler

Signed-off-by: Mark Huang <mhuang@pivotal.io>

mhuangpivotal added 5 commits

January 24, 2018 11:27


          Sync resource space job combinations when saving pipelines

4b72516

Signed-off-by: Mark Huang <mhuang@pivotal.io>


          Add a function to save resource spaces for a pipeline

8d40374

and a function to list job combinations given a job

Signed-off-by: Mark Huang <mhuang@pivotal.io>


          Test refactoring

a46fcf0

Signed-off-by: Mark Huang <mhuang@pivotal.io>


          Add go migration to populate job combinations table

793f64c

Signed-off-by: Mark Huang <mhuang@pivotal.io>


          Populate job combinations resource spaces as part of spaces migration

223e912

Signed-off-by: Joris Melchior <jmelchior@pivotal.io>

mhuangpivotal closed this

mhuangpivotal deleted the spaces branch

April 30, 2018 20:56

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet