Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Changes to GHA Update-Index Workflow #118

Merged
merged 109 commits into from
Dec 6, 2021
Merged
Changes from all commits
Commits
Show all changes
109 commits
Select commit Hold shift + click to select a range
b44fd1a
Update index-update.yaml
lm-ydubler Dec 1, 2021
745f5a1
Update index-update.yaml
lm-ydubler Dec 1, 2021
976b10e
Update index-update.yaml
lm-ydubler Dec 1, 2021
b082acf
Update index-update.yaml
lm-ydubler Dec 1, 2021
acc055c
Update index-update.yaml
lm-ydubler Dec 1, 2021
1d26ac3
Update index-update.yaml
lm-ydubler Dec 1, 2021
efc2884
Update index-update.yaml
lm-ydubler Dec 1, 2021
074bac2
Update index-update.yaml
lm-ydubler Dec 1, 2021
68d3b3e
Update index-update.yaml
lm-ydubler Dec 1, 2021
e3f9a54
Update index-update.yaml
lm-ydubler Dec 1, 2021
60b38f3
Update index-update.yaml
lm-ydubler Dec 1, 2021
4ac2530
Update index-update.yaml
lm-ydubler Dec 1, 2021
f09aa44
Update index-update.yaml
lm-ydubler Dec 1, 2021
501ede2
Update index-update.yaml
lm-ydubler Dec 1, 2021
63f09a5
Update index-update.yaml
lm-ydubler Dec 1, 2021
3c3a1e2
Update index-update.yaml
lm-ydubler Dec 1, 2021
fb22e31
Update index-update.yaml
lm-ydubler Dec 1, 2021
5c58886
Update index-update.yaml
lm-ydubler Dec 1, 2021
efcdef4
Update index-update.yaml
lm-ydubler Dec 1, 2021
a9590c9
Update index-update.yaml
lm-ydubler Dec 1, 2021
2e9d3d7
Update index-update.yaml
lm-ydubler Dec 1, 2021
609f22e
Update index-update.yaml
lm-ydubler Dec 1, 2021
e884893
Update index-update.yaml
lm-ydubler Dec 1, 2021
9b0fff3
Update index-update.yaml
lm-ydubler Dec 1, 2021
668be9d
Update index-update.yaml
lm-ydubler Dec 1, 2021
8041ddf
Update index-update.yaml
lm-ydubler Dec 2, 2021
2afd9b2
Update index-update.yaml
lm-ydubler Dec 2, 2021
ccf61ce
Update index-update.yaml
lm-ydubler Dec 3, 2021
a705649
Update index-update.yaml
lm-ydubler Dec 3, 2021
0cfc6ec
Update index-update.yaml
lm-ydubler Dec 3, 2021
29977b6
Update index-update.yaml
lm-ydubler Dec 3, 2021
6f06406
Update index-update.yaml
lm-ydubler Dec 3, 2021
52e79b1
Update index-update.yaml
lm-ydubler Dec 3, 2021
50efc3a
Update index-update.yaml
lm-ydubler Dec 3, 2021
ad09b9c
Update index-update.yaml
lm-ydubler Dec 3, 2021
1091931
Update index-update.yaml
lm-ydubler Dec 3, 2021
e78e166
Update index-update.yaml
lm-ydubler Dec 3, 2021
c1a33a2
Update index-update.yaml
lm-ydubler Dec 3, 2021
8e4dc78
Update index-update.yaml
lm-ydubler Dec 3, 2021
dcfe675
Update index-update.yaml
lm-ydubler Dec 3, 2021
ba329f3
Update index-update.yaml
lm-ydubler Dec 3, 2021
cddf408
Update index-update.yaml
lm-ydubler Dec 3, 2021
81b9a2b
Update index-update.yaml
lm-ydubler Dec 3, 2021
f13cb47
Update index-update.yaml
lm-ydubler Dec 3, 2021
a5bcab8
Update index-update.yaml
lm-ydubler Dec 3, 2021
4cfb47c
Update index-update.yaml
lm-ydubler Dec 3, 2021
3bdd261
Update index-update.yaml
lm-ydubler Dec 3, 2021
90551bc
Update index-update.yaml
lm-ydubler Dec 3, 2021
04d3853
Update index-update.yaml
lm-ydubler Dec 3, 2021
cc4a5e0
Update index-update.yaml
lm-ydubler Dec 3, 2021
df3f60d
Update index-update.yaml
lm-ydubler Dec 3, 2021
cc296fc
Update index-update.yaml
lm-ydubler Dec 3, 2021
f79cd67
Update index-update.yaml
lm-ydubler Dec 3, 2021
a1dacf3
Update index-update.yaml
lm-ydubler Dec 3, 2021
0b83360
Update index-update.yaml
lm-ydubler Dec 3, 2021
d4159e5
Update index-update.yaml
lm-ydubler Dec 3, 2021
e3bcf9d
Update index-update.yaml
lm-ydubler Dec 3, 2021
40285ce
Update index-update.yaml
lm-ydubler Dec 3, 2021
4d085bc
Update index-update.yaml
lm-ydubler Dec 3, 2021
878d641
Update index-update.yaml
lm-ydubler Dec 3, 2021
f4baf87
Update index-update.yaml
lm-ydubler Dec 3, 2021
2783098
Update index-update.yaml
lm-ydubler Dec 3, 2021
7f8ac5b
Update index-update.yaml
lm-ydubler Dec 3, 2021
80e5472
Update index-update.yaml
lm-ydubler Dec 3, 2021
820af95
Update index-update.yaml
lm-ydubler Dec 3, 2021
c3917e2
Update index-update.yaml
lm-ydubler Dec 3, 2021
b11a4b8
Update index-update.yaml
lm-ydubler Dec 3, 2021
1c88f4e
Update index-update.yaml
lm-ydubler Dec 3, 2021
f64dcfa
Update index-update.yaml
lm-ydubler Dec 3, 2021
21b3994
Update index-update.yaml
lm-ydubler Dec 3, 2021
7d34618
Update index-update.yaml
lm-ydubler Dec 3, 2021
c00b984
Update index-update.yaml
lm-ydubler Dec 3, 2021
71ec188
Update index-update.yaml
lm-ydubler Dec 3, 2021
5ba4996
Update index-update.yaml
lm-ydubler Dec 3, 2021
725677e
Update index-update.yaml
lm-ydubler Dec 3, 2021
8377fbe
Update index-update.yaml
lm-ydubler Dec 3, 2021
9e90dbb
Update index-update.yaml
lm-ydubler Dec 3, 2021
2f7d706
Update index-update.yaml
lm-ydubler Dec 3, 2021
f01da12
Update index-update.yaml
lm-ydubler Dec 3, 2021
5f801ff
Update index-update.yaml
lm-ydubler Dec 6, 2021
c0e256e
Update index-update.yaml
lm-ydubler Dec 6, 2021
420d616
Update index-update.yaml
lm-ydubler Dec 6, 2021
8bb83c8
Update index-update.yaml
lm-ydubler Dec 6, 2021
b924908
Update index-update.yaml
lm-ydubler Dec 6, 2021
21eb5c0
Update index-update.yaml
lm-ydubler Dec 6, 2021
1c7069c
Update index-update.yaml
lm-ydubler Dec 6, 2021
b0772d7
Update index-update.yaml
lm-ydubler Dec 6, 2021
96ad024
Update index-update.yaml
lm-ydubler Dec 6, 2021
489068e
Update index-update.yaml
lm-ydubler Dec 6, 2021
7835220
Update index-update.yaml
lm-ydubler Dec 6, 2021
a9b302e
Update index-update.yaml
lm-ydubler Dec 6, 2021
10cf58b
Update index-update.yaml
lm-ydubler Dec 6, 2021
6ac4c0c
Update index-update.yaml
lm-ydubler Dec 6, 2021
0e033aa
Update index-update.yaml
lm-ydubler Dec 6, 2021
d2975f6
Update index-update.yaml
lm-ydubler Dec 6, 2021
5b450f2
Update index-update.yaml
lm-ydubler Dec 6, 2021
ae7df0b
Update index-update.yaml
lm-ydubler Dec 6, 2021
c6697f9
Update index-update.yaml
lm-ydubler Dec 6, 2021
821aece
Update index-update.yaml
lm-ydubler Dec 6, 2021
833ee8e
Update index-update.yaml
lm-ydubler Dec 6, 2021
fea142e
Update index-update.yaml
lm-ydubler Dec 6, 2021
d0b8635
Update index-update.yaml
lm-ydubler Dec 6, 2021
9df33d8
Update index-update.yaml
lm-ydubler Dec 6, 2021
e022357
Update index-update.yaml
lm-ydubler Dec 6, 2021
bdc9c64
Update index-update.yaml
lm-ydubler Dec 6, 2021
9048220
Update index-update.yaml
lm-ydubler Dec 6, 2021
70a2399
Update index-update.yaml
lm-ydubler Dec 6, 2021
115b4a4
Update index-update.yaml
lm-ydubler Dec 6, 2021
d2f36c2
Update index-update.yaml
lm-ydubler Dec 6, 2021
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
37 changes: 24 additions & 13 deletions .github/workflows/index-update.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ on:
apt-cache-version:
required: false
type: string
default: "v0"
default: "v42"
py-cache-version:
required: false
type: string
Expand Down Expand Up @@ -132,19 +132,30 @@ jobs:
mkdir -p ${PACKS_PATH}
cd ${PACKS_PATH}
source ${TOOLS_DIR}/functions.sh
EXCLUDE_PACKS=$(grep -v '^#' "${INDEX_DIR}/v1/exclude_packs.txt" | xargs echo -n)
for repo_name in $(_gh_list_repo_names ${PACKS_ORG} ${PACKS_PREFIX}); do
echo "::group::Clone ${PACKS_ORG}/${repo_name}"
gh repo clone "${PACKS_ORG}/${repo_name}"
# !TODO: checkout the latest tag.
echo "::endgroup::"
# !TODO: exclude packs without tags
# !TODO: add index exclusion list to exclude utility packs like
# test, test_content_version
if ! [ -f "${repo_name}/pack.yaml" ] ; then
rm -rf ${repo_name}
echo "DELETED clone of ${PACKS_ORG}/${repo_name}: missing pack.yaml"
echo "${PACKS_ORG}/${repo_name}" >> ${GITHUB_WORKSPACE}/bad_pack_repos
fi
echo "::group::Clone ${PACKS_ORG}/${repo_name}"
gh repo clone "${PACKS_ORG}/${repo_name}"
if latestTag=$(git -C ${repo_name} describe --tags `git -C ${repo_name} rev-list --tags --max-count=1`); then
echo latestTag = $latestTag
git -C ${repo_name} checkout $latestTag -b latestTagBranch
fi
if [[ -z "$latestTag" ]]; then
rm -rf ${repo_name}
echo "DELETED clone of ${PACKS_ORG}/${repo_name}: missing git tags"
echo "${PACKS_ORG}/${repo_name}" >> ${GITHUB_WORKSPACE}/bad_pack_repos
elif [[ ! -f "./${repo_name}/pack.yaml" ]]; then
rm -rf ${repo_name}
echo "DELETED clone of ${PACKS_ORG}/${repo_name}: missing pack.yaml"
echo "${PACKS_ORG}/${repo_name}" >> ${GITHUB_WORKSPACE}/bad_pack_repos
elif [[ " ${EXCLUDE_PACKS} " =~ " ${repo_name#stackstorm-} " ]]; then
rm -rf ${repo_name}
echo "DELETED clone of ${PACKS_ORG}/${repo_name}: pack has been manually excluded"
echo "${PACKS_ORG}/${repo_name}" >> ${GITHUB_WORKSPACE}/bad_pack_repos
else
echo ${repo_name} is a valid pack.
fi
echo "::endgroup::"
done

# validate.py hard codes the pack repo prefix
Expand Down