Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DO NOT MERGE] Vefify for #2549 #2551

Closed
wants to merge 36 commits into from
Closed
Show file tree
Hide file tree
Changes from 6 commits
Commits
Show all changes
36 commits
Select commit Hold shift + click to select a range
120d86f
update deps
kpango Jul 29, 2024
eeb71db
feat: fix refactor
hlts2 Jul 30, 2024
f9a0346
fix: update image tag
hlts2 Jul 30, 2024
fa9461a
fix: use bind
hlts2 Jul 30, 2024
93fa7ce
Merge branch 'main' into fix/dependency/update/go-modules
hlts2 Jul 30, 2024
e3b28b3
fix: add --privileged option
hlts2 Jul 30, 2024
c87c1b0
fix: deleted unnecessary option
hlts2 Jul 30, 2024
24e1837
fix: revert k3d changes
hlts2 Jul 30, 2024
b2caaa4
fix: add port settings
hlts2 Jul 30, 2024
c6f9032
fix: docker host address
hlts2 Jul 30, 2024
7f9d2e5
fix: deleted unnecessary env
hlts2 Jul 30, 2024
a8b33b9
fix: add docker socket settings
hlts2 Jul 30, 2024
8c2349f
fix: add port
hlts2 Jul 30, 2024
8eaae95
fix: add env
hlts2 Jul 30, 2024
6370c7d
fix: docker socket
hlts2 Jul 30, 2024
b71e57f
fix: debug
hlts2 Jul 30, 2024
2deb3f3
fix: delete code
hlts2 Jul 30, 2024
d625b28
fix
hlts2 Jul 30, 2024
88b8b60
fix: add port settings
hlts2 Jul 30, 2024
f260169
fix: add docker settings
hlts2 Jul 30, 2024
a6148e4
fix: debug
hlts2 Jul 30, 2024
144317e
fix: update port
hlts2 Jul 30, 2024
020a8d0
fix
hlts2 Jul 30, 2024
1ec2e5d
fix: update settings
hlts2 Jul 30, 2024
364dbe4
fix: revert all changes
hlts2 Jul 30, 2024
56e1a06
fix
hlts2 Jul 30, 2024
300f9cd
fix:
hlts2 Jul 30, 2024
c0238b6
fix:
hlts2 Jul 30, 2024
f3a4551
fix
hlts2 Jul 30, 2024
59cee1d
fix
hlts2 Jul 30, 2024
ce1e3b6
Revert "fix"
hlts2 Jul 30, 2024
2795b05
fix:
hlts2 Jul 31, 2024
227cd19
fix:
hlts2 Jul 31, 2024
3557a32
feat: add e2e job
hlts2 Jul 31, 2024
d15517b
fix: update e2e and chaos
hlts2 Jul 31, 2024
5ea7269
fix
hlts2 Jul 31, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions .gitfiles
Original file line number Diff line number Diff line change
Expand Up @@ -1971,6 +1971,7 @@ rust/libs/proto/src/sidecar.v1.rs
rust/libs/proto/src/sidecar.v1.tonic.rs
rust/libs/proto/src/vald.v1.rs
rust/libs/proto/src/vald.v1.tonic.rs
rust/rust-toolchain
rust/rust-toolchain.toml
tests/chaos/chart/.helmignore
tests/chaos/chart/Chart.yaml
Expand Down Expand Up @@ -2000,6 +2001,7 @@ tests/e2e/sidecar/sidecar_test.go
tests/performance/max_vector_dim_test.go
versions/BUF_VERSION
versions/CHAOS_MESH_VERSION
versions/CMAKE_VERSION
versions/DOCKER_VERSION
versions/FAISS_VERSION
versions/GOLANGCILINT_VERSION
Expand Down
2 changes: 1 addition & 1 deletion .github/ISSUE_TEMPLATE/bug_report.md
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ assignees: ""

- Vald Version: v1.7.12
- Go Version: v1.22.5
- Rust Version: v1.77.2
- Rust Version: v1.80.0
- Docker Version: v27.1.1
- Kubernetes Version: v1.30.3
- Helm Version: v3.15.3
Expand Down
2 changes: 1 addition & 1 deletion .github/ISSUE_TEMPLATE/security_issue_report.md
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ assignees: ""

- Vald Version: v1.7.12
- Go Version: v1.22.5
- Rust Version: v1.77.2
- Rust Version: v1.80.0
- Docker Version: v27.1.1
- Kubernetes Version: v1.30.3
- Helm Version: v3.15.3
Expand Down
2 changes: 1 addition & 1 deletion .github/PULL_REQUEST_TEMPLATE.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@
<!--- Please change the versions below along with your environment -->
- Vald Version: v1.7.12
- Go Version: v1.22.5
- Rust Version: v1.77.2
- Rust Version: v1.80.0
- Docker Version: v27.1.1
- Kubernetes Version: v1.30.3
- Helm Version: v3.15.3
Expand Down
2 changes: 1 addition & 1 deletion .github/actions/setup-e2e/action.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ inputs:
require_libhdf5:
description: "If libhdf5 is not required, set this to false"
required: false
default: "true"
default: "false"
require_go:
description: "If go is not required, set this to false"
required: false
Expand Down
24 changes: 23 additions & 1 deletion .github/actions/setup-k3d/action.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -93,9 +93,31 @@ runs:
shell: bash
id: start_k3d
run: |
k3d cluster create ${{ inputs.name }} ${{ steps.k3d_options.outputs.options }}
k3d cluster create ${{ inputs.name }} ${{ steps.k3d_options.outputs.options }} \
--image docker.io/rancher/k3s:latest \
--k3s-arg "--disable=traefik@server:*" \
--api-port 0.0.0.0:6443 \
-v "/lib/modules:/lib/modules"
k3d cluster start ${{ inputs.name }}
k3d kubeconfig merge ${{ inputs.name }} --kubeconfig-switch-context
- name: Ready k8s cluster
shell: bash
run: |
k3d cluster list
server="k3d-${{ inputs.name }}-server-0"
docker logs ${server}
docker inspect ${server}
- name: Set k3d cluster config to KUBECONFIG
shell: bash
run: |
echo "KUBECONFIG=$(k3d kubeconfig write ${{ inputs.name }})" >> $GITHUB_ENV
- name: Check KUBECONFIG environment variable
shell: bash
run: |
echo $KUBECONFIG
cat $KUBECONFIG
cat /etc/hosts
- name: Show Kubernetes Cluster Info
shell: bash
run: |
kubectl cluster-info dump
18 changes: 14 additions & 4 deletions .github/workflows/e2e-chaos.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -35,11 +35,15 @@ jobs:
steps:
- uses: actions/checkout@v4
- uses: ./.github/actions/dump-context
detect-ci-container:
uses: ./.github/workflows/_detect-ci-container.yml
agent-failure:
name: "E2E chaos test (Agent failure: to test insert/search works even if one of the agents is failing)"
needs: [dump-contexts-to-log]
needs: [detect-ci-container]
runs-on: ubuntu-latest
timeout-minutes: 60
container:
image: ghcr.io/vdaas/vald/vald-ci-container:${{ needs.detect-ci-container.outputs.TAG }}
steps:
- uses: actions/checkout@v4
- name: Set Git config
Expand Down Expand Up @@ -75,9 +79,11 @@ jobs:
e2e/insert/search
random-pod-failure:
name: "E2E chaos test (random Pod failure: to test redundancy)"
needs: [dump-contexts-to-log]
needs: [detect-ci-container]
runs-on: ubuntu-latest
timeout-minutes: 60
container:
image: ghcr.io/vdaas/vald/vald-ci-container:${{ needs.detect-ci-container.outputs.TAG }}
steps:
- uses: actions/checkout@v4
- name: Set Git config
Expand Down Expand Up @@ -113,9 +119,11 @@ jobs:
e2e/insert/search
agent-network-partition:
name: "E2E chaos test (agent network partition: to test retries)"
needs: [dump-contexts-to-log]
needs: [detect-ci-container]
runs-on: ubuntu-latest
timeout-minutes: 60
container:
image: ghcr.io/vdaas/vald/vald-ci-container:${{ needs.detect-ci-container.outputs.TAG }}
steps:
- uses: actions/checkout@v4
- name: Set Git config
Expand Down Expand Up @@ -151,9 +159,11 @@ jobs:
e2e/insert/search
clusterwide-network-bandwidth:
name: "E2E chaos test (network bandwidth: to test it works properly under bandwidth limitation)"
needs: [dump-contexts-to-log]
needs: [detect-ci-container]
runs-on: ubuntu-latest
timeout-minutes: 60
container:
image: ghcr.io/vdaas/vald/vald-ci-container:${{ needs.detect-ci-container.outputs.TAG }}
steps:
- uses: actions/checkout@v4
- name: Set Git config
Expand Down
6 changes: 5 additions & 1 deletion .github/workflows/e2e-max-dim.yml
Original file line number Diff line number Diff line change
Expand Up @@ -32,11 +32,15 @@ jobs:
steps:
- uses: actions/checkout@v4
- uses: ./.github/actions/dump-context
detect-ci-container:
uses: ./.github/workflows/_detect-ci-container.yml
e2e-max-dimension-insert:
name: "E2E test (Max Dimension Insert: skip strict exist check)"
needs: [dump-contexts-to-log]
needs: [detect-ci-container]
runs-on: ubuntu-latest
timeout-minutes: 60
container:
image: ghcr.io/vdaas/vald/vald-ci-container:${{ needs.detect-ci-container.outputs.TAG }}
steps:
- uses: actions/checkout@v4
- name: Set Git config
Expand Down
6 changes: 5 additions & 1 deletion .github/workflows/e2e-profiling.yml
Original file line number Diff line number Diff line change
Expand Up @@ -33,11 +33,15 @@ jobs:
steps:
- uses: actions/checkout@v4
- uses: ./.github/actions/dump-context
detect-ci-container:
uses: ./.github/workflows/_detect-ci-container.yml
e2e-profiling:
name: "E2E profiling"
needs: [dump-contexts-to-log]
needs: [detect-ci-container]
runs-on: ubuntu-latest
timeout-minutes: 60
container:
image: ghcr.io/vdaas/vald/vald-ci-container:${{ needs.detect-ci-container.outputs.TAG }}
steps:
- uses: actions/checkout@v4
- name: Set Git config
Expand Down
Loading
Loading