Optimize Gradle builds by enabling local build caching

[reta]

Signed-off-by: Andriy Redko andriy.redko@aiven.io

Description

The Gradle build cache is a cache mechanism that aims to save time by reusing outputs produced by other builds. The build cache works by storing (locally or remotely) build outputs and allowing builds to fetch these outputs from the cache when it is determined that inputs have not changed, avoiding the expensive work of regenerating them [1].

Even when used by a single developer only, the build cache can be very useful. Gradle’s incremental build feature helps to avoid work that is already done, but once you re-execute a task, any previous results are forgotten. When you are switching branches back and forth, the local results get rebuilt over and over again, even if you are building something that has already been built before. The build cache remembers the earlier build results, and greatly reduces the need to rebuild things when they have already been built locally. [2]

[1] https://docs.gradle.org/current/userguide/build_cache.html
[2] https://docs.gradle.org/current/userguide/build_cache_use_cases.html#use_cases_cache

Issues Resolved

N/A

Check List

• New functionality includes testing.
  • All tests pass
• New functionality has been documented.
  • New functionality has javadoc added
• Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[opensearch-ci-bot]

❌   Gradle Check failure 4a9c83ba6a28010cac386f324e60d1405f97424e
Log 6379

Reports 6379

[opensearch-ci-bot]

✅   Gradle Check success 05d48456e0b514a35c312155eb8d5bd4839b3fd6
Log 6382

Reports 6382

[peterzhuamazon]

@reta could you rebase on main to consume the new gradle check?
Thanks.

[reta]

@reta could you rebase on main to consume the new gradle check?

@peterzhuamazon cryptic failure:

Run echo "https://github.com/opensearch-project/OpenSearch.git PR: 3718"
https://github.com/opensearch-project/OpenSearch.git PR: 3718
Raise from https://github.com/reta/OpenSearch.git 115f91b543c36ac332915b03f7699b8264d31836
PR Title: Optimize Gradle builds by enabling local build caching
Trigger Jenkins workflows
QUEUE_URL null
wait for jenkins to start workflow
Check if queue exist in Jenkins after triggering
Please check jenkins url for logs: 
Result: null

[peterzhuamazon]

@reta could you rebase on main to consume the new gradle check?

@peterzhuamazon cryptic failure:

Run echo "https://github.com/opensearch-project/OpenSearch.git PR: 3718"
https://github.com/opensearch-project/OpenSearch.git PR: 3718
Raise from https://github.com/reta/OpenSearch.git 115f91b543c36ac332915b03f7699b8264d31836
PR Title: Optimize Gradle builds by enabling local build caching
Trigger Jenkins workflows
QUEUE_URL null
wait for jenkins to start workflow
Check if queue exist in Jenkins after triggering
Please check jenkins url for logs: 
Result: null

Hi @reta I have fixed the issue in #3728 please rebase again.
Sorry for confusion.
Thanks.

[reta]

Hi @reta I have fixed the issue in #3728 please rebase again.
Sorry for confusion.

Thanks a lot, @peterzhuamazon , no problem at all

[peterzhuamazon]

@reta think failure related to this one?
#3579

[reta]

#3579

@reta think failure related to this one? #3579

Yes, sadly flaky tests :(

[peterzhuamazon]

Interesting that I just triggered a run on main and it passed.
https://build.ci.opensearch.org/job/gradle-check/31/

[reta]

Interesting that I just triggered a run on main and it passed. https://build.ci.opensearch.org/job/gradle-check/31/

Flakiness at work ... :(

[peterzhuamazon]

Lets give it a minute as I have a new PR incoming to clear up all the opensearch existing processes before using it for another run. Will rebase this PR once that is in.

Thanks.

[reta]

Lets give it a minute as I have a new PR incoming to clear up all the opensearch existing processes before using it for another run. Will rebase this PR once that is in.

Thanks.

We public CI we have awesome visibility on the health of the builds:

Thanks for that, @peterzhuamazon !

[peterzhuamazon]

😱 https://github.com/opensearch-project/OpenSearch/runs/7102002447?check_suite_focus=true ✅

[reta]

@dblock @andrross are you good with the change folks?

[andrross]

Looks good to me!

Random question...does ./gradlew clean also clear this cache?

[reta]

Looks good to me!

Thank you!

Random question...does ./gradlew clean also clear this cache?

Aha, good one - nope! That means next build ( fe ./gradlew clean followed by ./gradlew assemble) will be very fast if nothing changed :)