android_instrumentation_test test project failing in sandbox on Bazel CI

[jin]

This is the tracking bug for making the canonical googlesamples/android-testing project pass on Bazel CI postsubmit. Setup instructions available here: https://gist.github.com/jin/6babcbe600d8ee24c732494118f4bb27

This is not a release blocker for 0.12.0.

Latest run: https://buildkite.com/bazel/android-testing/builds/2

Issues:

• Requires Bazel 0.12.0 to pass. Tracking progress here: Release - March 2018 - Target RC date: 2018-03-01 - name: 0.12.0 #4582
• WORKSPACE declaration for android_sdk_repository is invalid. Fix here: Make android_sdk_repository path more CI friendly android/testing-samples#177.
• --spawn_strategy=local workaround required due to Xvfb lockfile bug. internal ref b/72871646 / blocked on on Update ATSL commit to include the fix for sandboxed tests android/testing-samples#184
• Non-deterministic Maven download failures. Fixed by removing Maven dependency in gmaven_rules.
• tests are timing out on API 19/21/22 https://buildkite.com/bazel/bazel-with-downstream-projects-bazel/builds/217#5c8577e8-7207-45af-96ec-cb7fc7170f92 / https://buildkite.com/bazel/bazel-with-downstream-projects-bazel/builds/217#d4a14dca-dd33-413b-a05a-04a648f1d9be

[jin]

cc @slinzner @ahumesky

[jin]

It's passing now: https://buildkite.com/bazel/android-testing/builds/5

[jin]

Looks like we're getting non-deterministic failures with the Maven downloads:

[INFO] ------------------------------------------------------------------------
--
  | [INFO] BUILD FAILURE
  | [INFO] ------------------------------------------------------------------------
  | [INFO] Total time: 5.795s
  | [INFO] Finished at: Fri Apr 13 06:30:02 UTC 2018
  | [INFO] Final Memory: 13M/1811M
  | [INFO] ------------------------------------------------------------------------
  | [ERROR] Failed to execute goal org.apache.maven.plugins:maven-dependency-plugin:2.10:get (default-cli) on project standalone-pom: Execution default-cli of goal org.apache.maven.plugins:maven-dependency-plugin:2.10:get failed: Plugin org.apache.maven.plugins:maven-dependency-plugin:2.10 or one of its dependencies could not be resolved: The following artifacts could not be resolved: backport-util-concurrent:backport-util-concurrent:jar:3.1, org.apache.maven.reporting:maven-reporting-impl:jar:2.2: Could not find artifact backport-util-concurrent:backport-util-concurrent:jar:3.1 -> [Help 1]
  | [ERROR]
  | [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
  | [ERROR] Re-run Maven using the -X switch to enable full debug logging.
  | [ERROR]
  | [ERROR] For more information about the errors and possible solutions, please read the following articles:
  | [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException
  |  
  | + mvn -s settings.xml org.apache.maven.plugins:maven-dependency-plugin:2.10:get -Dtransitive=false -Dartifact=com.android.support:support-compat:27.0.2:aar
  |  
  | Failed to fetch Maven dependency and referenced by '@com_android_support_support_vector_drawable_27_0_2//aar:aar'
  | ERROR: /var/lib/buildkite-agent/.cache/bazel/_bazel_buildkite-agent/1e68441e02182c8fbba725ba9b4d7033/external/com_android_support_support_media_compat_27_0_2/aar/BUILD:4:1: no such package '@com_android_support_support_compat_27_0_2//aar': Traceback (most recent call last):
  | File "/var/lib/buildkite-agent/.cache/bazel/_bazel_buildkite-agent/1e68441e02182c8fbba725ba9b4d7033/external/bazel_tools/tools/build_defs/repo/maven_rules.bzl", line 292
  | _maven_artifact_impl(ctx, "aar", _maven_aar_build_file_te...)
  | File "/var/lib/buildkite-agent/.cache/bazel/_bazel_buildkite-agent/1e68441e02182c8fbba725ba9b4d7033/external/bazel_tools/tools/build_defs/repo/maven_rules.bzl", line 258, in _maven_artifact_impl
  | _mvn_download(ctx = ctx, paths = paths, fully_qual...)
  | File "/var/lib/buildkite-agent/.cache/bazel/_bazel_buildkite-agent/1e68441e02182c8fbba725ba9b4d7033/external/bazel_tools/tools/build_defs/repo/maven_rules.bzl", line 211, in _mvn_download
  | fail(("%s\n%s\nFailed to fetch Maven ...)))

[INFO] ------------------------------------------------------------------------
  | [INFO] BUILD FAILURE
  | [INFO] ------------------------------------------------------------------------
  | [INFO] Total time: 5.109s
  | [INFO] Finished at: Fri Apr 13 06:33:48 UTC 2018
  | [INFO] Final Memory: 13M/1811M
  | [INFO] ------------------------------------------------------------------------
  | [ERROR] Failed to execute goal org.apache.maven.plugins:maven-dependency-plugin:2.10:get (default-cli) on project standalone-pom: Execution default-cli of goal org.apache.maven.plugins:maven-dependency-plugin:2.10:get failed: Plugin org.apache.maven.plugins:maven-dependency-plugin:2.10 or one of its dependencies could not be resolved: Failed to collect dependencies for org.apache.maven.plugins:maven-dependency-plugin:jar:2.10 (): Failed to read artifact descriptor for org.apache.maven.shared:maven-shared-io:jar:1.1: Could not find artifact org.apache.maven.shared:maven-shared-components:pom:8 -> [Help 1]
  | [ERROR]
  | [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
  | [ERROR] Re-run Maven using the -X switch to enable full debug logging.
  | [ERROR]
  | [ERROR] For more information about the errors and possible solutions, please read the following articles:
  | [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException
  |  
  | + mvn -s settings.xml org.apache.maven.plugins:maven-dependency-plugin:2.10:get -Dtransitive=false -Dartifact=com.android.support.test.espresso:espresso-idling-resource:3.0.1:aar

Failed to fetch Maven dependency and referenced by '//ui/espresso/IdlingResourceSample:IdlingResourceSampleTestLib'

https://buildkite.com/bazel/android-testing/builds/7#bc05d42f-5b5c-45c0-ada4-4ec88d3cb5d0

[jin]

We're getting timeout failures for tests on API 19, 21 and 22.

14.04: https://buildkite.com/bazel/bazel-with-downstream-projects-bazel/builds/217#5c8577e8-7207-45af-96ec-cb7fc7170f92
16.04 https://buildkite.com/bazel/bazel-with-downstream-projects-bazel/builds/217#d4a14dca-dd33-413b-a05a-04a648f1d9be

[jin]

Removed tests for 19, 21 and 22. It's now green again.