Remote Output Service: place bazel-out/ on a FUSE file system

Builds that yield large output files can generate lots of network
bandwidth when remote execution is used. To combat this, we have flags
such as --remote_download_minimal to disable downloading of output
files. Unfortunately, this makes it hard to perform ad hoc exploration
of build outputs.

In an attempt to solve this, this change adds an option to Bazel named
--remote_output_service. When enabled, Bazel effectively gives up the
responsibility of managing a bazel-out/ directory. Instead, it calls
into a gRPC service to request a directory and creates a symlink that
points to it.

Smart implementations of this gRPC service may use things like FUSE to
let this replacement bazel-out/ directory be lazy-loading, thereby
reducing network bandwidth significantly. In order to create
lazy-loading files and directories, Bazel can call into a BatchCreate()
RPC that takes a list of Output{File,Directory,Symlink} messages,
similar to REv2's ActionResult. This call is also used to create
runfiles directories by providing fictive instances of OutputSymlink.

To prevent Bazel from reading the contents of files stored in the FUSE
file system (which would cause network I/O), the protocol offers a
BatchStat() call that can return information such as the REv2 digest.
Though this is redundant with --unix_digest_hash_attribute_name, there
are a couple of reasons why I added this feature:

1. For non-Linux operating systems, it may make more sense to use NFSv4
   instead of FUSE (i.e., running a virtual NFS daemon on localhost).
   Even though RFC 8276 adds support for extended attributes to NFSv4,
   not all operating systems implement it.

2. It addresses the security/hermeticity concerns that people raised
   when this feature was added. There is no way to add extended
   attributes to files that can't be tampered with (as a non-root user),
   while using gRPC solves that problem inherently.

3. Callers of Bazel's BatchStat.batchStat() may generate many system
   calls successively. This causes a large number of context switches
   between Bazel and the FUSE daemon. Using gRPC seems to be cheaper.

By requiring that the output path returned by the gRPC service is
writable, no-remote actions can still run as before, both with
sandboxing enabled and disabled. The only difference is that it will use
space on the gRPC service side, as opposed to the user's home directory
(though the gRPC service may continue to store data in the user's home
directory.

I have a server implementation is written in Go on top of Buildbarn's
storage and file system layer. My plan is to release the code for this
service as soon as I've got a 'thumbs up' on the overall approach.

Change-Id: I320586d7d153627fa2425a54e3cc505befe886c0

src/main/java/com/google/devtools/build/lib/buildtool/ExecutionTool.java

@@ -294,6 +294,7 @@ public void prepareForExecution(UUID buildId)
       try (SilentCloseable c = Profiler.instance().profile("outputService.startBuild")) {
         modifiedOutputFiles =
             outputService.startBuild(
+                getExecRoot(), env.getDirectories().getRelativeOutputPath(),
                 env.getReporter(), buildId, request.getBuildOptions().finalizeActions);
       }
     } else {
@@ -382,6 +383,7 @@ void executeBuild(
       try (SilentCloseable c = Profiler.instance().profile("outputService.startBuild")) {
         modifiedOutputFiles =
             outputService.startBuild(
+                getExecRoot(), env.getDirectories().getRelativeOutputPath(),
                 env.getReporter(), buildId, request.getBuildOptions().finalizeActions);
       }
     } else {

src/main/java/com/google/devtools/build/lib/remote/ActionResultDownloader.java

@@ -0,0 +1,8 @@
+package com.google.devtools.build.lib.remote;
+
+import build.bazel.remote.execution.v2.ActionResult;
+import com.google.common.util.concurrent.ListenableFuture;
+
+public interface ActionResultDownloader {
+  public ListenableFuture<Void> downloadActionResult(ActionResult actionResult);
+}

src/main/java/com/google/devtools/build/lib/remote/BUILD

@@ -111,6 +111,8 @@ java_library(
         "//src/main/java/com/google/devtools/build/skyframe",
         "//src/main/java/com/google/devtools/common/options",
         "//src/main/protobuf:failure_details_java_proto",
+        "//src/main/protobuf:remote_output_service_java_grpc",
+        "//src/main/protobuf:remote_output_service_java_proto",
         "//third_party:auth",
         "//third_party:caffeine",
         "//third_party:flogger",