Unable to find Arrow headers during build

[zhztheplayer]

@weiting-chen

I am trying to use the new build options.

Below is what I encountered once executing build command mvn clean package -am -DskipTests -Dbuild_arrow=OFF -Dbuild_protobuf=OFF -Darrow_root=/root/Documents/SourceCode/arrow/cpp/cmake-build-release-withgandiva/bundle/

CMAKE Arguments:
TESTS=OFF
BUILD_ARROW=OFF
STATIC_ARROW=OFF
BUILD_PROTOBUF=OFF
ARROW_ROOT=/root/Documents/SourceCode/arrow/cpp/cmake-build-release-withgandiva/bundle/
[proxychains] DLL init: proxychains-ng 4.13
/root/Documents/SourceCode/native-sql-engine/native-sql-engine/cpp
[proxychains] DLL init: proxychains-ng 4.13
[proxychains] DLL init: proxychains-ng 4.13
[proxychains] DLL init: proxychains-ng 4.13
-- The C compiler identification is GNU 10.1.1
-- The CXX compiler identification is GNU 10.1.1
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc - works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ - works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Found PkgConfig: /usr/bin/pkg-config (found version "1.6.3") 
-- Found Boost: /usr/include (found version "1.69.0")  
-- Found JNI: /usr/lib/jvm/java-1.8.0-openjdk/jre/lib/amd64/libjawt.so  
-- thirdparty is third_party/gandiva/decimal_ops.cc;third_party/gandiva/time.cc
[proxychains] DLL init: proxychains-ng 4.13
-- Found Protobuf: /usr/lib64/libprotobuf.so;-lpthread (found version "3.11.2") 
-- Use existing ProtoBuf libraries: /usr/lib64/libprotobuf.so

-- Building ARROW from Source: OFF
-- Set Arrow Header Directory in /root/Documents/SourceCode/arrow/cpp/cmake-build-release-withgandiva/bundle/include
-- Set Arrow Library Directory in /root/Documents/SourceCode/arrow/cpp/cmake-build-release-withgandiva/bundle/lib or /root/Documents/SourceCode/arrow/cpp/cmake-build-release-withgandiva/bundle/lib64
-- Set Arrow Include Directory in /root/Documents/SourceCode/arrow/cpp/cmake-build-release-withgandiva/bundle/include
-- Arrow Library Can Be Found in /root/Documents/SourceCode/arrow/cpp/cmake-build-release-withgandiva/bundle/lib64/libarrow.so.300
-- Gandiva Library Can Be Found in /root/Documents/SourceCode/arrow/cpp/cmake-build-release-withgandiva/bundle/lib64/libgandiva.so.300
-- Use existing ARROW libraries
-- Configuring done
-- Generating done
-- Build files have been written to: /root/Documents/SourceCode/native-sql-engine/native-sql-engine/cpp/build
[proxychains] DLL init: proxychains-ng 4.13
[proxychains] DLL init: proxychains-ng 4.13
[proxychains] DLL init: proxychains-ng 4.13
[proxychains] DLL init: proxychains-ng 4.13
[proxychains] DLL init: proxychains-ng 4.13
[proxychains] DLL init: proxychains-ng 4.13
[proxychains] DLL init: proxychains-ng 4.13
Scanning dependencies of target jni_proto
[proxychains] DLL init: proxychains-ng 4.13
[proxychains] DLL init: proxychains-ng 4.13
[proxychains] DLL init: proxychains-ng 4.13
[  2%] Running PROTO compiler on Exprs.proto
[proxychains] DLL init: proxychains-ng 4.13
[proxychains] DLL init: proxychains-ng 4.13
[proxychains] DLL init: proxychains-ng 4.13
[proxychains] DLL init: proxychains-ng 4.13
[  2%] Built target jni_proto
[proxychains] DLL init: proxychains-ng 4.13
[proxychains] DLL init: proxychains-ng 4.13
[proxychains] DLL init: proxychains-ng 4.13
Scanning dependencies of target spark_columnar_jni
[proxychains] DLL init: proxychains-ng 4.13
[proxychains] DLL init: proxychains-ng 4.13
[proxychains] DLL init: proxychains-ng 4.13
[  5%] Building CXX object src/CMakeFiles/spark_columnar_jni.dir/jni/jni_wrapper.cc.o
[proxychains] DLL init: proxychains-ng 4.13
[proxychains] DLL init: proxychains-ng 4.13
[proxychains] DLL init: proxychains-ng 4.13
/root/Documents/SourceCode/native-sql-engine/native-sql-engine/cpp/src/jni/jni_wrapper.cc:18:10: fatal error: arrow/buffer.h: No such file or directory
   18 | #include <arrow/buffer.h>
      |          ^~~~~~~~~~~~~~~~
compilation terminated.
make[2]: *** [src/CMakeFiles/spark_columnar_jni.dir/build.make:90: src/CMakeFiles/spark_columnar_jni.dir/jni/jni_wrapper.cc.o] Error 1
make[1]: *** [CMakeFiles/Makefile2:163: src/CMakeFiles/spark_columnar_jni.dir/all] Error 2
make: *** [Makefile:150: all] Error 2
[ERROR] Command execution failed.
org.apache.commons.exec.ExecuteException: Process exited with an error: 2 (Exit value: 2)
    at org.apache.commons.exec.DefaultExecutor.executeInternal (DefaultExecutor.java:404)
    at org.apache.commons.exec.DefaultExecutor.execute (DefaultExecutor.java:166)
    at org.codehaus.mojo.exec.ExecMojo.executeCommandLine (ExecMojo.java:804)
    at org.codehaus.mojo.exec.ExecMojo.executeCommandLine (ExecMojo.java:751)
    at org.codehaus.mojo.exec.ExecMojo.execute (ExecMojo.java:313)
    at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:137)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:210)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:156)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:148)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81)
    at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:56)
    at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192)
    at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105)
    at org.apache.maven.cli.MavenCli.execute (MavenCli.java:956)
    at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:288)
    at org.apache.maven.cli.MavenCli.main (MavenCli.java:192)
    at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:498)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:406)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:347)
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Native SQL Engine Parent Pom 1.1.0:
[INFO] 
[INFO] OAP Project Spark Arrow Datasource ................. SUCCESS [  2.340 s]
[INFO] spark-arrow-datasource-common ...................... SUCCESS [  3.583 s]
[INFO] spark-arrow-datasource-standard .................... SUCCESS [ 11.124 s]
[INFO] spark-arrow-datasource-parquet ..................... SUCCESS [  6.113 s]

[zhztheplayer]

@weiting-chen Would you please help to check whether we can directly put variable ARROW_INCLUDE_DIR to the overall include paths? See #180

[weiting-chen]

Done to fix this issue.
Add ARROW_INCLUDE_DIR in target_include_directory for custom arrow path case

[zhouyuan]

closed in #181