Ascot Moss
2018-11-27 08:02:15 UTC
Hi,
Does Hive 2.3.4 support Hadoop 2.8.x?
When compiling Hive 2.3.4 on Hadoop 2.8.5, I got the following errors:
Finding:
1) Hive 2.3.4 on Hadoop 2.7.7 no problem
2) Hive 2..3.4 on Hadoop 2.8.5, 7 errors
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[34,17]
package org.junit does not exist
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[48,4]
cannot find symbol
symbol: class Test
location: class org.apache.hadoop.hive.io.TestHdfsUtils
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[69,4]
cannot find symbol
symbol: class Test
location: class org.apache.hadoop.hive.io.TestHdfsUtils
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[94,4]
cannot find symbol
symbol: class Test
location: class org.apache.hadoop.hive.io.TestHdfsUtils
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[115,4]
cannot find symbol
symbol: class Test
location: class org.apache.hadoop.hive.io.TestHdfsUtils
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[140,4]
cannot find symbol
symbol: class Test
location: class org.apache.hadoop.hive.io.TestHdfsUtils
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[166,4]
cannot find symbol
symbol: class Test
location: class org.apache.hadoop.hive.io.TestHdfsUtils
[INFO] 7 errors
[INFO] -------------------------------------------------------------
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Hive ............................................... SUCCESS [ 1.328
s]
[INFO] Hive Shims Common .................................. FAILURE [ 2.653
s]
[INFO] Hive Shims 0.23 .................................... SKIPPED
[INFO] Hive Shims Scheduler ............................... SKIPPED
[INFO] Hive Shims ......................................... SKIPPED
[INFO] Hive Common ........................................ SKIPPED
[INFO] Hive Service RPC ................................... SKIPPED
[INFO] Hive Serde ......................................... SKIPPED
[INFO] Hive Metastore ..................................... SKIPPED
[INFO] Hive Vector-Code-Gen Utilities ..................... SKIPPED
[INFO] Hive Llap Common ................................... SKIPPED
[INFO] Hive Llap Client ................................... SKIPPED
[INFO] Hive Llap Tez ...................................... SKIPPED
[INFO] Spark Remote Client ................................ SKIPPED
[INFO] Hive Query Language ................................ SKIPPED
[INFO] Hive Llap Server ................................... SKIPPED
[INFO] Hive Service ....................................... SKIPPED
[INFO] Hive Accumulo Handler .............................. SKIPPED
[INFO] Hive JDBC .......................................... SKIPPED
[INFO] Hive Beeline ....................................... SKIPPED
[INFO] Hive CLI ........................................... SKIPPED
[INFO] Hive Contrib ....................................... SKIPPED
[INFO] Hive Druid Handler ................................. SKIPPED
[INFO] Hive HBase Handler ................................. SKIPPED
[INFO] Hive JDBC Handler .................................. SKIPPED
[INFO] Hive HCatalog ...................................... SKIPPED
[INFO] Hive HCatalog Core ................................. SKIPPED
[INFO] Hive HCatalog Pig Adapter .......................... SKIPPED
[INFO] Hive HCatalog Server Extensions .................... SKIPPED
[INFO] Hive HCatalog Webhcat Java Client .................. SKIPPED
[INFO] Hive HCatalog Webhcat .............................. SKIPPED
[INFO] Hive HCatalog Streaming ............................ SKIPPED
[INFO] Hive HPL/SQL ....................................... SKIPPED
[INFO] Hive Llap External Client .......................... SKIPPED
[INFO] Hive Shims Aggregator .............................. SKIPPED
[INFO] Hive TestUtils ..................................... SKIPPED
[INFO] Hive Packaging ..................................... SKIPPED
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 4.434 s
[INFO] Finished at: 2018-11-27T15:57:05+08:00
[INFO] Final Memory: 53M/774M
[INFO]
------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.1:testCompile
(default-testCompile) on project hive-shims-common: Compilation failure:
Compilation failure:
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[34,17]
package org.junit does not exist
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[48,4]
cannot find symbol
[ERROR] symbol: class Test
[ERROR] location: class org.apache.hadoop.hive.io.TestHdfsUtils
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[69,4]
cannot find symbol
[ERROR] symbol: class Test
[ERROR] location: class org.apache.hadoop.hive.io.TestHdfsUtils
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[94,4]
cannot find symbol
[ERROR] symbol: class Test
[ERROR] location: class org.apache.hadoop.hive.io.TestHdfsUtils
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[115,4]
cannot find symbol
[ERROR] symbol: class Test
[ERROR] location: class org.apache.hadoop.hive.io.TestHdfsUtils
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[140,4]
cannot find symbol
[ERROR] symbol: class Test
[ERROR] location: class org.apache.hadoop.hive.io.TestHdfsUtils
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[166,4]
cannot find symbol
[ERROR] symbol: class Test
[ERROR] location: class org.apache.hadoop.hive.io.TestHdfsUtils
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR] mvn <goals> -rf :hive-shims-common
Please help.
Does Hive 2.3.4 support Hadoop 2.8.x?
When compiling Hive 2.3.4 on Hadoop 2.8.5, I got the following errors:
Finding:
1) Hive 2.3.4 on Hadoop 2.7.7 no problem
2) Hive 2..3.4 on Hadoop 2.8.5, 7 errors
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[34,17]
package org.junit does not exist
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[48,4]
cannot find symbol
symbol: class Test
location: class org.apache.hadoop.hive.io.TestHdfsUtils
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[69,4]
cannot find symbol
symbol: class Test
location: class org.apache.hadoop.hive.io.TestHdfsUtils
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[94,4]
cannot find symbol
symbol: class Test
location: class org.apache.hadoop.hive.io.TestHdfsUtils
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[115,4]
cannot find symbol
symbol: class Test
location: class org.apache.hadoop.hive.io.TestHdfsUtils
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[140,4]
cannot find symbol
symbol: class Test
location: class org.apache.hadoop.hive.io.TestHdfsUtils
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[166,4]
cannot find symbol
symbol: class Test
location: class org.apache.hadoop.hive.io.TestHdfsUtils
[INFO] 7 errors
[INFO] -------------------------------------------------------------
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Hive ............................................... SUCCESS [ 1.328
s]
[INFO] Hive Shims Common .................................. FAILURE [ 2.653
s]
[INFO] Hive Shims 0.23 .................................... SKIPPED
[INFO] Hive Shims Scheduler ............................... SKIPPED
[INFO] Hive Shims ......................................... SKIPPED
[INFO] Hive Common ........................................ SKIPPED
[INFO] Hive Service RPC ................................... SKIPPED
[INFO] Hive Serde ......................................... SKIPPED
[INFO] Hive Metastore ..................................... SKIPPED
[INFO] Hive Vector-Code-Gen Utilities ..................... SKIPPED
[INFO] Hive Llap Common ................................... SKIPPED
[INFO] Hive Llap Client ................................... SKIPPED
[INFO] Hive Llap Tez ...................................... SKIPPED
[INFO] Spark Remote Client ................................ SKIPPED
[INFO] Hive Query Language ................................ SKIPPED
[INFO] Hive Llap Server ................................... SKIPPED
[INFO] Hive Service ....................................... SKIPPED
[INFO] Hive Accumulo Handler .............................. SKIPPED
[INFO] Hive JDBC .......................................... SKIPPED
[INFO] Hive Beeline ....................................... SKIPPED
[INFO] Hive CLI ........................................... SKIPPED
[INFO] Hive Contrib ....................................... SKIPPED
[INFO] Hive Druid Handler ................................. SKIPPED
[INFO] Hive HBase Handler ................................. SKIPPED
[INFO] Hive JDBC Handler .................................. SKIPPED
[INFO] Hive HCatalog ...................................... SKIPPED
[INFO] Hive HCatalog Core ................................. SKIPPED
[INFO] Hive HCatalog Pig Adapter .......................... SKIPPED
[INFO] Hive HCatalog Server Extensions .................... SKIPPED
[INFO] Hive HCatalog Webhcat Java Client .................. SKIPPED
[INFO] Hive HCatalog Webhcat .............................. SKIPPED
[INFO] Hive HCatalog Streaming ............................ SKIPPED
[INFO] Hive HPL/SQL ....................................... SKIPPED
[INFO] Hive Llap External Client .......................... SKIPPED
[INFO] Hive Shims Aggregator .............................. SKIPPED
[INFO] Hive TestUtils ..................................... SKIPPED
[INFO] Hive Packaging ..................................... SKIPPED
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 4.434 s
[INFO] Finished at: 2018-11-27T15:57:05+08:00
[INFO] Final Memory: 53M/774M
[INFO]
------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.1:testCompile
(default-testCompile) on project hive-shims-common: Compilation failure:
Compilation failure:
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[34,17]
package org.junit does not exist
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[48,4]
cannot find symbol
[ERROR] symbol: class Test
[ERROR] location: class org.apache.hadoop.hive.io.TestHdfsUtils
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[69,4]
cannot find symbol
[ERROR] symbol: class Test
[ERROR] location: class org.apache.hadoop.hive.io.TestHdfsUtils
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[94,4]
cannot find symbol
[ERROR] symbol: class Test
[ERROR] location: class org.apache.hadoop.hive.io.TestHdfsUtils
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[115,4]
cannot find symbol
[ERROR] symbol: class Test
[ERROR] location: class org.apache.hadoop.hive.io.TestHdfsUtils
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[140,4]
cannot find symbol
[ERROR] symbol: class Test
[ERROR] location: class org.apache.hadoop.hive.io.TestHdfsUtils
[ERROR]
/apache-hive-2.3.4-src/shims/common/src/main/test/org/apache/hadoop/hive/io/TestHdfsUtils.java:[166,4]
cannot find symbol
[ERROR] symbol: class Test
[ERROR] location: class org.apache.hadoop.hive.io.TestHdfsUtils
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR] mvn <goals> -rf :hive-shims-common
Please help.