Master maven build failing for 6 days -- may need some more eyes

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Master maven build failing for 6 days -- may need some more eyes

Sean Owen-2
I might need some help figuring this out. The master Maven build has
been failing for almost a week, and I'm having trouble diagnosing why.
Of course, the PR builder has been fine.


First one seems to be:

https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-master-test-maven-hadoop-2.7/6393/

[SPARK-27831][SQL][TEST][test-hadoop3.2] Move Hive test jars to maven
(detail / githubweb)
[MINOR][DOCS][R] Use actual version in SparkR Arrow guide for (detail
/ githubweb)
[SPARK-26356][SQL] remove SaveMode from data source v2 (detail / githubweb)
[SPARK-27824][SQL] Make rule EliminateResolvedHint idempotent (detail
/ githubweb)
[SPARK-27677][CORE] Disable by default fetching of disk persisted RDD
(detail / githubweb)
...
===== FINISHED o.a.s.sql.hive.thriftserver.HiveThriftBinaryServerSuite:
'test add jar' =====

*** RUN ABORTED ***
  java.lang.NoClassDefFoundError:
org/apache/hadoop/hive/contrib/udaf/example/UDAFExampleMax
  at org.apache.spark.sql.hive.test.HiveTestUtils$.<init>(HiveTestUtils.scala:28)
  at org.apache.spark.sql.hive.test.HiveTestUtils$.<clinit>(HiveTestUtils.scala)
  at org.apache.spark.sql.hive.thriftserver.HiveThriftBinaryServerSuite.$anonfun$new$55(HiveThriftServer2Suites.scala:488)




but scanning later failed builds I'm seeing things like:

https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-master-test-maven-hadoop-2.7/6412

- conjuncts before nondeterministic
DataSourceV2ScanExecRedactionSuite:
- treeString is redacted *** FAILED ***
  "== Parsed Logical Plan ==
  RelationV2[a#863554L, foo#863555] orc
*********(redacted).7/sql/core/target/tmp/spark-9a065829-75ff-450e-90eb-ec8e344851da


This might be caused by https://github.com/apache/spark/pull/24719



I posted some comments on related PRs already but heads up that others
may want to look at these failures too.

---------------------------------------------------------------------
To unsubscribe e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

Re: Master maven build failing for 6 days -- may need some more eyes

Xiao Li-2
Thanks! Yuming and Gengliang are working on this. 

On Thu, May 30, 2019 at 8:21 AM Sean Owen <[hidden email]> wrote:
I might need some help figuring this out. The master Maven build has
been failing for almost a week, and I'm having trouble diagnosing why.
Of course, the PR builder has been fine.


First one seems to be:

https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-master-test-maven-hadoop-2.7/6393/

[SPARK-27831][SQL][TEST][test-hadoop3.2] Move Hive test jars to maven
(detail / githubweb)
[MINOR][DOCS][R] Use actual version in SparkR Arrow guide for (detail
/ githubweb)
[SPARK-26356][SQL] remove SaveMode from data source v2 (detail / githubweb)
[SPARK-27824][SQL] Make rule EliminateResolvedHint idempotent (detail
/ githubweb)
[SPARK-27677][CORE] Disable by default fetching of disk persisted RDD
(detail / githubweb)
...
===== FINISHED o.a.s.sql.hive.thriftserver.HiveThriftBinaryServerSuite:
'test add jar' =====

*** RUN ABORTED ***
  java.lang.NoClassDefFoundError:
org/apache/hadoop/hive/contrib/udaf/example/UDAFExampleMax
  at org.apache.spark.sql.hive.test.HiveTestUtils$.<init>(HiveTestUtils.scala:28)
  at org.apache.spark.sql.hive.test.HiveTestUtils$.<clinit>(HiveTestUtils.scala)
  at org.apache.spark.sql.hive.thriftserver.HiveThriftBinaryServerSuite.$anonfun$new$55(HiveThriftServer2Suites.scala:488)




but scanning later failed builds I'm seeing things like:

https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-master-test-maven-hadoop-2.7/6412

- conjuncts before nondeterministic
DataSourceV2ScanExecRedactionSuite:
- treeString is redacted *** FAILED ***
  "== Parsed Logical Plan ==
  RelationV2[a#863554L, foo#863555] orc
*********(redacted).7/sql/core/target/tmp/spark-9a065829-75ff-450e-90eb-ec8e344851da


This might be caused by https://github.com/apache/spark/pull/24719



I posted some comments on related PRs already but heads up that others
may want to look at these failures too.

---------------------------------------------------------------------
To unsubscribe e-mail: [hidden email]



--
Databricks Summit - Watch the talks