BUILD FAILURE at Spark Project Test Tags for 2.11.7?

classic Classic list List threaded Threaded
7 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

BUILD FAILURE at Spark Project Test Tags for 2.11.7?

Jacek Laskowski
Hi,

Build is broken again for me :( I build for Scala 2.11.7 and use
maven. Is this a known issue? Anyone looking into it?

➜  spark git:(master) ✗ ./build/mvn -Pyarn -Phadoop-2.6
-Dhadoop.version=2.7.1 -Dscala-2.11 -Phive -Phive-thriftserver
-DskipTests clean install
...
[INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @
spark-test-tags_2.11 ---
[INFO] Using zinc server for incremental compilation
[warn] Pruning sources from previous analysis, due to incompatible CompileSetup.
[info] Compiling 3 Java sources to
/Users/jacek/dev/oss/spark/tags/target/scala-2.11/classes...
[error] Cannot run program "javac": error=2, No such file or directory
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Spark Project Parent POM ........................... SUCCESS [  2.843 s]
[INFO] Spark Project Test Tags ............................ FAILURE [  0.321 s]


Pozdrawiam,
Jacek

Jacek Laskowski | https://medium.com/@jaceklaskowski/
Mastering Apache Spark
==> https://jaceklaskowski.gitbooks.io/mastering-apache-spark/
Follow me at https://twitter.com/jaceklaskowski

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: BUILD FAILURE at Spark Project Test Tags for 2.11.7?

Marcelo Vanzin
On Wed, Jan 20, 2016 at 11:46 AM, Jacek Laskowski <[hidden email]> wrote:
> /Users/jacek/dev/oss/spark/tags/target/scala-2.11/classes...
> [error] Cannot run program "javac": error=2, No such file or directory

That doesn't exactly look like a Spark problem.

--
Marcelo

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: BUILD FAILURE at Spark Project Test Tags for 2.11.7?

Jacek Laskowski
On Wed, Jan 20, 2016 at 8:48 PM, Marcelo Vanzin <[hidden email]> wrote:
> On Wed, Jan 20, 2016 at 11:46 AM, Jacek Laskowski <[hidden email]> wrote:
>> /Users/jacek/dev/oss/spark/tags/target/scala-2.11/classes...
>> [error] Cannot run program "javac": error=2, No such file or directory
>
> That doesn't exactly look like a Spark problem.

You're right and moreover I just today upgraded Java 8 to the latest
release. Kafka compiles fine (they use gradle, though). Other apps
build fine too. Just a friendly heads-up.

Jacek

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: BUILD FAILURE at Spark Project Test Tags for 2.11.7?

Jacek Laskowski
In reply to this post by Marcelo Vanzin
On Wed, Jan 20, 2016 at 8:48 PM, Marcelo Vanzin <[hidden email]> wrote:
> On Wed, Jan 20, 2016 at 11:46 AM, Jacek Laskowski <[hidden email]> wrote:
>> /Users/jacek/dev/oss/spark/tags/target/scala-2.11/classes...
>> [error] Cannot run program "javac": error=2, No such file or directory
>
> That doesn't exactly look like a Spark problem.

It *was* a Spark problem. The issue was that zinc was up while I
upgraded JDK and eventually it couldn't find proper binaries. When I
killed com.typesafe.zinc.Nailgun the build went fine.

I remember I saw the issue reported in the past and when I was
completely hopeless to figure it out without rebooting the machine the
idea of zinc being "misconfigured" came! `jps -lm` to the rescue!

Sorry for the noise.

Jacek

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: BUILD FAILURE at Spark Project Test Tags for 2.11.7?

Sean Owen
That's not a Spark problem. Your compiler was not available.

On Wed, Jan 20, 2016 at 10:44 PM, Jacek Laskowski <[hidden email]> wrote:

> On Wed, Jan 20, 2016 at 8:48 PM, Marcelo Vanzin <[hidden email]> wrote:
>> On Wed, Jan 20, 2016 at 11:46 AM, Jacek Laskowski <[hidden email]> wrote:
>>> /Users/jacek/dev/oss/spark/tags/target/scala-2.11/classes...
>>> [error] Cannot run program "javac": error=2, No such file or directory
>>
>> That doesn't exactly look like a Spark problem.
>
> It *was* a Spark problem. The issue was that zinc was up while I
> upgraded JDK and eventually it couldn't find proper binaries. When I
> killed com.typesafe.zinc.Nailgun the build went fine.
>
> I remember I saw the issue reported in the past and when I was
> completely hopeless to figure it out without rebooting the machine the
> idea of zinc being "misconfigured" came! `jps -lm` to the rescue!
>
> Sorry for the noise.
>
> Jacek
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [hidden email]
> For additional commands, e-mail: [hidden email]
>

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: BUILD FAILURE at Spark Project Test Tags for 2.11.7?

Jacek Laskowski
On Wed, Jan 20, 2016 at 10:47 PM, Sean Owen <[hidden email]> wrote:
> That's not a Spark problem. Your compiler was not available.

It's Spark to use zinc. It starts it for a built, but alas doesn't
stop it afterwards. If you happen to upgrade your JDK without
restarting zinc, you *will* run into the issue. If you say it's not a
Spark problem, whom could that be? I personally don't use zinc. I
can't seem to find anyone more guilty than Spark. Sorry.

Jacek

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: BUILD FAILURE at Spark Project Test Tags for 2.11.7?

hazem
this can also happen if your PATH is not set properly (but JAVA_HOME is), just in case anyone hits this in the future. This simply fixes it:

$ export PATH=$PATH:$JAVA_HOME/bin

and rerun build
Loading...