Sprak Cache mechanism.

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view

Sprak Cache mechanism.

This post has NOT been accepted by the mailing list yet.
Hi all,

I am new to spark, we are willing to do a poc on spark, I red that spark working on in-memory computation, but i am could not clear idea, let say we have 5GB of data, my ram is 4GB, if i am execute the persist on the data frame how spark will behave in this scenario.

When to go for spark and When to go for Drill.