As some of you know, I am writing a book on Spark (and it’s coming to an end soon), published by Manning, called Spark in Action, 2e. I am pretty sure you are not the target audience for this book as it is more tailored for the data engineer and architect who is starting their journey along Spark, but it contains a lot of non-Spark info and best practices as well.
If you are interested, I am happy to send you a copy - no strings attached, you don’t have to promote it, you don’t have to like it, you don’t have to give me any feedback. If you do any of that, it’s great, but really not necessary. If you learn something, that’s my pleasure. It’s a basic (maybe ridiculous) way to say thank you for this awesome tool you are building.