[DStream][Kinesis] Requesting review for spark-kinesis retries

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
Report Content as Inappropriate

[DStream][Kinesis] Requesting review for spark-kinesis retries

Yash Sharma
Hi Fellow Devs,
Please share your thoughts on the pull request that allows spark to have more graceful retries with kinesis streaming.

The patch removes simple hard codings in the code and allows user to pass the values in config. This will help users to cope up with kinesis throttling errors and make spark recovery faster. I would love to work on the suggested changes.

Best Regards,