Spark Streaming Kinesis Missing Records

logs I see many ProvisionedThroughputExceededException however this should be benign in that the KCL should retry those records. Unfortunately I am not seeing the missing records processed at a later date. Where to look next? . . . . . . . . . . . . . . . . . . . . . . . . . . . Richard M

Re: [Spark Core] Does spark support read from remote Hive server via JDBC

ort() .getOrCreate() . . . . . . . . . . . . . . . . . . . . . . . . . . . Richard Moorhead Software Engineer richard.moorh...@c2fo.com<mailto:richard.moorh...@gmail.com> C2FO: The World's Market for Working Capital® [http://c2fo.com/wp-content/uploads/sites/1/2016/03/LinkedIN.png] <https://www.linkedin.com/company/c2f

Re: Spark Streaming Job Stuck

Set your master to local[10]; you are only allocating one core currently. . . . . . . . . . . . . . . . . . . . . . . . . . . . Richard Moorhead Software Engineer richard.moorh...@c2fo.com<mailto:richard.moorh...@gmail.com> C2FO: The World's Market for Working Capital® [http://c2fo.

Re: Jupyter spark Scala notebooks

active and collaborative documents with SQL ... . . . . . . . . . . . . . . . . . . . . . . . . . . . Richard Moorhead Software Engineer richard.moorh...@c2fo.com<mailto:richard.moorh...@gmail.com> C2FO: The World's Market for Working Capital® [http://c2fo.com/wp-content/uploads/sit

Spark Streaming: NullPointerException when restoring Spark Streaming job from hdfs/s3 checkpoint

operations? logger.info(s"RDD LENGTH: ${events.count}") //nullpointer exception on call to .map val df = events.map(e => { ... } } } . . . . . . . . . . . . . . . . . . . . . . . . . . . Richard Moorhead Software Engineer richard.moorh...@c2fo.com<mailto:richard