Re: [Spark Core] - Spark dynamoDB integration

2016-12-12 Thread Neil Jonkers
Hello, Good examples on how to interface with DynamoDB from Spark here: https://aws.amazon.com/blogs/big-data/using-spark-sql-for-etl/ https://aws.amazon.com/blogs/big-data/analyze-your-data-on-amazon-dynamodb-with-apache-spark/ Thanks On Mon, Dec 12, 2016 at 7:56 PM, Marco Mistroni

Re: [Spark Core] - Spark dynamoDB integration

2016-12-12 Thread Marco Mistroni
Hi If it can help 1.Check Java docs of when that method was introduced 2. U building a fat jar? Check which libraries have been includedsome other dependencies might have forced an old copy to be included 3. If u. Take code outside spark.does it work successfully? 4. Send short

[Spark Core] - Spark dynamoDB integration

2016-12-12 Thread Pratyaksh Sharma
Hey I am using Apache Spark for one streaming application. I am trying to store the processed data into dynamodb using java sdk. Getting the following exception - 16/12/08 23:23:43 WARN TaskSetManager: Lost task 0.0 in stage 1.0: java.lang.NoSuchMethodError: com.amazonaws.SDKGlobalConfigu