Re: DynamoDB Connector?

2015-11-16 Thread Nick Pentreath
See this thread for some info: http://apache-spark-user-list.1001560.n3.nabble.com/DynamoDB-input-source-td8814.html I don't think the situation has changed that much - if you're using Spark on EMR, then I think the InputFormat is available in a JAR (though I haven't tested that). Otherwise you'll

DynamoDB Connector?

2015-11-15 Thread Charles Cobb
Hi, What is the best practice for reading from DynamoDB from Spark? I know I can use the Java API, but this doesn't seem to take data locality into consideration at all. I was looking for something along the lines of the cassandra connector: https://github.com/datastax/spark-cassandra-connector