AWS_CREDENTIAL_FILE

2015-09-21 Thread Michel Lemay
Hi, It looks like spark does read AWS credentials from environment variable AWS_CREDENTIAL_FILE like awscli does. Mike

Breakpoints not hit with Scalatest + intelliJ

2015-09-18 Thread Michel Lemay
Hi, I'm adding unit tests to some utility functions that are using SparkContext but I'm unable to debug code and hit breakpoints when running under IntelliJ. My test creates a SparkContext from a SparkConf().setMaster("local[*]")... However, when I place a breakpoint in the functions inside a