Re: Why my Spark job is slow and it throws OOM which leads YARN killing executors?

2015-09-12 Thread Umesh Kacha
request = request.replaceAll(key, > dMap.get(key)); > } > } else if (request.contains("ABC IJK")) { > if (dMap.containsKey(key)) { > request = request.re

Re: Why my Spark job is slow and it throws OOM which leads YARN killing executors?

2015-09-12 Thread Richard W. Eggert II
ove(key); } } } rowAsList.set(2, request); } return rowAsList; } public static class DataWorker implements Callable { private String entity; private int date;

Why my Spark job is slow and it throws OOM which leads YARN killing executors?

2015-09-12 Thread unk1102
private HiveContext hiveContext; public DataWorker(HiveContext hiveContext,String entity,int date) { this.hiveContext = hiveContext; this.entity = entity; this.date = date; } @Override public Void call()