[jira] [Commented] (SPARK-8008) sqlContext.jdbc can kill your database due to high concurrency

2015-06-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567221#comment-14567221 ] Sean Owen commented on SPARK-8008: -- Isnt this what connection pooling is for? Is that an

[jira] [Commented] (SPARK-8008) sqlContext.jdbc can kill your database due to high concurrency

2015-06-01 Thread Rene Treffer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567230#comment-14567230 ] Rene Treffer commented on SPARK-8008: - At the moment each partition uses it's own

[jira] [Commented] (SPARK-8008) sqlContext.jdbc can kill your database due to high concurrency

2015-06-01 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567219#comment-14567219 ] Michael Armbrust commented on SPARK-8008: - I'm okay adding documentation about

[jira] [Commented] (SPARK-8008) sqlContext.jdbc can kill your database due to high concurrency

2015-06-01 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567227#comment-14567227 ] Michael Armbrust commented on SPARK-8008: - I think connection pooling is used

[jira] [Commented] (SPARK-8008) sqlContext.jdbc can kill your database due to high concurrency

2015-06-01 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567234#comment-14567234 ] Michael Armbrust commented on SPARK-8008: - What is the problem with large

[jira] [Commented] (SPARK-8008) sqlContext.jdbc can kill your database due to high concurrency

2015-06-01 Thread Rene Treffer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567240#comment-14567240 ] Rene Treffer commented on SPARK-8008: - I've seen very poor performance when streaming

[jira] [Commented] (SPARK-8008) sqlContext.jdbc can kill your database due to high concurrency

2015-06-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567757#comment-14567757 ] Sean Owen commented on SPARK-8008: -- I suppose I meant you can block waiting on a new

[jira] [Commented] (SPARK-8008) sqlContext.jdbc can kill your database due to high concurrency

2015-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567993#comment-14567993 ] Reynold Xin commented on SPARK-8008: As discussed on the dev list, there's already

[jira] [Commented] (SPARK-8008) sqlContext.jdbc can kill your database due to high concurrency

2015-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567999#comment-14567999 ] Reynold Xin commented on SPARK-8008: Batching everything into giant partitions have