[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14156865#comment-14156865 ] Ted Malaska commented on SPARK-2447: Hey Norman, Yes the github project has been used

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605663#comment-14605663 ] Ted Malaska commented on SPARK-2447: Yeah, I have talked a lot with TD (Spark), Job H(

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606109#comment-14606109 ] Ted Malaska commented on SPARK-2447: There may be one. I will double check, if not I

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606166#comment-14606166 ] Ted Malaska commented on SPARK-2447: Hey Andrew, https://issues.apache.org/jira/brows

[jira] [Commented] (SPARK-1642) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-2083

[ https://issues.apache.org/jira/browse/SPARK-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14032101#comment-14032101 ] Ted Malaska commented on SPARK-1642: OK I'm back. I will start working on this Jira t

[jira] [Created] (SPARK-2173) Add Master Computer and SuperStep Accumulator to Pregel GraphX Implement

Ted Malaska created SPARK-2173: -- Summary: Add Master Computer and SuperStep Accumulator to Pregel GraphX Implement Key: SPARK-2173 URL: https://issues.apache.org/jira/browse/SPARK-2173 Project: Spark

[jira] [Updated] (SPARK-2173) Add Master Computer and SuperStep Accumulator to Pregel GraphX Implemention

[ https://issues.apache.org/jira/browse/SPARK-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska updated SPARK-2173: --- Summary: Add Master Computer and SuperStep Accumulator to Pregel GraphX Implemention (was: Add Maste

[jira] [Commented] (SPARK-2173) Add Master Computer and SuperStep Accumulator to Pregel GraphX Implemention

[ https://issues.apache.org/jira/browse/SPARK-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034748#comment-14034748 ] Ted Malaska commented on SPARK-2173: This is my first attempt. Let me know what you t

[jira] [Commented] (SPARK-2173) Add Master Computer and SuperStep Accumulator to Pregel GraphX Implemention

[ https://issues.apache.org/jira/browse/SPARK-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034751#comment-14034751 ] Ted Malaska commented on SPARK-2173: Never mind. I had to close the pull request. I

[jira] [Commented] (SPARK-2173) Add Master Computer and SuperStep Accumulator to Pregel GraphX Implemention

[ https://issues.apache.org/jira/browse/SPARK-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034798#comment-14034798 ] Ted Malaska commented on SPARK-2173: Nope a broadcast wont work either. Let me think

[jira] [Commented] (SPARK-2173) Add Master Computer and SuperStep Accumulator to Pregel GraphX Implemention

[ https://issues.apache.org/jira/browse/SPARK-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034816#comment-14034816 ] Ted Malaska commented on SPARK-2173: Sorry I'm slow I just realized I don't even need

[jira] [Closed] (SPARK-2173) Add Master Computer and SuperStep Accumulator to Pregel GraphX Implemention

[ https://issues.apache.org/jira/browse/SPARK-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska closed SPARK-2173. -- Resolution: Invalid Not an issue. GraphX doesn't need these features because it is not as limiting at

[jira] [Commented] (SPARK-1478) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-1915

[ https://issues.apache.org/jira/browse/SPARK-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14039937#comment-14039937 ] Ted Malaska commented on SPARK-1478: OK I have made the changes requested. But I had

[jira] [Commented] (SPARK-944) Give example of writing to HBase from Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14058184#comment-14058184 ] Ted Malaska commented on SPARK-944: --- Thank you for the assign. I will start working on t

[jira] [Created] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

Ted Malaska created SPARK-2447: -- Summary: Add common solution for sending upsert actions to HBase (put, deletes, and increment) Key: SPARK-2447 URL: https://issues.apache.org/jira/browse/SPARK-2447 Proje

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14058645#comment-14058645 ] Ted Malaska commented on SPARK-2447: tdas when you have time can you assign to me. Th

[jira] [Commented] (SPARK-1642) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-2083

[ https://issues.apache.org/jira/browse/SPARK-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14058648#comment-14058648 ] Ted Malaska commented on SPARK-1642: Hey Tdas. Yes now that SPARK-1478 is done I will

[jira] [Commented] (SPARK-1642) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-2083

[ https://issues.apache.org/jira/browse/SPARK-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059594#comment-14059594 ] Ted Malaska commented on SPARK-1642: OK I got it working and all the test passed. I'l

[jira] [Commented] (SPARK-1642) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-2083

[ https://issues.apache.org/jira/browse/SPARK-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059736#comment-14059736 ] Ted Malaska commented on SPARK-1642: OK I finished testing and cleaning up. Its ready

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063126#comment-14063126 ] Ted Malaska commented on SPARK-2447: OK here is the first beta batch of code. It is n

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066321#comment-14066321 ] Ted Malaska commented on SPARK-2447: Code review on Thur July 17. At least 14 action

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14068549#comment-14068549 ] Ted Malaska commented on SPARK-2447: Over the weekend I got the following done: 1. Con

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14070937#comment-14070937 ] Ted Malaska commented on SPARK-2447: Added JavaDoc and rename method changes This is

[jira] [Commented] (SPARK-1642) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-2083

[ https://issues.apache.org/jira/browse/SPARK-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14070938#comment-14070938 ] Ted Malaska commented on SPARK-1642: Are there any changes needed here? > Upgrade Flu

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075376#comment-14075376 ] Ted Malaska commented on SPARK-2447: Getting closer to the first pull request. 1. Add

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075536#comment-14075536 ] Ted Malaska commented on SPARK-2447: Added first of many pull request. Please feel fr

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14077179#comment-14077179 ] Ted Malaska commented on SPARK-2447: Making good progress. Just FYI it may take a lit

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078047#comment-14078047 ] Ted Malaska commented on SPARK-2447: So Spark has HBase 94.6 as the default HBase. Th

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078059#comment-14078059 ] Ted Malaska commented on SPARK-2447: Just talked to JMS from HBase and we don't want t

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14080035#comment-14080035 ] Ted Malaska commented on SPARK-2447: The build is fixed and the pull request is update

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14080055#comment-14080055 ] Ted Malaska commented on SPARK-2447: OK had a status meeting with TD. 1. 2447 will be

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14080166#comment-14080166 ] Ted Malaska commented on SPARK-2447: Hey Matei, Lets do a webex or something in the n

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14081514#comment-14081514 ] Ted Malaska commented on SPARK-2447: Tell me if I'm wrong but the core offering of 112

[jira] [Created] (SPARK-9237) Added Top N Column Values for DataFrames

Ted Malaska created SPARK-9237: -- Summary: Added Top N Column Values for DataFrames Key: SPARK-9237 URL: https://issues.apache.org/jira/browse/SPARK-9237 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-9237) Added Top N Column Values for DataFrames

[ https://issues.apache.org/jira/browse/SPARK-9237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14637871#comment-14637871 ] Ted Malaska commented on SPARK-9237: It is very common in banks, to do data quality ch

[jira] [Created] (SPARK-1478) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-1915

Ted Malaska created SPARK-1478: -- Summary: Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-1915 Key: SPARK-1478 URL: https://issues.apache.org/jira/browse/SPARK-1478 Project: Spark Is

[jira] [Commented] (SPARK-1478) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-1915

[ https://issues.apache.org/jira/browse/SPARK-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13967525#comment-13967525 ] Ted Malaska commented on SPARK-1478: After reviewing the code and I found that Spark S

[jira] [Commented] (SPARK-1478) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-1915

[ https://issues.apache.org/jira/browse/SPARK-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13968561#comment-13968561 ] Ted Malaska commented on SPARK-1478: I sent the initial patch. Here is the link. htt

[jira] [Commented] (SPARK-1478) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-1915

[ https://issues.apache.org/jira/browse/SPARK-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13968880#comment-13968880 ] Ted Malaska commented on SPARK-1478: Chated with tdas. He reviewed the code, but he h

[jira] [Commented] (SPARK-1584) Upgrade Flume dependency to 1.4.0

[ https://issues.apache.org/jira/browse/SPARK-1584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13978212#comment-13978212 ] Ted Malaska commented on SPARK-1584: Hey Sandy, I hope you don't mind. I made a pull

[jira] [Commented] (SPARK-1584) Upgrade Flume dependency to 1.4.0

[ https://issues.apache.org/jira/browse/SPARK-1584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13978223#comment-13978223 ] Ted Malaska commented on SPARK-1584: Never mind it does like the build issue I'm havin

[jira] [Commented] (SPARK-1478) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-1915

[ https://issues.apache.org/jira/browse/SPARK-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13980962#comment-13980962 ] Ted Malaska commented on SPARK-1478: Spark-1584 is done and so is PR #300. So final w

[jira] [Commented] (SPARK-1478) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-1915

[ https://issues.apache.org/jira/browse/SPARK-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13981539#comment-13981539 ] Ted Malaska commented on SPARK-1478: Having some issues "Executor has not been attach

[jira] [Commented] (SPARK-1478) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-1915

[ https://issues.apache.org/jira/browse/SPARK-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13981583#comment-13981583 ] Ted Malaska commented on SPARK-1478: I re cloned the code and ran a test. There is a

[jira] [Commented] (SPARK-1478) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-1915

[ https://issues.apache.org/jira/browse/SPARK-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13981601#comment-13981601 ] Ted Malaska commented on SPARK-1478: never mind it is working now. > Upgrade FlumeI

[jira] [Commented] (SPARK-1478) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-1915

[ https://issues.apache.org/jira/browse/SPARK-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13981855#comment-13981855 ] Ted Malaska commented on SPARK-1478: No worries that error was caused by me. Still le

[jira] [Commented] (SPARK-1478) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-1915

[ https://issues.apache.org/jira/browse/SPARK-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13981976#comment-13981976 ] Ted Malaska commented on SPARK-1478: OK I submitted the pull request: https://github.c

[jira] [Created] (SPARK-1642) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-2083

Ted Malaska created SPARK-1642: -- Summary: Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-2083 Key: SPARK-1642 URL: https://issues.apache.org/jira/browse/SPARK-1642 Project: Spark Is

[jira] [Commented] (SPARK-1642) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-2083

[ https://issues.apache.org/jira/browse/SPARK-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13981981#comment-13981981 ] Ted Malaska commented on SPARK-1642: This is an easy change once a1478 is committed >

[jira] [Commented] (SPARK-1642) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-2083

[ https://issues.apache.org/jira/browse/SPARK-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983811#comment-13983811 ] Ted Malaska commented on SPARK-1642: Will do. :) > Upgrade FlumeInputDStream's Flume

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200554#comment-14200554 ] Ted Malaska commented on SPARK-2447: Hey Norman, Totally agree. TD and I talked abou

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200602#comment-14200602 ] Ted Malaska commented on SPARK-2447: Cool thanks. Connect me at ted.mala...@cloudera.

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200646#comment-14200646 ] Ted Malaska commented on SPARK-2447: I totally understand. I also don't know the answ

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14253586#comment-14253586 ] Ted Malaska commented on SPARK-2447: Hey guy, Just wanted to update this jira. In su

[jira] [Commented] (SPARK-4911) Report the inputs and outputs of Spark jobs so that external systems can track data lineage

[ https://issues.apache.org/jira/browse/SPARK-4911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353598#comment-14353598 ] Ted Malaska commented on SPARK-4911: Thanks [~sandyr]. Yes this would be very helpful