RE: Java/Spark

2021-02-01 Thread Aaron.K.Mathews
8:13 AM To: Mathews, Aaron K. [SYSTEMS OPERATIONS ENGINEER] Cc: User Subject: Re: Java/Spark The Spark distro does not include Java. That has to be present in the environment where the Spark cluster is run. It works with Java 8, and 11 in 3.x (Oracle and OpenJDK AFAIK). It seems to 99% work o

Re: Java/Spark

2021-02-01 Thread Sean Owen
Owen > *Sent:* Monday, February 1, 2021 8:13 AM > *To:* Mathews, Aaron K. [SYSTEMS OPERATIONS ENGINEER] < > aaron.k.math...@wellsfargo.com> > *Cc:* User > *Subject:* Re: Java/Spark > > > > The Spark distro does not include Java. That has to be present in the &g

Re: Java/Spark

2021-02-01 Thread Sean Owen
The Spark distro does not include Java. That has to be present in the environment where the Spark cluster is run. It works with Java 8, and 11 in 3.x (Oracle and OpenJDK AFAIK). It seems to 99% work on 14+ even. On Mon, Feb 1, 2021 at 9:11 AM wrote: > Hello, > > > > I am looking for information

RE: Java Spark Streaming - SparkFlumeEvent

2014-04-28 Thread Kulkarni, Vikram
out.println("Processed this batch in: " + (System.currentTimeMillis() - t1)/1000 + " seconds"); return null; } }); Regards, Vikram From: Tathagata Das [mailto:tathagata.das1...@gmail.com] Sent: Tuesday, April 29, 2014 2:41 AM

Re: Java Spark Streaming - SparkFlumeEvent

2014-04-28 Thread Tathagata Das
You can get the internal AvroFlumeEvent inside the SparkFlumeEvent using SparkFlumeEvent.event. That should probably give you all the original text data. On Mon, Apr 28, 2014 at 5:46 AM, Kulkarni, Vikram wrote: > Hi Spark-users, > > Within my Spark Streaming program, I am able to ingest data