I think you need to start your streaming job, then put the files there to
get them read. textFileStream doesn't read the existing files i believe.
Also are you sure the path is not the following? (no missing / in the
beginning?)
JavaDStream textStream = ssc.textFileStream("/user/
huser/user/huser
Talked with Yi offline, personally I think this feature is pretty
useful, and the design makes sense, and he's already got a running
prototype.
Yi, would you mind to open a PR for this? Thanks!
Cheng
On 1/6/15 5:25 PM, Yi Tian wrote:
Hi, all
I have create a JIRA ticket about adding a monito
Hi Hari,
Iam trying to read data from a file which is stored in HDFS. Using Flume the
data is tailed and stored in HDFS.
Now I want to read this data using TextFileStream. Using the below mentioned
code Iam not able to fetch the
Data from a file which is stored in HDFS. Can anyone help me with
the regular url is working now, thanks for your patience.
On Mon, Jan 5, 2015 at 2:25 PM, Josh Rosen wrote:
> The pull request builder and SCM-polling builds appear to be working fine,
> but the links in pull request comments won't work because the AMP Lab
> webserver is still down. In the mean
Thanks a LOT for your answer ! I've updated the diagram, at the same
address :
https://www.dropbox.com/s/q79taoce2ywdmf1/SparkStreaming.pdf?dl=0
I've addressed your more straightforward remarks directly in the diagram. A
couple questions:
- the location of instances (Executor, Master, Driver) is
Hi, all
I have create a JIRA ticket about adding a monitor page for Thrift server.
https://issues.apache.org/jira/browse/SPARK-5100
Anyone could review the design doc, and give some advises?
-
To unsubscribe, e-mail: dev-unsub
Hi,
I have been running a simple Spark app on a local spark cluster and I came
across this error.
Exception in thread "main" java.lang.NoSuchMethodError:
com.google.common.hash.HashFunction.hashInt(I)Lcom/google/common/hash/HashCode;
at org.apache.spark.util.collection.OpenHashSet.org
$apache