GitHub user animeshbaranawal opened a pull request:
https://github.com/apache/spark/pull/6347
[SPARK-7221] [Streaming] Expose the current processed file name of
FileInputDStream to the users
@akhilthatipamula
Introduced a parameter called display_filename in StreamingContext which if
true displays the filenames being processed otherwise the file names will not
be displayed.
I affirm that the contribution is my original work and I license the work
to the project under the project's open source license.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/animeshbaranawal/spark SPARK-7221
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/6347.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #6347
----
commit f92b29de06f5f9dbca7435e42e1c0e33b5747807
Author: animesh <[email protected]>
Date: 2015-05-22T04:59:21Z
SPARK-7221: Modified StreamingContext.scala, FileInputDStream.scala
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
