[
https://issues.apache.org/jira/browse/BAHIR-39?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401991#comment-15401991
]
ASF GitHub Bot commented on BAHIR-39:
-------------------------------------
Github user ScrapCodes commented on the issue:
https://github.com/apache/bahir/pull/13
Potential issues with this source,
1) Not all MQTT options are exposed to end user. Not sure how useful they
can be.
2) Message parser is not pluggable, this limits as to what a user can do
with our source.
3) Currently persistence layer used create a file per message it stores,
this can lead to serious problems if number of messages go very large. Too many
files in a directory is not supported by all File systems (since it uses local
filesystem).
4) I have not yet run a very long job with this source. And study the
memory usage and so on.
....
> MQTT as a streaming source for SQL Streaming.
> ---------------------------------------------
>
> Key: BAHIR-39
> URL: https://issues.apache.org/jira/browse/BAHIR-39
> Project: Bahir
> Issue Type: New Feature
> Components: Spark SQL Data Sources
> Affects Versions: 2.1.0
> Reporter: Prashant Sharma
>
> MQTT compatible streaming source for Spark SQL Streaming.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
