[jira] [Commented] (BAHIR-51) Add additional MQTT options/parameters to MQTTInputDStream and MqttStreamSource

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/BAHIR-51?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431189#comment-15431189
 ] 

ASF subversion and git services commented on BAHIR-51:
--

Commit a351549cf634adf5249862599166ef9ed9073725 in bahir's branch 
refs/heads/master from [~prashant_]
[ https://git-wip-us.apache.org/repos/asf?p=bahir.git;h=a351549 ]

[BAHIR-51] Add new configuration options to MqttStreamSource.

Add new configuration options to enable secured connections and
other quality of services.

Closes #22


> Add additional MQTT options/parameters to MQTTInputDStream and 
> MqttStreamSource
> ---
>
> Key: BAHIR-51
> URL: https://issues.apache.org/jira/browse/BAHIR-51
> Project: Bahir
>  Issue Type: Improvement
>  Components: Spark Streaming Connectors, Spark Structured Streaming 
> Connectors
>Reporter: Sebastian Woehrl
>
> We are using Spark Streaming in the automotive IOT environment with MQTT as 
> the data source.
> For security reasons our MQTT broker is protected by username and password 
> (as is default for these kind of environments). At the moment it is not 
> possible to set username/password when creating an MQTT Receiver 
> (MQTTInputDStream or MqttStreamSource).
> I propose that the MQTTInputDStream and MqttStreamSource be extended to 
> optionally allow setting the following mqtt options / parameters:
> * username
> * password
> * clientId
> * cleanSession
> * QoS
> * connectionTimeout
> * keepAliveInterval
> * mqttVersion
> If this proposal meets your approval I am willing to create a pull request 
> with these changes implemented.
> *Note*: The part for MqttInputDStream has been split off into BAHIR-53.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (BAHIR-51) Add additional MQTT options/parameters to MQTTInputDStream and MqttStreamSource

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BAHIR-51?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431191#comment-15431191
 ] 

ASF GitHub Bot commented on BAHIR-51:
-

Github user asfgit closed the pull request at:

https://github.com/apache/bahir/pull/22


> Add additional MQTT options/parameters to MQTTInputDStream and 
> MqttStreamSource
> ---
>
> Key: BAHIR-51
> URL: https://issues.apache.org/jira/browse/BAHIR-51
> Project: Bahir
>  Issue Type: Improvement
>  Components: Spark Streaming Connectors, Spark Structured Streaming 
> Connectors
>Reporter: Sebastian Woehrl
>
> We are using Spark Streaming in the automotive IOT environment with MQTT as 
> the data source.
> For security reasons our MQTT broker is protected by username and password 
> (as is default for these kind of environments). At the moment it is not 
> possible to set username/password when creating an MQTT Receiver 
> (MQTTInputDStream or MqttStreamSource).
> I propose that the MQTTInputDStream and MqttStreamSource be extended to 
> optionally allow setting the following mqtt options / parameters:
> * username
> * password
> * clientId
> * cleanSession
> * QoS
> * connectionTimeout
> * keepAliveInterval
> * mqttVersion
> If this proposal meets your approval I am willing to create a pull request 
> with these changes implemented.
> *Note*: The part for MqttInputDStream has been split off into BAHIR-53.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (BAHIR-51) Add additional MQTT options/parameters to MQTTInputDStream and MqttStreamSource

[Sebastian Woehrl (JIRA)]

[ 
https://issues.apache.org/jira/browse/BAHIR-51?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15422951#comment-15422951
 ] 

Sebastian Woehrl commented on BAHIR-51:
---

[~luciano resende] I created it as BAHIR-53.

> Add additional MQTT options/parameters to MQTTInputDStream and 
> MqttStreamSource
> ---
>
> Key: BAHIR-51
> URL: https://issues.apache.org/jira/browse/BAHIR-51
> Project: Bahir
>  Issue Type: Improvement
>  Components: Spark Streaming Connectors, Spark Structured Streaming 
> Connectors
>Reporter: Sebastian Woehrl
>
> We are using Spark Streaming in the automotive IOT environment with MQTT as 
> the data source.
> For security reasons our MQTT broker is protected by username and password 
> (as is default for these kind of environments). At the moment it is not 
> possible to set username/password when creating an MQTT Receiver 
> (MQTTInputDStream or MqttStreamSource).
> I propose that the MQTTInputDStream and MqttStreamSource be extended to 
> optionally allow setting the following mqtt options / parameters:
> * username
> * password
> * clientId
> * cleanSession
> * QoS
> * connectionTimeout
> * keepAliveInterval
> * mqttVersion
> If this proposal meets your approval I am willing to create a pull request 
> with these changes implemented.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (BAHIR-51) Add additional MQTT options/parameters to MQTTInputDStream and MqttStreamSource

[Luciano Resende (JIRA)]

[ 
https://issues.apache.org/jira/browse/BAHIR-51?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15422804#comment-15422804
 ] 

Luciano Resende commented on BAHIR-51:
--

[~swoehrl-mw] Would you mind creating a separate jira for MQTT DStream so i can 
have it assigned to you ?

> Add additional MQTT options/parameters to MQTTInputDStream and 
> MqttStreamSource
> ---
>
> Key: BAHIR-51
> URL: https://issues.apache.org/jira/browse/BAHIR-51
> Project: Bahir
>  Issue Type: Improvement
>  Components: Spark Streaming Connectors, Spark Structured Streaming 
> Connectors
>Reporter: Sebastian Woehrl
>
> We are using Spark Streaming in the automotive IOT environment with MQTT as 
> the data source.
> For security reasons our MQTT broker is protected by username and password 
> (as is default for these kind of environments). At the moment it is not 
> possible to set username/password when creating an MQTT Receiver 
> (MQTTInputDStream or MqttStreamSource).
> I propose that the MQTTInputDStream and MqttStreamSource be extended to 
> optionally allow setting the following mqtt options / parameters:
> * username
> * password
> * clientId
> * cleanSession
> * QoS
> * connectionTimeout
> * keepAliveInterval
> * mqttVersion
> If this proposal meets your approval I am willing to create a pull request 
> with these changes implemented.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (BAHIR-51) Add additional MQTT options/parameters to MQTTInputDStream and MqttStreamSource

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BAHIR-51?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15422342#comment-15422342
 ] 

ASF GitHub Bot commented on BAHIR-51:
-

Github user ScrapCodes commented on the issue:

https://github.com/apache/bahir/pull/22
  
Thanks Luciano !


> Add additional MQTT options/parameters to MQTTInputDStream and 
> MqttStreamSource
> ---
>
> Key: BAHIR-51
> URL: https://issues.apache.org/jira/browse/BAHIR-51
> Project: Bahir
>  Issue Type: Improvement
>  Components: Spark Streaming Connectors, Spark Structured Streaming 
> Connectors
>Reporter: Sebastian Woehrl
>
> We are using Spark Streaming in the automotive IOT environment with MQTT as 
> the data source.
> For security reasons our MQTT broker is protected by username and password 
> (as is default for these kind of environments). At the moment it is not 
> possible to set username/password when creating an MQTT Receiver 
> (MQTTInputDStream or MqttStreamSource).
> I propose that the MQTTInputDStream and MqttStreamSource be extended to 
> optionally allow setting the following mqtt options / parameters:
> * username
> * password
> * clientId
> * cleanSession
> * QoS
> * connectionTimeout
> * keepAliveInterval
> * mqttVersion
> If this proposal meets your approval I am willing to create a pull request 
> with these changes implemented.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (BAHIR-51) Add additional MQTT options/parameters to MQTTInputDStream and MqttStreamSource

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BAHIR-51?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15421726#comment-15421726
 ] 

ASF GitHub Bot commented on BAHIR-51:
-

Github user lresende commented on the issue:

https://github.com/apache/bahir/pull/22
  
Never mind, #23 is taking care of these changes on the DStream MQTT 
extension.


> Add additional MQTT options/parameters to MQTTInputDStream and 
> MqttStreamSource
> ---
>
> Key: BAHIR-51
> URL: https://issues.apache.org/jira/browse/BAHIR-51
> Project: Bahir
>  Issue Type: Improvement
>  Components: Spark Streaming Connectors, Spark Structured Streaming 
> Connectors
>Reporter: Sebastian Woehrl
>
> We are using Spark Streaming in the automotive IOT environment with MQTT as 
> the data source.
> For security reasons our MQTT broker is protected by username and password 
> (as is default for these kind of environments). At the moment it is not 
> possible to set username/password when creating an MQTT Receiver 
> (MQTTInputDStream or MqttStreamSource).
> I propose that the MQTTInputDStream and MqttStreamSource be extended to 
> optionally allow setting the following mqtt options / parameters:
> * username
> * password
> * clientId
> * cleanSession
> * QoS
> * connectionTimeout
> * keepAliveInterval
> * mqttVersion
> If this proposal meets your approval I am willing to create a pull request 
> with these changes implemented.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (BAHIR-51) Add additional MQTT options/parameters to MQTTInputDStream and MqttStreamSource

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BAHIR-51?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15421727#comment-15421727
 ] 

ASF GitHub Bot commented on BAHIR-51:
-

Github user lresende commented on the issue:

https://github.com/apache/bahir/pull/22
  
LGTM


> Add additional MQTT options/parameters to MQTTInputDStream and 
> MqttStreamSource
> ---
>
> Key: BAHIR-51
> URL: https://issues.apache.org/jira/browse/BAHIR-51
> Project: Bahir
>  Issue Type: Improvement
>  Components: Spark Streaming Connectors, Spark Structured Streaming 
> Connectors
>Reporter: Sebastian Woehrl
>
> We are using Spark Streaming in the automotive IOT environment with MQTT as 
> the data source.
> For security reasons our MQTT broker is protected by username and password 
> (as is default for these kind of environments). At the moment it is not 
> possible to set username/password when creating an MQTT Receiver 
> (MQTTInputDStream or MqttStreamSource).
> I propose that the MQTTInputDStream and MqttStreamSource be extended to 
> optionally allow setting the following mqtt options / parameters:
> * username
> * password
> * clientId
> * cleanSession
> * QoS
> * connectionTimeout
> * keepAliveInterval
> * mqttVersion
> If this proposal meets your approval I am willing to create a pull request 
> with these changes implemented.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (BAHIR-51) Add additional MQTT options/parameters to MQTTInputDStream and MqttStreamSource

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BAHIR-51?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15421720#comment-15421720
 ] 

ASF GitHub Bot commented on BAHIR-51:
-

Github user lresende commented on the issue:

https://github.com/apache/bahir/pull/22
  
Would these also apply to the DStream MQTT extension ? if so, should we try 
to maintain the same level of MQTT supported functionality between the two ?


> Add additional MQTT options/parameters to MQTTInputDStream and 
> MqttStreamSource
> ---
>
> Key: BAHIR-51
> URL: https://issues.apache.org/jira/browse/BAHIR-51
> Project: Bahir
>  Issue Type: Improvement
>  Components: Spark Streaming Connectors, Spark Structured Streaming 
> Connectors
>Reporter: Sebastian Woehrl
>
> We are using Spark Streaming in the automotive IOT environment with MQTT as 
> the data source.
> For security reasons our MQTT broker is protected by username and password 
> (as is default for these kind of environments). At the moment it is not 
> possible to set username/password when creating an MQTT Receiver 
> (MQTTInputDStream or MqttStreamSource).
> I propose that the MQTTInputDStream and MqttStreamSource be extended to 
> optionally allow setting the following mqtt options / parameters:
> * username
> * password
> * clientId
> * cleanSession
> * QoS
> * connectionTimeout
> * keepAliveInterval
> * mqttVersion
> If this proposal meets your approval I am willing to create a pull request 
> with these changes implemented.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (BAHIR-51) Add additional MQTT options/parameters to MQTTInputDStream and MqttStreamSource

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BAHIR-51?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420265#comment-15420265
 ] 

ASF GitHub Bot commented on BAHIR-51:
-

GitHub user swoehrl-mw opened a pull request:

https://github.com/apache/bahir/pull/23

[BAHIR-51] Add important mqtt options to MQTTInputDStream



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/swoehrl-mw/bahir bahir-51

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bahir/pull/23.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #23


commit ab0d69a60f908af91a57f3ac00f4fb668ec64f0d
Author: Sebastian Woehrl 
Date:   2016-08-13T13:00:13Z

[BAHIR-51] Add important mqtt options to MQTTInputDStream




> Add additional MQTT options/parameters to MQTTInputDStream and 
> MqttStreamSource
> ---
>
> Key: BAHIR-51
> URL: https://issues.apache.org/jira/browse/BAHIR-51
> Project: Bahir
>  Issue Type: Improvement
>  Components: Spark Streaming Connectors, Spark Structured Streaming 
> Connectors
>Reporter: Sebastian Woehrl
>
> We are using Spark Streaming in the automotive IOT environment with MQTT as 
> the data source.
> For security reasons our MQTT broker is protected by username and password 
> (as is default for these kind of environments). At the moment it is not 
> possible to set username/password when creating an MQTT Receiver 
> (MQTTInputDStream or MqttStreamSource).
> I propose that the MQTTInputDStream and MqttStreamSource be extended to 
> optionally allow setting the following mqtt options / parameters:
> * username
> * password
> * clientId
> * cleanSession
> * QoS
> * connectionTimeout
> * keepAliveInterval
> * mqttVersion
> If this proposal meets your approval I am willing to create a pull request 
> with these changes implemented.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (BAHIR-51) Add additional MQTT options/parameters to MQTTInputDStream and MqttStreamSource

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BAHIR-51?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15418377#comment-15418377
 ] 

ASF GitHub Bot commented on BAHIR-51:
-

Github user ScrapCodes commented on the issue:

https://github.com/apache/bahir/pull/22
  
Thanks @swoehrl-mw, @lresende Please take a look !


> Add additional MQTT options/parameters to MQTTInputDStream and 
> MqttStreamSource
> ---
>
> Key: BAHIR-51
> URL: https://issues.apache.org/jira/browse/BAHIR-51
> Project: Bahir
>  Issue Type: Improvement
>  Components: Spark Streaming Connectors, Spark Structured Streaming 
> Connectors
>Reporter: Sebastian Woehrl
>
> We are using Spark Streaming in the automotive IOT environment with MQTT as 
> the data source.
> For security reasons our MQTT broker is protected by username and password 
> (as is default for these kind of environments). At the moment it is not 
> possible to set username/password when creating an MQTT Receiver 
> (MQTTInputDStream or MqttStreamSource).
> I propose that the MQTTInputDStream and MqttStreamSource be extended to 
> optionally allow setting the following mqtt options / parameters:
> * username
> * password
> * clientId
> * cleanSession
> * QoS
> * connectionTimeout
> * keepAliveInterval
> * mqttVersion
> If this proposal meets your approval I am willing to create a pull request 
> with these changes implemented.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (BAHIR-51) Add additional MQTT options/parameters to MQTTInputDStream and MqttStreamSource

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BAHIR-51?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15417334#comment-15417334
 ] 

ASF GitHub Bot commented on BAHIR-51:
-

Github user swoehrl-mw commented on the issue:

https://github.com/apache/bahir/pull/22
  
Change looks good to me. It adds all the important mqtt options and uses 
sensible defaults.


> Add additional MQTT options/parameters to MQTTInputDStream and 
> MqttStreamSource
> ---
>
> Key: BAHIR-51
> URL: https://issues.apache.org/jira/browse/BAHIR-51
> Project: Bahir
>  Issue Type: Improvement
>  Components: Spark Streaming Connectors, Spark Structured Streaming 
> Connectors
>Reporter: Sebastian Woehrl
>
> We are using Spark Streaming in the automotive IOT environment with MQTT as 
> the data source.
> For security reasons our MQTT broker is protected by username and password 
> (as is default for these kind of environments). At the moment it is not 
> possible to set username/password when creating an MQTT Receiver 
> (MQTTInputDStream or MqttStreamSource).
> I propose that the MQTTInputDStream and MqttStreamSource be extended to 
> optionally allow setting the following mqtt options / parameters:
> * username
> * password
> * clientId
> * cleanSession
> * QoS
> * connectionTimeout
> * keepAliveInterval
> * mqttVersion
> If this proposal meets your approval I am willing to create a pull request 
> with these changes implemented.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (BAHIR-51) Add additional MQTT options/parameters to MQTTInputDStream and MqttStreamSource

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BAHIR-51?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416990#comment-15416990
 ] 

ASF GitHub Bot commented on BAHIR-51:
-

GitHub user ScrapCodes opened a pull request:

https://github.com/apache/bahir/pull/22

[BAHIR-51] MqttStreamSource supports a few important MqttConnectOptions.



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/ScrapCodes/bahir BAHIR-51

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bahir/pull/22.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #22


commit de08f208454f9a96381d5fac90afb4d33b6ef352
Author: Prashant Sharma 
Date:   2016-08-11T10:26:20Z

[BAHIR-51] MqttStreamSource supports a few important MqttConnectOptions.




> Add additional MQTT options/parameters to MQTTInputDStream and 
> MqttStreamSource
> ---
>
> Key: BAHIR-51
> URL: https://issues.apache.org/jira/browse/BAHIR-51
> Project: Bahir
>  Issue Type: Improvement
>  Components: Spark Streaming Connectors, Spark Structured Streaming 
> Connectors
>Reporter: Sebastian Woehrl
>
> We are using Spark Streaming in the automotive IOT environment with MQTT as 
> the data source.
> For security reasons our MQTT broker is protected by username and password 
> (as is default for these kind of environments). At the moment it is not 
> possible to set username/password when creating an MQTT Receiver 
> (MQTTInputDStream or MqttStreamSource).
> I propose that the MQTTInputDStream and MqttStreamSource be extended to 
> optionally allow setting the following mqtt options / parameters:
> * username
> * password
> * clientId
> * cleanSession
> * QoS
> * connectionTimeout
> * keepAliveInterval
> * mqttVersion
> If this proposal meets your approval I am willing to create a pull request 
> with these changes implemented.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (BAHIR-51) Add additional MQTT options/parameters to MQTTInputDStream and MqttStreamSource

[Prashant Sharma (JIRA)]

[ 
https://issues.apache.org/jira/browse/BAHIR-51?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416952#comment-15416952
 ] 

Prashant Sharma commented on BAHIR-51:
--

QoS is set on message, when it is published. There is no way, I could see to 
set QoS on the receiver.

> Add additional MQTT options/parameters to MQTTInputDStream and 
> MqttStreamSource
> ---
>
> Key: BAHIR-51
> URL: https://issues.apache.org/jira/browse/BAHIR-51
> Project: Bahir
>  Issue Type: Improvement
>  Components: Spark Streaming Connectors, Spark Structured Streaming 
> Connectors
>Reporter: Sebastian Woehrl
>
> We are using Spark Streaming in the automotive IOT environment with MQTT as 
> the data source.
> For security reasons our MQTT broker is protected by username and password 
> (as is default for these kind of environments). At the moment it is not 
> possible to set username/password when creating an MQTT Receiver 
> (MQTTInputDStream or MqttStreamSource).
> I propose that the MQTTInputDStream and MqttStreamSource be extended to 
> optionally allow setting the following mqtt options / parameters:
> * username
> * password
> * clientId
> * cleanSession
> * QoS
> * connectionTimeout
> * keepAliveInterval
> * mqttVersion
> If this proposal meets your approval I am willing to create a pull request 
> with these changes implemented.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)