Re: spark streaming web ui not showing the events - direct kafka api

[Cody Koeninger]

There have been changes to visibility of info in ui between 1.4 and 1.5, I
can't say off the top of my head at which point versions they took place.

On Thu, Feb 4, 2016 at 12:07 AM, vimal dinakaran 
wrote:

> No I am using DSE 4.8 which has spark 1.4. Is this a known issue ?
>
> On Wed, Jan 27, 2016 at 11:52 PM, Cody Koeninger 
> wrote:
>
>> Have you tried spark 1.5?
>>
>> On Wed, Jan 27, 2016 at 11:14 AM, vimal dinakaran 
>> wrote:
>>
>>> Hi ,
>>>  I am using spark 1.4 with direct kafka api . In my streaming ui , I am
>>> able to see the events listed in UI only if add stream.print() statements
>>> or else event rate and input events remains in 0 eventhough the events gets
>>> processed.
>>>
>>> Without print statements , I have the action saveToCassandra in the
>>> dstream.
>>>
>>> Any reasons why is this not working ?
>>>
>>> Thanks
>>> Vimal
>>>
>>
>>
>

Re: spark streaming web ui not showing the events - direct kafka api

[vimal dinakaran]

No I am using DSE 4.8 which has spark 1.4. Is this a known issue ?

On Wed, Jan 27, 2016 at 11:52 PM, Cody Koeninger  wrote:

> Have you tried spark 1.5?
>
> On Wed, Jan 27, 2016 at 11:14 AM, vimal dinakaran 
> wrote:
>
>> Hi ,
>>  I am using spark 1.4 with direct kafka api . In my streaming ui , I am
>> able to see the events listed in UI only if add stream.print() statements
>> or else event rate and input events remains in 0 eventhough the events gets
>> processed.
>>
>> Without print statements , I have the action saveToCassandra in the
>> dstream.
>>
>> Any reasons why is this not working ?
>>
>> Thanks
>> Vimal
>>
>
>

Re: spark streaming web ui not showing the events - direct kafka api

[Cody Koeninger]

Have you tried spark 1.5?

On Wed, Jan 27, 2016 at 11:14 AM, vimal dinakaran 
wrote:

> Hi ,
>  I am using spark 1.4 with direct kafka api . In my streaming ui , I am
> able to see the events listed in UI only if add stream.print() statements
> or else event rate and input events remains in 0 eventhough the events gets
> processed.
>
> Without print statements , I have the action saveToCassandra in the
> dstream.
>
> Any reasons why is this not working ?
>
> Thanks
> Vimal
>

spark streaming web ui not showing the events - direct kafka api

[vimal dinakaran]

Hi ,
 I am using spark 1.4 with direct kafka api . In my streaming ui , I am
able to see the events listed in UI only if add stream.print() statements
or else event rate and input events remains in 0 eventhough the events gets
processed.

Without print statements , I have the action saveToCassandra in the
dstream.

Any reasons why is this not working ?

Thanks
Vimal