Re: Jenkins jobs not running for my PR 10438

2020-05-13 Thread Rehman Murad Ali
Hi Beam committers,

I appreciate if you can trigger tests for this pr:


https://github.com/apache/beam/pull/11350

*Thanks & Regards*



*Rehman Murad Ali*
Software Engineer
Mobile: +92 3452076766
Skype: rehman.muradali


On Tue, May 12, 2020 at 1:25 PM Ismaël Mejía  wrote:

> done
>
> On Tue, May 12, 2020 at 4:04 AM rahul patwari
>  wrote:
> >
> > Hi,
> >
> > Can you please trigger pre-commit checks for
> https://github.com/apache/beam/pull/11581
> >
> > Thanks,
> > Rahul
> >
> > On Tue, May 12, 2020 at 7:12 AM Ahmet Altay  wrote:
> >>
> >> Done for both Yoshiki and Tomo's PRs.
> >>
> >> On Mon, May 11, 2020 at 6:33 PM Tomo Suzuki  wrote:
> >>>
> >>> Hi Beam committers,
> >>>
> >>> Would you run the basic precommit checks for
> https://github.com/apache/beam/pull/11674 ?
> >>>
> >>> Regards,
> >>> Tomo
>


Re: Jenkins jobs not running for my PR 10438

2020-05-04 Thread Rehman Murad Ali
Hi Beam committers,

Would you please trigger the basic checks as well as validatesRunner check
for this PR?
https://github.com/apache/beam/pull/11350


*Thanks & Regards*

*Rehman Murad Ali*
Software Engineer
Mobile: +92 3452076766
Skype: rehman.muradali


On Fri, May 1, 2020 at 5:11 PM Ismaël Mejía  wrote:

> done
>
> On Fri, May 1, 2020 at 5:31 AM Tomo Suzuki  wrote:
> >
> > Hi Beam committers,
> >
> > Would you trigger the precommit checks for this PR?
> > https://github.com/apache/beam/pull/11586
> >
> > Regards,
> > Tomo
>


Re: Jenkins jobs not running for my PR 10438

2020-04-22 Thread Rehman Murad Ali
Hello Beam Committers.

Would you please trigger basic tests as well as all *validatesRunner* test
on this PR:
https://github.com/apache/beam/pull/11154 <http://goog_2075714097>
<https://github.com/apache/beam/pull/11350>


*Thanks & Regards*



*Rehman Murad Ali*
Software Engineer
Mobile: +92 3452076766
Skype: rehman.muradali


On Wed, Apr 22, 2020 at 9:25 PM Yoshiki Obata 
wrote:

> Hello Beam Committers,
>
> I would appreciate if you could trigger precommit checks for these PRs;
> https://github.com/apache/beam/pull/11493
> https://github.com/apache/beam/pull/11494
>
> Regards
> yoshiki
>
> 2020年4月21日(火) 1:11 Luke Cwik :
>
>> The precommits started and I provided the comments for the postcommits as
>> you have requested but they have yet to start.
>>
>> On Mon, Apr 20, 2020 at 8:31 AM Shoaib Zafar <
>> shoaib.za...@venturedive.com> wrote:
>>
>>> Hello Beam Committers.
>>>
>>> Would you please trigger the pre-commit checks on the PR:
>>> https://github.com/apache/beam/pull/11210 along with the python
>>> post-commit checks (Run Python PostCommit, Run Python 3.5 PostCommit)?
>>>
>>> Thanks! Regards,
>>>
>>> *Shoaib Zafar*
>>> Software Engineering Lead
>>> Mobile: +92 333 274 6242
>>> Skype: live:shoaibzafar_1
>>>
>>> <http://venturedive.com/>
>>>
>>>
>>> On Fri, Apr 17, 2020 at 1:19 PM Ismaël Mejía  wrote:
>>>
>>>> done
>>>>
>>>> On Thu, Apr 16, 2020 at 4:32 PM Rehman Murad Ali <
>>>> rehman.murad...@venturedive.com> wrote:
>>>>
>>>>> Hello Beam Committers.
>>>>>
>>>>> Would you please trigger basic tests as well as validatesRunner test
>>>>> on this PR:
>>>>>
>>>>> <http://goog_2075714097>
>>>>> https://github.com/apache/beam/pull/11350
>>>>>
>>>>>
>>>>> *Thanks & Regards*
>>>>>
>>>>>
>>>>>
>>>>> *Rehman Murad Ali*
>>>>> Software Engineer
>>>>> Mobile: +92 3452076766 <+92%20345%202076766>
>>>>> Skype: rehman.muradali
>>>>>
>>>>>
>>>>> On Mon, Apr 13, 2020 at 10:16 PM Ahmet Altay  wrote:
>>>>>
>>>>>> Done.
>>>>>>
>>>>>> On Mon, Apr 13, 2020 at 8:52 AM Shoaib Zafar <
>>>>>> shoaib.za...@venturedive.com> wrote:
>>>>>>
>>>>>>> Hello Beam Committers.
>>>>>>>
>>>>>>> Would you please trigger the pre-commit checks on the PR:
>>>>>>> https://github.com/apache/beam/pull/11210 along with the python
>>>>>>> post-commit checks (Run Python PostCommit, Run Python 3.5 PostCommit)?
>>>>>>>
>>>>>>> Thanks!
>>>>>>>
>>>>>>> *Shoaib Zafar*
>>>>>>> Software Engineering Lead
>>>>>>> Mobile: +92 333 274 6242
>>>>>>> Skype: live:shoaibzafar_1
>>>>>>>
>>>>>>> <http://venturedive.com/>
>>>>>>>
>>>>>>>
>>>>>>> On Mon, Apr 13, 2020 at 4:00 PM Ismaël Mejía 
>>>>>>> wrote:
>>>>>>>
>>>>>>>> done
>>>>>>>>
>>>>>>>> On Mon, Apr 13, 2020 at 12:42 PM Rehman Murad Ali
>>>>>>>>  wrote:
>>>>>>>> >
>>>>>>>> > Hi Beam Committers!
>>>>>>>> >
>>>>>>>> > Thanks( Ismael )
>>>>>>>> >
>>>>>>>> > I appreciate if someone could trigger these tests on this PR
>>>>>>>> https://github.com/apache/beam/pull/11154
>>>>>>>> >
>>>>>>>> > run dataflow validatesrunner
>>>>>>>> > run flink validatesrunner
>>>>>>>> > Run Java Flink PortableValidatesRunner Streaming
>>>>>>>> >
>>>>>>>> > Thanks
>>>>>>>> >
>>>>>>>> >
>>>>>>>> >
>>>>>>>> > Rehman Murad Ali
>>>>>>>> > Software Engineer
>>>>>>>> > Mobile: +92 3452076766 <

Re: Jenkins jobs not running for my PR 10438

2020-04-16 Thread Rehman Murad Ali
Hello Beam Committers.

Would you please trigger basic tests as well as validatesRunner test on
this PR:


https://github.com/apache/beam/pull/11350


*Thanks & Regards*



*Rehman Murad Ali*
Software Engineer
Mobile: +92 3452076766
Skype: rehman.muradali


On Mon, Apr 13, 2020 at 10:16 PM Ahmet Altay  wrote:

> Done.
>
> On Mon, Apr 13, 2020 at 8:52 AM Shoaib Zafar 
> wrote:
>
>> Hello Beam Committers.
>>
>> Would you please trigger the pre-commit checks on the PR:
>> https://github.com/apache/beam/pull/11210 along with the python
>> post-commit checks (Run Python PostCommit, Run Python 3.5 PostCommit)?
>>
>> Thanks!
>>
>> *Shoaib Zafar*
>> Software Engineering Lead
>> Mobile: +92 333 274 6242
>> Skype: live:shoaibzafar_1
>>
>> <http://venturedive.com/>
>>
>>
>> On Mon, Apr 13, 2020 at 4:00 PM Ismaël Mejía  wrote:
>>
>>> done
>>>
>>> On Mon, Apr 13, 2020 at 12:42 PM Rehman Murad Ali
>>>  wrote:
>>> >
>>> > Hi Beam Committers!
>>> >
>>> > Thanks( Ismael )
>>> >
>>> > I appreciate if someone could trigger these tests on this PR
>>> https://github.com/apache/beam/pull/11154
>>> >
>>> > run dataflow validatesrunner
>>> > run flink validatesrunner
>>> > Run Java Flink PortableValidatesRunner Streaming
>>> >
>>> > Thanks
>>> >
>>> >
>>> >
>>> > Rehman Murad Ali
>>> > Software Engineer
>>> > Mobile: +92 3452076766 <+92%20345%202076766>
>>> > Skype: rehman.muradali
>>> >
>>> >
>>> >
>>> > On Wed, Apr 1, 2020 at 1:19 PM Ismaël Mejía  wrote:
>>> >>
>>> >> done
>>> >>
>>> >> On Wed, Apr 1, 2020 at 9:15 AM Rehman Murad Ali
>>> >>  wrote:
>>> >> >
>>> >> > Hi Beam Committers!
>>> >> >
>>> >> > I appreciate if someone could trigger the tests on this PR
>>> https://github.com/apache/beam/pull/11154
>>> >> >
>>> >> > Thanks
>>> >> >
>>> >> >
>>> >> >
>>> >> > Rehman Murad Ali
>>> >> > Software Engineer
>>> >> > Mobile: +92 3452076766 <+92%20345%202076766>
>>> >> > Skype: rehman.muradali
>>> >> >
>>> >> >
>>> >> >
>>> >> > On Mon, Mar 30, 2020 at 8:09 PM Kamil Wasilewski <
>>> kamil.wasilew...@polidea.com> wrote:
>>> >> >>
>>> >> >> Done.
>>> >> >>
>>> >> >> On Mon, Mar 30, 2020 at 4:58 PM Tomo Suzuki 
>>> wrote:
>>> >> >>>
>>> >> >>> Hi Beam committers,
>>> >> >>> (Thanks Ahmet)
>>> >> >>>
>>> >> >>> Would you retrigger the following 5 jobs for
>>> https://github.com/apache/beam/pull/11156 ?
>>> >> >>> Run Dataflow ValidatesRunner
>>> >> >>> Run Java PreCommit
>>> >> >>> Run Portable_Python PreCommit
>>> >> >>> Run PythonFormatter PreCommit
>>> >> >>> Run Website PreCommit
>>> >> >>>
>>> >> >>>
>>> >> >>> On Thu, Mar 26, 2020 at 9:45 PM Ahmet Altay 
>>> wrote:
>>> >> >>>>
>>> >> >>>> Done.
>>> >> >>>>
>>> >> >>>> On Thu, Mar 26, 2020 at 2:37 PM Tomo Suzuki 
>>> wrote:
>>> >> >>>>>
>>> >> >>>>> Hi Beam committers,
>>> >> >>>>> (Thanks Ahmet for previous attempt)
>>> >> >>>>>
>>> >> >>>>> Would you trigger
>>> >> >>>>> - The failed "Run Java Precommit" for
>>> https://github.com/apache/beam/pull/11208,
>>> >> >>>>> - and the precommit checks for
>>> https://github.com/apache/beam/pull/11156  with the following 6 checks?
>>> >> >>>>> Run Java PostCommit
>>> >> >>>>> Run Java HadoopFormatIO Performance Test
>>> >> >>>>> Run BigQueryIO Streaming Performance Test Java
>>> >> >>>>> Run Da

Re: Jenkins jobs not running for my PR 10438

2020-04-13 Thread Rehman Murad Ali
Hi Beam Committers!

Thanks( Ismael )

I appreciate if someone could trigger these tests on this PR
https://github.com/apache/beam/pull/11154

run dataflow validatesrunner
run flink validatesrunner
Run Java Flink PortableValidatesRunner Streaming

Thanks



*Rehman Murad Ali*
Software Engineer
Mobile: +92 3452076766
Skype: rehman.muradali


On Wed, Apr 1, 2020 at 1:19 PM Ismaël Mejía  wrote:

> done
>
> On Wed, Apr 1, 2020 at 9:15 AM Rehman Murad Ali
>  wrote:
> >
> > Hi Beam Committers!
> >
> > I appreciate if someone could trigger the tests on this PR
> https://github.com/apache/beam/pull/11154
> >
> > Thanks
> >
> >
> >
> > Rehman Murad Ali
> > Software Engineer
> > Mobile: +92 3452076766
> > Skype: rehman.muradali
> >
> >
> >
> > On Mon, Mar 30, 2020 at 8:09 PM Kamil Wasilewski <
> kamil.wasilew...@polidea.com> wrote:
> >>
> >> Done.
> >>
> >> On Mon, Mar 30, 2020 at 4:58 PM Tomo Suzuki  wrote:
> >>>
> >>> Hi Beam committers,
> >>> (Thanks Ahmet)
> >>>
> >>> Would you retrigger the following 5 jobs for
> https://github.com/apache/beam/pull/11156 ?
> >>> Run Dataflow ValidatesRunner
> >>> Run Java PreCommit
> >>> Run Portable_Python PreCommit
> >>> Run PythonFormatter PreCommit
> >>> Run Website PreCommit
> >>>
> >>>
> >>> On Thu, Mar 26, 2020 at 9:45 PM Ahmet Altay  wrote:
> >>>>
> >>>> Done.
> >>>>
> >>>> On Thu, Mar 26, 2020 at 2:37 PM Tomo Suzuki 
> wrote:
> >>>>>
> >>>>> Hi Beam committers,
> >>>>> (Thanks Ahmet for previous attempt)
> >>>>>
> >>>>> Would you trigger
> >>>>> - The failed "Run Java Precommit" for
> https://github.com/apache/beam/pull/11208,
> >>>>> - and the precommit checks for
> https://github.com/apache/beam/pull/11156  with the following 6 checks?
> >>>>> Run Java PostCommit
> >>>>> Run Java HadoopFormatIO Performance Test
> >>>>> Run BigQueryIO Streaming Performance Test Java
> >>>>> Run Dataflow ValidatesRunner
> >>>>> Run Spark ValidatesRunner
> >>>>> Run SQL Postcommit
> >>>>>
> >>>>> On Tue, Mar 24, 2020 at 6:37 PM Ahmet Altay 
> wrote:
> >>>>>>
> >>>>>> KInd of done. 11208 is running the tests. 11156 did not start all
> the tests. Someone could retry that again in a bit.
> >>>>>>
> >>>>>> On Tue, Mar 24, 2020 at 12:11 PM Tomo Suzuki 
> wrote:
> >>>>>>>
> >>>>>>> Hi Beam committers,
> >>>>>>>
> >>>>>>> Would you trigger precommit checks for
> https://github.com/apache/beam/pull/11156 and
> https://github.com/apache/beam/pull/11208 with the following 6 checks?
> >>>>>>> Run Java PostCommit
> >>>>>>> Run Java HadoopFormatIO Performance Test
> >>>>>>> Run BigQueryIO Streaming Performance Test Java
> >>>>>>> Run Dataflow ValidatesRunner
> >>>>>>> Run Spark ValidatesRunner
> >>>>>>> Run SQL Postcommit
> >>>>>>>
> >>>>>>>
> >>>>>>> On Fri, Mar 20, 2020 at 11:13 AM Jan Lukavský 
> wrote:
> >>>>>>>>
> >>>>>>>> Hi, done.
> >>>>>>>>
> >>>>>>>> On 3/20/20 3:59 PM, Tomo Suzuki wrote:
> >>>>>>>>
> >>>>>>>> HI Beam committers,
> >>>>>>>> (Thanks Ahmet)
> >>>>>>>>
> >>>>>>>> Would you re-run the presubmit checks for
> https://github.com/apache/beam/pull/11168 with the followings?
> >>>>>>>> Run Java PostCommit
> >>>>>>>> Run Java HadoopFormatIO Performance Test
> >>>>>>>> Run BigQueryIO Streaming Performance Test Java
> >>>>>>>> Run Dataflow ValidatesRunner
> >>>>>>>> Run Spark ValidatesRunner
> >>>>>>>> Run SQL Postcommit
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> On Wed, Mar 18, 2020 a

Re: Jenkins jobs not running for my PR 10438

2020-04-01 Thread Rehman Murad Ali
Hi Beam Committers!

I appreciate if someone could trigger the tests on this PR
https://github.com/apache/beam/pull/11154

Thanks



*Rehman Murad Ali*
Software Engineer
Mobile: +92 3452076766
Skype: rehman.muradali


On Mon, Mar 30, 2020 at 8:09 PM Kamil Wasilewski <
kamil.wasilew...@polidea.com> wrote:

> Done.
>
> On Mon, Mar 30, 2020 at 4:58 PM Tomo Suzuki  wrote:
>
>> Hi Beam committers,
>> (Thanks Ahmet)
>>
>> Would you retrigger the following 5 jobs for
>> https://github.com/apache/beam/pull/11156 ?
>> Run Dataflow ValidatesRunner
>> Run Java PreCommit
>> Run Portable_Python PreCommit
>> Run PythonFormatter PreCommit
>> Run Website PreCommit
>>
>>
>> On Thu, Mar 26, 2020 at 9:45 PM Ahmet Altay  wrote:
>>
>>> Done.
>>>
>>> On Thu, Mar 26, 2020 at 2:37 PM Tomo Suzuki  wrote:
>>>
>>>> Hi Beam committers,
>>>> (Thanks Ahmet for previous attempt)
>>>>
>>>> Would you trigger
>>>> - The failed "Run Java Precommit" for
>>>> https://github.com/apache/beam/pull/11208,
>>>> - and the precommit checks for
>>>> https://github.com/apache/beam/pull/11156  with the following 6 checks?
>>>> Run Java PostCommit
>>>> Run Java HadoopFormatIO Performance Test
>>>> Run BigQueryIO Streaming Performance Test Java
>>>> Run Dataflow ValidatesRunner
>>>> Run Spark ValidatesRunner
>>>> Run SQL Postcommit
>>>>
>>>> On Tue, Mar 24, 2020 at 6:37 PM Ahmet Altay  wrote:
>>>>
>>>>> KInd of done. 11208 is running the tests. 11156 did not start all the
>>>>> tests. Someone could retry that again in a bit.
>>>>>
>>>>> On Tue, Mar 24, 2020 at 12:11 PM Tomo Suzuki 
>>>>> wrote:
>>>>>
>>>>>> Hi Beam committers,
>>>>>>
>>>>>> Would you trigger precommit checks for
>>>>>> https://github.com/apache/beam/pull/11156 and
>>>>>> https://github.com/apache/beam/pull/11208 with the following 6
>>>>>> checks?
>>>>>> Run Java PostCommit
>>>>>> Run Java HadoopFormatIO Performance Test
>>>>>> Run BigQueryIO Streaming Performance Test Java
>>>>>> Run Dataflow ValidatesRunner
>>>>>> Run Spark ValidatesRunner
>>>>>> Run SQL Postcommit
>>>>>>
>>>>>>
>>>>>> On Fri, Mar 20, 2020 at 11:13 AM Jan Lukavský 
>>>>>> wrote:
>>>>>>
>>>>>>> Hi, done.
>>>>>>> On 3/20/20 3:59 PM, Tomo Suzuki wrote:
>>>>>>>
>>>>>>> HI Beam committers,
>>>>>>> (Thanks Ahmet)
>>>>>>>
>>>>>>> Would you re-run the presubmit checks for
>>>>>>> https://github.com/apache/beam/pull/11168 with the followings?
>>>>>>> Run Java PostCommit
>>>>>>> Run Java HadoopFormatIO Performance Test
>>>>>>> Run BigQueryIO Streaming Performance Test Java
>>>>>>> Run Dataflow ValidatesRunner
>>>>>>> Run Spark ValidatesRunner
>>>>>>> Run SQL Postcommit
>>>>>>>
>>>>>>>
>>>>>>> On Wed, Mar 18, 2020 at 9:09 PM Ahmet Altay 
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Done.
>>>>>>>>
>>>>>>>> On Wed, Mar 18, 2020 at 5:57 PM Tomo Suzuki 
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Hi Beam committers,
>>>>>>>>> (Alexey, thank you!)
>>>>>>>>>
>>>>>>>>> 1. Would you run the 2 failed checks Java PreCommit and Python
>>>>>>>>> PreCommit for https://github.com/apache/beam/pull/11156
>>>>>>>>>
>>>>>>>>> 2. Would you run the precommit checks for
>>>>>>>>> https://github.com/apache/beam/pull/11168 with the following 6
>>>>>>>>> commands?
>>>>>>>>> Run Java PostCommit
>>>>>>>>> Run Java HadoopFormatIO Performance Test
>>>>>>>>> Run BigQueryIO Streaming Performance Test Java
>>>>>>>>> Run Dataflow ValidatesRunner
>>>>>>>>> Run Spark ValidatesRunner
>>>>>>>>> Run SQL Postcommit
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Wed, Mar 18, 2020 at 1:08 PM Alexey Romanenko <
>>>>>>>>> aromanenko@gmail.com> wrote:
>>>>>>>>>
>>>>>>>>>> Done
>>>>>>>>>>
>>>>>>>>>> On 18 Mar 2020, at 15:25, Tomo Suzuki  wrote:
>>>>>>>>>>
>>>>>>>>>> Hi Beam committers,
>>>>>>>>>>
>>>>>>>>>> Would you trigger the precommit checks for
>>>>>>>>>> https://github.com/apache/beam/pull/11156 with the following 6
>>>>>>>>>> commands ?
>>>>>>>>>>
>>>>>>>>>> Run Java PostCommit
>>>>>>>>>> Run Java HadoopFormatIO Performance Test
>>>>>>>>>> Run BigQueryIO Streaming Performance Test Java
>>>>>>>>>> Run Dataflow ValidatesRunner
>>>>>>>>>> Run Spark ValidatesRunner
>>>>>>>>>> Run SQL Postcommit
>>>>>>>>>>
>>>>>>>>>> Regards,
>>>>>>>>>> Tomo
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Regards,
>>>>>>>>> Tomo
>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Regards,
>>>>>>> Tomo
>>>>>>>
>>>>>>>
>>>>>>
>>>>>> --
>>>>>> Regards,
>>>>>> Tomo
>>>>>>
>>>>>
>>>>
>>>> --
>>>> Regards,
>>>> Tomo
>>>>
>>>
>>
>> --
>> Regards,
>> Tomo
>>
>


Re: Jenkins jobs not running for my PR 10438

2020-03-19 Thread Rehman Murad Ali
Hello Committer,

Would you please retrigger Java Precommit for this PR?
https://github.com/apache/beam/pull/11154

Thanks.


*Rehman Murad Ali*
Software Engineer
Mobile: +92 3452076766
Skype: rehman.muradali


On Thu, Mar 19, 2020 at 6:09 AM Ahmet Altay  wrote:

> Done.
>
> On Wed, Mar 18, 2020 at 5:57 PM Tomo Suzuki  wrote:
>
>> Hi Beam committers,
>> (Alexey, thank you!)
>>
>> 1. Would you run the 2 failed checks Java PreCommit and Python PreCommit
>> for https://github.com/apache/beam/pull/11156
>>
>> 2. Would you run the precommit checks for
>> https://github.com/apache/beam/pull/11168 with the following 6 commands?
>> Run Java PostCommit
>> Run Java HadoopFormatIO Performance Test
>> Run BigQueryIO Streaming Performance Test Java
>> Run Dataflow ValidatesRunner
>> Run Spark ValidatesRunner
>> Run SQL Postcommit
>>
>>
>>
>>
>>
>> On Wed, Mar 18, 2020 at 1:08 PM Alexey Romanenko <
>> aromanenko@gmail.com> wrote:
>>
>>> Done
>>>
>>> On 18 Mar 2020, at 15:25, Tomo Suzuki  wrote:
>>>
>>> Hi Beam committers,
>>>
>>> Would you trigger the precommit checks for
>>> https://github.com/apache/beam/pull/11156 with the following 6 commands
>>> ?
>>>
>>> Run Java PostCommit
>>> Run Java HadoopFormatIO Performance Test
>>> Run BigQueryIO Streaming Performance Test Java
>>> Run Dataflow ValidatesRunner
>>> Run Spark ValidatesRunner
>>> Run SQL Postcommit
>>>
>>> Regards,
>>> Tomo
>>>
>>>
>>>
>>
>> --
>> Regards,
>> Tomo
>>
>


Re: Jenkins jobs not running for my PR 10438

2020-03-18 Thread Rehman Murad Ali
Hello Committers,

I appreciate if you could run jobs for this PR:
https://github.com/apache/beam/pull/11154

Thanks

*Rehman Murad Ali*
Software Engineer
Mobile: +92 3452076766
Skype: rehman.muradali


On Wed, Mar 11, 2020 at 12:24 AM Ahmet Altay  wrote:

> Done.
>
> On Tue, Mar 10, 2020 at 12:21 PM Tomo Suzuki  wrote:
>
>> Hi Beam committers,
>>
>> Would you trigger precomimt checks for
>> https://github.com/apache/beam/pull/11095 with the following 6 commands ?
>> Run Java PostCommit
>> Run Java HadoopFormatIO Performance Test
>> Run BigQueryIO Streaming Performance Test Java
>> Run Dataflow ValidatesRunner
>> Run Spark ValidatesRunner
>> Run SQL Postcommit
>>
>> Regards,
>> Tomo
>>
>>


Re: Unable to run ParDoTests from CLI

2020-02-07 Thread Rehman Murad Ali
Thanks, Ismaël.



*Rehman Murad Ali*
Software Engineer
Mobile: +92 3452076766
Skype: rehman.muradali


On Fri, Feb 7, 2020 at 7:29 PM Ismaël Mejía  wrote:

> Use
>
> ./gradlew :runners:direct-java:needsRunner --tests "*ParDoTest\$TimerTests"
>
> For ValidatesRunner for example:
> /gradlew :runners:direct-java:validatesRunner --tests
> "*ParDoTest\$TimerFamily*"
>
> Credit to Brian who helped me because I was struggling with the same issue
> last week.
>
>
> On Fri, Feb 7, 2020 at 3:19 PM Rehman Murad Ali <
> rehman.murad...@venturedive.com> wrote:
>
>> Hello Community,
>>
>> I have been trying to run test cases from CLI. ParDoTest.java has some
>> inner classes with test functions (for example TimerTest). This is the
>> command I have used to run the test:
>>
>> ./gradlew runners:direct-java:needsRunnerTests --tests
>> "org.apache.beam.sdk.transforms.ParDoTest$TimerTests"
>>
>> Here is the error message:
>> [image: image.png]
>>
>>
>> I need assistance regarding this matter.
>>
>>
>> *Thanks & Regards*
>>
>>
>>
>> *Rehman Murad Ali*
>> Software Engineer
>> Mobile: +92 3452076766
>> Skype: rehman.muradali
>>
>


Unable to run ParDoTests from CLI

2020-02-07 Thread Rehman Murad Ali
Hello Community,

I have been trying to run test cases from CLI. ParDoTest.java has some
inner classes with test functions (for example TimerTest). This is the
command I have used to run the test:

./gradlew runners:direct-java:needsRunnerTests --tests
"org.apache.beam.sdk.transforms.ParDoTest$TimerTests"

Here is the error message:
[image: image.png]


I need assistance regarding this matter.


*Thanks & Regards*



*Rehman Murad Ali*
Software Engineer
Mobile: +92 3452076766
Skype: rehman.muradali


Re: Jenkins jobs not running for my PR 10438

2020-02-02 Thread Rehman Murad Ali
Hi Committers,

Could you please re-trigger failed jobs for
https://github.com/apache/beam/pull/10627.

*Thanks & Regards*



*Rehman Murad Ali*
Software Engineer
Mobile: +92 3452076766
Skype: rehman.muradali


On Fri, Jan 31, 2020 at 10:28 PM Udi Meiri  wrote:

> done
>
> On Fri, Jan 31, 2020 at 9:07 AM Tomo Suzuki  wrote:
>
>> HI Beam committers,
>>
>> Would you re-trigger the 2 failed checks in
>> https://github.com/apache/beam/pull/10714 ?
>> Run Java PreCommit
>> Run Java_Examples_Dataflow PreCommit
>>
>>
>> On Fri, Jan 31, 2020 at 7:51 AM Rehman Murad Ali <
>> rehman.murad...@venturedive.com> wrote:
>>
>>> Hi,
>>>
>>> I appreciate if someone could trigger the jobs for this PR:
>>>
>>> https://github.com/apache/beam/pull/10627
>>>
>>> *Thanks*
>>>
>>> *Rehman Murad Ali*
>>> Software Engineer
>>> Mobile: +92 3452076766 <+92%20345%202076766>
>>> Skype: rehman.muradali
>>>
>>>
>>> On Thu, Jan 30, 2020 at 10:19 PM Luke Cwik  wrote:
>>>
>>>> done
>>>>
>>>> On Thu, Jan 30, 2020 at 12:28 AM Shoaib Zafar <
>>>> shoaib.za...@venturedive.com> wrote:
>>>>
>>>>> Hi Beam Committer,
>>>>>
>>>>> I appreciate if someone could trigger jobs for
>>>>> https://github.com/apache/beam/pull/10712.
>>>>>
>>>>> Thanks!
>>>>>
>>>>> *Shoaib Zafar*
>>>>>
>>>>> Software Engineering Lead
>>>>> Mobile: +92 333 274 6242
>>>>> Skype: live:shoaibzafar_1
>>>>>
>>>>> <http://venturedive.com/>
>>>>>
>>>>>
>>>>> On Thu, Jan 30, 2020 at 9:09 AM Boyuan Zhang 
>>>>> wrote:
>>>>>
>>>>>> Done : )
>>>>>>
>>>>>> On Wed, Jan 29, 2020 at 7:52 PM Tomo Suzuki 
>>>>>> wrote:
>>>>>>
>>>>>>> HI Beam committers:
>>>>>>> (Thanks, Luke!)
>>>>>>>
>>>>>>> Can somebody retrigger the following 2 failed checks for
>>>>>>> https://github.com/apache/beam/pull/10714 ?
>>>>>>> Run Java PreCommit
>>>>>>> Run Java_Examples_Dataflow PreCommit
>>>>>>>
>>>>>>> On Wed, Jan 29, 2020 at 4:48 PM Luke Cwik  wrote:
>>>>>>> >
>>>>>>> > done
>>>>>>> >
>>>>>>> > On Wed, Jan 29, 2020 at 11:07 AM Tomo Suzuki 
>>>>>>> wrote:
>>>>>>> >>
>>>>>>> >> Hi Beam committers,
>>>>>>> >>
>>>>>>> >> I appreciate if you can trigger the precommit checks for
>>>>>>> >> https://github.com/apache/beam/pull/10714
>>>>>>> >>
>>>>>>> >> with following 6 additional commands (one command per comment):
>>>>>>> >>
>>>>>>> >> Run Java PostCommit
>>>>>>> >> Run Java HadoopFormatIO Performance Test
>>>>>>> >> Run BigQueryIO Streaming Performance Test Java
>>>>>>> >> Run Dataflow ValidatesRunner
>>>>>>> >> Run Spark ValidatesRunner
>>>>>>> >> Run SQL Postcommit
>>>>>>> >>
>>>>>>> >> Regards,
>>>>>>> >> Tomo
>>>>>>> >>
>>>>>>> >>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Regards,
>>>>>>> Tomo
>>>>>>>
>>>>>>
>>
>> --
>> Regards,
>> Tomo
>>
>


Re: Jenkins jobs not running for my PR 10438

2020-01-31 Thread Rehman Murad Ali
Hi,

I appreciate if someone could trigger the jobs for this PR:

https://github.com/apache/beam/pull/10627

*Thanks*

*Rehman Murad Ali*
Software Engineer
Mobile: +92 3452076766
Skype: rehman.muradali


On Thu, Jan 30, 2020 at 10:19 PM Luke Cwik  wrote:

> done
>
> On Thu, Jan 30, 2020 at 12:28 AM Shoaib Zafar <
> shoaib.za...@venturedive.com> wrote:
>
>> Hi Beam Committer,
>>
>> I appreciate if someone could trigger jobs for
>> https://github.com/apache/beam/pull/10712.
>>
>> Thanks!
>>
>> *Shoaib Zafar*
>>
>> Software Engineering Lead
>> Mobile: +92 333 274 6242
>> Skype: live:shoaibzafar_1
>>
>> <http://venturedive.com/>
>>
>>
>> On Thu, Jan 30, 2020 at 9:09 AM Boyuan Zhang  wrote:
>>
>>> Done : )
>>>
>>> On Wed, Jan 29, 2020 at 7:52 PM Tomo Suzuki  wrote:
>>>
>>>> HI Beam committers:
>>>> (Thanks, Luke!)
>>>>
>>>> Can somebody retrigger the following 2 failed checks for
>>>> https://github.com/apache/beam/pull/10714 ?
>>>> Run Java PreCommit
>>>> Run Java_Examples_Dataflow PreCommit
>>>>
>>>> On Wed, Jan 29, 2020 at 4:48 PM Luke Cwik  wrote:
>>>> >
>>>> > done
>>>> >
>>>> > On Wed, Jan 29, 2020 at 11:07 AM Tomo Suzuki 
>>>> wrote:
>>>> >>
>>>> >> Hi Beam committers,
>>>> >>
>>>> >> I appreciate if you can trigger the precommit checks for
>>>> >> https://github.com/apache/beam/pull/10714
>>>> >>
>>>> >> with following 6 additional commands (one command per comment):
>>>> >>
>>>> >> Run Java PostCommit
>>>> >> Run Java HadoopFormatIO Performance Test
>>>> >> Run BigQueryIO Streaming Performance Test Java
>>>> >> Run Dataflow ValidatesRunner
>>>> >> Run Spark ValidatesRunner
>>>> >> Run SQL Postcommit
>>>> >>
>>>> >> Regards,
>>>> >> Tomo
>>>> >>
>>>> >>
>>>>
>>>>
>>>> --
>>>> Regards,
>>>> Tomo
>>>>
>>>


Re: Jenkins jobs not running for my PR 10438

2020-01-29 Thread Rehman Murad Ali
Thanks.


*Rehman Murad Ali*
Software Engineer
Mobile: +92 3452076766
Skype: rehman.muradali


On Wed, Jan 29, 2020 at 5:52 PM Michał Walenia 
wrote:

> it worked, job is triggered
>
> On Wed, Jan 29, 2020 at 1:23 PM Rehman Murad Ali <
> rehman.murad...@venturedive.com> wrote:
>
>> Thanks, Michal. Seems like the job didn't trigger.
>>
>>
>> *Thanks & Regards*
>>
>>
>>
>> *Rehman Murad Ali*
>> Software Engineer
>> Mobile: +92 3452076766
>> Skype: rehman.muradali
>>
>>
>> On Wed, Jan 29, 2020 at 5:10 PM Michał Walenia <
>> michal.wale...@polidea.com> wrote:
>>
>>> Sure, I'll trigger it
>>>
>>> On Wed, Jan 29, 2020 at 12:56 PM Rehman Murad Ali <
>>> rehman.murad...@venturedive.com> wrote:
>>>
>>>> Hello again,
>>>>
>>>> Could anyone re-trigger Java Precommit only for this PR?
>>>>
>>>> Run Java PreCommit
>>>> https://github.com/apache/beam/pull/10627
>>>>
>>>>
>>>> *Thanks & Regards*
>>>>
>>>>
>>>>
>>>> *Rehman Murad Ali*
>>>> Software Engineer
>>>> Mobile: +92 3452076766
>>>> Skype: rehman.muradali
>>>>
>>>>
>>>> On Tue, Jan 28, 2020 at 6:29 PM Ismaël Mejía  wrote:
>>>>
>>>>> done
>>>>>
>>>>> On Tue, Jan 28, 2020 at 12:41 PM Rehman Murad Ali <
>>>>> rehman.murad...@venturedive.com> wrote:
>>>>>
>>>>>> Hi Committer,
>>>>>>
>>>>>> Could anyone run jobs for this PR?
>>>>>>
>>>>>> https://github.com/apache/beam/pull/10627
>>>>>>
>>>>>> *Thanks*
>>>>>>
>>>>>>
>>>>>> *Rehman Murad Ali*
>>>>>> Software Engineer
>>>>>> Mobile: +92 3452076766
>>>>>> Skype: rehman.muradali
>>>>>>
>>>>>>
>>>>>> On Mon, Jan 27, 2020 at 6:21 PM Rehman Murad Ali <
>>>>>> rehman.murad...@venturedive.com> wrote:
>>>>>>
>>>>>>> Thanks, Ismaël.
>>>>>>>
>>>>>>> *Rehman Murad Ali*
>>>>>>> Software Engineer
>>>>>>> Mobile: +92 3452076766
>>>>>>> Skype: rehman.muradali
>>>>>>>
>>>>>>>
>>>>>>> On Mon, Jan 27, 2020 at 6:18 PM Ismaël Mejía 
>>>>>>> wrote:
>>>>>>>
>>>>>>>> done
>>>>>>>>
>>>>>>>> On Mon, Jan 27, 2020 at 2:13 PM Rehman Murad Ali <
>>>>>>>> rehman.murad...@venturedive.com> wrote:
>>>>>>>>
>>>>>>>>> Hi,
>>>>>>>>>
>>>>>>>>> I appreciate if somebody can run jobs for this PR:
>>>>>>>>>
>>>>>>>>> https://github.com/apache/beam/pull/10627
>>>>>>>>>
>>>>>>>>> *Thanks & Regards*
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> *Rehman Murad Ali*
>>>>>>>>> Software Engineer
>>>>>>>>> Mobile: +92 3452076766
>>>>>>>>> Skype: rehman.muradali
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Fri, Jan 24, 2020 at 3:53 AM Rui Wang 
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> Done
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> -Rui
>>>>>>>>>>
>>>>>>>>>> On Thu, Jan 23, 2020 at 2:45 PM Tomo Suzuki 
>>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hi Beam Comitters,
>>>>>>>>>>>
>>>>>>>>>>> Can somebody trigger 2 failed checks below for
>>>>>>>>>>> https://github.com/apache/beam/pull/10674 ?
>>>>>>>>>>> Run Java PreCommit
>>>>>>>>>>> Run JavaPortabilityApi PreCommit
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> On Thu, Jan 23, 2020 at 14:32 Tomo Suzuki 
>>>>>>>>>>> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Hi Rui,
>>>>>>>>>>>> (Thank you for quick response)
>>>>>>>>>>>>
>>>>>>>>>>>> Would you run one command per one comment? I don't think Jenkins
>>>>>>>>>>>> recognizes multiple at once.
>>>>>>>>>>>>
>>>>>>>>>>>> On Thu, Jan 23, 2020 at 2:25 PM Rui Wang 
>>>>>>>>>>>> wrote:
>>>>>>>>>>>> >
>>>>>>>>>>>> > Done
>>>>>>>>>>>> >
>>>>>>>>>>>> > On Thu, Jan 23, 2020 at 11:20 AM Tomo Suzuki <
>>>>>>>>>>>> suzt...@google.com> wrote:
>>>>>>>>>>>> >>
>>>>>>>>>>>> >> Hi Beam Committers,
>>>>>>>>>>>> >>
>>>>>>>>>>>> >> I appreciate if you can run precommit checks for
>>>>>>>>>>>> >> https://github.com/apache/beam/pull/10674
>>>>>>>>>>>> >> plus the following 6 extra commands:
>>>>>>>>>>>> >>
>>>>>>>>>>>> >> Run Java PostCommit
>>>>>>>>>>>> >> Run Java HadoopFormatIO Performance Test
>>>>>>>>>>>> >> Run BigQueryIO Streaming Performance Test Java
>>>>>>>>>>>> >> Run Dataflow ValidatesRunner
>>>>>>>>>>>> >> Run Spark ValidatesRunner
>>>>>>>>>>>> >> Run SQL Postcommit
>>>>>>>>>>>> >>
>>>>>>>>>>>> >> Regards,
>>>>>>>>>>>> >> Tomo
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>> Regards,
>>>>>>>>>>>> Tomo
>>>>>>>>>>>>
>>>>>>>>>>>
>>>
>>> --
>>>
>>> Michał Walenia
>>> Polidea <https://www.polidea.com/> | Software Engineer
>>>
>>> M: +48 791 432 002 <+48791432002>
>>> E: michal.wale...@polidea.com
>>>
>>> Unique Tech
>>> Check out our projects! <https://www.polidea.com/our-work>
>>>
>>
>
> --
>
> Michał Walenia
> Polidea <https://www.polidea.com/> | Software Engineer
>
> M: +48 791 432 002 <+48791432002>
> E: michal.wale...@polidea.com
>
> Unique Tech
> Check out our projects! <https://www.polidea.com/our-work>
>


Re: Jenkins jobs not running for my PR 10438

2020-01-29 Thread Rehman Murad Ali
Thanks, Michal. Seems like the job didn't trigger.


*Thanks & Regards*



*Rehman Murad Ali*
Software Engineer
Mobile: +92 3452076766
Skype: rehman.muradali


On Wed, Jan 29, 2020 at 5:10 PM Michał Walenia 
wrote:

> Sure, I'll trigger it
>
> On Wed, Jan 29, 2020 at 12:56 PM Rehman Murad Ali <
> rehman.murad...@venturedive.com> wrote:
>
>> Hello again,
>>
>> Could anyone re-trigger Java Precommit only for this PR?
>>
>> Run Java PreCommit
>> https://github.com/apache/beam/pull/10627
>>
>>
>> *Thanks & Regards*
>>
>>
>>
>> *Rehman Murad Ali*
>> Software Engineer
>> Mobile: +92 3452076766
>> Skype: rehman.muradali
>>
>>
>> On Tue, Jan 28, 2020 at 6:29 PM Ismaël Mejía  wrote:
>>
>>> done
>>>
>>> On Tue, Jan 28, 2020 at 12:41 PM Rehman Murad Ali <
>>> rehman.murad...@venturedive.com> wrote:
>>>
>>>> Hi Committer,
>>>>
>>>> Could anyone run jobs for this PR?
>>>>
>>>> https://github.com/apache/beam/pull/10627
>>>>
>>>> *Thanks*
>>>>
>>>>
>>>> *Rehman Murad Ali*
>>>> Software Engineer
>>>> Mobile: +92 3452076766
>>>> Skype: rehman.muradali
>>>>
>>>>
>>>> On Mon, Jan 27, 2020 at 6:21 PM Rehman Murad Ali <
>>>> rehman.murad...@venturedive.com> wrote:
>>>>
>>>>> Thanks, Ismaël.
>>>>>
>>>>> *Rehman Murad Ali*
>>>>> Software Engineer
>>>>> Mobile: +92 3452076766
>>>>> Skype: rehman.muradali
>>>>>
>>>>>
>>>>> On Mon, Jan 27, 2020 at 6:18 PM Ismaël Mejía 
>>>>> wrote:
>>>>>
>>>>>> done
>>>>>>
>>>>>> On Mon, Jan 27, 2020 at 2:13 PM Rehman Murad Ali <
>>>>>> rehman.murad...@venturedive.com> wrote:
>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> I appreciate if somebody can run jobs for this PR:
>>>>>>>
>>>>>>> https://github.com/apache/beam/pull/10627
>>>>>>>
>>>>>>> *Thanks & Regards*
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> *Rehman Murad Ali*
>>>>>>> Software Engineer
>>>>>>> Mobile: +92 3452076766
>>>>>>> Skype: rehman.muradali
>>>>>>>
>>>>>>>
>>>>>>> On Fri, Jan 24, 2020 at 3:53 AM Rui Wang  wrote:
>>>>>>>
>>>>>>>> Done
>>>>>>>>
>>>>>>>>
>>>>>>>> -Rui
>>>>>>>>
>>>>>>>> On Thu, Jan 23, 2020 at 2:45 PM Tomo Suzuki 
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Hi Beam Comitters,
>>>>>>>>>
>>>>>>>>> Can somebody trigger 2 failed checks below for
>>>>>>>>> https://github.com/apache/beam/pull/10674 ?
>>>>>>>>> Run Java PreCommit
>>>>>>>>> Run JavaPortabilityApi PreCommit
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Thu, Jan 23, 2020 at 14:32 Tomo Suzuki 
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> Hi Rui,
>>>>>>>>>> (Thank you for quick response)
>>>>>>>>>>
>>>>>>>>>> Would you run one command per one comment? I don't think Jenkins
>>>>>>>>>> recognizes multiple at once.
>>>>>>>>>>
>>>>>>>>>> On Thu, Jan 23, 2020 at 2:25 PM Rui Wang 
>>>>>>>>>> wrote:
>>>>>>>>>> >
>>>>>>>>>> > Done
>>>>>>>>>> >
>>>>>>>>>> > On Thu, Jan 23, 2020 at 11:20 AM Tomo Suzuki <
>>>>>>>>>> suzt...@google.com> wrote:
>>>>>>>>>> >>
>>>>>>>>>> >> Hi Beam Committers,
>>>>>>>>>> >>
>>>>>>>>>> >> I appreciate if you can run precommit checks for
>>>>>>>>>> >> https://github.com/apache/beam/pull/10674
>>>>>>>>>> >> plus the following 6 extra commands:
>>>>>>>>>> >>
>>>>>>>>>> >> Run Java PostCommit
>>>>>>>>>> >> Run Java HadoopFormatIO Performance Test
>>>>>>>>>> >> Run BigQueryIO Streaming Performance Test Java
>>>>>>>>>> >> Run Dataflow ValidatesRunner
>>>>>>>>>> >> Run Spark ValidatesRunner
>>>>>>>>>> >> Run SQL Postcommit
>>>>>>>>>> >>
>>>>>>>>>> >> Regards,
>>>>>>>>>> >> Tomo
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Regards,
>>>>>>>>>> Tomo
>>>>>>>>>>
>>>>>>>>>
>
> --
>
> Michał Walenia
> Polidea <https://www.polidea.com/> | Software Engineer
>
> M: +48 791 432 002 <+48791432002>
> E: michal.wale...@polidea.com
>
> Unique Tech
> Check out our projects! <https://www.polidea.com/our-work>
>


Re: Jenkins jobs not running for my PR 10438

2020-01-29 Thread Rehman Murad Ali
Hello again,

Could anyone re-trigger Java Precommit only for this PR?

Run Java PreCommit
https://github.com/apache/beam/pull/10627


*Thanks & Regards*



*Rehman Murad Ali*
Software Engineer
Mobile: +92 3452076766
Skype: rehman.muradali


On Tue, Jan 28, 2020 at 6:29 PM Ismaël Mejía  wrote:

> done
>
> On Tue, Jan 28, 2020 at 12:41 PM Rehman Murad Ali <
> rehman.murad...@venturedive.com> wrote:
>
>> Hi Committer,
>>
>> Could anyone run jobs for this PR?
>>
>> https://github.com/apache/beam/pull/10627
>>
>> *Thanks*
>>
>>
>> *Rehman Murad Ali*
>> Software Engineer
>> Mobile: +92 3452076766
>> Skype: rehman.muradali
>>
>>
>> On Mon, Jan 27, 2020 at 6:21 PM Rehman Murad Ali <
>> rehman.murad...@venturedive.com> wrote:
>>
>>> Thanks, Ismaël.
>>>
>>> *Rehman Murad Ali*
>>> Software Engineer
>>> Mobile: +92 3452076766
>>> Skype: rehman.muradali
>>>
>>>
>>> On Mon, Jan 27, 2020 at 6:18 PM Ismaël Mejía  wrote:
>>>
>>>> done
>>>>
>>>> On Mon, Jan 27, 2020 at 2:13 PM Rehman Murad Ali <
>>>> rehman.murad...@venturedive.com> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> I appreciate if somebody can run jobs for this PR:
>>>>>
>>>>> https://github.com/apache/beam/pull/10627
>>>>>
>>>>> *Thanks & Regards*
>>>>>
>>>>>
>>>>>
>>>>> *Rehman Murad Ali*
>>>>> Software Engineer
>>>>> Mobile: +92 3452076766
>>>>> Skype: rehman.muradali
>>>>>
>>>>>
>>>>> On Fri, Jan 24, 2020 at 3:53 AM Rui Wang  wrote:
>>>>>
>>>>>> Done
>>>>>>
>>>>>>
>>>>>> -Rui
>>>>>>
>>>>>> On Thu, Jan 23, 2020 at 2:45 PM Tomo Suzuki 
>>>>>> wrote:
>>>>>>
>>>>>>> Hi Beam Comitters,
>>>>>>>
>>>>>>> Can somebody trigger 2 failed checks below for
>>>>>>> https://github.com/apache/beam/pull/10674 ?
>>>>>>> Run Java PreCommit
>>>>>>> Run JavaPortabilityApi PreCommit
>>>>>>>
>>>>>>>
>>>>>>> On Thu, Jan 23, 2020 at 14:32 Tomo Suzuki 
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Hi Rui,
>>>>>>>> (Thank you for quick response)
>>>>>>>>
>>>>>>>> Would you run one command per one comment? I don't think Jenkins
>>>>>>>> recognizes multiple at once.
>>>>>>>>
>>>>>>>> On Thu, Jan 23, 2020 at 2:25 PM Rui Wang  wrote:
>>>>>>>> >
>>>>>>>> > Done
>>>>>>>> >
>>>>>>>> > On Thu, Jan 23, 2020 at 11:20 AM Tomo Suzuki 
>>>>>>>> wrote:
>>>>>>>> >>
>>>>>>>> >> Hi Beam Committers,
>>>>>>>> >>
>>>>>>>> >> I appreciate if you can run precommit checks for
>>>>>>>> >> https://github.com/apache/beam/pull/10674
>>>>>>>> >> plus the following 6 extra commands:
>>>>>>>> >>
>>>>>>>> >> Run Java PostCommit
>>>>>>>> >> Run Java HadoopFormatIO Performance Test
>>>>>>>> >> Run BigQueryIO Streaming Performance Test Java
>>>>>>>> >> Run Dataflow ValidatesRunner
>>>>>>>> >> Run Spark ValidatesRunner
>>>>>>>> >> Run SQL Postcommit
>>>>>>>> >>
>>>>>>>> >> Regards,
>>>>>>>> >> Tomo
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Regards,
>>>>>>>> Tomo
>>>>>>>>
>>>>>>>


Re: Jenkins jobs not running for my PR 10438

2020-01-28 Thread Rehman Murad Ali
Hi Committer,

Could anyone run jobs for this PR?

https://github.com/apache/beam/pull/10627

*Thanks*


*Rehman Murad Ali*
Software Engineer
Mobile: +92 3452076766
Skype: rehman.muradali


On Mon, Jan 27, 2020 at 6:21 PM Rehman Murad Ali <
rehman.murad...@venturedive.com> wrote:

> Thanks, Ismaël.
>
> *Rehman Murad Ali*
> Software Engineer
> Mobile: +92 3452076766
> Skype: rehman.muradali
>
>
> On Mon, Jan 27, 2020 at 6:18 PM Ismaël Mejía  wrote:
>
>> done
>>
>> On Mon, Jan 27, 2020 at 2:13 PM Rehman Murad Ali <
>> rehman.murad...@venturedive.com> wrote:
>>
>>> Hi,
>>>
>>> I appreciate if somebody can run jobs for this PR:
>>>
>>> https://github.com/apache/beam/pull/10627
>>>
>>> *Thanks & Regards*
>>>
>>>
>>>
>>> *Rehman Murad Ali*
>>> Software Engineer
>>> Mobile: +92 3452076766
>>> Skype: rehman.muradali
>>>
>>>
>>> On Fri, Jan 24, 2020 at 3:53 AM Rui Wang  wrote:
>>>
>>>> Done
>>>>
>>>>
>>>> -Rui
>>>>
>>>> On Thu, Jan 23, 2020 at 2:45 PM Tomo Suzuki  wrote:
>>>>
>>>>> Hi Beam Comitters,
>>>>>
>>>>> Can somebody trigger 2 failed checks below for
>>>>> https://github.com/apache/beam/pull/10674 ?
>>>>> Run Java PreCommit
>>>>> Run JavaPortabilityApi PreCommit
>>>>>
>>>>>
>>>>> On Thu, Jan 23, 2020 at 14:32 Tomo Suzuki  wrote:
>>>>>
>>>>>> Hi Rui,
>>>>>> (Thank you for quick response)
>>>>>>
>>>>>> Would you run one command per one comment? I don't think Jenkins
>>>>>> recognizes multiple at once.
>>>>>>
>>>>>> On Thu, Jan 23, 2020 at 2:25 PM Rui Wang  wrote:
>>>>>> >
>>>>>> > Done
>>>>>> >
>>>>>> > On Thu, Jan 23, 2020 at 11:20 AM Tomo Suzuki 
>>>>>> wrote:
>>>>>> >>
>>>>>> >> Hi Beam Committers,
>>>>>> >>
>>>>>> >> I appreciate if you can run precommit checks for
>>>>>> >> https://github.com/apache/beam/pull/10674
>>>>>> >> plus the following 6 extra commands:
>>>>>> >>
>>>>>> >> Run Java PostCommit
>>>>>> >> Run Java HadoopFormatIO Performance Test
>>>>>> >> Run BigQueryIO Streaming Performance Test Java
>>>>>> >> Run Dataflow ValidatesRunner
>>>>>> >> Run Spark ValidatesRunner
>>>>>> >> Run SQL Postcommit
>>>>>> >>
>>>>>> >> Regards,
>>>>>> >> Tomo
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Regards,
>>>>>> Tomo
>>>>>>
>>>>>


Re: Jenkins jobs not running for my PR 10438

2020-01-27 Thread Rehman Murad Ali
Thanks, Ismaël.

*Rehman Murad Ali*
Software Engineer
Mobile: +92 3452076766
Skype: rehman.muradali


On Mon, Jan 27, 2020 at 6:18 PM Ismaël Mejía  wrote:

> done
>
> On Mon, Jan 27, 2020 at 2:13 PM Rehman Murad Ali <
> rehman.murad...@venturedive.com> wrote:
>
>> Hi,
>>
>> I appreciate if somebody can run jobs for this PR:
>>
>> https://github.com/apache/beam/pull/10627
>>
>> *Thanks & Regards*
>>
>>
>>
>> *Rehman Murad Ali*
>> Software Engineer
>> Mobile: +92 3452076766
>> Skype: rehman.muradali
>>
>>
>> On Fri, Jan 24, 2020 at 3:53 AM Rui Wang  wrote:
>>
>>> Done
>>>
>>>
>>> -Rui
>>>
>>> On Thu, Jan 23, 2020 at 2:45 PM Tomo Suzuki  wrote:
>>>
>>>> Hi Beam Comitters,
>>>>
>>>> Can somebody trigger 2 failed checks below for
>>>> https://github.com/apache/beam/pull/10674 ?
>>>> Run Java PreCommit
>>>> Run JavaPortabilityApi PreCommit
>>>>
>>>>
>>>> On Thu, Jan 23, 2020 at 14:32 Tomo Suzuki  wrote:
>>>>
>>>>> Hi Rui,
>>>>> (Thank you for quick response)
>>>>>
>>>>> Would you run one command per one comment? I don't think Jenkins
>>>>> recognizes multiple at once.
>>>>>
>>>>> On Thu, Jan 23, 2020 at 2:25 PM Rui Wang  wrote:
>>>>> >
>>>>> > Done
>>>>> >
>>>>> > On Thu, Jan 23, 2020 at 11:20 AM Tomo Suzuki 
>>>>> wrote:
>>>>> >>
>>>>> >> Hi Beam Committers,
>>>>> >>
>>>>> >> I appreciate if you can run precommit checks for
>>>>> >> https://github.com/apache/beam/pull/10674
>>>>> >> plus the following 6 extra commands:
>>>>> >>
>>>>> >> Run Java PostCommit
>>>>> >> Run Java HadoopFormatIO Performance Test
>>>>> >> Run BigQueryIO Streaming Performance Test Java
>>>>> >> Run Dataflow ValidatesRunner
>>>>> >> Run Spark ValidatesRunner
>>>>> >> Run SQL Postcommit
>>>>> >>
>>>>> >> Regards,
>>>>> >> Tomo
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Regards,
>>>>> Tomo
>>>>>
>>>>


Re: Jenkins jobs not running for my PR 10438

2020-01-27 Thread Rehman Murad Ali
Hi,

I appreciate if somebody can run jobs for this PR:

https://github.com/apache/beam/pull/10627

*Thanks & Regards*



*Rehman Murad Ali*
Software Engineer
Mobile: +92 3452076766
Skype: rehman.muradali


On Fri, Jan 24, 2020 at 3:53 AM Rui Wang  wrote:

> Done
>
>
> -Rui
>
> On Thu, Jan 23, 2020 at 2:45 PM Tomo Suzuki  wrote:
>
>> Hi Beam Comitters,
>>
>> Can somebody trigger 2 failed checks below for
>> https://github.com/apache/beam/pull/10674 ?
>> Run Java PreCommit
>> Run JavaPortabilityApi PreCommit
>>
>>
>> On Thu, Jan 23, 2020 at 14:32 Tomo Suzuki  wrote:
>>
>>> Hi Rui,
>>> (Thank you for quick response)
>>>
>>> Would you run one command per one comment? I don't think Jenkins
>>> recognizes multiple at once.
>>>
>>> On Thu, Jan 23, 2020 at 2:25 PM Rui Wang  wrote:
>>> >
>>> > Done
>>> >
>>> > On Thu, Jan 23, 2020 at 11:20 AM Tomo Suzuki 
>>> wrote:
>>> >>
>>> >> Hi Beam Committers,
>>> >>
>>> >> I appreciate if you can run precommit checks for
>>> >> https://github.com/apache/beam/pull/10674
>>> >> plus the following 6 extra commands:
>>> >>
>>> >> Run Java PostCommit
>>> >> Run Java HadoopFormatIO Performance Test
>>> >> Run BigQueryIO Streaming Performance Test Java
>>> >> Run Dataflow ValidatesRunner
>>> >> Run Spark ValidatesRunner
>>> >> Run SQL Postcommit
>>> >>
>>> >> Regards,
>>> >> Tomo
>>>
>>>
>>>
>>> --
>>> Regards,
>>> Tomo
>>>
>>


Re: Dynamic timers now supported!

2020-01-23 Thread Rehman Murad Ali
Thank you Reuven for the guidance throughout the development process. I am
delighted to contribute my two cents to the Beam project.

Looking forward to more active contributions.


*Thanks & Regards*



*Rehman Murad Ali*
Software Engineer
Mobile: +92 3452076766
Skype: rehman.muradali


On Thu, Jan 23, 2020 at 11:09 PM Reuven Lax  wrote:

> Thanks to a lot of hard work by Rehman, Beam now supports dynamic timers.
> As a reminder, this was discussed on the dev list some time back.
>
> As background, previously one had to statically declare all timers in your
> code. So if you wanted to have two timers, you needed to create two timer
> variables and two callbacks - one for each timer. A number of users kept
> hitting stumbling blocks where they needed a dynamic set of timers (often
> based on the element), which was not supported in Beam. The workarounds
> were quite ugly and complicated.
>
> The new support allows declaring a TimerMap, which is a map of timers.
> Each TimerMap is scoped by a family name, so you can create multiple
> TimerMaps each with its own callback. The use looks as follows:
>
> class MyDoFn extends DoFn<...> {
>@TimerFamily("timers")
>private final TimerSpec timerMap =
> TimerSpecs.timerMap(TimeDomain.EVENT_TIME);
>
>@ProcessElement
> public void process(@TimerFamily("timers") TimerMap timers, @Element
> Type e) {
>timers.set("mainTimer", timestamp);
>timers.set("actionType" + e.getActionType(), timestamp);
>}
>
>   @OnTimerFamily .
>   public void onTimer(@TimerId String timerId) {
>  System.out.println("Timer fired. id: " + timerId);
>   }
> }
>
> This currently works for the Flink and the Dataflow runners.
>
> Thank you Rehman for getting this done! Beam users will find it very
> valuable.
>
> Reuven
>


Re: Jenkins jobs not running for my PR 10438

2020-01-23 Thread Rehman Murad Ali
Hi Committer,

I appreciate if you could trigger jobs for
https://github.com/apache/beam/pull/10627




*Thanks & Regards*



*Rehman Murad Ali*
Software Engineer
Mobile: +92 3452076766
Skype: rehman.muradali


On Wed, Jan 22, 2020 at 5:18 AM Kirill Kozlov 
wrote:

> Thank you Rui and Ankur!
>
> On Tue, Jan 21, 2020 at 4:14 PM Ankur Goenka  wrote:
>
>> Done
>>
>> On Tue, Jan 21, 2020 at 4:03 PM Kirill Kozlov 
>> wrote:
>>
>>> Forgot to paste a link to a PR:
>>> https://github.com/apache/beam/pull/10649
>>>
>>> On Tue, Jan 21, 2020 at 3:47 PM Rui Wang  wrote:
>>>
>>>> Done but I am not seeing tests are triggered by those two commands.
>>>>
>>>> On Tue, Jan 21, 2020 at 3:42 PM Kirill Kozlov 
>>>> wrote:
>>>>
>>>>> Hello again!
>>>>>
>>>>> Could someone trigger tests on this PR please?
>>>>> *Run SQL postcommit*
>>>>> *Run JavaBeamZetaSQL PreCommit*
>>>>>
>>>>> On Mon, Jan 20, 2020 at 2:38 PM Kirill Kozlov 
>>>>> wrote:
>>>>>
>>>>>> Thank you, Ismaël!
>>>>>>
>>>>>> On Mon, Jan 20, 2020 at 2:14 PM Ismaël Mejía 
>>>>>> wrote:
>>>>>>
>>>>>>> done
>>>>>>>
>>>>>>> On Mon, Jan 20, 2020 at 9:27 PM Kirill Kozlov <
>>>>>>> kirillkoz...@google.com> wrote:
>>>>>>>
>>>>>>>> Hello Beam community,
>>>>>>>>
>>>>>>>> Can a committer re-run tests for this PR please?
>>>>>>>> https://github.com/apache/beam/pull/10440
>>>>>>>>
>>>>>>>> Thank you!
>>>>>>>>
>>>>>>>> On Fri, Jan 17, 2020 at 4:44 PM Tomo Suzuki 
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Thank you, Ahmet.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Fri, Jan 17, 2020 at 7:22 PM Tomo Suzuki 
>>>>>>>>> wrote:
>>>>>>>>> >
>>>>>>>>> > Hi Beam committer,
>>>>>>>>> >
>>>>>>>>> > I appreciate if somebody can trigger the following checks for
>>>>>>>>> https://github.com/apache/beam/pull/10631
>>>>>>>>> >
>>>>>>>>> > Run JavaPortabilityApi PreCommit
>>>>>>>>> > Run Java PostCommit
>>>>>>>>> > Run Java HadoopFormatIO Performance Test
>>>>>>>>> > Run BigQueryIO Streaming Performance Test Java
>>>>>>>>> > Run Dataflow ValidatesRunner
>>>>>>>>> > Run Spark ValidatesRunner
>>>>>>>>> > Run SQL Postcommit
>>>>>>>>> >
>>>>>>>>> > Regards,
>>>>>>>>> > Tomo
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Regards,
>>>>>>>>> Tomo
>>>>>>>>>
>>>>>>>>


Re: Jenkins jobs not running for my PR 10438

2020-01-16 Thread Rehman Murad Ali
Thank Ismaël. Java Precommit failed due to timed out. Can you rerun it
please?

https://github.com/apache/beam/pull/10316



*Thanks & Regards*



*Rehman Murad Ali*
Software Engineer
Mobile: +92 3452076766
Skype: rehman.muradali


On Thu, Jan 16, 2020 at 7:17 PM Ismaël Mejía  wrote:

> done
>
> On Thu, Jan 16, 2020 at 8:08 AM Rehman Murad Ali <
> rehman.murad...@venturedive.com> wrote:
>
>> Hi,
>>
>> I appreciate if someone can run the mentioned job for this PR.
>> https://github.com/apache/beam/pull/10316
>>
>> Run Java Flink PortableValidatesRunner Streaming
>>
>>
>> *Thanks & Regards*
>>
>>
>>
>> *Rehman Murad Ali*
>> Software Engineer
>> Mobile: +92 3452076766
>> Skype: rehman.muradali
>>
>>
>> On Thu, Jan 16, 2020 at 3:44 AM Andrew Pilloud 
>> wrote:
>>
>>> Done.
>>>
>>> Infra shut our .adf.yaml file off for being too large. Updates are here:
>>> https://issues.apache.org/jira/browse/INFRA-19670
>>>
>>> On Wed, Jan 15, 2020 at 2:40 PM Tomo Suzuki  wrote:
>>>
>>>> Hi Beam committers,
>>>>
>>>> Can somebody trigger the precommit cheeks for my new PR
>>>> https://github.com/apache/beam/pull/10603 ?
>>>>
>>>> This PR still does not trigger the checks. I confirmed that my account
>>>> is in the .adf.yaml.
>>>>
>>>> On Tue, Jan 14, 2020 at 9:48 PM Ahmet Altay  wrote:
>>>> >
>>>> > Done.
>>>> >
>>>> > +Kenneth Knowles, any updates from INFRA on this?
>>>> >
>>>> > On Tue, Jan 14, 2020 at 6:43 PM Tomo Suzuki 
>>>> wrote:
>>>> >>
>>>> >> It hit Dataflow quota error again. Can somebody run
>>>> >> Run Dataflow ValidatesRunner
>>>> >> for https://github.com/apache/beam/pull/10554 ?
>>>> >>
>>>> >> On Tue, Jan 14, 2020 at 12:14 PM Tomo Suzuki 
>>>> wrote:
>>>> >> >
>>>> >> > Valentyn, thank you.
>>>> >> >
>>>> >> > On Tue, Jan 14, 2020 at 12:05 PM Valentyn Tymofieiev
>>>> >> >  wrote:
>>>> >> > >
>>>> >> > > Done. If tests still don't trigger, you could try to make a push
>>>> to the branch to reset the test status.
>>>> >> > >
>>>> >> > > On Tue, Jan 14, 2020 at 8:38 AM Tomo Suzuki 
>>>> wrote:
>>>> >> > >>
>>>> >> > >> Hi Beam developers,
>>>> >> > >>
>>>> >> > >> Can somebody run the following to
>>>> https://github.com/apache/beam/pull/10554 ?
>>>> >> > >> Run Dataflow ValidatesRunner
>>>> >> > >> Run Java PreCommit
>>>> >> > >>
>>>> >> > >> On Mon, Jan 13, 2020 at 2:35 PM Tomo Suzuki 
>>>> wrote:
>>>> >> > >> >
>>>> >> > >> > Thank you, Mark and Ismaël.
>>>> >> > >> >
>>>> >> > >> > On Mon, Jan 13, 2020 at 2:34 PM Mark Liu 
>>>> wrote:
>>>> >> > >> > >
>>>> >> > >> > > done
>>>> >> > >> > >
>>>> >> > >> > > On Mon, Jan 13, 2020 at 8:03 AM Tomo Suzuki <
>>>> suzt...@google.com> wrote:
>>>> >> > >> > >>
>>>> >> > >> > >> Thanks Yifan (but Java Precommit is still missing).
>>>> >> > >> > >> Can somebody run "Run Java PreCommit" on
>>>> >> > >> > >> https://github.com/apache/beam/pull/10554?
>>>> >> > >> > >>
>>>> >> > >> > >>
>>>> >> > >> > >> On Mon, Jan 13, 2020 at 2:59 AM Yifan Zou <
>>>> yifan...@google.com> wrote:
>>>> >> > >> > >> >
>>>> >> > >> > >> > done.
>>>> >> > >> > >> >
>>>> >> > >> > >> > On Sun, Jan 12, 2020 at 6:27 PM Tomo Suzuki <
>>>> suzt...@google.com> wrote:
>>>> >> > >> > >> >>

Re: Jenkins jobs not running for my PR 10438

2020-01-15 Thread Rehman Murad Ali
Hi,

I appreciate if someone can run the mentioned job for this PR.
https://github.com/apache/beam/pull/10316

Run Java Flink PortableValidatesRunner Streaming


*Thanks & Regards*



*Rehman Murad Ali*
Software Engineer
Mobile: +92 3452076766
Skype: rehman.muradali


On Thu, Jan 16, 2020 at 3:44 AM Andrew Pilloud  wrote:

> Done.
>
> Infra shut our .adf.yaml file off for being too large. Updates are here:
> https://issues.apache.org/jira/browse/INFRA-19670
>
> On Wed, Jan 15, 2020 at 2:40 PM Tomo Suzuki  wrote:
>
>> Hi Beam committers,
>>
>> Can somebody trigger the precommit cheeks for my new PR
>> https://github.com/apache/beam/pull/10603 ?
>>
>> This PR still does not trigger the checks. I confirmed that my account
>> is in the .adf.yaml.
>>
>> On Tue, Jan 14, 2020 at 9:48 PM Ahmet Altay  wrote:
>> >
>> > Done.
>> >
>> > +Kenneth Knowles, any updates from INFRA on this?
>> >
>> > On Tue, Jan 14, 2020 at 6:43 PM Tomo Suzuki  wrote:
>> >>
>> >> It hit Dataflow quota error again. Can somebody run
>> >> Run Dataflow ValidatesRunner
>> >> for https://github.com/apache/beam/pull/10554 ?
>> >>
>> >> On Tue, Jan 14, 2020 at 12:14 PM Tomo Suzuki 
>> wrote:
>> >> >
>> >> > Valentyn, thank you.
>> >> >
>> >> > On Tue, Jan 14, 2020 at 12:05 PM Valentyn Tymofieiev
>> >> >  wrote:
>> >> > >
>> >> > > Done. If tests still don't trigger, you could try to make a push
>> to the branch to reset the test status.
>> >> > >
>> >> > > On Tue, Jan 14, 2020 at 8:38 AM Tomo Suzuki 
>> wrote:
>> >> > >>
>> >> > >> Hi Beam developers,
>> >> > >>
>> >> > >> Can somebody run the following to
>> https://github.com/apache/beam/pull/10554 ?
>> >> > >> Run Dataflow ValidatesRunner
>> >> > >> Run Java PreCommit
>> >> > >>
>> >> > >> On Mon, Jan 13, 2020 at 2:35 PM Tomo Suzuki 
>> wrote:
>> >> > >> >
>> >> > >> > Thank you, Mark and Ismaël.
>> >> > >> >
>> >> > >> > On Mon, Jan 13, 2020 at 2:34 PM Mark Liu 
>> wrote:
>> >> > >> > >
>> >> > >> > > done
>> >> > >> > >
>> >> > >> > > On Mon, Jan 13, 2020 at 8:03 AM Tomo Suzuki <
>> suzt...@google.com> wrote:
>> >> > >> > >>
>> >> > >> > >> Thanks Yifan (but Java Precommit is still missing).
>> >> > >> > >> Can somebody run "Run Java PreCommit" on
>> >> > >> > >> https://github.com/apache/beam/pull/10554?
>> >> > >> > >>
>> >> > >> > >>
>> >> > >> > >> On Mon, Jan 13, 2020 at 2:59 AM Yifan Zou <
>> yifan...@google.com> wrote:
>> >> > >> > >> >
>> >> > >> > >> > done.
>> >> > >> > >> >
>> >> > >> > >> > On Sun, Jan 12, 2020 at 6:27 PM Tomo Suzuki <
>> suzt...@google.com> wrote:
>> >> > >> > >> >>
>> >> > >> > >> >> Hi Beam committers,
>> >> > >> > >> >>
>> >> > >> > >> >> Four Jenkins jobs did not report back for this PR
>> >> > >> > >> >> https://github.com/apache/beam/pull/10554 .
>> >> > >> > >> >> Can somebody trigger them?
>> >> > >> > >> >>
>> >> > >> > >> >> On Fri, Jan 10, 2020 at 4:51 PM Andrew Pilloud <
>> apill...@google.com> wrote:
>> >> > >> > >> >> >
>> >> > >> > >> >> > Done.
>> >> > >> > >> >> >
>> >> > >> > >> >> > On Fri, Jan 10, 2020 at 12:59 PM Tomo Suzuki <
>> suzt...@google.com> wrote:
>> >> > >> > >> >> >>
>> >> > >> > >> >> >> Hi Bean developers,
>> >> > >> > >> >> >>
>> >> > >> > >> >> >> I appreciate a committer can trigger precommit build
>> for
>> >> > >> > >> >> >> https://github.com/apache/beam/pull/10554.
>> >> > >> > >> >> >>
>> >> > >> > >> >> >> In addition to normal precommit checks, I want the
>> followings:
>> >> > >> > >> >> >> Run Java PostCommit
>> >> > >> > >> >> >> Run Java HadoopFormatIO Performance Test
>> >> > >> > >> >> >> Run BigQueryIO Streaming Performance Test Java
>> >> > >> > >> >> >> Run Dataflow ValidatesRunner
>> >> > >> > >> >> >> Run Spark ValidatesRunner
>> >> > >> > >> >> >> Run SQL Postcommit
>> >> > >> > >> >> >>
>> >> > >> > >> >> >> Regards,
>> >> > >> > >> >> >> Tomo
>> >> > >> > >> >>
>> >> > >> > >> >>
>> >> > >> > >> >>
>> >> > >> > >> >> --
>> >> > >> > >> >> Regards,
>> >> > >> > >> >> Tomo
>> >> > >> > >>
>> >> > >> > >>
>> >> > >> > >>
>> >> > >> > >> --
>> >> > >> > >> Regards,
>> >> > >> > >> Tomo
>> >> > >> >
>> >> > >> >
>> >> > >> >
>> >> > >> > --
>> >> > >> > Regards,
>> >> > >> > Tomo
>> >> > >>
>> >> > >>
>> >> > >>
>> >> > >> --
>> >> > >> Regards,
>> >> > >> Tomo
>> >> >
>> >> >
>> >> >
>> >> > --
>> >> > Regards,
>> >> > Tomo
>> >>
>> >>
>> >>
>> >> --
>> >> Regards,
>> >> Tomo
>>
>>
>>
>> --
>> Regards,
>> Tomo
>>
>


Re: Jenkins jobs not running for my PR 10438

2020-01-08 Thread Rehman Murad Ali
Thank you Ismaël and Alexey.




*Thanks & Regards*



*Rehman Murad Ali*
Software Engineer
Mobile: +92 3452076766
Skype: rehman.muradali


On Wed, Jan 8, 2020 at 6:03 PM Ismaël Mejía  wrote:

> It worked for me, it is running now, not sure if it was me or just a
> delayed queue I noticed in other PRs that the jobs take longer to start
> than before.
>
> On Wed, Jan 8, 2020 at 1:51 PM Alexey Romanenko 
> wrote:
>
>> I tried to retest it but seems that even for committers it doesn’t always
>> work...
>>
>>
>> On 8 Jan 2020, at 12:48, Rehman Murad Ali <
>> rehman.murad...@venturedive.com> wrote:
>>
>> Hi Committer,
>>
>> I appreciate if you could trigger jobs for
>> https://github.com/apache/beam/pull/9677
>>
>>
>> *Thanks & Regards*
>>
>>
>>
>> *Rehman Murad Ali*
>> Software Engineer
>> Mobile: +92 3452076766
>> Skype: rehman.muradali
>>
>>
>> On Wed, Jan 8, 2020 at 2:27 PM Michał Walenia 
>> wrote:
>>
>>> Hi, I also think that a whitelist would be a good solution, in terms of
>>> security and trust it would be between no restrictions and committers only
>>> being able to run jobs.
>>> How would we proceed with this? Does it need to be voted on?
>>>
>>> On Wed, Jan 8, 2020 at 12:50 AM Mark Liu  wrote:
>>>
>>>> Thank you Kenn. I'm also asking white-list for Beam jobs in INFRA-19670
>>>> <https://issues.apache.org/jira/browse/INFRA-19670> if possible.
>>>>
>>>> Here are my experiences of job trigger in
>>>> https://github.com/apache/beam/pull/10051 (created by non-committer):
>>>> - committer's trigger ("Run XVR_Flink PostCommit") works, and job was
>>>> waiting in the queue immediately (job link
>>>> <https://builds.apache.org/view/A-D/view/Beam/view/All/job/beam_PostCommit_XVR_Flink_PR/53/>
>>>> ).
>>>> - there is no triggered job showing in the bottom of the PR page. Guess
>>>> something could go wrong in the Github plugin.
>>>> - sometimes manual trigger may miss jobs which could be hard to
>>>> discover.
>>>>
>>>> Mark
>>>>
>>>> On Tue, Jan 7, 2020 at 3:08 PM Robert Bradshaw 
>>>> wrote:
>>>>
>>>>> I agree. If this can't be done, perhaps we could have a basic suite of
>>>>> smoke tests (at least) run on TravisCI.
>>>>>
>>>>> On Tue, Jan 7, 2020 at 2:53 PM Kenneth Knowles 
>>>>> wrote:
>>>>>
>>>>>> This new policy seems pretty unwelcoming. I would like to work with
>>>>>> INFRA to see if we can set up a sufficient sandbox that the security
>>>>>> concern goes away. Clearly this has been solved many times.
>>>>>>
>>>>>> Kenn
>>>>>>
>>>>>> On Tue, Jan 7, 2020 at 2:45 PM Valentyn Tymofieiev <
>>>>>> valen...@google.com> wrote:
>>>>>>
>>>>>>> jiangkai@ - done.
>>>>>>>
>>>>>>> I've been reviewing a few PRs, e.g. [1], from  contributors who are
>>>>>>> not committers. My experience is as follows:
>>>>>>> - tests are not triggered by default, but  trigger as soon as a
>>>>>>> committer leaves any comment on the PR . This happens only once, unless 
>>>>>>> new
>>>>>>> commits are added to the PR.
>>>>>>> - sometimes committer's comment trigger only a subset of test
>>>>>>> suites, which creates an illusion that all test suites are passing while
>>>>>>> some were not triggered.
>>>>>>> - Some tests suites never trigger within a reasonable timeframe
>>>>>>> after "run suite X" command. For example, Run PythonLint precommit 
>>>>>>> didn't
>>>>>>> trigger the suite after two requests, but did trigger it an hour later
>>>>>>> after yet another "Run PythonLint precommit".
>>>>>>>
>>>>>>> cc: @Mark Liu  @Alan Myrvold
>>>>>>> 
>>>>>>>
>>>>>>> [1] https://github.com/apache/beam/pull/10504
>>>>>>>
>>>>>>>
>>>>>>> On Tue, Jan 7, 2020 at 1:18 PM Kai Jiang  wrote:
>>>>>>>
>>>>>>>> Hi Beam Committer,
>&

Re: Jenkins jobs not running for my PR 10438

2020-01-08 Thread Rehman Murad Ali
Hi Committer,

I appreciate if you could trigger jobs for
https://github.com/apache/beam/pull/9677


*Thanks & Regards*



*Rehman Murad Ali*
Software Engineer
Mobile: +92 3452076766
Skype: rehman.muradali


On Wed, Jan 8, 2020 at 2:27 PM Michał Walenia 
wrote:

> Hi, I also think that a whitelist would be a good solution, in terms of
> security and trust it would be between no restrictions and committers only
> being able to run jobs.
> How would we proceed with this? Does it need to be voted on?
>
> On Wed, Jan 8, 2020 at 12:50 AM Mark Liu  wrote:
>
>> Thank you Kenn. I'm also asking white-list for Beam jobs in INFRA-19670
>> <https://issues.apache.org/jira/browse/INFRA-19670> if possible.
>>
>> Here are my experiences of job trigger in
>> https://github.com/apache/beam/pull/10051 (created by non-committer):
>> - committer's trigger ("Run XVR_Flink PostCommit") works, and job was
>> waiting in the queue immediately (job link
>> <https://builds.apache.org/view/A-D/view/Beam/view/All/job/beam_PostCommit_XVR_Flink_PR/53/>
>> ).
>> - there is no triggered job showing in the bottom of the PR page. Guess
>> something could go wrong in the Github plugin.
>> - sometimes manual trigger may miss jobs which could be hard to discover.
>>
>> Mark
>>
>> On Tue, Jan 7, 2020 at 3:08 PM Robert Bradshaw 
>> wrote:
>>
>>> I agree. If this can't be done, perhaps we could have a basic suite of
>>> smoke tests (at least) run on TravisCI.
>>>
>>> On Tue, Jan 7, 2020 at 2:53 PM Kenneth Knowles  wrote:
>>>
>>>> This new policy seems pretty unwelcoming. I would like to work with
>>>> INFRA to see if we can set up a sufficient sandbox that the security
>>>> concern goes away. Clearly this has been solved many times.
>>>>
>>>> Kenn
>>>>
>>>> On Tue, Jan 7, 2020 at 2:45 PM Valentyn Tymofieiev 
>>>> wrote:
>>>>
>>>>> jiangkai@ - done.
>>>>>
>>>>> I've been reviewing a few PRs, e.g. [1], from  contributors who are
>>>>> not committers. My experience is as follows:
>>>>> - tests are not triggered by default, but  trigger as soon as a
>>>>> committer leaves any comment on the PR . This happens only once, unless 
>>>>> new
>>>>> commits are added to the PR.
>>>>> - sometimes committer's comment trigger only a subset of test suites,
>>>>> which creates an illusion that all test suites are passing while some were
>>>>> not triggered.
>>>>> - Some tests suites never trigger within a reasonable timeframe after
>>>>> "run suite X" command. For example, Run PythonLint precommit didn't 
>>>>> trigger
>>>>> the suite after two requests, but did trigger it an hour later after yet
>>>>> another "Run PythonLint precommit".
>>>>>
>>>>> cc: @Mark Liu  @Alan Myrvold 
>>>>>
>>>>>
>>>>> [1] https://github.com/apache/beam/pull/10504
>>>>>
>>>>>
>>>>> On Tue, Jan 7, 2020 at 1:18 PM Kai Jiang  wrote:
>>>>>
>>>>>> Hi Beam Committer,
>>>>>>
>>>>>> I appreciate if you could trigger precommit checks for
>>>>>> https://github.com/apache/beam/pull/9903.
>>>>>>
>>>>>> Run Flink ValidatesRunner
>>>>>> Run Flink Runner Nexmark Tests
>>>>>> Run SQL Postcommit
>>>>>>
>>>>>> Best,
>>>>>> Kai
>>>>>>
>>>>>> On Tue, Jan 7, 2020 at 8:17 AM Ismaël Mejía 
>>>>>> wrote:
>>>>>>
>>>>>>> Done
>>>>>>>
>>>>>>> On Tue, Jan 7, 2020 at 5:09 PM Tomo Suzuki 
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Hi Ismaël and Beam committer,
>>>>>>>>
>>>>>>>> I appreciate the help! Would you trigger precommit checks for
>>>>>>>> https://github.com/apache/beam/pull/10508. I also want the
>>>>>>>> following checks.
>>>>>>>>
>>>>>>>> Run Java PostCommit
>>>>>>>> Run Java HadoopFormatIO Performance Test
>>>>>>>> Run BigQueryIO Streaming Performance Test Java
>>>>>>>> Run Dataflow ValidatesRunner
>>>>>

[BEAM-2535] Set required watermarks holds for Flink

2019-12-07 Thread Rehman Murad Ali
Hi Community,

We are working on adding output time independent of firing specification
for all timers. Currently, we have set the required holds for Direct Runner
and Dataflow. We need to do the same for Flink as well. Need some
assistance in how we can achieve this.


Watermark holds for Flink to set:
https://github.com/apache/beam/pull/9677#discussion_r346541589


*Thanks & Regards*


<http://venturedive.com/>

*Rehman Murad Ali*
Software Engineer
Mobile: +92 3452076766
Skype: rehman.muradali


Re: Exception at testing DataFlow with preCommitLegacyWorker

2019-11-28 Thread Rehman Murad Ali
Thank you for suggestion. It will definitely reduce development efforts.

On Thu, Nov 28, 2019, 6:51 PM Michał Walenia 
wrote:

> I'm glad I was able to help :)
> And you might consider using WSL, it will allow you to run commands in
> Bash without starting a Docker container or a VM :)
> Good luck!
> Michal
>
> On Thu, Nov 28, 2019 at 2:46 PM Rehman Murad Ali <
> rehman.murad...@venturedive.com> wrote:
>
>> After running tasks with --info and --rerun-tasks, I got to know that
>> application default credentials were not set in Docker. I have set
>> GOOGLE_APPLICATION_CREDENTIALS and now it is working fine. I can find the
>> job on the dataflow cloud. Thank you for your guidance.
>>
>>
>> *Thanks & Regards*
>>
>>
>> *Rehman Murad Ali*
>>
>> Software Engineer
>> Mobile: +92 3452076766
>> Skype: rehman,muradali
>>
>> <http://venturedive.com/>
>>
>>
>> On Thu, Nov 28, 2019 at 5:29 PM Michał Walenia <
>> michal.wale...@polidea.com> wrote:
>>
>>> It seems that Windows CMD doesn't play nice with JSON. I'm not sure
>>> what's the problem in your Docker though, try running gradle with --info
>>> and --rerun-tasks. You'll see more output this way
>>>
>>> On Thu, Nov 28, 2019 at 1:02 PM Rehman Murad Ali <
>>> rehman.murad...@venturedive.com> wrote:
>>>
>>>> Above mentioned screenshot and output logs are run on docker using bash
>>>> shell on Windows. Yes, I have the permission and I was able to upload a
>>>> file on cloud storage as well.
>>>>
>>>> On the other hand, I am getting JsonParsingException when running on
>>>> Window's CMD. See the attached screenshots.
>>>>
>>>>
>>>>
>>>>
>>>> *Thanks & Regards*
>>>>
>>>>
>>>> *Rehman Murad Ali*
>>>>
>>>> Software Engineer
>>>> Mobile: +92 3452076766
>>>> Skype: rehman,muradali
>>>>
>>>> <http://venturedive.com/>
>>>>
>>>>
>>>> On Thu, Nov 28, 2019 at 4:29 PM Michał Walenia <
>>>> michal.wale...@polidea.com> wrote:
>>>>
>>>>> What kind of a shell are you using? Screenshot suggests it's not CMD,
>>>>> but a bash shell on Windows(?) BTW, do you have permissions on the
>>>>> apache-beam-testing project that allow you to start dataflow jobs 
>>>>> directly?
>>>>> If you don't, change the project to your org project, get the
>>>>> permissions and try again :)
>>>>>
>>>>> On Thu, Nov 28, 2019 at 11:19 AM Rehman Murad Ali <
>>>>> rehman.murad...@venturedive.com> wrote:
>>>>>
>>>>>> I am using Windows CLI for this command. Moreover, I have tried
>>>>>> setting up docker and run this command which results in "Build 
>>>>>> Successful"
>>>>>> but I cannot find any jobs running on the cloud console. Here are the
>>>>>> output logs. Is there another way to run Dataflow test case on Windows?
>>>>>>
>>>>>> root@cfbdbfdf72ea:/beam# ./gradlew
>>>>>> :runners:google-cloud-dataflow-java:examples:preCommitLegacyWorker
>>>>>> -PdataflowProject=apache-beam-testing -Pproject=apache-beam-testing
>>>>>> -PgcpProject=apache-beam-testing
>>>>>> -PgcsTempRoot=gs://venturedive-beamers-shoaib-mszb/rehman-java
>>>>>> -PdataflowTempRoot=gs://venturedive-beamers-shoaib-mszb/rehman-java
>>>>>> > Task :buildSrc:compileJava NO-SOURCE
>>>>>> > Task :buildSrc:compileGroovy UP-TO-DATE
>>>>>> > Task :buildSrc:pluginDescriptors UP-TO-DATE
>>>>>> > Task :buildSrc:processResources UP-TO-DATE
>>>>>> > Task :buildSrc:classes UP-TO-DATE
>>>>>> > Task :buildSrc:jar UP-TO-DATE
>>>>>> > Task :buildSrc:assemble UP-TO-DATE
>>>>>> > Task :buildSrc:spotlessGroovy UP-TO-DATE
>>>>>> > Task :buildSrc:spotlessGroovyCheck UP-TO-DATE
>>>>>> > Task :buildSrc:spotlessGroovyGradle UP-TO-DATE
>>>>>> > Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE
>>>>>> > Task :buildSrc:spotlessCheck UP-TO-DATE
>>>>>> > Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE
>>>>>> > Task :buildSrc:compileTestJava NO-SOURCE
>>&g

Re: Exception at testing DataFlow with preCommitLegacyWorker

2019-11-28 Thread Rehman Murad Ali
After running tasks with --info and --rerun-tasks, I got to know that
application default credentials were not set in Docker. I have set
GOOGLE_APPLICATION_CREDENTIALS and now it is working fine. I can find the
job on the dataflow cloud. Thank you for your guidance.


*Thanks & Regards*


*Rehman Murad Ali*

Software Engineer
Mobile: +92 3452076766
Skype: rehman,muradali

<http://venturedive.com/>


On Thu, Nov 28, 2019 at 5:29 PM Michał Walenia 
wrote:

> It seems that Windows CMD doesn't play nice with JSON. I'm not sure what's
> the problem in your Docker though, try running gradle with --info and
> --rerun-tasks. You'll see more output this way
>
> On Thu, Nov 28, 2019 at 1:02 PM Rehman Murad Ali <
> rehman.murad...@venturedive.com> wrote:
>
>> Above mentioned screenshot and output logs are run on docker using bash
>> shell on Windows. Yes, I have the permission and I was able to upload a
>> file on cloud storage as well.
>>
>> On the other hand, I am getting JsonParsingException when running on
>> Window's CMD. See the attached screenshots.
>>
>>
>>
>>
>> *Thanks & Regards*
>>
>>
>> *Rehman Murad Ali*
>>
>> Software Engineer
>> Mobile: +92 3452076766
>> Skype: rehman,muradali
>>
>> <http://venturedive.com/>
>>
>>
>> On Thu, Nov 28, 2019 at 4:29 PM Michał Walenia <
>> michal.wale...@polidea.com> wrote:
>>
>>> What kind of a shell are you using? Screenshot suggests it's not CMD,
>>> but a bash shell on Windows(?) BTW, do you have permissions on the
>>> apache-beam-testing project that allow you to start dataflow jobs directly?
>>> If you don't, change the project to your org project, get the
>>> permissions and try again :)
>>>
>>> On Thu, Nov 28, 2019 at 11:19 AM Rehman Murad Ali <
>>> rehman.murad...@venturedive.com> wrote:
>>>
>>>> I am using Windows CLI for this command. Moreover, I have tried setting
>>>> up docker and run this command which results in "Build Successful" but I
>>>> cannot find any jobs running on the cloud console. Here are the output
>>>> logs. Is there another way to run Dataflow test case on Windows?
>>>>
>>>> root@cfbdbfdf72ea:/beam# ./gradlew
>>>> :runners:google-cloud-dataflow-java:examples:preCommitLegacyWorker
>>>> -PdataflowProject=apache-beam-testing -Pproject=apache-beam-testing
>>>> -PgcpProject=apache-beam-testing
>>>> -PgcsTempRoot=gs://venturedive-beamers-shoaib-mszb/rehman-java
>>>> -PdataflowTempRoot=gs://venturedive-beamers-shoaib-mszb/rehman-java
>>>> > Task :buildSrc:compileJava NO-SOURCE
>>>> > Task :buildSrc:compileGroovy UP-TO-DATE
>>>> > Task :buildSrc:pluginDescriptors UP-TO-DATE
>>>> > Task :buildSrc:processResources UP-TO-DATE
>>>> > Task :buildSrc:classes UP-TO-DATE
>>>> > Task :buildSrc:jar UP-TO-DATE
>>>> > Task :buildSrc:assemble UP-TO-DATE
>>>> > Task :buildSrc:spotlessGroovy UP-TO-DATE
>>>> > Task :buildSrc:spotlessGroovyCheck UP-TO-DATE
>>>> > Task :buildSrc:spotlessGroovyGradle UP-TO-DATE
>>>> > Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE
>>>> > Task :buildSrc:spotlessCheck UP-TO-DATE
>>>> > Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE
>>>> > Task :buildSrc:compileTestJava NO-SOURCE
>>>> > Task :buildSrc:compileTestGroovy NO-SOURCE
>>>> > Task :buildSrc:processTestResources NO-SOURCE
>>>> > Task :buildSrc:testClasses UP-TO-DATE
>>>> > Task :buildSrc:test NO-SOURCE
>>>> > Task :buildSrc:validateTaskProperties UP-TO-DATE
>>>> > Task :buildSrc:check UP-TO-DATE
>>>> > Task :buildSrc:build UP-TO-DATE
>>>> Configuration on demand is an incubating feature.
>>>> > Task :model:job-management:extractProto UP-TO-DATE
>>>> > Task :model:job-management:processResources UP-TO-DATE
>>>> > Task :sdks:java:core:generateAvroProtocol NO-SOURCE
>>>> > Task :sdks:java:core:generateAvroJava NO-SOURCE
>>>> > Task :sdks:java:core:generateGrammarSource UP-TO-DATE
>>>> > Task :sdks:java:core:processResources UP-TO-DATE
>>>> > Task
>>>> :sdks:java:extensions:google-cloud-platform-core:processResources NO-SOURCE
>>>> > Task :sdks:java:extensions:protobuf:extractProto UP-TO-DATE
>>>> > Task :sdks:java:extensions:protobuf:processResources NO-SOURCE
>>>> > Tas

Re: Exception at testing DataFlow with preCommitLegacyWorker

2019-11-28 Thread Rehman Murad Ali
TO-DATE
> Task :sdks:java:core:compileJava UP-TO-DATE
> Task :sdks:java:core:classes UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:shadowJar
UP-TO-DATE
> Task
:runners:google-cloud-dataflow-java:worker:legacy-worker:processResources
NO-SOURCE
> Task :sdks:java:core:shadowJar UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:compileJava
UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:jar UP-TO-DATE
> Task :sdks:java:extensions:protobuf:extractIncludeProto UP-TO-DATE
> Task :sdks:java:extensions:protobuf:generateProto NO-SOURCE
> Task :sdks:java:extensions:protobuf:compileJava UP-TO-DATE
> Task :sdks:java:extensions:protobuf:classes UP-TO-DATE
> Task :sdks:java:extensions:protobuf:jar UP-TO-DATE
> Task :runners:core-construction-java:compileJava UP-TO-DATE
> Task :runners:core-construction-java:classes UP-TO-DATE
> Task :runners:core-construction-java:jar UP-TO-DATE
> Task :sdks:java:fn-execution:compileJava UP-TO-DATE
> Task :sdks:java:fn-execution:classes UP-TO-DATE
> Task :sdks:java:fn-execution:jar UP-TO-DATE
> Task :runners:core-java:compileJava UP-TO-DATE
> Task :runners:core-java:classes UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:compileJava UP-TO-DATE
> Task :runners:core-java:jar UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:jar UP-TO-DATE
> Task :vendor:sdks-java-extensions-protobuf:compileJava UP-TO-DATE
> Task :vendor:sdks-java-extensions-protobuf:classes UP-TO-DATE
> Task :vendor:sdks-java-extensions-protobuf:shadowJar UP-TO-DATE
> Task :sdks:java:harness:compileJava UP-TO-DATE
> Task :sdks:java:harness:classes UP-TO-DATE
> Task :sdks:java:harness:jar UP-TO-DATE
> Task :examples:java:compileJava UP-TO-DATE
> Task :examples:java:classes UP-TO-DATE
> Task :examples:java:jar UP-TO-DATE
> Task :sdks:java:harness:shadowJar UP-TO-DATE
> Task :examples:java:compileTestJava UP-TO-DATE
> Task :examples:java:testClasses UP-TO-DATE
> Task :examples:java:testJar UP-TO-DATE
> Task :runners:local-java:compileJava UP-TO-DATE
> Task :runners:local-java:classes UP-TO-DATE
> Task :runners:java-fn-execution:compileJava UP-TO-DATE
> Task :runners:java-fn-execution:classes UP-TO-DATE
> Task :runners:java-fn-execution:jar UP-TO-DATE
> Task :runners:local-java:jar UP-TO-DATE
> Task :runners:direct-java:compileJava UP-TO-DATE
> Task :runners:direct-java:classes UP-TO-DATE
> Task :runners:direct-java:shadowJar UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:compileJava UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:classes UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:jar UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava
UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:classes
UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar
UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:examples:preCommitLegacyWorker
FROM-CACHE

Deprecated Gradle features were used in this build, making it incompatible
with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD SUCCESSFUL in 2s
65 actionable tasks: 1 from cache, 64 up-to-date
root@cfbdbfdf72ea:/beam#



*Thanks & Regards*


*Rehman Murad Ali*

Software Engineer
Mobile: +92 3452076766
Skype: rehman,muradali

<http://venturedive.com/>


On Thu, Nov 28, 2019 at 12:37 PM Michał Walenia 
wrote:

> That's interesting, the command works for me (it crashes on communication
> with GCP, but that was expected). From the log output it seems you're using
> Windows.
> Did you use WSL to run this? Do you have an option to use Linux to check
> this command? The JSON created in the Gradle script may be treated
> differently in CMD (due to quoting differences between it and Bash/ZSH/
> other shells).
>
> I'd try to run this somewhere else other than CMD.
> Good luck!
>
> @Brian: -DbeamPipelineOptions parameter is constructed by Gradle from an
> object via JsonOutput, so it should be a valid object after reading back.
>
> On Thu, Nov 28, 2019 at 7:39 AM Rehman Murad Ali <
> rehman.murad...@venturedive.com> wrote:
>
>> Thank you, Brian and Michal, for replying. Here is the full command:
>>
>> ./gradlew
>> :runners:google-cloud-dataflow-java:examples:preCommitLegacyWorker
>> -PdataflowProject=apache-beam-testing -Pproject=apache-beam-testing
>> -PgcpProject=apache-beam-testing
>> -PgcsTempRoot=gs://venturedive-beamers-shoaib-mszb/rehman-java
>> -PdataflowTempRoot=gs://venturedive

Re: Exception at testing DataFlow with preCommitLegacyWorker

2019-11-27 Thread Rehman Murad Ali
Thank you, Brian and Michal, for replying. Here is the full command:

./gradlew
:runners:google-cloud-dataflow-java:examples:preCommitLegacyWorker
-PdataflowProject=apache-beam-testing -Pproject=apache-beam-testing
-PgcpProject=apache-beam-testing
-PgcsTempRoot=gs://venturedive-beamers-shoaib-mszb/rehman-java
-PdataflowTempRoot=gs://venturedive-beamers-shoaib-mszb/rehman-java


Source: Confluence Java Tips
<https://cwiki.apache.org/confluence/display/BEAM/Java+Tips>



*Thanks & Regards*


*Rehman Murad Ali*

Software Engineer
Mobile: +92 3452076766
Skype: rehman,muradali

<http://venturedive.com/>


On Thu, Nov 28, 2019 at 10:42 AM Zohaib Baig 
wrote:

> +Rehman Murad Ali 
>
> On Thu, Nov 28, 2019 at 2:58 AM Brian Hulette  wrote:
>
>> It looks like you passed an argument like
>> -DbeamTestPipelineOptions 
>> "[--project=apache-beam-testing,--tempRoot=gs://venturedive-beamers-shoaib-mszb/rehman-java,--runner=TestDataflowRunner,--dataflowWorkerJar=D:\\Workspace\\apache\\beam\\runners\\google-cloud-dataflow-java\\worker\\legacy-worker\\build\\libs\\beam-runners-google-cloud-dataflow-java-legacy-worker-2.18.0-SNAPSHOT.jar,]",
>> but the string inside the quotes needs to be a valid JSON array of strings.
>> If you change it to something like -DbeamTestPipelineOptions
>> '["--project=apache-beam-testing",...]' you should get past that error.
>>
>> Agree with Michał though that we could help best if you share your full
>> command line.
>>
>> Brian
>>
>> On Wed, Nov 27, 2019 at 8:20 AM Michał Walenia <
>> michal.wale...@polidea.com> wrote:
>>
>>> Hi,
>>> can you please post the command you used in the terminal? It seems you
>>> used a wrong combination of quotes, but I'd need to see it to be sure.
>>> Cheers,
>>> Michal
>>>
>>> On Wed, Nov 27, 2019 at 5:11 PM Rehman Murad Ali <
>>> rehman.murad...@venturedive.com> wrote:
>>>
>>>> Hi Community,
>>>>
>>>> I have been recently trying to test data flow jobs with the beam. I
>>>> have set up Gcloud account and tried to copy a file from the local system
>>>> to the Gcloud storage (which works fine).
>>>>
>>>> Now I am trying to run preCommitLegacyWorker task on local and I am
>>>> getting the following error:
>>>>
>>>> Unable to instantiate test options from system property
>>>> beamTestPipelineOptions
>>>>
>>>>
>>>> Caused by: com.fasterxml.jackson.core.JsonParseException: Unexpected
>>>> character ('-' (code 45)) in numeric value: expected digit (0-9) to follow
>>>> minus sign, for valid numeric value
>>>>  at [Source:
>>>> (String)"[--project=apache-beam-testing,--tempRoot=gs://venturedive-beamers-shoaib-mszb/rehman-java,--runner=TestDataflowRunner,--dataflowWorkerJar=D:\\Workspace\\apache\\beam\\runners\\google-cloud-dataflow-java\\worker\\legacy-worker\\build\\libs\\beam-runners-google-cloud-dataflow-java-legacy-worker-2.18.0-SNAPSHOT.jar,]";
>>>> line: 1, column: 4]
>>>> at
>>>> com.fasterxml.jackson.core.JsonParser._constructError(JsonParser.java:1804)
>>>> at
>>>> com.fasterxml.jackson.core.base.ParserMinimalBase._reportError(ParserMinimalBase.java:693)
>>>> at
>>>> com.fasterxml.jackson.core.base.ParserMinimalBase.reportUnexpectedNumberChar(ParserMinimalBase.java:541)
>>>> at
>>>> com.fasterxml.jackson.core.json.ReaderBasedJsonParser._handleInvalidNumberStart(ReaderBasedJsonParser.java:1637)
>>>> at
>>>> com.fasterxml.jackson.core.json.ReaderBasedJsonParser._parseNegNumber(ReaderBasedJsonParser.java:1391)
>>>> at
>>>> com.fasterxml.jackson.core.json.ReaderBasedJsonParser.nextToken(ReaderBasedJsonParser.java:742)
>>>> at
>>>> com.fasterxml.jackson.core.json.ReaderBasedJsonParser.nextTextValue(ReaderBasedJsonParser.java:1160)
>>>> at
>>>> com.fasterxml.jackson.databind.deser.std.StringArrayDeserializer.deserialize(StringArrayDeserializer.java:145)
>>>>
>>>>
>>>>
>>>> Any help would be appreciable.
>>>>
>>>>
>>>>
>>>> *Thanks & Regards*
>>>>
>>>>
>>>> *Rehman Murad Ali*
>>>>
>>>> Software Engineer
>>>> Mobile: +92 3452076766 <+92%20345%202076766>
>>>> Skype: rehman,muradali
>>>>
>>>> <http://venturedive.com/>
>>>>
>>>
>>>
>>> --
>>>
>>> Michał Walenia
>>> Polidea <https://www.polidea.com/> | Software Engineer
>>>
>>> M: +48 791 432 002 <+48791432002>
>>> E: michal.wale...@polidea.com
>>>
>>> Unique Tech
>>> Check out our projects! <https://www.polidea.com/our-work>
>>>
>>
>
> --
>
> *Muhammad Zohaib Baig*
> Senior Software Engineer
> Mobile: +92 3443060266
> Skype: mzobii.baig
>
> <http://venturedive.com/>
>


Exception at testing DataFlow with preCommitLegacyWorker

2019-11-27 Thread Rehman Murad Ali
Hi Community,

I have been recently trying to test data flow jobs with the beam. I have
set up Gcloud account and tried to copy a file from the local system to the
Gcloud storage (which works fine).

Now I am trying to run preCommitLegacyWorker task on local and I am getting
the following error:

Unable to instantiate test options from system property
beamTestPipelineOptions


Caused by: com.fasterxml.jackson.core.JsonParseException: Unexpected
character ('-' (code 45)) in numeric value: expected digit (0-9) to follow
minus sign, for valid numeric value
 at [Source:
(String)"[--project=apache-beam-testing,--tempRoot=gs://venturedive-beamers-shoaib-mszb/rehman-java,--runner=TestDataflowRunner,--dataflowWorkerJar=D:\\Workspace\\apache\\beam\\runners\\google-cloud-dataflow-java\\worker\\legacy-worker\\build\\libs\\beam-runners-google-cloud-dataflow-java-legacy-worker-2.18.0-SNAPSHOT.jar,]";
line: 1, column: 4]
at
com.fasterxml.jackson.core.JsonParser._constructError(JsonParser.java:1804)
at
com.fasterxml.jackson.core.base.ParserMinimalBase._reportError(ParserMinimalBase.java:693)
at
com.fasterxml.jackson.core.base.ParserMinimalBase.reportUnexpectedNumberChar(ParserMinimalBase.java:541)
at
com.fasterxml.jackson.core.json.ReaderBasedJsonParser._handleInvalidNumberStart(ReaderBasedJsonParser.java:1637)
at
com.fasterxml.jackson.core.json.ReaderBasedJsonParser._parseNegNumber(ReaderBasedJsonParser.java:1391)
at
com.fasterxml.jackson.core.json.ReaderBasedJsonParser.nextToken(ReaderBasedJsonParser.java:742)
at
com.fasterxml.jackson.core.json.ReaderBasedJsonParser.nextTextValue(ReaderBasedJsonParser.java:1160)
at
com.fasterxml.jackson.databind.deser.std.StringArrayDeserializer.deserialize(StringArrayDeserializer.java:145)



Any help would be appreciable.



*Thanks & Regards*


*Rehman Murad Ali*

Software Engineer
Mobile: +92 3452076766
Skype: rehman,muradali

<http://venturedive.com/>


Re: Jenkin jobs taking too long

2019-10-25 Thread Rehman Murad Ali
Thank you Kyle for letting me know work around.


*Thanks & Regards*


*Rehman Murad Ali*

Software Engineer
Mobile: +92 3452076766
Skype: rehman,muradali

<http://venturedive.com/>


On Fri, Oct 25, 2019 at 12:26 PM Kyle Weaver  wrote:

> Looks like Jenkins might have got stuck for a while (this happened on my
> PR as well), but it seems to be working again now. You can manually re-run
> individual jobs with a comment on the PR containing one of the commands
> listed (such as Run Python PreCommit).
>
> Does anyone know if there's a PR command for "rerun all"?
>
> On Fri, Oct 25, 2019 at 9:09 AM Rehman Murad Ali <
> rehman.murad...@venturedive.com> wrote:
>
>> Hello,
>>
>> It's been more than 17 hours,  Jenkin jobs are still running. Here is the
>> PR https://github.com/apache/beam/pull/9677.
>>
>> Any help would be appreciated.
>>
>>
>> Rehman
>>
>


Jenkin jobs taking too long

2019-10-25 Thread Rehman Murad Ali
Hello,

It's been more than 17 hours,  Jenkin jobs are still running. Here is the
PR https://github.com/apache/beam/pull/9677.

Any help would be appreciated.


Rehman


[no subject]

2019-10-09 Thread Rehman Murad Ali
*Thanks & Regards*


*Rehman Murad Ali*

Software Engineer
Mobile: +92 3452076766
Skype: rehman,muradali

<http://venturedive.com/>