ASF GitHub Bot logged work on BEAM-3217:

                Author: ASF GitHub Bot
            Created on: 12/Mar/18 02:57
            Start Date: 12/Mar/18 02:57
    Worklog Time Spent: 10m 
      Work Description: chamikaramj commented on issue #4758: [BEAM-3217] 
Jenkins job for HadoopInputFormatIOIT
URL: https://github.com/apache/beam/pull/4758#issuecomment-372180736
   LGTM. Merged.

This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:

Issue Time Tracking

    Worklog Id:     (was: 79322)
    Time Spent: 6h 10m  (was: 6h)

> Add a performance test for HadoopInputFormatIO
> ----------------------------------------------
>                 Key: BEAM-3217
>                 URL: https://issues.apache.org/jira/browse/BEAM-3217
>             Project: Beam
>          Issue Type: Test
>          Components: io-java-hadoop
>            Reporter: Chamikara Jayalath
>            Assignee: Ɓukasz Gajowy
>            Priority: Major
>          Time Spent: 6h 10m
>  Remaining Estimate: 0h
> We should add a large scale performance test for HadoopInputFormatIO. We 
> should use PerfKitBenchmarker based performance testing framework [1] to 
> manage Kubernetes based muti-node data store and to publish benchmark results.
> Example input format implementation to use: DBInputFormat to connect to a 
> Postgres instance.
> https://github.com/hanborq/hadoop/blob/master/src/mapred/org/apache/hadoop/mapreduce/lib/db/DBInputFormat.java
> Example docker image to use: https://hub.docker.com/_/postgres/
> [1] https://beam.apache.org/documentation/io/testing/

This message was sent by Atlassian JIRA

Reply via email to