It would be great to add some lower level benchmark tests for the java SDK.
I was thinking of using open census for collecting benchmarks, which looks
easy to use should be license compatible. I'm just not sure about how to
export the results so that we can display them on the perfkit dashboard
I updated the PR addressing the last of Scott's comments and also migrated
to use an integral fraction as Robert had recommended by using approach A
for the proto representation and BigDecimal within the Java SDK:
A:
// Represents a non-negative decimal number: unscaled_value * 10^(-scale)
message
I have granted you access.
On Tue, Nov 27, 2018 at 2:39 PM Huygaa Batsaikhan wrote:
> Hi devs, can anyone grant me edit access? Would like to update
> https://cwiki.apache.org/confluence/display/BEAM/Usage+Guide.
>
> Thanks.
>
+u...@beam.apache.org
On Mon, Nov 26, 2018 at 5:33 PM Reuven Lax wrote:
> Do you need it to change based on the timestamps of the records being
> processed, or based on actual current time?
>
> On Mon, Nov 26, 2018 at 5:30 PM Matthew Schneid <
> matthew.t.schn...@gmail.com> wrote:
>
>> Hello,
Thanks,
let me run a new build with -scan option.
I keep you posted.
Regards
JB
On 27/11/2018 18:46, Ahmet Altay wrote:
> I have not seen this one before. Could you share the link to gradle
> build scan, perhaps that will have more information?
>
> On Tue, Nov 27, 2018 at 6:42 AM,
I actually didn't look at this one. I filed a bunch more adjacent flake
bugs. I didn't find your bug but I do see that test flaking at the same
time as the others. FWIW here is the list of flakes and sickbayed tests:
https://issues.apache.org/jira/issues/?filter=12343195
Kenn
On Tue, Nov 27,
+Ken,
Did you happen to look into this test? I heard that you may have been
looking into this.
On Mon, Nov 26, 2018 at 3:36 PM Maximilian Michels wrote:
> Hi Alex,
>
> Thanks for your help! I'm quite used to debugging concurrent/distributed
> problems. But this one is quite tricky, especially
I have not seen this one before. Could you share the link to gradle build
scan, perhaps that will have more information?
On Tue, Nov 27, 2018 at 6:42 AM, Jean-Baptiste Onofré
wrote:
> Hi guys
>
> I have some tests failures on Python SDK (19 failures exactly).
>
> They all look the same, for
Hi Chaim,
do you mean that MongoDbIO could provided a PCollection
containing the payload + id + time ?
Regards
JB
On 27/11/2018 12:47, Chaim Turkel wrote:
> Hi,
> I would like to write a sync to validate that i have all records
> from mongo in my bigquery.
> to do this i would like to bring
Hi Chaim,
The best is to create a Jira describing the new features you want to
add. Then, you can create a PR related to this Jira.
As I'm the original MongoDbIO author, I would be more than happy to help
you and review the PR.
Thanks !
Regards
JB
On 27/11/2018 15:37, Chaim Turkel wrote:
> Hi,
Hi guys
I have some tests failures on Python SDK (19 failures exactly).
They all look the same, for instance:
FAIL: testIndexing
(apache_beam.typehints.trivial_inference_test.TrivialInferenceTest)
--
Traceback (most recent call
Hi,
I have added a few features to the MongoDbIO and would like to add
them to the project.
I have read https://beam.apache.org/contribute/
I have added a jira user, what do i need to do next?
chaim
--
Loans are funded by
FinWise Bank, a Utah-chartered bank located in Sandy,
Utah, member
Hi,
I would like to write a sync to validate that i have all records
from mongo in my bigquery.
to do this i would like to bring the fields id,time from mongo to
biguqery, and only on the missing docuements to read the full
document,
I did not see a way to bring a paritial document?
chaim
--
13 matches
Mail list logo
