Re: [GitHub] drill issue #1237: DRILL-6348: Fixed code so that Unordered Receiver reports...

2018-04-27 Thread salim achouche
Correction for example II as Drill uses a single thread per pipeline (a batch is fully processed before the next one is; only receive of batches can happen concurrently): - Using batch identifiers for more clarity - t0: (fragment, opr-1, opr-2) = ([b1], [], []) - t1: (fragment, opr-1, opr-2) =

Re: [GitHub] drill issue #1237: DRILL-6348: Fixed code so that Unordered Receiver reports...

2018-04-27 Thread salim achouche
Another point, I don't see a functional benefit from avoiding a change of ownership for pass-through operators. Consider the following use-cases: Example I - - Single batch of size 8MB is received at time t0 and then is passed through a set of pass-through operators - At time t1 owned by operator

[GitHub] drill issue #1241: DRILL-6364: Handle Cluster Info in WebUI when existing/ne...

2018-04-27 Thread kkhatua
Github user kkhatua commented on the issue: https://github.com/apache/drill/pull/1241 @sohami / @arina-ielchiieva can you review this? The change is not extensive and fairly straightforward. ---

[GitHub] drill issue #1241: DRILL-6364: Handle Cluster Info in WebUI when existing/ne...

2018-04-27 Thread kkhatua
Github user kkhatua commented on the issue: https://github.com/apache/drill/pull/1241 Screenshot of when UI node `kk127` goes down. The UI's javascript logic queries other Drillbits in the list (in this case, `kk128`) and discovers two new previously unseen Drillbits - `kk130` and

[GitHub] drill pull request #1241: DRILL-6364: Handle Cluster Info in WebUI when exis...

2018-04-27 Thread kkhatua
GitHub user kkhatua opened a pull request: https://github.com/apache/drill/pull/1241 DRILL-6364: Handle Cluster Info in WebUI when existing/new bits restart As a follow up to DRILL-6289, the following improvements have been done: 1. When loading the page for the first time, the

[jira] [Created] (DRILL-6364) WebUI does not cleanly handle shutdown and state toggling when Drillbits go on and offline

2018-04-27 Thread Kunal Khatua (JIRA)
Kunal Khatua created DRILL-6364: --- Summary: WebUI does not cleanly handle shutdown and state toggling when Drillbits go on and offline Key: DRILL-6364 URL: https://issues.apache.org/jira/browse/DRILL-6364

[GitHub] drill issue #1184: DRILL-6242 - Use java.sql.[Date|Time|Timestamp] classes t...

2018-04-27 Thread parthchandra
Github user parthchandra commented on the issue: https://github.com/apache/drill/pull/1184 ``` What do you mean by "Json representation"? ``` Sorry, my mistake, got all tangled up. ``` we may want to further translate the Local [Date|Time|DateTime] objects

[GitHub] drill issue #1237: DRILL-6348: Fixed code so that Unordered Receiver reports...

2018-04-27 Thread vrozov
Github user vrozov commented on the issue: https://github.com/apache/drill/pull/1237 IMO, it will be good to understand what other operators do as well. For example what Project or Filter operators do. Do they take ownership of incoming batches? And if they do, when is the ownership

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-27 Thread sachouche
Github user sachouche commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184807153 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/unorderedreceiver/UnorderedReceiverBatch.java --- @@ -149,25 +149,32 @@

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-27 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184804819 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/unorderedreceiver/UnorderedReceiverBatch.java --- @@ -149,25 +149,32 @@ private

[GitHub] drill issue #1237: DRILL-6348: Fixed code so that Unordered Receiver reports...

2018-04-27 Thread sachouche
Github user sachouche commented on the issue: https://github.com/apache/drill/pull/1237 That was not my intention as my current change aimed at describing the system the way it is. @parthchandra, any feedback? ---

[GitHub] drill issue #1240: DRILL-6327: Update unary operators to handle IterOutcome....

2018-04-27 Thread parthchandra
Github user parthchandra commented on the issue: https://github.com/apache/drill/pull/1240 +1. Very nicely done. ---

[GitHub] drill issue #1237: DRILL-6348: Fixed code so that Unordered Receiver reports...

2018-04-27 Thread sachouche
Github user sachouche commented on the issue: https://github.com/apache/drill/pull/1237 @vrozov, **What are we trying to solve / improve** - Drill is currently not properly reporting memory held in Fragment's receive queues - This makes it hard to analyze OOM

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-27 Thread sachouche
Github user sachouche commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184747702 --- Diff: exec/memory/base/src/main/java/org/apache/drill/exec/memory/AllocationManager.java --- @@ -253,10 +261,12 @@ public boolean

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-27 Thread sachouche
Github user sachouche commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184727914 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/unorderedreceiver/UnorderedReceiverBatch.java --- @@ -149,25 +149,32 @@

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-27 Thread sachouche
Github user sachouche commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184730050 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/record/RawFragmentBatch.java --- @@ -77,4 +83,46 @@ public long getByteCount() {

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-27 Thread sachouche
Github user sachouche commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184728292 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/unorderedreceiver/UnorderedReceiverBatch.java --- @@ -149,25 +149,32 @@

[GitHub] drill issue #1225: DRILL-6272: Refactor dynamic UDFs and function initialize...

2018-04-27 Thread arina-ielchiieva
Github user arina-ielchiieva commented on the issue: https://github.com/apache/drill/pull/1225 @vrozov now PR contains two commits: 1. jmockit and mockito upgrade (DRILL-6363); 2. maven-embedder usage for unit tests (used latest version as you suggested) (DRILL-6272).

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-27 Thread sachouche
Github user sachouche commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184726839 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/unorderedreceiver/UnorderedReceiverBatch.java --- @@ -201,6 +208,11 @@ public

[GitHub] drill pull request #1238: DRILL-6281: Refactor TimedRunnable

2018-04-27 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/drill/pull/1238#discussion_r184724657 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/TimedCallable.java --- @@ -0,0 +1,266 @@ +/* + * Licensed to the Apache Software

[jira] [Created] (DRILL-6363) Upgrade jmockit and mockito libs

2018-04-27 Thread Arina Ielchiieva (JIRA)
Arina Ielchiieva created DRILL-6363: --- Summary: Upgrade jmockit and mockito libs Key: DRILL-6363 URL: https://issues.apache.org/jira/browse/DRILL-6363 Project: Apache Drill Issue Type: Task

[GitHub] drill pull request #1238: DRILL-6281: Refactor TimedRunnable

2018-04-27 Thread arina-ielchiieva
Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/1238#discussion_r184701824 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/TimedCallable.java --- @@ -0,0 +1,266 @@ +/* + * Licensed to the Apache

[GitHub] drill pull request #1238: DRILL-6281: Refactor TimedRunnable

2018-04-27 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/drill/pull/1238#discussion_r184694930 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/TimedCallable.java --- @@ -0,0 +1,266 @@ +/* + * Licensed to the Apache Software

[GitHub] drill pull request #1238: DRILL-6281: Refactor TimedRunnable

2018-04-27 Thread arina-ielchiieva
Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/1238#discussion_r184693216 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/TimedCallable.java --- @@ -0,0 +1,258 @@ +/* + * Licensed to the Apache

[GitHub] drill pull request #1238: DRILL-6281: Refactor TimedRunnable

2018-04-27 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/drill/pull/1238#discussion_r184691926 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/TimedCallable.java --- @@ -0,0 +1,258 @@ +/* + * Licensed to the Apache Software

[GitHub] drill issue #1214: DRILL-6331: Revisit Hive Drill native parquet implementat...

2018-04-27 Thread vrozov
Github user vrozov commented on the issue: https://github.com/apache/drill/pull/1214 When moving files around please preserve the history of modifications done to the file. ---

[GitHub] drill pull request #1214: DRILL-6331: Revisit Hive Drill native parquet impl...

2018-04-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/drill/pull/1214 ---

[GitHub] drill pull request #1231: DRILL-6342: Fix schema path unIndexed method to re...

2018-04-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/drill/pull/1231 ---

[GitHub] drill issue #1230: DRILL-6345: DRILL Query fails on Function LOG10

2018-04-27 Thread vladimirtkach
Github user vladimirtkach commented on the issue: https://github.com/apache/drill/pull/1230 @vvysotskyi made changes according to your remarks ---