Re: msgpack handling lists with elements of different types

2018-10-17 Thread Paul Rogers
Hi JC, Bingo, you just hit the core problem with schema-on-read: there is no "right" rule for how to handle ambiguous or inconsistent schemas. Take your string/binary example. You determined that the binary fields were actually strings (encoded in what, UTF-8? ASCII? Host's native codeset?)

[GitHub] amansinha100 commented on a change in pull request #1488: DRILL-786: Allow CROSS JOIN syntax

2018-10-17 Thread GitBox
amansinha100 commented on a change in pull request #1488: DRILL-786: Allow CROSS JOIN syntax URL: https://github.com/apache/drill/pull/1488#discussion_r226056318 ## File path: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/join/JoinUtils.java ## @@

Re: Topics for Drill Hackathon/Drill Developers Day - 2018!

2018-10-17 Thread Hanumath Rao Maduri
Hello All, Please vote for the list of the topics which you would be interested in. This will be very helpful to prioritize the topics on Developer Day. https://docs.google.com/forms/d/1C8nNIznllct_zY68R-XZkWtb3VHWBMFSkMnDs42isLs/edit On Wed, Oct 17, 2018 at 9:45 PM Hanumath Rao Maduri wrote:

Re: Topics for Drill Hackathon/Drill Developers Day - 2018!

2018-10-17 Thread Hanumath Rao Maduri
Hello Charles, Thank you for your interest to volunteer. We are planning to host a remote session as well. I have added your name as a volunteer to Storage plugins, REST APIs related enhancements discussion. On Tue, Oct 16, 2018 at 3:53 PM Charles Givre wrote: > @All, > I don’t know if remote

[GitHub] kkhatua closed pull request #1491: DRILL-6084: Show Drill functions in WebUI for autocomplete

2018-10-17 Thread GitBox
kkhatua closed pull request #1491: DRILL-6084: Show Drill functions in WebUI for autocomplete URL: https://github.com/apache/drill/pull/1491 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As

[GitHub] kkhatua commented on issue #1392: DRILL-6611 : Enable meta-enter query submission in web query interface

2018-10-17 Thread GitBox
kkhatua commented on issue #1392: DRILL-6611 : Enable meta-enter query submission in web query interface URL: https://github.com/apache/drill/pull/1392#issuecomment-430771581 @hrbrmstr I've made a fork of your PR and made the additional changes there.

Re: msgpack handling lists with elements of different types

2018-10-17 Thread Jean-Claude Cote
I see what you mean by a schema only gets you so far. Your Fred Flinstone example shows how you almost need the ability to apply a transformation at the reader level (instead of at the projection level) to properly read such data files. I think I agree with Charles Givre. I've always like the tag

[GitHub] amansinha100 commented on issue #1488: DRILL-786: Allow CROSS JOIN syntax

2018-10-17 Thread GitBox
amansinha100 commented on issue #1488: DRILL-786: Allow CROSS JOIN syntax URL: https://github.com/apache/drill/pull/1488#issuecomment-430517349 The formatting of the message is still incorrect. Also, I ran some test queries and found an issue. After I set the

[GitHub] arina-ielchiieva closed pull request #1505: DRILL-6797: Fix UntypedNull handling for complex types

2018-10-17 Thread GitBox
arina-ielchiieva closed pull request #1505: DRILL-6797: Fix UntypedNull handling for complex types URL: https://github.com/apache/drill/pull/1505 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance:

[GitHub] arina-ielchiieva commented on issue #1505: DRILL-6797: Fix UntypedNull handling for complex types

2018-10-17 Thread GitBox
arina-ielchiieva commented on issue #1505: DRILL-6797: Fix UntypedNull handling for complex types URL: https://github.com/apache/drill/pull/1505#issuecomment-430554845 @priteshm this no not required: Jira tile describes the issue, commit message describes the changes.

[GitHub] vvysotskyi commented on a change in pull request #1506: DRILL-6793: FragmentExecutor cannot send its final state for the case…

2018-10-17 Thread GitBox
vvysotskyi commented on a change in pull request #1506: DRILL-6793: FragmentExecutor cannot send its final state for the case… URL: https://github.com/apache/drill/pull/1506#discussion_r225852711 ## File path:

[GitHub] KazydubB commented on a change in pull request #1506: DRILL-6793: FragmentExecutor cannot send its final state for the case…

2018-10-17 Thread GitBox
KazydubB commented on a change in pull request #1506: DRILL-6793: FragmentExecutor cannot send its final state for the case… URL: https://github.com/apache/drill/pull/1506#discussion_r225861490 ## File path:

[GitHub] KazydubB commented on a change in pull request #1506: DRILL-6793: FragmentExecutor cannot send its final state for the case…

2018-10-17 Thread GitBox
KazydubB commented on a change in pull request #1506: DRILL-6793: FragmentExecutor cannot send its final state for the case… URL: https://github.com/apache/drill/pull/1506#discussion_r225861055 ## File path:

[GitHub] KazydubB commented on a change in pull request #1506: DRILL-6793: FragmentExecutor cannot send its final state for the case…

2018-10-17 Thread GitBox
KazydubB commented on a change in pull request #1506: DRILL-6793: FragmentExecutor cannot send its final state for the case… URL: https://github.com/apache/drill/pull/1506#discussion_r225861548 ## File path:

[GitHub] vvysotskyi commented on a change in pull request #1506: DRILL-6793: FragmentExecutor cannot send its final state for the case…

2018-10-17 Thread GitBox
vvysotskyi commented on a change in pull request #1506: DRILL-6793: FragmentExecutor cannot send its final state for the case… URL: https://github.com/apache/drill/pull/1506#discussion_r225853187 ## File path:

[GitHub] vvysotskyi commented on a change in pull request #1506: DRILL-6793: FragmentExecutor cannot send its final state for the case…

2018-10-17 Thread GitBox
vvysotskyi commented on a change in pull request #1506: DRILL-6793: FragmentExecutor cannot send its final state for the case… URL: https://github.com/apache/drill/pull/1506#discussion_r225851956 ## File path:

[GitHub] arina-ielchiieva commented on issue #1491: DRILL-6084: Show Drill functions in WebUI for autocomplete

2018-10-17 Thread GitBox
arina-ielchiieva commented on issue #1491: DRILL-6084: Show Drill functions in WebUI for autocomplete URL: https://github.com/apache/drill/pull/1491#issuecomment-430574625 +1, please squash the commits. This is an automated

[GitHub] amansinha100 commented on a change in pull request #1488: DRILL-786: Allow CROSS JOIN syntax

2018-10-17 Thread GitBox
amansinha100 commented on a change in pull request #1488: DRILL-786: Allow CROSS JOIN syntax URL: https://github.com/apache/drill/pull/1488#discussion_r225801519 ## File path: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/join/JoinUtils.java ## @@

[GitHub] ihuzenko commented on a change in pull request #1488: DRILL-786: Allow CROSS JOIN syntax

2018-10-17 Thread GitBox
ihuzenko commented on a change in pull request #1488: DRILL-786: Allow CROSS JOIN syntax URL: https://github.com/apache/drill/pull/1488#discussion_r225826784 ## File path: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/join/JoinUtils.java ## @@ -65,6

[GitHub] KazydubB opened a new pull request #1506: DRILL-6793: FragmentExecutor cannot send its final state for the case…

2018-10-17 Thread GitBox
KazydubB opened a new pull request #1506: DRILL-6793: FragmentExecutor cannot send its final state for the case… URL: https://github.com/apache/drill/pull/1506 … when RootExec root wasn't initialized This is an automated

msgpack handling lists with elements of different types

2018-10-17 Thread Jean-Claude Cote
I'm writing a msgpack reader and have encountered datasets where an array contains different types for example a VARCHAR and a BINARY. Turns out the BINARY is actually a string. I know this is probably just not modeled correctly in the first place but I'll still going to modify the reading of list