[GitHub] josephglanville commented on issue #6004: Automatically Determine Ingestion Schema

2018-08-07 Thread GitBox
josephglanville commented on issue #6004: Automatically Determine Ingestion Schema URL: https://github.com/apache/incubator-druid/issues/6004#issuecomment-411288680 It's already possible for an InputRowParser to automatically do this. When writing an InputRowParser you can choose to

[GitHub] doc987 commented on issue #6004: Automatically Determine Ingestion Schema

2018-08-07 Thread GitBox
doc987 commented on issue #6004: Automatically Determine Ingestion Schema URL: https://github.com/apache/incubator-druid/issues/6004#issuecomment-411281495 That gets part of the way there, though the data provided by Collectd and Telegraf are formatted somewhat differently. That means

[GitHub] jihoonson edited a comment on issue #6124: KafkaIndexTask can delete published segments on restart

2018-08-07 Thread GitBox
jihoonson edited a comment on issue #6124: KafkaIndexTask can delete published segments on restart URL: https://github.com/apache/incubator-druid/issues/6124#issuecomment-411279909 > This doesn't seem right: there is code specifically to handle the case where a task tries to publish a

[GitHub] jihoonson commented on issue #6124: KafkaIndexTask can delete published segments on restart

2018-08-07 Thread GitBox
jihoonson commented on issue #6124: KafkaIndexTask can delete published segments on restart URL: https://github.com/apache/incubator-druid/issues/6124#issuecomment-411279909 > This doesn't seem right: there is code specifically to handle the case where a task tries to publish a segment

[GitHub] jon-wei commented on issue #6127: Unified configuration doc page

2018-08-07 Thread GitBox
jon-wei commented on issue #6127: Unified configuration doc page URL: https://github.com/apache/incubator-druid/pull/6127#issuecomment-411262036 Updated redirects This is an automated message from the Apache Git Service. To

[GitHub] jon-wei opened a new pull request #6128: Unified API doc page

2018-08-07 Thread GitBox
jon-wei opened a new pull request #6128: Unified API doc page URL: https://github.com/apache/incubator-druid/pull/6128 This PR creates a unified API reference page that lists all of the endpoints supported by each Druid service. The endpoint docs have been moved from `design` to the

[GitHub] gianm commented on issue #6127: Unified configuration doc page

2018-08-07 Thread GitBox
gianm commented on issue #6127: Unified configuration doc page URL: https://github.com/apache/incubator-druid/pull/6127#issuecomment-411255990 I LOVE THIS IDEA. Please add some lines to redirects.json so the old links keep working.

[GitHub] jon-wei opened a new pull request #6127: Unified configuration doc page

2018-08-07 Thread GitBox
jon-wei opened a new pull request #6127: Unified configuration doc page URL: https://github.com/apache/incubator-druid/pull/6127 This PR combines each of the individual service configuration pages under `configuration` into one unified page. TLS and auth configs have been added to

[GitHub] jon-wei opened a new pull request #6126: New quickstart and tutorials

2018-08-07 Thread GitBox
jon-wei opened a new pull request #6126: New quickstart and tutorials URL: https://github.com/apache/incubator-druid/pull/6126 This PR updates the quickstart and provides several new tutorials, as shown in `toc.md`. * [Quickstart] * [Tutorial: Loading a file] *

[GitHub] jihoonson commented on a change in pull request #6090: Fix missing exception handling as part of `io.druid.java.util.http.client.netty.HttpClientPipelineFactory`

2018-08-07 Thread GitBox
jihoonson commented on a change in pull request #6090: Fix missing exception handling as part of `io.druid.java.util.http.client.netty.HttpClientPipelineFactory` URL: https://github.com/apache/incubator-druid/pull/6090#discussion_r208428314 ## File path:

[GitHub] jihoonson commented on a change in pull request #6090: Fix missing exception handling as part of `io.druid.java.util.http.client.netty.HttpClientPipelineFactory`

2018-08-07 Thread GitBox
jihoonson commented on a change in pull request #6090: Fix missing exception handling as part of `io.druid.java.util.http.client.netty.HttpClientPipelineFactory` URL: https://github.com/apache/incubator-druid/pull/6090#discussion_r208428237 ## File path:

[GitHub] KenjiTakahashi opened a new pull request #6125: Fix appenderator_realtime creating shards bigger by 1 than maxRowsPerSegment

2018-08-07 Thread GitBox
KenjiTakahashi opened a new pull request #6125: Fix appenderator_realtime creating shards bigger by 1 than maxRowsPerSegment URL: https://github.com/apache/incubator-druid/pull/6125 Not that big of a deal generally, but it messes with our ingestion validation routines :-).

[GitHub] jihoonson commented on a change in pull request #6095: Add support 'keepSegmentGranularity' for compactionTask

2018-08-07 Thread GitBox
jihoonson commented on a change in pull request #6095: Add support 'keepSegmentGranularity' for compactionTask URL: https://github.com/apache/incubator-druid/pull/6095#discussion_r208425755 ## File path:

[GitHub] jihoonson commented on a change in pull request #6095: Add support 'keepSegmentGranularity' for compactionTask

2018-08-07 Thread GitBox
jihoonson commented on a change in pull request #6095: Add support 'keepSegmentGranularity' for compactionTask URL: https://github.com/apache/incubator-druid/pull/6095#discussion_r208425657 ## File path:

[incubator-druid] branch master updated: validate non-empty String baseDataSource in MaterializedViewSupervisorSpec, added tests (#6075)

2018-08-07 Thread jihoonson
This is an automated email from the ASF dual-hosted git repository. jihoonson pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-druid.git The following commit(s) were added to refs/heads/master by this push: new c3b7704 validate non-empty String

[incubator-druid] branch master updated: Fix missing argument of TaskToolbox (#6121)

2018-08-07 Thread jihoonson
This is an automated email from the ASF dual-hosted git repository. jihoonson pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-druid.git The following commit(s) were added to refs/heads/master by this push: new 577632f Fix missing argument of

[GitHub] jihoonson opened a new issue #6124: KafkaIndexTask can delete published segments on restart

2018-08-07 Thread GitBox
jihoonson opened a new issue #6124: KafkaIndexTask can delete published segments on restart URL: https://github.com/apache/incubator-druid/issues/6124 This can happen in the following scenario. 1. A kafka index task starts publishing segments. 2. The task succeeds to publish

[GitHub] sasounda commented on issue #5577: historical miscalculating remaining disk capacity - segment too large exception causing segments to not load

2018-08-07 Thread GitBox
sasounda commented on issue #5577: historical miscalculating remaining disk capacity - segment too large exception causing segments to not load URL: https://github.com/apache/incubator-druid/issues/5577#issuecomment-411213124 @gianm just wanted to check if someone is looking into this ?

[GitHub] jihoonson opened a new issue #6123: ClassCastException in groupBy when sorting on numeric columns containing nulls

2018-08-07 Thread GitBox
jihoonson opened a new issue #6123: ClassCastException in groupBy when sorting on numeric columns containing nulls URL: https://github.com/apache/incubator-druid/issues/6123 Here is the sample query. ``` { "queryType": "groupBy", "dataSource": { "type": "table",

[GitHub] KenjiTakahashi commented on issue #5006: No protections for select query

2018-08-07 Thread GitBox
KenjiTakahashi commented on issue #5006: No protections for select query URL: https://github.com/apache/incubator-druid/issues/5006#issuecomment-411212023 I'm with @gianm on this. I have examined the select in quite a detail in the past (before scan came to be, it is to be found somewhere

[GitHub] jon-wei opened a new pull request #6122: New docs intro

2018-08-07 Thread GitBox
jon-wei opened a new pull request #6122: New docs intro URL: https://github.com/apache/incubator-druid/pull/6122 Replaces the old intro concepts/architecture page and adds a new ingestion overview page This is an automated

[GitHub] jihoonson opened a new pull request #6121: Fix broken master

2018-08-07 Thread GitBox
jihoonson opened a new pull request #6121: Fix broken master URL: https://github.com/apache/incubator-druid/pull/6121 Fix missing argument of TaskToolbox. This is an automated message from the Apache Git Service. To respond

[GitHub] RestfulBlue edited a comment on issue #5006: No protections for select query

2018-08-07 Thread GitBox
RestfulBlue edited a comment on issue #5006: No protections for select query URL: https://github.com/apache/incubator-druid/issues/5006#issuecomment-411163311 @gianm yes, i have considered, but currently druid api can be used only from some ui apps, like grafana/metabase/etc. if we let

[GitHub] jon-wei opened a new pull request #6120: Separate hadoop and native batch docs more

2018-08-07 Thread GitBox
jon-wei opened a new pull request #6120: Separate hadoop and native batch docs more URL: https://github.com/apache/incubator-druid/pull/6120 Slight adjustment to batch ingestion docs, creating a separate page for hadoop and restructuring the existing batch ingestion page to be a directory

[GitHub] RestfulBlue edited a comment on issue #4826: AvaticaClientRuntimeException: Remote driver error: IllegalStateException: DefaultQueryMetrics must not be modified from multiple threads.

2018-08-07 Thread GitBox
RestfulBlue edited a comment on issue #4826: AvaticaClientRuntimeException: Remote driver error: IllegalStateException: DefaultQueryMetrics must not be modified from multiple threads. URL: https://github.com/apache/incubator-druid/issues/4826#issuecomment-411160413 @gianm i also issue

[GitHub] RestfulBlue commented on issue #5006: No protections for select query

2018-08-07 Thread GitBox
RestfulBlue commented on issue #5006: No protections for select query URL: https://github.com/apache/incubator-druid/issues/5006#issuecomment-411163311 @gianm yes, i have considered, but currently druid api can be used only from some ui apps, like grafana/metabase/etc. if we let every

[GitHub] RestfulBlue commented on issue #4826: AvaticaClientRuntimeException: Remote driver error: IllegalStateException: DefaultQueryMetrics must not be modified from multiple threads.

2018-08-07 Thread GitBox
RestfulBlue commented on issue #4826: AvaticaClientRuntimeException: Remote driver error: IllegalStateException: DefaultQueryMetrics must not be modified from multiple threads. URL: https://github.com/apache/incubator-druid/issues/4826#issuecomment-411160413 @gianm i also issue this

[GitHub] himanshug commented on issue #6088: Scan query: time-ordering

2018-08-07 Thread GitBox
himanshug commented on issue #6088: Scan query: time-ordering URL: https://github.com/apache/incubator-druid/issues/6088#issuecomment-411139043 Implementing (3) makes sense to me as well with one additional change that if limit was L then it would work like below. try finding latest L

[GitHub] gianm closed pull request #5108: Cache: Add maxEntrySize config, make groupBy cacheable by default.

2018-08-07 Thread GitBox
gianm closed pull request #5108: Cache: Add maxEntrySize config, make groupBy cacheable by default. URL: https://github.com/apache/incubator-druid/pull/5108 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[incubator-druid] branch master updated: Cache: Add maxEntrySize config, make groupBy cacheable by default. (#5108)

2018-08-07 Thread gian
This is an automated email from the ASF dual-hosted git repository. gian pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-druid.git The following commit(s) were added to refs/heads/master by this push: new 3525d40 Cache: Add maxEntrySize config,

[GitHub] jihoonson edited a comment on issue #5492: Native parallel batch indexing without shuffle

2018-08-07 Thread GitBox
jihoonson edited a comment on issue #5492: Native parallel batch indexing without shuffle URL: https://github.com/apache/incubator-druid/pull/5492#issuecomment-410923528 @josephglanville in perfect roll-up, all rows which have the timestamp falling in the same interval should be in the

[GitHub] drcrallen commented on issue #5492: Native parallel batch indexing without shuffle

2018-08-07 Thread GitBox
drcrallen commented on issue #5492: Native parallel batch indexing without shuffle URL: https://github.com/apache/incubator-druid/pull/5492#issuecomment-411124748 Tagged for special callout in release notes This is an

[GitHub] a2l007 commented on issue #6104: Webhdfs support for orc-extension

2018-08-07 Thread GitBox
a2l007 commented on issue #6104: Webhdfs support for orc-extension URL: https://github.com/apache/incubator-druid/issues/6104#issuecomment-411105781 Sure I'll investigate if it is indeed a better solution and then work towards contributing it.