kirkvicent commented on issue #7198: batch igesting data from hadoop
URL:
https://github.com/apache/incubator-druid/issues/7198#issuecomment-470088471
my ORDERED_DATE value is like this 1422955892000,which type is long
This
dene14 commented on issue #2748: Add ability to handle s3a URIs
URL:
https://github.com/apache/incubator-druid/issues/2748#issuecomment-470045406
@drcrallen shouldn't it be closed now?
This is an automated message from the
legedexinshi opened a new pull request #7199: Improve building
SegmentsCostCache for CachingCostBalancerStrategy
URL: https://github.com/apache/incubator-druid/pull/7199
In SegmentsCostCache.Bucket.Build, updating leftSum/rightSum for every
addSegment/removeSegment method is expensive and
asdf2014 commented on a change in pull request #7020: Write null byte when
indexing numeric dimensions with Hadoop
URL: https://github.com/apache/incubator-druid/pull/7020#discussion_r262931093
##
File path:
indexing-hadoop/src/main/java/org/apache/druid/indexer/InputRowSerde.java
kirkvicent opened a new issue #7198: batch igesting data from hadoop
URL: https://github.com/apache/incubator-druid/issues/7198
**my durid version is 0.12.0
my config file is like**
"parser" : {
"type" : "avro_hadoop",
"parseSpec" : {
"format"
YDHui opened a new issue #7197: Druid0.13.0 - 405 method not allow when I send
post to coordinator url
URL: https://github.com/apache/incubator-druid/issues/7197
### Affected Version
Druid 0.13.0
### Description
I post a lookup to coordinator url ,and it return a
kirkvicent commented on issue #5313: [Bug] Unparseable timestamp found!
URL:
https://github.com/apache/incubator-druid/issues/5313#issuecomment-470019786
do you fix it ? @QiuMM
This is an automated message from the Apache
drcrallen commented on a change in pull request #6953: Move GCP to a core
extension
URL: https://github.com/apache/incubator-druid/pull/6953#discussion_r263125953
##
File path: server/pom.xml
##
@@ -42,6 +42,11 @@
druid-aws-common
leventov commented on a change in pull request #7185: Avoid many unnecessary
materializations of collections of 'all segments in cluster' cardinality
URL: https://github.com/apache/incubator-druid/pull/7185#discussion_r263142135
##
File path:
jihoonson opened a new pull request #7203: Fix race in historical when loading
segments in parallel
URL: https://github.com/apache/incubator-druid/pull/7203
Partially addresses https://github.com/apache/incubator-druid/issues/7192.
In this PR,
- `segmentManager` is supposed
jon-wei opened a new pull request #7200: Reduce default max # of subTasks to 1
for native parallel task (#7181)
URL: https://github.com/apache/incubator-druid/pull/7200
* Reduce # of max subTasks to 2
* fix typo and add more doc
* add more doc and link
* change default
drcrallen commented on a change in pull request #6953: Move GCP to a core
extension
URL: https://github.com/apache/incubator-druid/pull/6953#discussion_r263127811
##
File path:
cloud/gcp-common/src/main/java/org/apache/druid/common/gcp/GcpModule.java
##
@@ -0,0 +1,80 @@
leventov opened a new issue #7201: Coordinator documentation is stale
URL: https://github.com/apache/incubator-druid/issues/7201
Coordinator documentation has the following paragraph:
> Before any unassigned segments are serviced by historical nodes, the
available historical nodes
leventov commented on issue #7073: Remove unnecessary check for contains() in
LoadRule
URL: https://github.com/apache/incubator-druid/pull/7073#issuecomment-470282165
@fjy I'm going to merge this PR next Monday unless you will leave some
comments.
jihoonson commented on issue #7192: Segments are not cleaned up properly after
unannouncing them in HTTP-based segment loading if numLoadingThreads > 1
URL:
https://github.com/apache/incubator-druid/issues/7192#issuecomment-470295519
I raised
leventov commented on a change in pull request #7154: rename maintenance mode
to decommission
URL: https://github.com/apache/incubator-druid/pull/7154#discussion_r263149183
##
File path: docs/content/configuration/index.md
##
@@ -803,9 +803,9 @@ Issuing a GET request at
leventov commented on a change in pull request #7154: rename maintenance mode
to decommission
URL: https://github.com/apache/incubator-druid/pull/7154#discussion_r263155699
##
File path: docs/content/configuration/index.md
##
@@ -803,9 +803,9 @@ Issuing a GET request at
jihoonson commented on a change in pull request #7203: Fix race in historical
when loading segments in parallel
URL: https://github.com/apache/incubator-druid/pull/7203#discussion_r263158128
##
File path: server/src/main/java/org/apache/druid/server/SegmentManager.java
##
drcrallen edited a comment on issue #6865: Densify swapped hll buffer
URL: https://github.com/apache/incubator-druid/pull/6865#issuecomment-470253897
If the solutions were presented which fixed up items related to the core HLL
aggregator itself. This part of the code still would have the
drcrallen edited a comment on issue #6865: Densify swapped hll buffer
URL: https://github.com/apache/incubator-druid/pull/6865#issuecomment-470253897
If the solutions were presented which fixed up items related to the core HLL
aggregator itself. This part of the code still would have the
drcrallen commented on a change in pull request #6865: Densify swapped hll
buffer
URL: https://github.com/apache/incubator-druid/pull/6865#discussion_r263120641
##
File path: hll/src/test/java/org/apache/druid/hll/HyperLogLogCollectorTest.java
##
@@ -79,14 +95,13 @@
drcrallen commented on issue #6865: Densify swapped hll buffer
URL: https://github.com/apache/incubator-druid/pull/6865#issuecomment-470264296
the problem with the sparseness checks is that sometimes the buffer has a
read only with the headers, and sometimes it is a read only without the
leventov opened a new issue #7202: DruidCoordinatorBalancer may move
overshadowed segments
URL: https://github.com/apache/incubator-druid/issues/7202
I don't see why `DruidCoordinatorBalancer` shouldn't exclude overshadowed
segments from consideration as well as
clintropolis commented on issue #7201: Coordinator documentation is stale
URL:
https://github.com/apache/incubator-druid/issues/7201#issuecomment-470287410
Yes, you are right, loading and dropping decisions are done with the
`BalancerStrategy` so that the load rules and the balancer do
clintropolis commented on issue #7201: Coordinator documentation is stale
URL:
https://github.com/apache/incubator-druid/issues/7201#issuecomment-470290575
>... actually it does, if HTTP announcing (should we better call it "HTTP
segment loading info communication"?) is used.
gianm commented on a change in pull request #6953: Move GCP to a core extension
URL: https://github.com/apache/incubator-druid/pull/6953#discussion_r263153644
##
File path: server/pom.xml
##
@@ -42,6 +42,11 @@
druid-aws-common
leventov commented on a change in pull request #7154: rename maintenance mode
to decommission
URL: https://github.com/apache/incubator-druid/pull/7154#discussion_r263155699
##
File path: docs/content/configuration/index.md
##
@@ -803,9 +803,9 @@ Issuing a GET request at
clintropolis commented on a change in pull request #7154: rename maintenance
mode to decommission
URL: https://github.com/apache/incubator-druid/pull/7154#discussion_r263157013
##
File path: docs/content/configuration/index.md
##
@@ -803,9 +803,9 @@ Issuing a GET request
leventov commented on a change in pull request #7154: rename maintenance mode
to decommission
URL: https://github.com/apache/incubator-druid/pull/7154#discussion_r263155699
##
File path: docs/content/configuration/index.md
##
@@ -803,9 +803,9 @@ Issuing a GET request at
leventov commented on a change in pull request #7154: rename maintenance mode
to decommission
URL: https://github.com/apache/incubator-druid/pull/7154#discussion_r263155699
##
File path: docs/content/configuration/index.md
##
@@ -803,9 +803,9 @@ Issuing a GET request at
drcrallen commented on a change in pull request #6953: Move GCP to a core
extension
URL: https://github.com/apache/incubator-druid/pull/6953#discussion_r263104760
##
File path:
cloud/gcp-common/src/main/java/org/apache/druid/common/gcp/GcpModule.java
##
@@ -0,0 +1,80 @@
drcrallen commented on issue #6865: Densify swapped hll buffer
URL: https://github.com/apache/incubator-druid/pull/6865#issuecomment-470253897
If the solutions were presented which fixed up items related to the core HLL
aggregator itself. This part of the code still would have the
clintropolis commented on issue #6865: Densify swapped hll buffer
URL: https://github.com/apache/incubator-druid/pull/6865#issuecomment-470267725
@drcrallen I spent some time last night trying to sift through the hll code
to have a stronger opinion, and I think I agree with you. I suspect
leventov commented on a change in pull request #7185: Avoid many unnecessary
materializations of collections of 'all segments in cluster' cardinality
URL: https://github.com/apache/incubator-druid/pull/7185#discussion_r263142135
##
File path:
leventov commented on a change in pull request #7185: Avoid many unnecessary
materializations of collections of 'all segments in cluster' cardinality
URL: https://github.com/apache/incubator-druid/pull/7185#discussion_r263142135
##
File path:
leventov commented on a change in pull request #7185: Avoid many unnecessary
materializations of collections of 'all segments in cluster' cardinality
URL: https://github.com/apache/incubator-druid/pull/7185#discussion_r263144931
##
File path:
leventov commented on a change in pull request #7154: rename maintenance mode
to decommission
URL: https://github.com/apache/incubator-druid/pull/7154#discussion_r263155699
##
File path: docs/content/configuration/index.md
##
@@ -803,9 +803,9 @@ Issuing a GET request at
gianm commented on a change in pull request #7203: Fix race in historical when
loading segments in parallel
URL: https://github.com/apache/incubator-druid/pull/7203#discussion_r263156936
##
File path: server/src/main/java/org/apache/druid/server/SegmentManager.java
##
@@
jihoonson commented on a change in pull request #7048: Make
IngestSegmentFirehoseFactory splittable for parallel ingestion
URL: https://github.com/apache/incubator-druid/pull/7048#discussion_r263170456
##
File path:
jorbay-au opened a new pull request #7205: Remove outdated instruction for rule
updates
URL: https://github.com/apache/incubator-druid/pull/7205
When updating rules, I see my results immediately and do not need to restart
the coordinator to see this reflected. Also, this line is [almost 4
leventov opened a new pull request #7206: Add the pull-request template
URL: https://github.com/apache/incubator-druid/pull/7206
Adds the pull request template. Includes "Description" and "Design" sections.
In the bottom, the template contains a nudge for PR authors to review their
leventov commented on a change in pull request #7154: rename maintenance mode
to decommission
URL: https://github.com/apache/incubator-druid/pull/7154#discussion_r263186425
##
File path: docs/content/configuration/index.md
##
@@ -803,9 +803,9 @@ Issuing a GET request at
clintropolis opened a new pull request #7204: [Backport] Densify swapped hll
buffer
URL: https://github.com/apache/incubator-druid/pull/7204
Backport of #6865 to 0.14.0-incubating.
This is an automated message from the
drcrallen commented on a change in pull request #6953: Move GCP to a core
extension
URL: https://github.com/apache/incubator-druid/pull/6953#discussion_r263179414
##
File path: server/pom.xml
##
@@ -42,6 +42,11 @@
druid-aws-common
drcrallen commented on a change in pull request #6953: Move GCP to a core
extension
URL: https://github.com/apache/incubator-druid/pull/6953#discussion_r263180097
##
File path: server/pom.xml
##
@@ -42,6 +42,11 @@
druid-aws-common
peferron commented on issue #7187: Improve topN algorithm
URL:
https://github.com/apache/incubator-druid/issues/7187#issuecomment-470307248
@leerho Going back to your song example, could FIS support getting the top
song titles by number of unique listeners over the past week? The current
This is an automated email from the ASF dual-hosted git repository.
cwylie pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-druid.git
The following commit(s) were added to refs/heads/master by this push:
new 3ed2507 Densify swapped hll buffer
clintropolis merged pull request #6865: Densify swapped hll buffer
URL: https://github.com/apache/incubator-druid/pull/6865
This is an automated message from the Apache Git Service.
To respond to the message, please log on
clintropolis commented on a change in pull request #7154: rename maintenance
mode to decommission
URL: https://github.com/apache/incubator-druid/pull/7154#discussion_r263173158
##
File path: docs/content/configuration/index.md
##
@@ -803,9 +803,9 @@ Issuing a GET request
clintropolis commented on a change in pull request #7154: rename maintenance
mode to decommission
URL: https://github.com/apache/incubator-druid/pull/7154#discussion_r263187568
##
File path: docs/content/configuration/index.md
##
@@ -803,9 +803,9 @@ Issuing a GET request
leerho commented on issue #7187: Improve topN algorithm
URL:
https://github.com/apache/incubator-druid/issues/7187#issuecomment-470366530
> getting the top song titles by number of unique listeners over the past
week
@peferron Now that is very interesting! The current FIS doesn't
leerho edited a comment on issue #7187: Improve topN algorithm
URL:
https://github.com/apache/incubator-druid/issues/7187#issuecomment-470366530
> getting the top song titles by number of unique listeners over the past
week
@peferron Now that is very interesting! The current FIS
QiuMM commented on issue #5313: [Bug] Unparseable timestamp found!
URL:
https://github.com/apache/incubator-druid/issues/5313#issuecomment-470369737
@kirkvicent yes, it was fixed in 0.11.0, you can upgrade you version.
This
leerho commented on issue #7187: Improve topN algorithm
URL:
https://github.com/apache/incubator-druid/issues/7187#issuecomment-470369765
@peferron
By the way, we do have an[ HLL Map
sketch](https://datasketches.github.io/docs/HLL/HllMap.html), but it was
designed with a different
jon-wei commented on a change in pull request #7154: rename maintenance mode to
decommission
URL: https://github.com/apache/incubator-druid/pull/7154#discussion_r263195294
##
File path: docs/content/configuration/index.md
##
@@ -803,9 +803,9 @@ Issuing a GET request at
This is an automated email from the ASF dual-hosted git repository.
jonwei pushed a commit to branch 0.14.0-incubating
in repository https://gitbox.apache.org/repos/asf/incubator-druid.git
The following commit(s) were added to refs/heads/0.14.0-incubating by this push:
new 9058e68 Reduce
jon-wei merged pull request #7200: [Backport] Reduce default max # of subTasks
to 1 for native parallel task (#7181)
URL: https://github.com/apache/incubator-druid/pull/7200
This is an automated message from the Apache Git
gianm commented on a change in pull request #6953: Move GCP to a core extension
URL: https://github.com/apache/incubator-druid/pull/6953#discussion_r263208535
##
File path: server/pom.xml
##
@@ -42,6 +42,11 @@
druid-aws-common
gianm commented on issue #6953: Move GCP to a core extension
URL: https://github.com/apache/incubator-druid/pull/6953#issuecomment-470350539
@drcrallen in extensions-core/google-extensions/pom.xml, the groupId's gotta
be `org.apache.druid.extensions`
jon-wei commented on a change in pull request #7206: Add the pull-request
template
URL: https://github.com/apache/incubator-druid/pull/7206#discussion_r263197433
##
File path: .github/pull_request_template.md
##
@@ -0,0 +1,53 @@
+Fixes #.
+
+(Replace with the id
jon-wei commented on a change in pull request #7206: Add the pull-request
template
URL: https://github.com/apache/incubator-druid/pull/7206#discussion_r263197283
##
File path: .github/pull_request_template.md
##
@@ -0,0 +1,53 @@
+Fixes #.
+
+(Replace with the id
jon-wei commented on a change in pull request #7206: Add the pull-request
template
URL: https://github.com/apache/incubator-druid/pull/7206#discussion_r263199240
##
File path: .github/pull_request_template.md
##
@@ -0,0 +1,53 @@
+Fixes #.
+
+(Replace with the id
leerho commented on issue #6865: Densify swapped hll buffer
URL: https://github.com/apache/incubator-druid/pull/6865#issuecomment-470353651
@drcrallen
I agree with what you are attempting to do.
This is an automated
drcrallen commented on issue #6865: Densify swapped hll buffer
URL: https://github.com/apache/incubator-druid/pull/6865#issuecomment-470257066
For longer term fixes, I'm not even sure if documenting the existing HLL
design is worth it. For example, simply saying "Legacy HLL implementation
jon-wei commented on issue #6865: Densify swapped hll buffer
URL: https://github.com/apache/incubator-druid/pull/6865#issuecomment-470276731
> For longer term fixes, I'm not even sure if documenting the existing HLL
design is worth it. For example, simply saying "Legacy HLL implementation
jon-wei edited a comment on issue #6865: Densify swapped hll buffer
URL: https://github.com/apache/incubator-druid/pull/6865#issuecomment-470276731
> For longer term fixes, I'm not even sure if documenting the existing HLL
design is worth it. For example, simply saying "Legacy HLL
stale[bot] commented on issue #6702: Add SelfDiscoveryResource
URL: https://github.com/apache/incubator-druid/pull/6702#issuecomment-470398793
This pull request has been closed due to lack of activity. If you think that
is incorrect, or the pull request requires review, you can revive the
stale[bot] commented on issue #6484: Fix handling of cached data populated from
result level cache (#6483)
URL: https://github.com/apache/incubator-druid/pull/6484#issuecomment-470398769
This pull request has been closed due to lack of activity. If you think that
is incorrect, or the
stale[bot] commented on issue #3530: Create basePersistDirectory only when
needed
URL: https://github.com/apache/incubator-druid/pull/3530#issuecomment-470398752
This pull request has been closed due to lack of activity. If you think that
is incorrect, or the pull request requires review,
stale[bot] closed pull request #4919: Add a metric task/assign/time for
indexing service
URL: https://github.com/apache/incubator-druid/pull/4919
This is an automated message from the Apache Git Service.
To respond to the
stale[bot] closed pull request #4425: support multiValueDelimiter
URL: https://github.com/apache/incubator-druid/pull/4425
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
stale[bot] commented on issue #5674: Bump kafka to 1.1.0 in indexer
URL: https://github.com/apache/incubator-druid/pull/5674#issuecomment-470398786
This pull request has been closed due to lack of activity. If you think that
is incorrect, or the pull request requires review, you can revive
stale[bot] closed pull request #5514: Add http endpoint to check query history
URL: https://github.com/apache/incubator-druid/pull/5514
This is an automated message from the Apache Git Service.
To respond to the message,
stale[bot] closed pull request #5151: Add view support in Druid
URL: https://github.com/apache/incubator-druid/pull/5151
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
stale[bot] commented on issue #3778: add
SegmentGranularityRejectionPolicyFactory
URL: https://github.com/apache/incubator-druid/pull/3778#issuecomment-470398742
This pull request has been closed due to lack of activity. If you think that
is incorrect, or the pull request requires review,
stale[bot] closed pull request #5345: [WIP]Use DefaultBlockingPool for Global
Processing Pool instead of StupidPool that can allocate arbitrary number of
buffers and cause crashes.
URL: https://github.com/apache/incubator-druid/pull/5345
stale[bot] closed pull request #5787: Adding additional datatypes support for
Parquet extension
URL: https://github.com/apache/incubator-druid/pull/5787
This is an automated message from the Apache Git Service.
To respond
stale[bot] closed pull request #4446: correction in HLL algo
URL: https://github.com/apache/incubator-druid/pull/4446
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
stale[bot] closed pull request #4775: Throw exception when start broker or
historical using default config.
URL: https://github.com/apache/incubator-druid/pull/4775
This is an automated message from the Apache Git Service.
glasser commented on issue #5789: Add stringLast and stringFirst aggregators
extension
URL: https://github.com/apache/incubator-druid/pull/5789#issuecomment-470404056
OK, I attempted a a trivial reproduction by working through the Kafka stream
tutorial but removing `channel` from
leerho commented on issue #7187: Improve topN algorithm
URL:
https://github.com/apache/incubator-druid/issues/7187#issuecomment-470408649
Thanks for your clarifications. I was led to believe that the TopN process
was the one I described. A PriorityQueue is a Min-heap so it sounds like
glasser commented on issue #5789: Add stringLast and stringFirst aggregators
extension
URL: https://github.com/apache/incubator-druid/pull/5789#issuecomment-470415828
I don't really understand the variety of slightly different entry points
involved in the metric aggregation process, but
stale[bot] closed pull request #4321: fix it didn't remove multiple copies of
task
URL: https://github.com/apache/incubator-druid/pull/4321
This is an automated message from the Apache Git Service.
To respond to the
stale[bot] closed pull request #3915: [DO NOT Merge] Very initial pass -
ByteBuffer -> Memory
URL: https://github.com/apache/incubator-druid/pull/3915
This is an automated message from the Apache Git Service.
To respond to
stale[bot] closed pull request #3545: add prefetch ability to data fetcher
URL: https://github.com/apache/incubator-druid/pull/3545
This is an automated message from the Apache Git Service.
To respond to the message, please
stale[bot] commented on issue #3779: [QTL] Check lookup extractor factory spec
at registration time
URL: https://github.com/apache/incubator-druid/pull/3779#issuecomment-470412245
This pull request has been closed due to lack of activity. If you think that
is incorrect, or the pull
stale[bot] closed pull request #3264: UDFs for comparator and math expression
URL: https://github.com/apache/incubator-druid/pull/3264
This is an automated message from the Apache Git Service.
To respond to the message,
stale[bot] closed pull request #3292: support select mata query
URL: https://github.com/apache/incubator-druid/pull/3292
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
stale[bot] closed pull request #3542: Support regex type datasource
URL: https://github.com/apache/incubator-druid/pull/3542
This is an automated message from the Apache Git Service.
To respond to the message, please log on
stale[bot] closed pull request #4159: new extension for aliyun oss support
URL: https://github.com/apache/incubator-druid/pull/4159
This is an automated message from the Apache Git Service.
To respond to the message, please
stale[bot] closed pull request #3285: Support projection post operator
URL: https://github.com/apache/incubator-druid/pull/3285
This is an automated message from the Apache Git Service.
To respond to the message, please log
stale[bot] closed pull request #2953: Embeded druid broker
URL: https://github.com/apache/incubator-druid/pull/2953
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub
stale[bot] closed pull request #3490: Close partial indices after merging for
batch indexing
URL: https://github.com/apache/incubator-druid/pull/3490
This is an automated message from the Apache Git Service.
To respond to
stale[bot] closed pull request #3445: Enhancing SegmentLoaderLocalCacheManager
URL: https://github.com/apache/incubator-druid/pull/3445
This is an automated message from the Apache Git Service.
To respond to the message,
stale[bot] closed pull request #3482: Hadoop Index Task to support creating
multiple dataSources
URL: https://github.com/apache/incubator-druid/pull/3482
This is an automated message from the Apache Git Service.
To respond
stale[bot] commented on issue #3511: Add option for skipping groupby-ing on
null dimension
URL: https://github.com/apache/incubator-druid/pull/3511#issuecomment-470412233
This pull request has been closed due to lack of activity. If you think that
is incorrect, or the pull request
stale[bot] closed pull request #3319: introduce /druid/v3 query endpoint that
gives query responseContext
URL: https://github.com/apache/incubator-druid/pull/3319
This is an automated message from the Apache Git Service.
To
stale[bot] closed pull request #3392: [WIP] Cache bitmap of dimfilters
URL: https://github.com/apache/incubator-druid/pull/3392
This is an automated message from the Apache Git Service.
To respond to the message, please log
stale[bot] commented on issue #4066: tupleDoubleArraySketch
URL: https://github.com/apache/incubator-druid/pull/4066#issuecomment-470412251
This pull request has been closed due to lack of activity. If you think that
is incorrect, or the pull request requires review, you can revive the PR
stale[bot] commented on issue #4201: [DO NOT MERGE] New ToC
URL: https://github.com/apache/incubator-druid/pull/4201#issuecomment-470412262
This pull request has been closed due to lack of activity. If you think that
is incorrect, or the pull request requires review, you can revive the PR
1 - 100 of 187 matches
Mail list logo
