[GitHub] [incubator-doris] imay opened a new issue #1837: Reduce the number of rowset of a table who has HLL column

2019-09-19 Thread GitBox
imay opened a new issue #1837: Reduce the number of rowset of a table who has HLL column URL: https://github.com/apache/incubator-doris/issues/1837 When we load data to table who contains HLL columns. Doris will generate many small rowsets whose size is about 100KB, then there will be two

[incubator-doris] branch master updated: Remove unused debug (#1836)

2019-09-19 Thread zhaoc
This is an automated email from the ASF dual-hosted git repository. zhaoc pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new abd27df Remove unused debug (#1836)

[GitHub] [incubator-doris] imay merged pull request #1836: Remove unused debug

2019-09-19 Thread GitBox
imay merged pull request #1836: Remove unused debug URL: https://github.com/apache/incubator-doris/pull/1836 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [incubator-doris] imay merged pull request #1831: Support setting timezone for stream load and routine load

2019-09-19 Thread GitBox
imay merged pull request #1831: Support setting timezone for stream load and routine load URL: https://github.com/apache/incubator-doris/pull/1831 This is an automated message from the Apache Git Service. To respond to the

[incubator-doris] branch master updated: Support setting timezone for stream load and routine load (#1831)

2019-09-19 Thread zhaoc
This is an automated email from the ASF dual-hosted git repository. zhaoc pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new e8da855 Support setting timezone for

[GitHub] [incubator-doris] imay merged pull request #1832: Fix bug that routine load may mistakenly skipped some data

2019-09-19 Thread GitBox
imay merged pull request #1832: Fix bug that routine load may mistakenly skipped some data URL: https://github.com/apache/incubator-doris/pull/1832 This is an automated message from the Apache Git Service. To respond to the

[incubator-doris] branch master updated: Fix bug that routine load may mistakenly skipped some data (#1832)

2019-09-19 Thread zhaoc
This is an automated email from the ASF dual-hosted git repository. zhaoc pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new 7bf02d0 Fix bug that routine load may

[GitHub] [incubator-doris] imay merged pull request #1833: Remove config::max_file_descriptor_number

2019-09-19 Thread GitBox
imay merged pull request #1833: Remove config::max_file_descriptor_number URL: https://github.com/apache/incubator-doris/pull/1833 This is an automated message from the Apache Git Service. To respond to the message, please

[incubator-doris] branch master updated: Remove config::max_file_descriptor_number (#1833)

2019-09-19 Thread zhaoc
This is an automated email from the ASF dual-hosted git repository. zhaoc pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new 720808f Remove

[GitHub] [incubator-doris] imay opened a new pull request #1836: Remove unused debug

2019-09-19 Thread GitBox
imay opened a new pull request #1836: Remove unused debug URL: https://github.com/apache/incubator-doris/pull/1836 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [incubator-doris] kangpinghuang opened a new pull request #1835: add default value column iterator #1834

2019-09-19 Thread GitBox
kangpinghuang opened a new pull request #1835: add default value column iterator #1834 URL: https://github.com/apache/incubator-doris/pull/1835 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-doris] kangpinghuang opened a new issue #1834: add default value column iterator for segment v2

2019-09-19 Thread GitBox
kangpinghuang opened a new issue #1834: add default value column iterator for segment v2 URL: https://github.com/apache/incubator-doris/issues/1834 Doris supports online schema change. So the tablet schema may change and be different with segment file's schema. Now Doris realize linked

[GitHub] [incubator-doris] chaoyli commented on a change in pull request #1833: Remove config::max_file_descriptor_number

2019-09-19 Thread GitBox
chaoyli commented on a change in pull request #1833: Remove config::max_file_descriptor_number URL: https://github.com/apache/incubator-doris/pull/1833#discussion_r326152928 ## File path: be/test/olap/delete_handler_test.cpp ## @@ -53,9 +53,7 @@ void set_up() {

[GitHub] [incubator-doris] imay commented on a change in pull request #1833: Remove config::max_file_descriptor_number

2019-09-19 Thread GitBox
imay commented on a change in pull request #1833: Remove config::max_file_descriptor_number URL: https://github.com/apache/incubator-doris/pull/1833#discussion_r326150259 ## File path: be/test/olap/delete_handler_test.cpp ## @@ -53,9 +53,7 @@ void set_up() {

[GitHub] [incubator-doris] chaoyli opened a new pull request #1833: Remove config::max_file_descriptor_number

2019-09-19 Thread GitBox
chaoyli opened a new pull request #1833: Remove config::max_file_descriptor_number URL: https://github.com/apache/incubator-doris/pull/1833 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-doris] morningman opened a new pull request #1832: Fix bug that routine load may mistakenly skipped some data

2019-09-19 Thread GitBox
morningman opened a new pull request #1832: Fix bug that routine load may mistakenly skipped some data URL: https://github.com/apache/incubator-doris/pull/1832 Reproduce: 1. start a routine load, send a routine load task to BE 2. BE executes task successfully and commit to FE. 3.

[incubator-doris] branch master updated (aaabf97 -> 315f762)

2019-09-19 Thread lichaoyong
This is an automated email from the ASF dual-hosted git repository. lichaoyong pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from aaabf97 Split channel close operation into two phase (#1830) add 315f762 Seek block when starts

[GitHub] [incubator-doris] chaoyli merged pull request #1828: Seek block when starts a ScanKey

2019-09-19 Thread GitBox
chaoyli merged pull request #1828: Seek block when starts a ScanKey URL: https://github.com/apache/incubator-doris/pull/1828 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [incubator-doris] imay commented on a change in pull request #1798: Optimize the load performance for large file

2019-09-19 Thread GitBox
imay commented on a change in pull request #1798: Optimize the load performance for large file URL: https://github.com/apache/incubator-doris/pull/1798#discussion_r326104070 ## File path: be/src/runtime/memtable_flush_executor.cpp ## @@ -0,0 +1,128 @@ +// Licensed to the

[GitHub] [incubator-doris] imay commented on a change in pull request #1798: Optimize the load performance for large file

2019-09-19 Thread GitBox
imay commented on a change in pull request #1798: Optimize the load performance for large file URL: https://github.com/apache/incubator-doris/pull/1798#discussion_r326102477 ## File path: be/src/runtime/memtable_flush_executor.h ## @@ -0,0 +1,85 @@ +// Licensed to the

[GitHub] [incubator-doris] imay commented on a change in pull request #1798: Optimize the load performance for large file

2019-09-19 Thread GitBox
imay commented on a change in pull request #1798: Optimize the load performance for large file URL: https://github.com/apache/incubator-doris/pull/1798#discussion_r326090612 ## File path: be/src/runtime/tablets_channel.h ## @@ -0,0 +1,122 @@ +// Licensed to the Apache

[GitHub] [incubator-doris] imay commented on a change in pull request #1798: Optimize the load performance for large file

2019-09-19 Thread GitBox
imay commented on a change in pull request #1798: Optimize the load performance for large file URL: https://github.com/apache/incubator-doris/pull/1798#discussion_r326082656 ## File path: be/src/common/config.h ## @@ -465,6 +465,8 @@ namespace config {

[GitHub] [incubator-doris] imay commented on a change in pull request #1798: Optimize the load performance for large file

2019-09-19 Thread GitBox
imay commented on a change in pull request #1798: Optimize the load performance for large file URL: https://github.com/apache/incubator-doris/pull/1798#discussion_r326082863 ## File path: be/src/olap/delta_writer.cpp ## @@ -26,24 +26,32 @@ namespace doris {

[GitHub] [incubator-doris] imay commented on a change in pull request #1798: Optimize the load performance for large file

2019-09-19 Thread GitBox
imay commented on a change in pull request #1798: Optimize the load performance for large file URL: https://github.com/apache/incubator-doris/pull/1798#discussion_r326084947 ## File path: be/src/olap/delta_writer.h ## @@ -75,10 +102,36 @@ class DeltaWriter {

[GitHub] [incubator-doris] morningman merged pull request #1830: Split channel close operation into two phase

2019-09-19 Thread GitBox
morningman merged pull request #1830: Split channel close operation into two phase URL: https://github.com/apache/incubator-doris/pull/1830 This is an automated message from the Apache Git Service. To respond to the

[incubator-doris] branch master updated (17e52a4 -> aaabf97)

2019-09-19 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from 17e52a4 Improve LRUCache to get better performance (#1826) add aaabf97 Split channel close

[GitHub] [incubator-doris] chaoyli closed pull request #1828: Seek block when starts a ScanKey

2019-09-19 Thread GitBox
chaoyli closed pull request #1828: Seek block when starts a ScanKey URL: https://github.com/apache/incubator-doris/pull/1828 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [incubator-doris] chaoyli opened a new pull request #1828: Seek block when starts a ScanKey

2019-09-19 Thread GitBox
chaoyli opened a new pull request #1828: Seek block when starts a ScanKey URL: https://github.com/apache/incubator-doris/pull/1828 In Doris, one block has 1024 rows. 1. If the previous ScanKey scan rows multiple blocks, and also the final block has 1024 rows just right. 2. The

[incubator-doris] branch master updated (e516eba -> 17e52a4)

2019-09-19 Thread lichaoyong
This is an automated email from the ASF dual-hosted git repository. lichaoyong pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from e516eba Remove the "author" tag (#1829) add 17e52a4 Improve LRUCache to get better performance

[GitHub] [incubator-doris] chaoyli merged pull request #1826: Improve LRUCache to get better performance

2019-09-19 Thread GitBox
chaoyli merged pull request #1826: Improve LRUCache to get better performance URL: https://github.com/apache/incubator-doris/pull/1826 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [incubator-doris] imay merged pull request #1829: Remove the "author" tag

2019-09-19 Thread GitBox
imay merged pull request #1829: Remove the "author" tag URL: https://github.com/apache/incubator-doris/pull/1829 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[incubator-doris] branch master updated: Remove the "author" tag (#1829)

2019-09-19 Thread zhaoc
This is an automated email from the ASF dual-hosted git repository. zhaoc pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new e516eba Remove the "author" tag

[GitHub] [incubator-doris] morningman opened a new pull request #1831: Support setting timezone for stream load and routine load

2019-09-19 Thread GitBox
morningman opened a new pull request #1831: Support setting timezone for stream load and routine load URL: https://github.com/apache/incubator-doris/pull/1831 This is an automated message from the Apache Git Service. To

[GitHub] [incubator-doris] morningman commented on a change in pull request #1828: Seek block when starts a ScanKey

2019-09-19 Thread GitBox
morningman commented on a change in pull request #1828: Seek block when starts a ScanKey URL: https://github.com/apache/incubator-doris/pull/1828#discussion_r325990989 ## File path: be/src/olap/rowset/segment_reader.cpp ## @@ -832,7 +841,7 @@ OLAPStatus

[GitHub] [incubator-doris] morningman commented on a change in pull request #1828: Seek block when starts a ScanKey

2019-09-19 Thread GitBox
morningman commented on a change in pull request #1828: Seek block when starts a ScanKey URL: https://github.com/apache/incubator-doris/pull/1828#discussion_r325990885 ## File path: be/src/olap/rowset/segment_reader.h ## @@ -308,7 +308,7 @@ class SegmentReader { //

[GitHub] [incubator-doris] HangyuanLiu edited a comment on issue #1825: HLL support default value

2019-09-19 Thread GitBox
HangyuanLiu edited a comment on issue #1825: HLL support default value URL: https://github.com/apache/incubator-doris/pull/1825#issuecomment-533002312 @kangkaisen If we add a empty_hll function , so we should write load command like . LOAD LABEL test.uv DATA INFILE

[GitHub] [incubator-doris] HangyuanLiu edited a comment on issue #1825: HLL support default value

2019-09-19 Thread GitBox
HangyuanLiu edited a comment on issue #1825: HLL support default value URL: https://github.com/apache/incubator-doris/pull/1825#issuecomment-533002312 @kangkaisen If we add a empty_hll function , so we should write load command like . LOAD LABEL test.uv DATA INFILE

[GitHub] [incubator-doris] HangyuanLiu commented on issue #1825: HLL support default value

2019-09-19 Thread GitBox
HangyuanLiu commented on issue #1825: HLL support default value URL: https://github.com/apache/incubator-doris/pull/1825#issuecomment-533002312 @kangkaisen If we add a empty_hll function , so we should write load command like . LOAD LABEL test.uv DATA INFILE

[GitHub] [incubator-doris] imay opened a new pull request #1830: Split channel close operation into two phase

2019-09-19 Thread GitBox
imay opened a new pull request #1830: Split channel close operation into two phase URL: https://github.com/apache/incubator-doris/pull/1830 In this change, channel close is finished into two phases. So we can close channels parallel, which can make query faster.

[GitHub] [incubator-doris] kangkaisen commented on issue #1825: HLL support default value

2019-09-19 Thread GitBox
kangkaisen commented on issue #1825: HLL support default value URL: https://github.com/apache/incubator-doris/pull/1825#issuecomment-532996610 @HangyuanLiu Hi, I See. Could we add a `empty_hll` function support this capability? add then, we could still ensure the HLL input in

[GitHub] [incubator-doris] imay commented on a change in pull request #1828: Seek block when starts a ScanKey

2019-09-19 Thread GitBox
imay commented on a change in pull request #1828: Seek block when starts a ScanKey URL: https://github.com/apache/incubator-doris/pull/1828#discussion_r326007261 ## File path: be/src/olap/rowset/segment_reader.h ## @@ -308,7 +308,7 @@ class SegmentReader { // If

[GitHub] [incubator-doris] HangyuanLiu commented on issue #1825: HLL support default value

2019-09-19 Thread GitBox
HangyuanLiu commented on issue #1825: HLL support default value URL: https://github.com/apache/incubator-doris/pull/1825#issuecomment-532987181 This PR will support this capability. There is a scenario where a Doris table may have multiple HLL columns that may come from different

[GitHub] [incubator-doris] imay commented on a change in pull request #1829: Remove the "author" tag

2019-09-19 Thread GitBox
imay commented on a change in pull request #1829: Remove the "author" tag URL: https://github.com/apache/incubator-doris/pull/1829#discussion_r326004953 ## File path: be/src/gutil/dynamic_annotations.c ## @@ -28,7 +28,6 @@ * OF THIS SOFTWARE, EVEN IF ADVISED OF THE

[GitHub] [incubator-doris] imay commented on a change in pull request #1829: Remove the "author" tag

2019-09-19 Thread GitBox
imay commented on a change in pull request #1829: Remove the "author" tag URL: https://github.com/apache/incubator-doris/pull/1829#discussion_r326004709 ## File path: be/src/gutil/utf/rune.c ## @@ -1,5 +1,4 @@ /* - * The authors of this software are Rob Pike and Ken

[GitHub] [incubator-doris] imay commented on a change in pull request #1829: Remove the "author" tag

2019-09-19 Thread GitBox
imay commented on a change in pull request #1829: Remove the "author" tag URL: https://github.com/apache/incubator-doris/pull/1829#discussion_r326004828 ## File path: webroot/static/jquery.dataTables.js ## @@ -7,7 +7,6 @@ * @description Paginate, search and order HTML

[GitHub] [incubator-doris] imay commented on a change in pull request #1829: Remove the "author" tag

2019-09-19 Thread GitBox
imay commented on a change in pull request #1829: Remove the "author" tag URL: https://github.com/apache/incubator-doris/pull/1829#discussion_r326004684 ## File path: be/src/gutil/utf/LICENSE ## @@ -1,6 +1,5 @@ UTF-8 Library -The authors of this software are Rob Pike

[GitHub] [incubator-doris] kangkaisen commented on issue #1825: HLL support default value

2019-09-19 Thread GitBox
kangkaisen commented on issue #1825: HLL support default value URL: https://github.com/apache/incubator-doris/pull/1825#issuecomment-532983775 > curl --location-trusted -u root:123456 -H column_separator:, -H label:test_uv_15 -H "columns:pin_id,idx,u1,u2,id=12" -T uv_test