Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2816#discussion_r228028346
--- Diff: store/CSDK/main.cpp ---
@@ -21,6 +21,8 @@
#include
#include
#include "CarbonReader.h"
+#include &q
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2816#discussion_r228026273
--- Diff: store/CSDK/CMakeLists.txt ---
@@ -1,17 +1,17 @@
-cmake_minimum_required (VERSION 2.8)
-project (CJDK)
+cmake_minimum_required
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2816#discussion_r228025690
--- Diff: store/CSDK/main.cpp ---
@@ -21,6 +21,8 @@
#include
#include
#include "CarbonReader.h"
+#include &q
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2816#discussion_r228025597
--- Diff: store/CSDK/CarbonReader.cpp ---
@@ -17,6 +17,7 @@
#include "CarbonReader.h"
#include
+#include
--
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2816#discussion_r228025429
--- Diff: store/CSDK/CMakeLists.txt ---
@@ -1,17 +1,17 @@
-cmake_minimum_required (VERSION 2.8)
-project (CJDK)
+cmake_minimum_required
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2816#discussion_r228024318
--- Diff:
core/src/main/java/org/apache/carbondata/core/scan/result/iterator/ChunkRowIterator.java
---
@@ -74,4 +76,13 @@ public ChunkRowIterator
Github user xubo245 commented on the issue:
https://github.com/apache/carbondata/pull/2792
retest this please
---
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2792#discussion_r228010100
--- Diff:
store/sdk/src/test/java/org/apache/carbondata/sdk/file/CarbonReaderTest.java ---
@@ -1522,4 +1522,204 @@ public boolean accept(File dir
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2792#discussion_r228009608
--- Diff: docs/csdk-guide.md ---
@@ -68,20 +68,42 @@ JNIEnv *initJVM() {
bool readFromLocalWithoutProjection(JNIEnv *env
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2792#discussion_r228009633
--- Diff: docs/csdk-guide.md ---
@@ -106,20 +128,41 @@ bool readFromS3(JNIEnv *env, char *argv[]) {
// "your endPoint"
args
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2792#discussion_r228009906
--- Diff:
store/sdk/src/test/java/org/apache/carbondata/sdk/file/CarbonReaderTest.java ---
@@ -1522,4 +1522,204 @@ public boolean accept(File dir
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2792#discussion_r227807282
--- Diff:
store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonReader.java ---
@@ -93,32 +92,10 @@ public T readNextRow() throws IOException
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2792#discussion_r227798659
--- Diff: store/CSDK/CarbonRow.cpp ---
@@ -0,0 +1,128 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2842#discussion_r227635359
--- Diff: docs/sdk-guide.md ---
@@ -24,7 +24,8 @@ CarbonData provides SDK to facilitate
# SDK Writer
-In the carbon jars package
[
https://issues.apache.org/jira/browse/CARBONDATA-3037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xubo245 updated CARBONDATA-3037:
Description:
## Introduce
When read data by using CarbonData SDK from S3 , It throw some
[
https://issues.apache.org/jira/browse/CARBONDATA-3037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xubo245 updated CARBONDATA-3037:
Description:
##Introduce
When read data by using CarbonData SDK from S3 , It throw some
xubo245 created CARBONDATA-3037:
---
Summary: Throw ConnectionPoolTimeoutException when carbondata SDK
read data from S3
Key: CARBONDATA-3037
URL: https://issues.apache.org/jira/browse/CARBONDATA-3037
Github user xubo245 commented on the issue:
https://github.com/apache/carbondata/pull/2839
retest this please
---
GitHub user xubo245 opened a pull request:
https://github.com/apache/carbondata/pull/2842
[CARBONDATA-3032] Remove carbon.blocklet.size from properties template
1.Remove carbon.blocklet.size from properties template, because
carbon.blocklet.size is in V2, V3 use
xubo245 created CARBONDATA-3032:
---
Summary: Remove carbon.blocklet.size from properties template
Key: CARBONDATA-3032
URL: https://issues.apache.org/jira/browse/CARBONDATA-3032
Project: CarbonData
GitHub user xubo245 opened a pull request:
https://github.com/apache/carbondata/pull/2839
[CARBONDATA-3030] Remove no use parameter in test case
[CARBONDATA-3030] Remove no use parameter in test case
Remove no use parameter in test case
1. remove
xubo245 created CARBONDATA-3030:
---
Summary: Remove no use parameter in test case
Key: CARBONDATA-3030
URL: https://issues.apache.org/jira/browse/CARBONDATA-3030
Project: CarbonData
Issue Type
Github user xubo245 commented on the issue:
https://github.com/apache/carbondata/pull/2792
retest this please
---
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2792#discussion_r226830397
--- Diff:
store/sdk/src/main/java/org/apache/carbondata/sdk/file/RowUtil.java ---
@@ -0,0 +1,146 @@
+/*
+ * Licensed to the Apache Software
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2816#discussion_r226565398
--- Diff:
examples/spark2/src/main/java/org/apache/carbondata/benchmark/SDKReaderBenchmark.java
---
@@ -0,0 +1,261 @@
+/*
+ * Licensed
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2792#discussion_r226562638
--- Diff: docs/documentation.md ---
@@ -31,7 +31,7 @@ Apache CarbonData is a new big data file format for
faster interactive query usi
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2792#discussion_r226562555
--- Diff: docs/CSDK-guide.md ---
@@ -68,20 +68,42 @@ JNIEnv *initJVM() {
bool readFromLocalWithoutProjection(JNIEnv *env
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2792#discussion_r226562463
--- Diff: README.md ---
@@ -61,6 +61,7 @@ CarbonData is built using Apache Maven, to [build
CarbonData](https://github.com
* [CarbonData Pre
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2792#discussion_r226560678
--- Diff: docs/documentation.md ---
@@ -31,7 +31,7 @@ Apache CarbonData is a new big data file format for
faster interactive query usi
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2792#discussion_r226560544
--- Diff:
store/sdk/src/main/java/org/apache/carbondata/sdk/file/RowUtil.java ---
@@ -0,0 +1,146 @@
+/*
+ * Licensed to the Apache Software
GitHub user xubo245 opened a pull request:
https://github.com/apache/carbondata/pull/2837
[CARBONDATA-3000] Provide C++ interface for writing carbon data in CSDK
[CARBONDATA-3000] Provide C++ interface for writing carbon data in CSDK
1.suport string, short, int, long, double
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2836#discussion_r226548201
--- Diff:
core/src/main/java/org/apache/carbondata/core/constants/CarbonCommonConstants.java
---
@@ -1234,7 +1234,7 @@
@CarbonProperty
GitHub user xubo245 opened a pull request:
https://github.com/apache/carbondata/pull/2836
[CARBONDATA-3027] Increase unsafe working memory default size and add log
file for SDK
[CARBONDATA-3027] Increase unsafe working memory default size and add log
file for SDK
1
xubo245 created CARBONDATA-3027:
---
Summary: Throw MemoryException when read big data
Key: CARBONDATA-3027
URL: https://issues.apache.org/jira/browse/CARBONDATA-3027
Project: CarbonData
Issue
Github user xubo245 commented on the issue:
https://github.com/apache/carbondata/pull/2816
retest this please
---
GitHub user xubo245 opened a pull request:
https://github.com/apache/carbondata/pull/2816
[CARBONDATA-300] Suppor read batch row in CSDK
[CARBONDATA-300] Suppor read batch row in CSDK
1. support read batch row in SDK
2. support read batch row in CSDK
3. add
xubo245 created CARBONDATA-3003:
---
Summary: Suppor read batch row in CSDK
Key: CARBONDATA-3003
URL: https://issues.apache.org/jira/browse/CARBONDATA-3003
Project: CarbonData
Issue Type: Sub
GitHub user xubo245 opened a pull request:
https://github.com/apache/carbondata/pull/2811
[CARBONDATA-3002] Fix some spell error and remove the data after test case
finished running
[CARBONDATA-3002] Fix some spell error and remove the data after test case
finished running
Github user xubo245 commented on the issue:
https://github.com/apache/carbondata/pull/2792
@KanakaKumar @kunal642 @ajantha-bhat @jackylk please review it.
---
xubo245 created CARBONDATA-3002:
---
Summary: Fix some spell error and remove the data after test case
finished running
Key: CARBONDATA-3002
URL: https://issues.apache.org/jira/browse/CARBONDATA-3002
Github user xubo245 commented on the issue:
https://github.com/apache/carbondata/pull/2792
retest this please
---
Github user xubo245 commented on the issue:
https://github.com/apache/carbondata/pull/2691
merged to branch-1.3
---
Github user xubo245 commented on the issue:
https://github.com/apache/carbondata/pull/2792
retest this please
---
Github user xubo245 commented on the issue:
https://github.com/apache/carbondata/pull/2792
retest this please
---
Github user xubo245 commented on the issue:
https://github.com/apache/carbondata/pull/2792
retest this please
---
xubo245 created CARBONDATA-3000:
---
Summary: Provide C++ interface for writing carbon data
Key: CARBONDATA-3000
URL: https://issues.apache.org/jira/browse/CARBONDATA-3000
Project: CarbonData
xubo245 created CARBONDATA-2999:
---
Summary: support read schema from S3
Key: CARBONDATA-2999
URL: https://issues.apache.org/jira/browse/CARBONDATA-2999
Project: CarbonData
Issue Type: Sub-task
Github user xubo245 commented on the issue:
https://github.com/apache/carbondata/pull/2792
retest this please
---
Github user xubo245 commented on the issue:
https://github.com/apache/carbondata/pull/2807
@KanakaKumar @kunal642 @jackylk Please review it.
---
Github user xubo245 commented on the issue:
https://github.com/apache/carbondata/pull/2792
retest this please
---
Github user xubo245 commented on the issue:
https://github.com/apache/carbondata/pull/2804
@KanakaKumar @kunal642 @jackylk Please review it.
---
GitHub user xubo245 opened a pull request:
https://github.com/apache/carbondata/pull/2807
[CARBONDATA-2997] Support read schema from index file and data file in CSDK
[CARBONDATA-2997] Support read schema from index file and data file in CSDK
1.support readSchemaInIndexFile
Github user xubo245 commented on the issue:
https://github.com/apache/carbondata/pull/2792
retest this please
---
Github user xubo245 commented on the issue:
https://github.com/apache/carbondata/pull/2792
@KanakaKumar I optimize this PR. remove change in carbonRecordReader and
add static method in RowUtil.
I will raise a new PR for reading schema
---
xubo245 created CARBONDATA-2997:
---
Summary: Support read schema from index file and data file in CSDK
Key: CARBONDATA-2997
URL: https://issues.apache.org/jira/browse/CARBONDATA-2997
Project: CarbonData
GitHub user xubo245 opened a pull request:
https://github.com/apache/carbondata/pull/2804
[CARBONDATA-2996] CarbonSchemaReader support read schema from folder path
[CARBONDATA-2996] CarbonSchemaReader support read schema from folder path
1.readSchemaInDataFile suppurt read
xubo245 created CARBONDATA-2996:
---
Summary: readSchemaInIndexFile can't read schema by folder path
Key: CARBONDATA-2996
URL: https://issues.apache.org/jira/browse/CARBONDATA-2996
Project: CarbonData
Github user xubo245 closed the pull request at:
https://github.com/apache/carbondata/pull/2691
---
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2792#discussion_r223267582
--- Diff: README.md ---
@@ -52,6 +52,7 @@ CarbonData is built using Apache Maven, to [build
CarbonData](https://github.com
* [Configuring
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2792#discussion_r223244987
--- Diff:
hadoop/src/main/java/org/apache/carbondata/hadoop/readsupport/impl/DictionaryDecodeReadSupport.java
---
@@ -81,7 +82,24 @@
data
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2792#discussion_r223243327
--- Diff:
core/src/main/java/org/apache/carbondata/core/datastore/row/CarbonRow.java ---
@@ -18,8 +18,11 @@
package
Github user xubo245 commented on the issue:
https://github.com/apache/carbondata/pull/2792
@kunal642 OKï¼added
---
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2792#discussion_r223240030
--- Diff: store/CSDK/CarbonReader.cpp ---
@@ -89,10 +89,18 @@ jboolean CarbonReader::hasNext() {
return hasNext;
}
+jobject
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2792#discussion_r223238726
--- Diff:
hadoop/src/main/java/org/apache/carbondata/hadoop/CarbonRecordReader.java ---
@@ -116,6 +117,25 @@ public void initialize(InputSplit
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2792#discussion_r223238343
--- Diff:
core/src/main/java/org/apache/carbondata/core/datastore/row/CarbonRow.java ---
@@ -57,6 +74,154 @@ public String getString(int ordinal
GitHub user xubo245 opened a pull request:
https://github.com/apache/carbondata/pull/2792
[CARBONDATA-2981] Support read primitive data type in CSDK
[CARBONDATA-2981] Support read primitive data type in CSDK
1.support readNextCarbonRow
2.support
Github user xubo245 commented on the issue:
https://github.com/apache/carbondata/pull/2780
retest this please
---
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2738#discussion_r221423350
--- Diff:
store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonReader.java ---
@@ -90,6 +91,33 @@ public T readNextRow() throws IOException
Github user xubo245 commented on the issue:
https://github.com/apache/carbondata/pull/2780
@KanakaKumar @ajantha-bhat removed
---
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2780#discussion_r221411423
--- Diff:
store/sdk/src/test/java/org/apache/carbondata/sdk/file/CarbonReaderTest.java ---
@@ -1435,5 +1435,99 @@ public void
Github user xubo245 commented on the issue:
https://github.com/apache/carbondata/pull/2780
retest this please
---
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2738#discussion_r221153398
--- Diff:
store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonReader.java ---
@@ -90,6 +91,33 @@ public T readNextRow() throws IOException
GitHub user xubo245 opened a pull request:
https://github.com/apache/carbondata/pull/2780
Carbondata 2982 support array string in schema
Be sure to do all of the following checklist to help us incorporate
your contribution quickly and easily:
- [ ] Any interfaces
xubo245 created CARBONDATA-2982:
---
Summary: CarbonSchemaReader don't support Array
Key: CARBONDATA-2982
URL: https://issues.apache.org/jira/browse/CARBONDATA-2982
Project: CarbonData
Issue Type
[
https://issues.apache.org/jira/browse/CARBONDATA-2982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xubo245 updated CARBONDATA-2982:
Description:
CarbonSchemaReader don't support Array
When we read schema from index file
xubo245 created CARBONDATA-2981:
---
Summary: Support read primitive data type in CSDK
Key: CARBONDATA-2981
URL: https://issues.apache.org/jira/browse/CARBONDATA-2981
Project: CarbonData
Issue
Github user xubo245 closed the pull request at:
https://github.com/apache/carbondata/pull/2282
---
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2738#discussion_r220912378
--- Diff:
store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonReaderBuilder.java
---
@@ -101,6 +101,20 @@ public CarbonReaderBuilder
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2738#discussion_r220912011
--- Diff: store/sdk/pom.xml ---
@@ -39,6 +39,16 @@
hadoop-aws
${hadoop.version
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2738#discussion_r220907838
--- Diff: store/sdk/pom.xml ---
@@ -39,6 +39,16 @@
hadoop-aws
${hadoop.version
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2738#discussion_r220851174
--- Diff: store/CSDK/CarbonReader.h ---
@@ -0,0 +1,105 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2738#discussion_r220833952
--- Diff:
store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonReaderBuilder.java
---
@@ -101,6 +101,20 @@ public CarbonReaderBuilder
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2738#discussion_r220833721
--- Diff: store/CSDK/CarbonReader.cpp ---
@@ -0,0 +1,97 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2738#discussion_r220784376
--- Diff:
store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonReader.java ---
@@ -90,6 +91,33 @@ public T readNextRow() throws IOException
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2738#discussion_r220784150
--- Diff:
store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonReader.java ---
@@ -90,6 +91,33 @@ public T readNextRow() throws IOException
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2738#discussion_r220774262
--- Diff:
store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonReaderBuilder.java
---
@@ -101,6 +101,20 @@ public CarbonReaderBuilder
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2738#discussion_r220773227
--- Diff:
store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonReaderBuilder.java
---
@@ -101,6 +101,20 @@ public CarbonReaderBuilder
Github user xubo245 commented on the issue:
https://github.com/apache/carbondata/pull/2738
retest this please
---
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2738#discussion_r220461925
--- Diff: store/sdk/pom.xml ---
@@ -39,6 +39,16 @@
hadoop-aws
${hadoop.version
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2738#discussion_r220459945
--- Diff: store/CSDK/main.cpp ---
@@ -0,0 +1,239 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2738#discussion_r220459029
--- Diff:
store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonReaderBuilder.java
---
@@ -161,6 +161,20 @@ public CarbonReaderBuilder
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2738#discussion_r220457759
--- Diff: store/sdk/pom.xml ---
@@ -39,6 +39,16 @@
hadoop-aws
${hadoop.version
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2738#discussion_r220456385
--- Diff: store/CSDK/main.cpp ---
@@ -0,0 +1,239 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
Github user xubo245 commented on the issue:
https://github.com/apache/carbondata/pull/2738
@KanakaKumar @kunal642 @jackylk @ravikiran23 Can you review it?
---
Github user xubo245 closed the pull request at:
https://github.com/apache/carbondata/pull/2724
---
Github user xubo245 commented on the issue:
https://github.com/apache/carbondata/pull/2738
ok, I will try to support C to write carbon file later.
---
Github user xubo245 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2738#discussion_r219873751
--- Diff: store/CSDK/main.cpp ---
@@ -0,0 +1,122 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
Github user xubo245 commented on the issue:
https://github.com/apache/carbondata/pull/2738
@zzcclp Now we plan support C++, do you need C interface of carbon?
---
GitHub user xubo245 opened a pull request:
https://github.com/apache/carbondata/pull/2742
[CARBONDATA-2956] CarbonReader support use configuration to read S3 data
[CARBONDATA-2956] CarbonReader support use configuration to read S3 data
1.with filter
2.without filter function
[
https://issues.apache.org/jira/browse/CARBONDATA-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xubo245 updated CARBONDATA-2956:
Description:
Test code:
{code:java}
package org.apache.carbondata.examples.sdk;
import
801 - 900 of 2151 matches
Mail list logo
