[jira] [Updated] (CARBONDATA-4258) [Summer2021] After integration of Spark 3.X, add support in CarbonData
[ https://issues.apache.org/jira/browse/CARBONDATA-4258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiayi Wang updated CARBONDATA-4258: --- Description: [Summer2021] After integration of Spark 3.X, add support in CarbonData > [Summer2021] After integration of Spark 3.X, add support in CarbonData > -- > > Key: CARBONDATA-4258 > URL: https://issues.apache.org/jira/browse/CARBONDATA-4258 > Project: CarbonData > Issue Type: Task >Reporter: Jiayi Wang >Assignee: Jiayi Wang >Priority: Minor > > [Summer2021] After integration of Spark 3.X, add support in CarbonData -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (CARBONDATA-4258) [Summer2021] After integration of Spark 3.X, add support in CarbonData
[ https://issues.apache.org/jira/browse/CARBONDATA-4258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiayi Wang updated CARBONDATA-4258: --- Summary: [Summer2021] After integration of Spark 3.X, add support in CarbonData (was: [Summer2021] Add Spark 3.X Support in CarbonData) > [Summer2021] After integration of Spark 3.X, add support in CarbonData > -- > > Key: CARBONDATA-4258 > URL: https://issues.apache.org/jira/browse/CARBONDATA-4258 > Project: CarbonData > Issue Type: Task >Reporter: Jiayi Wang >Assignee: Jiayi Wang >Priority: Minor > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (CARBONDATA-4242) Improve the carbondata CDC merge performance Phase2
[ https://issues.apache.org/jira/browse/CARBONDATA-4242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajantha Bhat resolved CARBONDATA-4242. -- Fix Version/s: 2.2.0 Resolution: Fixed > Improve the carbondata CDC merge performance Phase2 > --- > > Key: CARBONDATA-4242 > URL: https://issues.apache.org/jira/browse/CARBONDATA-4242 > Project: CarbonData > Issue Type: Improvement >Reporter: Akash R Nilugal >Assignee: Akash R Nilugal >Priority: Major > Fix For: 2.2.0 > > Time Spent: 12h 40m > Remaining Estimate: 0h > > Identify the bottleneck and improve the performance -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (CARBONDATA-4258) [Summer2021] Add Spark 3.X Support in CarbonData
[ https://issues.apache.org/jira/browse/CARBONDATA-4258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiayi Wang updated CARBONDATA-4258: --- Summary: [Summer2021] Add Spark 3.X Support in CarbonData (was: first jira issue test) > [Summer2021] Add Spark 3.X Support in CarbonData > > > Key: CARBONDATA-4258 > URL: https://issues.apache.org/jira/browse/CARBONDATA-4258 > Project: CarbonData > Issue Type: Task >Reporter: Jiayi Wang >Assignee: Jiayi Wang >Priority: Minor > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (CARBONDATA-4260) Support Trino To Replace PrestoSQL
[ https://issues.apache.org/jira/browse/CARBONDATA-4260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenzhengyu updated CARBONDATA-4260: Affects Version/s: 2.4.0 > Support Trino To Replace PrestoSQL > -- > > Key: CARBONDATA-4260 > URL: https://issues.apache.org/jira/browse/CARBONDATA-4260 > Project: CarbonData > Issue Type: New Feature >Affects Versions: 2.4.0 > Environment: Must be use JDK 11.0.11 + to build mvn >Reporter: chenzhengyu >Assignee: chenzhengyu >Priority: Critical > Labels: Presto, Trino > > h3. Why is this PR needed? > PrestoSQL has now changed its name to Trino. Because Facebook established the > Presto Foundation at The Linux Foundation®，Led to prestosql Must be change > the name > More information can see > [here|https://trino.io/blog/2020/12/27/announcing-trino.html] > I'm here to suggest that we replace the old PrestoSQL implementation with a > new Trino, which will keep our CarbonData community in sync with the open > source community's technical path > CarbonData currently supports querying Hive/Spark data using PrestoSQL (316), > but many new features and performance improvements are not available to users > due to the new version of CarbonData > (!) We will first provide a beta version of CarbonData on the branch. You are > welcome to use the test, wait for the completion of the test and use cases, > we will officially merge into the trunk branch when the functionality is > stable > h3. What changes were proposed in this PR? > * Java 11 removed ConstructorAccessor class,use unsafe class for reflection > * Rename the file Trino beginning with Presto > * Unify file hump case style and Divide component package names > * CarbonDataSplitManager add properties serialization.lib about > StorageFormatSerDe > * TrinoFilterUtil Logical Changes to determine Rang > * Maven Pom Support Trino 358 > h3. Does this PR introduce any user interface change? > * No > h3. Is any new testcase added? > * No > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (CARBONDATA-4260) Support Trino To Replace PrestoSQL
[ https://issues.apache.org/jira/browse/CARBONDATA-4260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenzhengyu updated CARBONDATA-4260: Priority: Critical (was: Minor) > Support Trino To Replace PrestoSQL > -- > > Key: CARBONDATA-4260 > URL: https://issues.apache.org/jira/browse/CARBONDATA-4260 > Project: CarbonData > Issue Type: New Feature > Environment: Must be use JDK 11.0.11 + to build mvn >Reporter: chenzhengyu >Assignee: chenzhengyu >Priority: Critical > Labels: Presto, Trino > > h3. Why is this PR needed? > PrestoSQL has now changed its name to Trino. Because Facebook established the > Presto Foundation at The Linux Foundation®，Led to prestosql Must be change > the name > More information can see > [here|https://trino.io/blog/2020/12/27/announcing-trino.html] > I'm here to suggest that we replace the old PrestoSQL implementation with a > new Trino, which will keep our CarbonData community in sync with the open > source community's technical path > CarbonData currently supports querying Hive/Spark data using PrestoSQL (316), > but many new features and performance improvements are not available to users > due to the new version of CarbonData > (!) We will first provide a beta version of CarbonData on the branch. You are > welcome to use the test, wait for the completion of the test and use cases, > we will officially merge into the trunk branch when the functionality is > stable > h3. What changes were proposed in this PR? > * Java 11 removed ConstructorAccessor class,use unsafe class for reflection > * Rename the file Trino beginning with Presto > * Unify file hump case style and Divide component package names > * CarbonDataSplitManager add properties serialization.lib about > StorageFormatSerDe > * TrinoFilterUtil Logical Changes to determine Rang > * Maven Pom Support Trino 358 > h3. Does this PR introduce any user interface change? > * No > h3. Is any new testcase added? > * No > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (CARBONDATA-4260) Support Trino To Replace PrestoSQL
[ https://issues.apache.org/jira/browse/CARBONDATA-4260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenzhengyu updated CARBONDATA-4260: Fix Version/s: 2.4.0 > Support Trino To Replace PrestoSQL > -- > > Key: CARBONDATA-4260 > URL: https://issues.apache.org/jira/browse/CARBONDATA-4260 > Project: CarbonData > Issue Type: New Feature >Affects Versions: 2.4.0 > Environment: Must be use JDK 11.0.11 + to build mvn >Reporter: chenzhengyu >Assignee: chenzhengyu >Priority: Critical > Labels: Presto, Trino > Fix For: 2.4.0 > > > h3. Why is this PR needed? > PrestoSQL has now changed its name to Trino. Because Facebook established the > Presto Foundation at The Linux Foundation®，Led to prestosql Must be change > the name > More information can see > [here|https://trino.io/blog/2020/12/27/announcing-trino.html] > I'm here to suggest that we replace the old PrestoSQL implementation with a > new Trino, which will keep our CarbonData community in sync with the open > source community's technical path > CarbonData currently supports querying Hive/Spark data using PrestoSQL (316), > but many new features and performance improvements are not available to users > due to the new version of CarbonData > (!) We will first provide a beta version of CarbonData on the branch. You are > welcome to use the test, wait for the completion of the test and use cases, > we will officially merge into the trunk branch when the functionality is > stable > h3. What changes were proposed in this PR? > * Java 11 removed ConstructorAccessor class,use unsafe class for reflection > * Rename the file Trino beginning with Presto > * Unify file hump case style and Divide component package names > * CarbonDataSplitManager add properties serialization.lib about > StorageFormatSerDe > * TrinoFilterUtil Logical Changes to determine Rang > * Maven Pom Support Trino 358 > h3. Does this PR introduce any user interface change? > * No > h3. Is any new testcase added? > * No > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (CARBONDATA-4260) Support Trino To Replace PrestoSQL
[ https://issues.apache.org/jira/browse/CARBONDATA-4260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenzhengyu updated CARBONDATA-4260: Description: h3. Why is this PR needed? PrestoSQL has now changed its name to Trino. Because Facebook established the Presto Foundation at The Linux Foundation®，Led to prestosql Must be change the name More information can see [here|https://trino.io/blog/2020/12/27/announcing-trino.html] I'm here to suggest that we replace the old PrestoSQL implementation with a new Trino, which will keep our CarbonData community in sync with the open source community's technical path CarbonData currently supports querying Hive/Spark data using PrestoSQL (316), but many new features and performance improvements are not available to users due to the new version of CarbonData (!) We will first provide a beta version of CarbonData on the branch. You are welcome to use the test, wait for the completion of the test and use cases, we will officially merge into the trunk branch when the functionality is stable h3. What changes were proposed in this PR? * Java 11 removed ConstructorAccessor class,use unsafe class for reflection * Rename the file Trino beginning with Presto * Unify file hump case style and Divide component package names * CarbonDataSplitManager add properties serialization.lib about StorageFormatSerDe * TrinoFilterUtil Logical Changes to determine Rang * Maven Pom Support Trino 358 h3. Does this PR introduce any user interface change? * No h3. Is any new testcase added? * No was:Support Trino To Replace PrestoSQL Environment: Must be use JDK 11.0.11 + to build mvn Labels: Presto Trino (was: ) Summary: Support Trino To Replace PrestoSQL (was: Support Trino) > Support Trino To Replace PrestoSQL > -- > > Key: CARBONDATA-4260 > URL: https://issues.apache.org/jira/browse/CARBONDATA-4260 > Project: CarbonData > Issue Type: New Feature > Environment: Must be use JDK 11.0.11 + to build mvn >Reporter: chenzhengyu >Assignee: chenzhengyu >Priority: Minor > Labels: Presto, Trino > > h3. Why is this PR needed? > PrestoSQL has now changed its name to Trino. Because Facebook established the > Presto Foundation at The Linux Foundation®，Led to prestosql Must be change > the name > More information can see > [here|https://trino.io/blog/2020/12/27/announcing-trino.html] > I'm here to suggest that we replace the old PrestoSQL implementation with a > new Trino, which will keep our CarbonData community in sync with the open > source community's technical path > CarbonData currently supports querying Hive/Spark data using PrestoSQL (316), > but many new features and performance improvements are not available to users > due to the new version of CarbonData > (!) We will first provide a beta version of CarbonData on the branch. You are > welcome to use the test, wait for the completion of the test and use cases, > we will officially merge into the trunk branch when the functionality is > stable > h3. What changes were proposed in this PR? > * Java 11 removed ConstructorAccessor class,use unsafe class for reflection > * Rename the file Trino beginning with Presto > * Unify file hump case style and Divide component package names > * CarbonDataSplitManager add properties serialization.lib about > StorageFormatSerDe > * TrinoFilterUtil Logical Changes to determine Rang > * Maven Pom Support Trino 358 > h3. Does this PR introduce any user interface change? > * No > h3. Is any new testcase added? > * No > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (CARBONDATA-4262) summer.iscas.ac.cn-
[ https://issues.apache.org/jira/browse/CARBONDATA-4262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] CHEN XIN reassigned CARBONDATA-4262: Assignee: CHEN XIN > summer.iscas.ac.cn- > --- > > Key: CARBONDATA-4262 > URL: https://issues.apache.org/jira/browse/CARBONDATA-4262 > Project: CarbonData > Issue Type: Task > Components: docs, examples, test >Affects Versions: 2.1.0, 2.1.1 >Reporter: CHEN XIN >Assignee: CHEN XIN >Priority: Major > Fix For: 2.1.1 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (CARBONDATA-4262) summer.iscas.ac.cn-
CHEN XIN created CARBONDATA-4262: Summary: summer.iscas.ac.cn- Key: CARBONDATA-4262 URL: https://issues.apache.org/jira/browse/CARBONDATA-4262 Project: CarbonData Issue Type: Task Components: docs, examples, test Affects Versions: 2.1.1, 2.1.0 Reporter: CHEN XIN Fix For: 2.1.1 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (CARBONDATA-4261) first subtask
[ https://issues.apache.org/jira/browse/CARBONDATA-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiayi Wang reassigned CARBONDATA-4261: -- Assignee: Jiayi Wang > first subtask > - > > Key: CARBONDATA-4261 > URL: https://issues.apache.org/jira/browse/CARBONDATA-4261 > Project: CarbonData > Issue Type: Sub-task >Reporter: Jiayi Wang >Assignee: Jiayi Wang >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (CARBONDATA-4260) Support Trino
[ https://issues.apache.org/jira/browse/CARBONDATA-4260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenzhengyu reassigned CARBONDATA-4260: --- Assignee: chenzhengyu > Support Trino > - > > Key: CARBONDATA-4260 > URL: https://issues.apache.org/jira/browse/CARBONDATA-4260 > Project: CarbonData > Issue Type: New Feature >Reporter: chenzhengyu >Assignee: chenzhengyu >Priority: Minor > > Support Trino To Replace PrestoSQL -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (CARBONDATA-4261) first subtask
Jiayi Wang created CARBONDATA-4261: -- Summary: first subtask Key: CARBONDATA-4261 URL: https://issues.apache.org/jira/browse/CARBONDATA-4261 Project: CarbonData Issue Type: Sub-task Reporter: Jiayi Wang -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (CARBONDATA-4258) first jira issue test
[ https://issues.apache.org/jira/browse/CARBONDATA-4258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiayi Wang reassigned CARBONDATA-4258: -- Assignee: Jiayi Wang > first jira issue test > - > > Key: CARBONDATA-4258 > URL: https://issues.apache.org/jira/browse/CARBONDATA-4258 > Project: CarbonData > Issue Type: Task >Reporter: Jiayi Wang >Assignee: Jiayi Wang >Priority: Minor > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (CARBONDATA-4260) Support Trino
chenzhengyu created CARBONDATA-4260: --- Summary: Support Trino Key: CARBONDATA-4260 URL: https://issues.apache.org/jira/browse/CARBONDATA-4260 Project: CarbonData Issue Type: New Feature Reporter: chenzhengyu Support Trino To Replace PrestoSQL -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (CARBONDATA-4259) summer.iscas.ac.cn-test
CHEN XIN created CARBONDATA-4259: Summary: summer.iscas.ac.cn-test Key: CARBONDATA-4259 URL: https://issues.apache.org/jira/browse/CARBONDATA-4259 Project: CarbonData Issue Type: Task Reporter: CHEN XIN -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (CARBONDATA-4258) first jira issue test
Jiayi Wang created CARBONDATA-4258: -- Summary: first jira issue test Key: CARBONDATA-4258 URL: https://issues.apache.org/jira/browse/CARBONDATA-4258 Project: CarbonData Issue Type: Task Reporter: Jiayi Wang -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (CARBONDATA-4257) carbondata_Test
yu created CARBONDATA-4257: -- Summary: carbondata_Test Key: CARBONDATA-4257 URL: https://issues.apache.org/jira/browse/CARBONDATA-4257 Project: CarbonData Issue Type: Test Environment: carbondata2.1 Reporter: yu input data output accurant -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (CARBONDATA-4241) if the sort scope is changed to global sort and data loaded, major compaction fails
[
https://issues.apache.org/jira/browse/CARBONDATA-4241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Akash R Nilugal resolved CARBONDATA-4241.
-
Fix Version/s: 2.2.0
Assignee: Indhumathi Muthumurugesh
Resolution: Fixed
> if the sort scope is changed to global sort and data loaded, major compaction
> fails
> ---
>
> Key: CARBONDATA-4241
> URL: https://issues.apache.org/jira/browse/CARBONDATA-4241
> Project: CarbonData
> Issue Type: Bug
> Components: data-load
>Affects Versions: 2.2.0
> Environment: Spark 2.3.2 Carbon 1.6.1 , Spark 3.1.1 Carbon 2.2.0
>Reporter: Chetan Bhat
>Assignee: Indhumathi Muthumurugesh
>Priority: Major
> Fix For: 2.2.0
>
>
> *Scenario 1 : create table with table_page_size_inmb'='1', load data ,* *set
> sortscope as global sort , load data and do major compaction.***
> 0: jdbc:hive2://10.21.19.14:23040/default> CREATE TABLE uniqdata_pagesize
> (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION string, DOB timestamp, DOJ
> timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,DECIMAL_COLUMN1
> decimal(30,10), DECIMAL_COLUMN2 decimal(36,36),Double_COLUMN1 double,
> Double_COLUMN2 double,INTEGER_COLUMN1 int) STORED as carbondata
> TBLPROPERTIES('table_page_size_inmb'='1');
> +-+
> | Result |
> +-+
> +-+
> No rows selected (0.229 seconds)
> 0: jdbc:hive2://10.21.19.14:23040/default> LOAD DATA INPATH
> 'hdfs://hacluster/chetan/2000_UniqData.csv' into table uniqdata_pagesize
> OPTIONS('DELIMITER'=',' ,
> 'QUOTECHAR'='"','BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1');
> +-+
> | Segment ID |
> +-+
> | 0 |
> +-+
> 1 row selected (1.016 seconds)
> 0: jdbc:hive2://10.21.19.14:23040/default> alter table uniqdata_pagesize set
> tblproperties('sort_columns'='CUST_ID','sort_scope'='global_sort');
> +-+
> | Result |
> +-+
> +-+
> No rows selected (0.446 seconds)
> 0: jdbc:hive2://10.21.19.14:23040/default> LOAD DATA INPATH
> 'hdfs://hacluster/chetan/2000_UniqData.csv' into table uniqdata_pagesize
> OPTIONS('DELIMITER'=',' ,
> 'QUOTECHAR'='"','BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1');
> +-+
> | Segment ID |
> +-+
> | 1 |
> +-+
> 1 row selected (0.767 seconds)
> 0: jdbc:hive2://10.21.19.14:23040/default> alter table uniqdata_pagesize
> compact 'major';
> Error: org.apache.hive.service.cli.HiveSQLException: Error running query:
> org.apache.spark.sql.AnalysisException: Compaction failed. Please check logs
> for more info. Exception in compaction Compaction Failure in Merger Rdd.
> at
> org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation.org$apache$spark$sql$hive$thriftserver$SparkExecuteStatementOperation$$execute(SparkExecuteStatementOperation.scala:361)
> at
> org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$2$$anon$3.$anonfun$run$2(SparkExecuteStatementOperation.scala:263)
> at
> scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
> at
> org.apache.spark.sql.hive.thriftserver.SparkOperation.withLocalProperties(SparkOperation.scala:78)
> at
> org.apache.spark.sql.hive.thriftserver.SparkOperation.withLocalProperties$(SparkOperation.scala:62)
> at
> org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation.withLocalProperties(SparkExecuteStatementOperation.scala:43)
> at
> org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$2$$anon$3.run(SparkExecuteStatementOperation.scala:263)
> at
> org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$2$$anon$3.run(SparkExecuteStatementOperation.scala:258)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1746)
> at
> org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$2.run(SparkExecuteStatementOperation.scala:272)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
>
[jira] [Resolved] (CARBONDATA-4247) Add fix for timestamp issue induced due to Spark3.0 changes
[ https://issues.apache.org/jira/browse/CARBONDATA-4247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akash R Nilugal resolved CARBONDATA-4247. - Fix Version/s: 2.2.0 Assignee: Indhumathi Muthumurugesh Resolution: Fixed > Add fix for timestamp issue induced due to Spark3.0 changes > --- > > Key: CARBONDATA-4247 > URL: https://issues.apache.org/jira/browse/CARBONDATA-4247 > Project: CarbonData > Issue Type: Sub-task >Reporter: Vikram Ahuja >Assignee: Indhumathi Muthumurugesh >Priority: Major > Fix For: 2.2.0 > > Time Spent: 8.5h > Remaining Estimate: 0h > > Add fix for timestamp issue induced due to Spark3.0 changes > > With spark 3.1, timestamp values loaded before 1900 years gives wrong results > > Refer > https://github.com/apache/carbondata/blob/master/integration/spark/src/test/scala/org/apache/carbondata/spark/testsuite/directdictionary/TimestampNoDictionaryColumnTestCase.scala -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [carbondata] didiaode18 commented on issue #4182: FusionInsightHD 6518 spark2.3.2 carbon-2.0.0 skewedJoin adaptive execution no use.
didiaode18 commented on issue #4182: URL: https://github.com/apache/carbondata/issues/4182#issuecomment-889001315 +1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@carbondata.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Created] (CARBONDATA-4256) SI creation on a complex column that includes child column with a dot(.) fails with parse exception.
Nihal kumar ojha created CARBONDATA-4256:
Summary: SI creation on a complex column that includes child
column with a dot(.) fails with parse exception.
Key: CARBONDATA-4256
URL: https://issues.apache.org/jira/browse/CARBONDATA-4256
Project: CarbonData
Issue Type: Bug
Reporter: Nihal kumar ojha
sql("create table complextable (country struct, name string, id
Map, arr1 array, arr2 array) stored as
carbondata");
sql("create index index_1 on table complextable(country.b) as 'carbondata'");
The above query fails with a parsing exception.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
