[jira] [Created] (CARBONDATA-522) New data loading flow can not pass some testcase like big decimal etc
Lionx created CARBONDATA-522: Summary: New data loading flow can not pass some testcase like big decimal etc Key: CARBONDATA-522 URL: https://issues.apache.org/jira/browse/CARBONDATA-522 Project: CarbonData Issue Type: Bug Reporter: Lionx Assignee: Ravindra Pesala Pls check http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/105/. I suggest that we should test new data loading flow when adding new feature. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-479) Guarantee consistency for keyword LOCAL and file path in data loading command
Lionx created CARBONDATA-479:
Summary: Guarantee consistency for keyword LOCAL and file path in
data loading command
Key: CARBONDATA-479
URL: https://issues.apache.org/jira/browse/CARBONDATA-479
Project: CarbonData
Issue Type: Bug
Reporter: Lionx
Priority: Minor
In CarbonSqlParser.scala,
protected lazy val loadDataNew: Parser[LogicalPlan] =
LOAD ~> DATA ~> opt(LOCAL) ~> INPATH ~> stringLit ~ opt(OVERWRITE) ~
(INTO ~> TABLE ~> (ident <~ ".").? ~ ident) ~
(OPTIONS ~> "(" ~> repsep(loadOptions, ",") <~ ")").? <~ opt(";") ^^ {
case filePath ~ isOverwrite ~ table ~ optionsList =>
val (databaseNameOp, tableName) = table match {
case databaseName ~ tableName => (databaseName,
tableName.toLowerCase())
}
if (optionsList.isDefined) {
validateOptions(optionsList)
}
val optionsMap = optionsList.getOrElse(List.empty[(String,
String)]).toMap
LoadTable(databaseNameOp, tableName, filePath, Seq(), optionsMap,
isOverwrite.isDefined)
}
It seems that using Keyword LOCAL impacts noting. Loading data from hdfs or
file just depends on the path.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (CARBONDATA-401) Look forward to support reading csv file only once in data loading
Lionx created CARBONDATA-401: Summary: Look forward to support reading csv file only once in data loading Key: CARBONDATA-401 URL: https://issues.apache.org/jira/browse/CARBONDATA-401 Project: CarbonData Issue Type: Improvement Reporter: Lionx Assignee: Lionx Now, In Carbon data loading module, generating global dictionary is independent. Carbon read the csv file twice for generating global dictionary and loading carbon data, respectively. We look forward to read the csv file only once. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-388) Remove Useless File CarbonLoadStatisticsDummy.java
Lionx created CARBONDATA-388: Summary: Remove Useless File CarbonLoadStatisticsDummy.java Key: CARBONDATA-388 URL: https://issues.apache.org/jira/browse/CARBONDATA-388 Project: CarbonData Issue Type: Improvement Reporter: Lionx Priority: Minor Remove Useless File CarbonLoadStatisticsDummy.java -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-384) Add Table Properties Options Validation
Lionx created CARBONDATA-384:
Summary: Add Table Properties Options Validation
Key: CARBONDATA-384
URL: https://issues.apache.org/jira/browse/CARBONDATA-384
Project: CarbonData
Issue Type: Improvement
Reporter: Lionx
Priority: Minor
Now, Carbon does not validate the table properties options. This will cause
below problem.
For example,
Create table carbontable (...)
TABLEPROPERTIES('DICTIONARY_EXELUDE'='colname');
user want to use DICTIONARY_EXCLUDE property, but he types a wrong option name,
the setting will be ignored with no error throw.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (CARBONDATA-369) Remove Useless Files in carbondata.scan.expression
Lionx created CARBONDATA-369: Summary: Remove Useless Files in carbondata.scan.expression Key: CARBONDATA-369 URL: https://issues.apache.org/jira/browse/CARBONDATA-369 Project: CarbonData Issue Type: Improvement Reporter: Lionx Assignee: Lionx Remove Useless Files in carbondata.scan.expression core/src/main/java/org/apache/carbondata/scan/expression/UnaryExpression.java core/src/main/java/org/apache/carbondata/scan/expression/arithmetic/AddExpression.java core/src/main/java/org/apache/carbondata/scan/expression/arithmetic/BinaryArithmeticExpression.java core/src/main/java/org/apache/carbondata/scan/expression/arithmetic/DivideExpression.java core/src/main/java/org/apache/carbondata/scan/expression/arithmetic/MultiplyExpression.java core/src/main/java/org/apache/carbondata/scan/expression/arithmetic/SubstractExpression.java core/src/main/java/org/apache/carbondata/scan/expression/logical/NotExpression.java -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-356) Remove Two Useless Files ConvertedType.java and QuerySchemaInfo.java
Lionx created CARBONDATA-356: Summary: Remove Two Useless Files ConvertedType.java and QuerySchemaInfo.java Key: CARBONDATA-356 URL: https://issues.apache.org/jira/browse/CARBONDATA-356 Project: CarbonData Issue Type: Improvement Reporter: Lionx Assignee: Lionx Priority: Minor ConvertedType.java and QuerySchemaInfo.java are uselesss. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-353) Update doc for dateformat option
Lionx created CARBONDATA-353: Summary: Update doc for dateformat option Key: CARBONDATA-353 URL: https://issues.apache.org/jira/browse/CARBONDATA-353 Project: CarbonData Issue Type: Improvement Reporter: Lionx Assignee: Lionx Priority: Minor Update doc for dateformat option -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-350) Remove org.apache.carbondata.processing.sortdatastep
Lionx created CARBONDATA-350: Summary: Remove org.apache.carbondata.processing.sortdatastep Key: CARBONDATA-350 URL: https://issues.apache.org/jira/browse/CARBONDATA-350 Project: CarbonData Issue Type: Improvement Reporter: Lionx Priority: Trivial move the contents in org.apache.carbondata.processing.sortdatastep to org.apache.carbondata.processing.sortandgroupby.sortdatastep, and remove org.apache.carbondata.processing.sortdatastep. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-349) Support load local file
Lionx created CARBONDATA-349: Summary: Support load local file Key: CARBONDATA-349 URL: https://issues.apache.org/jira/browse/CARBONDATA-349 Project: CarbonData Issue Type: New Feature Reporter: Lionx Priority: Minor In cluster, we should support loading data from local file. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-348) Remove useless step in kettle and delete them in plugin.xml
Lionx created CARBONDATA-348: Summary: Remove useless step in kettle and delete them in plugin.xml Key: CARBONDATA-348 URL: https://issues.apache.org/jira/browse/CARBONDATA-348 Project: CarbonData Issue Type: Improvement Reporter: Lionx Priority: Trivial Remove useless step in kettle and delete them in plugin.xml like CarbonSortKeyAndGroupByStepMeta -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-347) Remove HadoopFileInputMeta
Lionx created CARBONDATA-347: Summary: Remove HadoopFileInputMeta Key: CARBONDATA-347 URL: https://issues.apache.org/jira/browse/CARBONDATA-347 Project: CarbonData Issue Type: Improvement Reporter: Lionx Priority: Trivial HadoopFileInputMeta is useless, should remove HadoopFileInputStep from GrapGenerator and remove related codes -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-337) Correct Inverted Index spelling mistakes
Lionx created CARBONDATA-337: Summary: Correct Inverted Index spelling mistakes Key: CARBONDATA-337 URL: https://issues.apache.org/jira/browse/CARBONDATA-337 Project: CarbonData Issue Type: Improvement Reporter: Lionx Assignee: Lionx Priority: Minor Correct Inverted Index spelling mistakes in three files. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-334) Correct Some Spelling Mistakes
Lionx created CARBONDATA-334: Summary: Correct Some Spelling Mistakes Key: CARBONDATA-334 URL: https://issues.apache.org/jira/browse/CARBONDATA-334 Project: CarbonData Issue Type: Bug Reporter: Lionx Assignee: Lionx Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-294) Timestamp datatype Error
Lionx created CARBONDATA-294: Summary: Timestamp datatype Error Key: CARBONDATA-294 URL: https://issues.apache.org/jira/browse/CARBONDATA-294 Project: CarbonData Issue Type: Bug Reporter: Lionx Assignee: Lionx Priority: Critical In CarbonExample, When Loading 2015/7/23 as a Timestamp, when querying, it will return 2015-01-23 xx:xx:xx:xx. Six months have been stolen. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-276) Add trim option
Lionx created CARBONDATA-276: Summary: Add trim option Key: CARBONDATA-276 URL: https://issues.apache.org/jira/browse/CARBONDATA-276 Project: CarbonData Issue Type: Bug Reporter: Lionx Assignee: Lionx Priority: Minor Fix a bug and add trim option. Bug: When string is contains LeadingWhiteSpace or TrailingWhiteSpace, query result is null. This is because the dictionary ignore the LeadingWhiteSpace and TrailingWhiteSpace and the csvInput dose not. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-258) update doc for adding information about COMMENTCHAR
Lionx created CARBONDATA-258: Summary: update doc for adding information about COMMENTCHAR Key: CARBONDATA-258 URL: https://issues.apache.org/jira/browse/CARBONDATA-258 Project: CarbonData Issue Type: Bug Reporter: Lionx Assignee: Lionx After adding COMMENTCHAR option, update the doc. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-237) Add testcase for auto load merge
Lionx created CARBONDATA-237: Summary: Add testcase for auto load merge Key: CARBONDATA-237 URL: https://issues.apache.org/jira/browse/CARBONDATA-237 Project: CarbonData Issue Type: Test Reporter: Lionx add an testcase for property "ENABLE_AUTO_LOAD_MERGE" -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-201) Add comment Option
Lionx created CARBONDATA-201: Summary: Add comment Option Key: CARBONDATA-201 URL: https://issues.apache.org/jira/browse/CARBONDATA-201 Project: CarbonData Issue Type: Bug Reporter: Lionx add csv comment option to csv paser, and fix one bug when passing qutochar. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-175) Load Decimal Data to BigInt Column, query is NULL
Lionx created CARBONDATA-175: Summary: Load Decimal Data to BigInt Column, query is NULL Key: CARBONDATA-175 URL: https://issues.apache.org/jira/browse/CARBONDATA-175 Project: CarbonData Issue Type: Bug Reporter: Lionx Priority: Minor when Loading Decimal Data to BigInt Column, the data is handle as NULL, like loading 3.14 into a BigInt Column, 3.14 is handle as NULL. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
