Re: Discussing to add carbondata-tools module
+1 在 2016/8/5 17:15, Jean-Baptiste Onofré 写道: I guess it's where we can put the checkstyle, ... (what we have in the dev folder right now), correct ? Regards JB On 08/05/2016 08:31 AM, QiangCai wrote: Hi all, To improve the CarbonData system's usability and maintainability, I suggest to add carbondata-tools module. I think this module should provide some command tools as following. 1. import import a data file/folder to any existing table 2. export export the given columns to a file 3. schema show the detail information of the specified table schema file 4. metadata show tablestatus metadata show the history track for dataloading and compaction 5. footer show blocklet metadata list show start/end key, min/max value, row number, total size for the specified blocklet 6. blocklet show blocket list show blocket data, RLE map, Inverted index for the given columns 7. index show BTree node list show node information:start/end key, min/max value) 8. dictionary show key-value list of specified gloabl/local dictionary file show sort index show dictionary metadata Thank you and look forward to having your opinion on this carbon-tools module. David Cai -- View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/Discussing-to-add-carbondata-tools-module-tp4.html Sent from the Apache CarbonData Mailing List archive mailing list archive at Nabble.com. -- 金铸 技术发展部（TDD） 东软集团股份有限公司 沈阳浑南新区新秀街2号东软软件园A2-105A Postcode:110179 Tel: (86 24)8366 2049 Mobile：13897999526 --- Confidentiality Notice: The information contained in this e-mail and any accompanying attachment(s) is intended only for the use of the intended recipient and may be confidential and/or privileged of Neusoft Corporation, its subsidiaries and/or its affiliates. If any reader of this communication is not the intended recipient, unauthorized use, forwarding, printing, storing, disclosure or copying is strictly prohibited, and may be unlawful.If you have received this communication in error,please immediately notify the sender by return e-mail, and delete the original message and all copies from your system. Thank you. ---
Re: Discussing to add carbondata-tools module
+1 Regards JB On 08/05/2016 08:31 AM, QiangCai wrote: Hi all, To improve the CarbonData system's usability and maintainability, I suggest to add carbondata-tools module. I think this module should provide some command tools as following. 1. import import a data file/folder to any existing table 2. export export the given columns to a file 3. schema show the detail information of the specified table schema file 4. metadata show tablestatus metadata show the history track for dataloading and compaction 5. footer show blocklet metadata list show start/end key, min/max value, row number, total size for the specified blocklet 6. blocklet show blocket list show blocket data, RLE map, Inverted index for the given columns 7. index show BTree node list show node information:start/end key, min/max value) 8. dictionary show key-value list of specified gloabl/local dictionary file show sort index show dictionary metadata Thank you and look forward to having your opinion on this carbon-tools module. David Cai -- View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/Discussing-to-add-carbondata-tools-module-tp4.html Sent from the Apache CarbonData Mailing List archive mailing list archive at Nabble.com. -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
[jira] [Created] (CARBONDATA-148) Provide an useful binary distribution
Jean-Baptiste Onofré created CARBONDATA-148:
---
Summary: Provide an useful binary distribution
Key: CARBONDATA-148
URL: https://issues.apache.org/jira/browse/CARBONDATA-148
Project: CarbonData
Issue Type: Improvement
Components: build
Reporter: Jean-Baptiste Onofré
Assignee: Jean-Baptiste Onofré
The {{assembly}} module (with the {{dist}} profile) generates a zip file just
containing {{lib}} folder with jar files.
The {{apache-release}} profile (inherited from the Apache POM) creates a source
distribution.
IMHO the binary distribution should be really useful with a bin folder,
examples, etc, allowing users to start quickly with CarbonData.
NOTE: the binary distribution should contain a specific NOTICE as it bundles
lot of dependencies.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Re: Discussing to add carbondata-tools module
Thanks for you started the discussion, these tools look good. I am trying to understand why need these tools : Can you provide some scenarios info, these tools could help users to solve what issues? Regards Liang -- View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/Discussing-to-add-carbondata-tools-module-tp4p9.html Sent from the Apache CarbonData Mailing List archive mailing list archive at Nabble.com.
[jira] [Created] (CARBONDATA-146) Data loading failure using carbon-spark-sql and carbon-spark-shell
Krishna Reddy created CARBONDATA-146: Summary: Data loading failure using carbon-spark-sql and carbon-spark-shell Key: CARBONDATA-146 URL: https://issues.apache.org/jira/browse/CARBONDATA-146 Project: CarbonData Issue Type: Bug Components: data-query Affects Versions: 0.1.0-incubating Environment: SUSE11SP3, standalone application with Spark 1.5.2 and Hadoop 2.7.2 version Reporter: Krishna Reddy Carbon plugin's path is not considering from carbon.properties file and it is refering from CARBON_HOME path. Because of that Data loading is failing using carbon-spark-sql and carbon-spark-shell. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
