Hi
First please send one mail to dev-subscr...@carbondata.apache.org <dev-subscr...@carbondata.incubator.apache.org> for joining mailing list group. After you join mailing list group, please send your question again to dev@carbondata.apache.org <d...@carbondata.incubator.apache.org> Please provide the error log message, and your create table script. Regards Liang 2017-09-15 11:42 GMT+08:00 < dev-reject-1505446964.37092.jdlciocnigpdiccpc...@carbondata.apache.org>: > > To approve: > dev-accept-1505446964.37092.jdlciocnigpdiccpc...@carbondata.apache.org > To reject: > dev-reject-1505446964.37092.jdlciocnigpdiccpc...@carbondata.apache.org > To give a reason to reject: > %%% Start comment > %%% End comment > > > > ---------- 已转发邮件 ---------- > From: "刘feng" <f...@neusoft.com> > To: <dev@carbondata.apache.org> > Cc: > Bcc: > Date: Fri, 15 Sep 2017 11:42:26 +0800 > Subject: carbondata 加载数据问题咨询 > > 您好， > > 最近研究carbondata，在加载数据时遇到几个问题： > > 1，load 数据量超过10G，在collect at GlobalDictionaryUtil.scala:746 > <http://namenode1:8088/proxy/application_1505443499883_0001/stages/stage?id=4&attempt=0> > 报错，导致无法进行 > > 2，5G以内数据，往新建的表中insert时，一两分钟就可以成功，但是按照增量的方式insert时会很慢，大约三十分钟。 > > 以上，请问有什么优化的办法吗？谢谢！！！ > > 配置：集群三个 数据节点，配置 128G内存 8核CPU，10块硬盘。 > > > > ------------------------------------------------------------ > ------------------------------------------- > > 刘峰 > > Mobile：13889865456 <138%208986%205456> > > > > ------------------------------------------------------------ > --------------------------------------- > Confidentiality Notice: The information contained in this e-mail and any > accompanying attachment(s) > is intended only for the use of the intended recipient and may be > confidential and/or privileged of > Neusoft Corporation, its subsidiaries and/or its affiliates. If any reader > of this communication is > not the intended recipient, unauthorized use, forwarding, printing, > storing, disclosure or copying > is strictly prohibited, and may be unlawful.If you have received this > communication in error,please > immediately notify the sender by return e-mail, and delete the original > message and all copies from > your system. Thank you. > ------------------------------------------------------------ > --------------------------------------- > >
