Re: error occur when I load data to s3

Hi kunalkapoor, I'd like give you more debug log as below. application/x-www-form-urlencoded; charset=utf-8 Tue, 04 Sep 2018 06:45:10 GMT /aa-sdk-test2/carbon-data/example/LockFiles/concurrentload.lock" 18/09/04 14:45:10 DEBUG request: Sending Request: GET

Re: error occur when I load data to s3

Ok. Let me have a look On Tue, Sep 4, 2018, 8:22 AM aaron <949835...@qq.com> wrote: > Hi kunalkapoor, >It seems that error not fixed yet. Do you have any idea? > > thanks > aaron > > aaron:2.2.1 aaron$ spark-shell --executor-memory 4g --driver-memory 2g > Ivy Default Cache set to:

Re: error occur when I load data to s3

Hi kunalkapoor, It seems that error not fixed yet. Do you have any idea? thanks aaron aaron:2.2.1 aaron$ spark-shell --executor-memory 4g --driver-memory 2g Ivy Default Cache set to: /Users/aaron/.ivy2/cache The jars for the packages stored in: /Users/aaron/.ivy2/jars :: loading settings ::

Re: error occur when I load data to s3

Did you build carbon with -Pbuild-with-format? it introduced Map datatype and changed the thrift, so you need to add it. On 09/04/2018 09:10, aaron wrote: Compile failed. My env is, aaron:carbondata aaron$ java -version java version "1.8.0_144" Java(TM) SE Runtime Environment (build

Re: error occur when I load data to s3

Compile failed. My env is, aaron:carbondata aaron$ java -version java version "1.8.0_144" Java(TM) SE Runtime Environment (build 1.8.0_144-b01) Java HotSpot(TM) 64-Bit Server VM (build 25.144-b01, mixed mode) aaron:carbondata aaron$ mvn -v Apache Maven 3.5.2

Re: error occur when I load data to s3

Thanks, I will have a try! -- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

Re: error occur when I load data to s3

Thanks, I will have a try. -- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

Re: error occur when I load data to s3

Hi kunal Can you list all S3 issues PR, we may need to give 1.4.2 patch release. Because aaron plan to use carbondata in production this month. To arron : First please you try master, see if can solve your problems. Regards Liang kunalkapoor wrote > Hi aaron, > Many issues like this have been

Re: error occur when I load data to s3

Hi aaron, Many issues like this have been identified in 1.4 version. Most of the issues have been fixed in the master code and will be released in 1.5 version. Remaing fixes are in progress. Can you try the same scenario in 1.5(master branch). Thanks Kunal Kapoor On Mon, Sep 3, 2018, 5:57 AM

Re: error occur when I load data to s3

*update the aws-java-sdk and hadoop-aws to below version, then authorization works. com.amazonaws:aws-java-sdk:1.10.75.1,org.apache.hadoop:hadoop-aws:2.7.3* *But we still can not load data, the exception is same. carbon.sql("LOAD DATA INPATH 'hdfs://localhost:9000/usr/carbon-s3/sample.csv' INTO

error occur when I load data to s3

Hi dear community, could anybody please kindly tell me what happened? *Env*: 1.spark 2.2.1 + carbon1.4.1 2.spark.jars.packages com.amazonaws:aws-java-sdk:1.7.4,org.apache.hadoop:hadoop-aws:2.7.2 3.spark.driver.extraClassPath file:///usr/local/Cellar/apache-spark/2.2.1/lib/*