We need to disable compression. search for "compression" in your job.xml on hadoop jobtracker, and then disable it with "set mapred.compression.xxx.xxx=false" on Hive command line.
Zheng On Wed, Jun 3, 2009 at 11:22 PM, Min Zhou <[email protected]> wrote: > I created a table similar with yours, > > CREATE EXTERNAL TABLE staticacs( > time string, > application string, > count1 int, > count2 int) > PARTITIONED BY (dt STRING) > ROW FORMAT DELIMITED FIELDS TERMINATED BY '"' > STORED AS TEXTFILE; > > but I found files named *.deflate in directory > 'warehouse/staticacs/dt=20090531/' are not flat text files, they were > unreadable. > > Min > > > On Thu, Jun 4, 2009 at 2:16 PM, Zheng Shao <[email protected]> wrote: > >> CREATE EXTERNAL TABLE abc ( a string, b string ) >> ROW FORMAT DELIMITED >> FIELDS TERMINATED BY '\t' >> STORED AS TEXTFILE >> LOCATION '/user/mzhou/table_abc'; >> >> Zheng >> >> >> On Wed, Jun 3, 2009 at 11:04 PM, Min Zhou <[email protected]> wrote: >> >>> Thanks, got. >>> Since output key-value pairs are serialized by Hive serdes, while I hope >>> that can be a human-readable text instead, how can i define this table when >>> creating? >>> >>> Min >>> >>> On Thu, Jun 4, 2009 at 1:48 PM, Zheng Shao <[email protected]> wrote: >>> >>>> No, we would need to copy the file back from HDFS. But I think there is >>>> no overhead - we are doing the same thing as INSERT OVERWRITE LOCAL >>>> DIRECTORY, I think. >>>> >>>> Zheng >>>> >>>> >>>> On Wed, Jun 3, 2009 at 10:45 PM, Min Zhou <[email protected]> wrote: >>>> >>>>> Can external table stored at a local directory? >>>>> >>>>> >>>>> On Thu, Jun 4, 2009 at 1:42 PM, Zheng Shao <[email protected]> wrote: >>>>> >>>>>> You can first create an external table and then insert into that >>>>>> table. >>>>>> >>>>>> Zheng >>>>>> >>>>>> >>>>>> On Wed, Jun 3, 2009 at 10:31 PM, Min Zhou <[email protected]>wrote: >>>>>> >>>>>>> Hi all, >>>>>>> >>>>>>> Any helps? >>>>>>> >>>>>>> >>>>>>> thanks, >>>>>>> Min >>>>>>> -- >>>>>>> My research interests are distributed systems, parallel computing and >>>>>>> bytecode based virtual machine. >>>>>>> >>>>>>> My profile: >>>>>>> http://www.linkedin.com/in/coderplay >>>>>>> My blog: >>>>>>> http://coderplay.javaeye.com >>>>>>> >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Yours, >>>>>> Zheng >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> My research interests are distributed systems, parallel computing and >>>>> bytecode based virtual machine. >>>>> >>>>> My profile: >>>>> http://www.linkedin.com/in/coderplay >>>>> My blog: >>>>> http://coderplay.javaeye.com >>>>> >>>> >>>> >>>> >>>> -- >>>> Yours, >>>> Zheng >>>> >>> >>> >>> >>> -- >>> My research interests are distributed systems, parallel computing and >>> bytecode based virtual machine. >>> >>> My profile: >>> http://www.linkedin.com/in/coderplay >>> My blog: >>> http://coderplay.javaeye.com >>> >> >> >> >> -- >> Yours, >> Zheng >> > > > > -- > My research interests are distributed systems, parallel computing and > bytecode based virtual machine. > > My profile: > http://www.linkedin.com/in/coderplay > My blog: > http://coderplay.javaeye.com > -- Yours, Zheng
