Thanks Zheng. Actaully , the property is hive.exec.compress.output, regardless of mapred.output.compress.
Min On Thu, Jun 4, 2009 at 2:40 PM, Zheng Shao <[email protected]> wrote: > We need to disable compression. > search for "compression" in your job.xml on hadoop jobtracker, and then > disable it with "set mapred.compression.xxx.xxx=false" on Hive command line. > > Zheng > > > On Wed, Jun 3, 2009 at 11:22 PM, Min Zhou <[email protected]> wrote: > >> I created a table similar with yours, >> >> CREATE EXTERNAL TABLE staticacs( >> time string, >> application string, >> count1 int, >> count2 int) >> PARTITIONED BY (dt STRING) >> ROW FORMAT DELIMITED FIELDS TERMINATED BY '"' >> STORED AS TEXTFILE; >> >> but I found files named *.deflate in directory >> 'warehouse/staticacs/dt=20090531/' are not flat text files, they were >> unreadable. >> >> Min >> >> >> On Thu, Jun 4, 2009 at 2:16 PM, Zheng Shao <[email protected]> wrote: >> >>> CREATE EXTERNAL TABLE abc ( a string, b string ) >>> ROW FORMAT DELIMITED >>> FIELDS TERMINATED BY '\t' >>> STORED AS TEXTFILE >>> LOCATION '/user/mzhou/table_abc'; >>> >>> Zheng >>> >>> >>> On Wed, Jun 3, 2009 at 11:04 PM, Min Zhou <[email protected]> wrote: >>> >>>> Thanks, got. >>>> Since output key-value pairs are serialized by Hive serdes, while I >>>> hope that can be a human-readable text instead, how can i define this >>>> table >>>> when creating? >>>> >>>> Min >>>> >>>> On Thu, Jun 4, 2009 at 1:48 PM, Zheng Shao <[email protected]> wrote: >>>> >>>>> No, we would need to copy the file back from HDFS. But I think there is >>>>> no overhead - we are doing the same thing as INSERT OVERWRITE LOCAL >>>>> DIRECTORY, I think. >>>>> >>>>> Zheng >>>>> >>>>> >>>>> On Wed, Jun 3, 2009 at 10:45 PM, Min Zhou <[email protected]> wrote: >>>>> >>>>>> Can external table stored at a local directory? >>>>>> >>>>>> >>>>>> On Thu, Jun 4, 2009 at 1:42 PM, Zheng Shao <[email protected]> wrote: >>>>>> >>>>>>> You can first create an external table and then insert into that >>>>>>> table. >>>>>>> >>>>>>> Zheng >>>>>>> >>>>>>> >>>>>>> On Wed, Jun 3, 2009 at 10:31 PM, Min Zhou <[email protected]>wrote: >>>>>>> >>>>>>>> Hi all, >>>>>>>> >>>>>>>> Any helps? >>>>>>>> >>>>>>>> >>>>>>>> thanks, >>>>>>>> Min >>>>>>>> -- >>>>>>>> My research interests are distributed systems, parallel computing >>>>>>>> and bytecode based virtual machine. >>>>>>>> >>>>>>>> My profile: >>>>>>>> http://www.linkedin.com/in/coderplay >>>>>>>> My blog: >>>>>>>> http://coderplay.javaeye.com >>>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Yours, >>>>>>> Zheng >>>>>>> >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> My research interests are distributed systems, parallel computing and >>>>>> bytecode based virtual machine. >>>>>> >>>>>> My profile: >>>>>> http://www.linkedin.com/in/coderplay >>>>>> My blog: >>>>>> http://coderplay.javaeye.com >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> Yours, >>>>> Zheng >>>>> >>>> >>>> >>>> >>>> -- >>>> My research interests are distributed systems, parallel computing and >>>> bytecode based virtual machine. >>>> >>>> My profile: >>>> http://www.linkedin.com/in/coderplay >>>> My blog: >>>> http://coderplay.javaeye.com >>>> >>> >>> >>> >>> -- >>> Yours, >>> Zheng >>> >> >> >> >> -- >> My research interests are distributed systems, parallel computing and >> bytecode based virtual machine. >> >> My profile: >> http://www.linkedin.com/in/coderplay >> My blog: >> http://coderplay.javaeye.com >> > > > > -- > Yours, > Zheng > -- My research interests are distributed systems, parallel computing and bytecode based virtual machine. My profile: http://www.linkedin.com/in/coderplay My blog: http://coderplay.javaeye.com
