Unsubscribe

Re: Unsubscribe

Unsubscribe On Fri, 17 Jun 2022, 06:13 Ranjini Rathinam, wrote: > Unsubcribe >

Unsubcribe

Unsubcribe

Conversion from MongoDB to hadoop

Hi, How to convert the Mapreduce from MongoDB to Mapreduce Hadoop. Please suggest . Thanks in advance. Ranjini.

Share point API +Mapreduce

Hi, Please help to have sample code for getting the Files from the sharepoiint API using mapreduce. How to Download the Files from Sharepoint API using java in mapreduce. Thanks in advance Ranjini

Re: Need FileName with Content

>> } >> } >> } >> public static class Reduce extends MapReduceBase implements >> Reducer { >> public void reduce(Text key, Iterator values, >> OutputCollector output, Reporter reporter) throws >> IOException { >> int sum = 0; >> while

Re: Need FileName with Content

(TextOutputFormat.class); > FileInputFormat.setInputPaths(conf, new Path(args[0])); > FileOutputFormat.setOutputPath(conf, new Path(args[1])); > JobClient.runJob(conf); > } > } > > > > Please help > > Thanks in advance. > > Ranjini >

Re: Need FileName with Content

C++3 sony ETL 4 sony oracle 3 Need fileaName along with the word in that particular file only. No merge should happen. Please help me out for this issue. Please help. Thanks in advance. Ranjini On Thu, Mar 20, 2014 at 10:56 AM, Ranjini Rathinam wrote: > &

Need FileName with Content

Hi, I have folder named INPUT. Inside INPUT i have 5 resume are there. hduser@localhost:~/Ranjini$ hadoop fs -ls /user/hduser/INPUT Found 5 items -rw-r--r-- 1 hduser supergroup 5438 2014-03-18 15:20 /user/hduser/INPUT/Rakesh Chowdary_Microstrategy.txt -rw-r--r-- 1 hduser supergroup

Conversion of files

Hi, How to convert .pdf and .doc files into text file using mapreduce in java. Please help me with sample code or any site to refer. Please provide sample code. Thanks in advance Ranjini

Re: Process of files in mapreduce

Hi , Need to convert the PDF file into Text file using mapreduce. Thanks for the support Ranjini On Wed, Mar 12, 2014 at 3:54 PM, Mingjiang Shi wrote: > Hi Ranjini, > What's your use case? How would you create key value pairs from the pdf? > > > On Wed, Mar 12, 2014

Process of files in mapreduce

Hi, How to read a PDF file in mapreduce. Please provide sample code or sample link for refernce. thanks in advance. Ranjini

Reg:Hive query with mapreduce

Hi, How to implement the Hive query such as select * from table comp; select empId from comp where sal>12000; in mapreduce. Need to use this query in mapreduce code. How to implement the above query in the code using mapreduce , JAVA. Please provide the sample code. Thanks in advance for th

Fwd: XML to TEXT

,tn >> 102,siva >> >> >> In normal java i have written using recursion but how to write in >> mapreduce. >> >> How to write the code in Mapreduce .? Pl help . >> >> Thanks in advance. >> Regards, >> Ranjini R >> >> &g

Re: HIVE+MAPREDUCE

21, 2014 4:48 PM > To: user@hadoop.apache.org > Subject: Re: HIVE+MAPREDUCE > > If you put the sentence > "Need to load the data into hive table using mapreduce, using java" > into your google search box you will get tons of information. > > On 1/21/2014 3:2

HIVE+MAPREDUCE

Hi, Need to load the data into hive table using mapreduce, using java. Please suggest the code related to hive +mapreduce. Thanks in advance Ranjini R

XML to TEXT

Hi, As suggest i tried with the code , but in the result.txt i got output only header. Nothing else was printing. After debugging i came to know that while parsing , there is no value. The problem is in line given below which is bold. While putting SysOut i found no value printing in this line.

passing Xml using hive

Hi, This is my xml file 100 ranjini IT1 123456 nextlevel1 Chennai1 Navallur1 1001 ranjinikumar IT 1234516 nextlevel Chennai Navallur In hive shell , i use xpath hive> select xpath(str,'/Company/Employee/ename/text()') from hivexml; Total MapReduce jobs = 1 Launching Job 1 out of 1 N

Re: XML to TEXT

Hi, I am using hive. As suggest i am using xpath in select clause, but the error is coming as invalid expression. Please give some sample xml to process xml in hive. Thanks in advance Ranjini On Tue, Jan 7, 2014 at 5:14 PM, Ranjini Rathinam wrote: > Hi Gutierrez , > > As suggest i t

Re: XML to TEXT

job.setNumReduceTasks(0); job.setMapOutputKeyClass(Text.class); job.setMapOutputValueClass(Text.class); System.exit(job.waitForCompletion(true) ? 0 : 1); } } My xml file 100 ranjini IT1 123456 nextlevel1 Chennai1 Navallur1 1001 ranjinikumar IT 1234516 nextlev

Re: Fine tunning

pper.class); TableMapReduceUtil.initTableReducerJob("Rancount11",null,job); job.setNumReduceTasks(0); System.out.println("Hello Hadoop 2nd Job!!"+job.waitForCompletion(true)); return 0; } public static void main(String[] args) throws Excepti

Fine tunning

Hi, I have a input File of 16 fields in it. Using Mapreduce code need to load the hbase tables. The first eight has to go into one table in hbase and last eight has to got to another hbase table. The data is being loaded into hbase table in 0.11 sec , but if any lookup is being added in the ma

Re: XML to TEXT

ss(XmlToTextMapper.class); > job.setNumReduceTasks(0); > job.setMapOutputKeyClass(Text.class); > job.setMapOutputValueClass(Text.class); > System.exit(job.waitForCompletion(true) ? 0 : 1); > > } > } > > To execute the job you can use

Re: XML to TEXT

t; > > you need to specify stream.recordreader.begin and stream.recordreader.end > in the Configuration: > Configuration conf = new Configuration(); > conf.set("stream.recordreader.begin", ""); > conf.set("stream.recordreader.end", ""); > > > > > &g

XML to TEXT

Hi, Need to convert XML into text using mapreduce. I have used DOM and SAX parser. After using SAX Builder in mapper class. the child node act as root Element. While seeing in Sys out i found thar root element is taking the child element and printing. For Eg, 100RR when this xml is passed in

Re: Split using mapreduce in hbase

> Hi, > > I am using 0.92 version for hbase. > > Ranjini > > On Thu, Jan 2, 2014 at 10:22 AM, Ranjini Rathinam > wrote: > >> >> >> -- Forwarded message -- >> From: Ted Yu >> Date: Tue, Dec 31, 2013 at 8:06 PM

LookUp in mapreduce

Hi, I want to compare the value from one hbase table to another hbase table value , and need to add one column as valid indicator if value is matching mark the field has 0 or not matching means 1. i have used Filter command in mapreduce code but the column is not printing in hbase table. if(By

Re: Error: Java Heap space

i have used the dash(-) but still the error is coming. Not ablre to fix. Please help to fix it. Regards, Ranjini On Mon, Dec 30, 2013 at 5:24 PM, Dieter De Witte wrote: > not sure but i think you need to write =-Xmx, you forgot the dash.. > > > 2013/12/30 Ranjini Rathi

Error: Java Heap space

Hi, While excuting the word count mapreduce program , input file is 95.2 MB. the error occures like this " Error: Java Heap space" I have added -D mapred.child.java.opts=Xmx4096M in runtime also, but the error has not solve . In code also i have written conf.mapred.map.java.task=Xmx512M for

Split the File using mapreduce

Hi, I have a file with 16 fields such as id,name,sa,dept,exp,address,company,phone,mobile,project,redk, so on My scenaraio is to split the first eight attributes in one file and another eight attributes in another file using MapReduce program. so first eight attributes and its value in o

count the number of rows in a table

Hi, Need to write a mapreduce program to count the number of rows in a table. Please suggest me with example. Thanks in advance. Ranjini R

XmlInputFormat Hadoop -Mapreduce

=0* > *13/12/17 15:18:14 INFO mapred.JobClient: Reduce input groups=2* > *13/12/17 15:18:14 INFO mapred.JobClient: Reduce shuffle bytes=0* > *13/12/17 15:18:14 INFO mapred.JobClient: Reduce input records=2* > *13/12/17 15:18:14 INFO mapred.JobClient: Reduce output records

XmlInputFormat Hadoop -Mapreduce

Hi, I am trying to process xml via mapreduce. and output should be in text format. I am using hadoop 0.20 the following error has occured , the link provided https://github.com/studhadoop/xmlparsing-hadoop/blob/master/XmlParser11.java I have used the Package org.apache.hadoop.mapreduce.lib. on

Re: Hadoop-MapReduce

not perfect ..I simply did to > check my xml data. > > https://github.com/studhadoop/xmlparsing-hadoop/blob/master/XmlParser11.java > > > On Tue, Dec 17, 2013 at 2:26 PM, Ranjini Rathinam > wrote: > >> Hi, >> >> The driver class and my Mapper class i have used

Re: Hadoop-MapReduce

; > The newer api has package structure package of > org.apache.hadoop.mapreduce.lib > > Check out the XMLINputFormat.java, which package of FileInputFormat > they have used... > > > Regards, > Som Shekhar Sharma > +91-8197243810 > > > On Tue, Dec 17, 2013 at 12:5

Re: Hadoop-MapReduce

1, 2013 at 12:30 PM, Ranjini Rathinam wrote: > hi, > > I have fixed the error , the code is running fine, but this code just > split the part of the tag. > > i want to convert into text format so that i can load them into tables of > hbase and hive. > > I have used the DO

Re: hadoop -Mapreduce

Hi, I am fresher to mapreduce concept, I would like to know how to implement multithread concept in mapreduce. Please provide sample program for implementating the above concept. Thanks in advance. Ranjini.R On Mon, Dec 9, 2013 at 12:34 PM, Ranjini Rathinam wrote: > hi, > > Will th

Re: Hadoop-MapReduce

s accessed through FileSystem. I kindly request u to , Please suggest me to fix the above issue. Thanks in advance Ranjini R On Tue, Dec 10, 2013 at 11:07 AM, Ranjini Rathinam wrote: > > > -- Forwarded message -- > From: Shekhar Sharma > Date: Mon, Dec 9, 2

Re: Hadoop-MapReduce

in classpath THe error is is coming has NoClasFoung Exception. Please provide sample code for the same. Thanks in advance, Ranjini.R On Mon, Dec 9, 2013 at 12:34 PM, Ranjini Rathinam wrote: > >Hi, >>> >>> As suggest by the link below , i have used for my program ,

Re: hadoop -Mapreduce

ites your needs. > > org.apache.hadoop.mapreduce.lib.map.MultithreadedMapper > > > > Thanks and Regards, > > Vinayakumar B > > *From:* Ranjini Rathinam [mailto:ranjinibe...@gmail.com] > *Sent:* 09 December 2013 11:13 > *To:* user@hadoop.apache.org > *Subject:* Re: hadoop -Mapreduce > > &g

Re: Hadoop-MapReduce

t;>^ >> Note: XmlReader.java uses unchecked or unsafe operations. >> Note: Recompile with -Xlint:unchecked for details. >> 2 errors >> >> >> i am using hadoop 0.20 version and java 1.6 . >> >> Please suggest. >> >> Than

Re: Hadoop-MapReduce

erations. > Note: Recompile with -Xlint:unchecked for details. > 2 errors > > > i am using hadoop 0.20 version and java 1.6 . > > Please suggest. > > Thanks in advance. > > Regrads, > Ranjini. R > On Mon, Dec 9, 2013 at 11:08 AM, Ranjini Rathinam > wrot

Re: hadoop -Mapreduce

reducers depends on availability of map and > reduce slots in the cluster. > > Cheers, > Subroto Sanyal > > On Dec 6, 2013, at 12:00 PM, Ranjini Rathinam wrote: > > HI, > > How to run more than one mapper and reduce parallelly.? > > Please suggest.Thanks in advance. > > Ranjini. > > >

Hadoop-MapReduce

Hi, How to read xml file via mapreduce and load them in hbase and hive using java. Please provide sample code. I am using hadoop 0.20 version and java 1.6. Which parser version should be used. Thanks in advance. Ranjini

hadoop -Mapreduce

HI, How to run more than one mapper and reduce parallelly.? Please suggest.Thanks in advance. Ranjini.

Re: issue about total input byte of MR job

THis is the input. please help with code example. 100 ert eewre wefwef On Tue, Dec 3, 2013 at 2:11 PM, Jeff Zhang wrote: > It depend on your input data. E.g. your input consists of 10 files, each > is 65M, then each file will take 2 mappers, overall it would cost 20 > mappers, but the i

Re: issue about total input byte of MR job

Hi, How to process a xml file via mapreduce and load them into hbase table. please suggest with sample code. Thanks in advance. On Tue, Dec 3, 2013 at 1:58 PM, ch huang wrote: > i run the MR job,at the MR output i see > > 13/12/03 14:02:28 INFO mapreduce.JobSubmitter: number of splits:2717 > >