Re: GC overhead limit exceeded

Thanks a lot, the answer is helpful. On Wed, Mar 12, 2014 at 2:20 PM, divye sheth wrote: > Hi Haihong, > > Please check out the link below, I believe it should solve your problem. > > > http://stackoverflow.com/questions/21005643/container-is-running-beyond-memory-limits > > Thanks > Divye Shet

Re: Use Cases for Structured Data

Hey D, Regarding your point 5: "For a proof of concept I would use a ready-made virtual machine from one to 3 big vendors - cloudera, mapR and hortonworks" I want to understand how this virtual setup would work and how much master and slaves nodes I can have in this virtual setup and in general wh

Re: Use Cases for Structured Data

Thanks D, that certainly answers my question. I was just taking quick look at Hortonworks HDP vs Hortonworks Sandbox, do you know of any benefits of using Sandbox as opposed to Hortonworks Data Platforms? On Wed, Mar 12, 2014 at 4:02 PM, Dieter De Witte wrote: > Hi, > > 1) HDFS is just a file

Re: Use Cases for Structured Data

Hi, 1) HDFS is just a file system, it hides the fact that it is distributed. 2) Mapreduce is the most lowlevel analytics tool I think, you can just specify an input and in your map and reduce function define some functionality to deal with this input. No need for HBase,... although they can be ext

Re: Use Cases for Structured Data

Assuming that the following is your initial questions: *"My question here is how benefits YARN architecture give me in tems of analysis that my Microsoft, Netezza of Tableau products are not giving me. I am just trying to understand value of introducing Hadoop in my Architecture in terms of Analysi

Re: Use Cases for Structured Data

Thank you Shahab but it would be really nice if I can get some input on my initial question as it would really help. On Wed, Mar 12, 2014 at 3:11 PM, Shahab Yunus wrote: > I would suggest that given the level of details that you are looking for > and fundamental nature of your questions, you sho

Creating a new file in HDFS from a URL

Hello, I'd like to create a new file in HDFS from a remote URL. Is there any way to do that with webhdfs? So instead of using the following command curl -i -X PUT -T FILE 'data_node_url' I like to use a url instead of the FILE. The input will be in another distributed filesystem (Disco's DFS) s

Re: Use Cases for Structured Data

I would suggest that given the level of details that you are looking for and fundamental nature of your questions, you should get hold of books or online documentation. Basically some reading/research. Latest edition of http://www.amazon.com/Hadoop-Definitive-Guide-Tom-White/dp/1449311520 is highl

Use Cases for Structured Data

Hello Team, I am starting off on Hadoop eco-system and wanted to learn first based on my use case if Hadoop is right tool for me. I have only structured data and my goal is to safe this data into Hadoop and take benefit of replication factor. I am using Microsoft tools for doing analysis and it p

default config tweaks for a better out-of-the-box experience

In recent versions of Mac OS X, a default Hadoop configuration such as from Homebrewraises errors on some operations: $ hadoop version Hadoop 1.2.1 Subversion https://svn.apache.org/repos/

Re: unsubsrcibe

You are: 1) Not unsubscribing correctly. From the welcome email you get when you subscribed - 'To remove your address from the list, send a message to: ' 2) Spelling 'unsubscribe' incorrectly. When you send the 'unsubscribe' request to the address above, spell it correctl

Re: unsubsrcibe

unsubsrcibe ME FROM LIST On Wednesday, 12 March 2014 5:28 PM, Junpeng Wang wrote: unsubsrcibe Junpeng WANG（王俊鹏） Mobile: +86.186.1819.5625 Skype: wangj...@hotmail.com -邮件原件- 发件人: Mailing-List [mailto:mailingl...@datenvandalismus.org] 发送时间: 2014年3月12日 18:16 收件人: user@hadoop.apache

RE: In hadoop All racks belongs to same subnet !

If you want to learn more about the networking on small to mid-size production sites, I recommend you do a search for “Hadoop reference architectures”. As an example, a good source of information is here: http://en.community.dell.com/techcenter/extras/m/white_papers/20353010.aspx (I’m not s

Re: Process of files in mapreduce

Hi , Need to convert the PDF file into Text file using mapreduce. Thanks for the support Ranjini On Wed, Mar 12, 2014 at 3:54 PM, Mingjiang Shi wrote: > Hi Ranjini, > What's your use case? How would you create key value pairs from the pdf? > > > On Wed, Mar 12, 2014 at 4:53 PM, Ranjini

unsubsrcibe

unsubsrcibe Junpeng WANG（王俊鹏） Mobile: +86.186.1819.5625 Skype: wangj...@hotmail.com -邮件原件- 发件人: Mailing-List [mailto:mailingl...@datenvandalismus.org] 发送时间: 2014年3月12日 18:16 收件人: user@hadoop.apache.org 主题: unsubsrcibe unsubsrcibe

Re: Process of files in mapreduce

Hi Ranjini, What's your use case? How would you create key value pairs from the pdf? On Wed, Mar 12, 2014 at 4:53 PM, Ranjini Rathinam wrote: > Hi, > > How to read a PDF file in mapreduce. > > Please provide sample code or sample link for refernce. > > > thanks in advance. > > Ranjini > > --

unsubsrcibe

unsubsrcibe

Re: Process of files in mapreduce

For reading PDF in java, you may refer to this link: http://stackoverflow.com/questions/4784825/how-to-read-pdf-files-using-java in mapreduce, you can use the same code; except that each map() function processes one file; Regards, *Stanley Shi,* On Wed, Mar 12, 2014 at 4:53 PM, Ranjini Rathina

Process of files in mapreduce

Hi, How to read a PDF file in mapreduce. Please provide sample code or sample link for refernce. thanks in advance. Ranjini