Re: transfer large file onto hdfs

Should we assume that the non-hadoop system has no way to get on the network of the hadoop cluster and its clients? Otherwise, you can grant it temporary access and do a write from it itself. If not: Run a micro FTP server pointed to that file, and then do a 'hadoop fs -cp ftp://location

Re: transfer large file onto hdfs

Thanks for the reply, Harsh. BTW Does anyone deploy cdh3u4 on Solaris ? On Thu, Jul 5, 2012 at 11:47 PM, Harsh J ha...@cloudera.com wrote: Should we assume that the non-hadoop system has no way to get on the network of the hadoop cluster and its clients? Otherwise, you can grant it temporary

Re: transfer large file onto hdfs

Hi Ted, Hadoop in general should work OK on Solaris, minus the native code, which may or may not require some tweaking to build for Solaris, but needs to be manually built nevertheless. For CDH-specific questions though, please mail to the CDH users list instead at

[jira] [Resolved] (HDFS-838) libhdfs causes a segfault due to race condition

[ https://issues.apache.org/jira/browse/HDFS-838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-838. --- Resolution: Fixed Fix Version/s: 1.0.0 The call to JNI_CreateJavaVM is now done

[jira] [Created] (HDFS-3605) Missing Block in following sceanrio.

Brahma Reddy Battula created HDFS-3605: -- Summary: Missing Block in following sceanrio. Key: HDFS-3605 URL: https://issues.apache.org/jira/browse/HDFS-3605 Project: Hadoop HDFS Issue

[jira] [Resolved] (HDFS-3304) fix fuse_dfs build

[ https://issues.apache.org/jira/browse/HDFS-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-3304. Resolution: Fixed Assignee: Colin Patrick McCabe Fixed by HADOOP-8368

Hadoop-Hdfs-trunk - Build # 1095 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1095/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 11635 lines...] [INFO] ---

Build failed in Jenkins: Hadoop-Hdfs-trunk #1095

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1095/changes Changes: [jeagles] HADOOP-8523. test-patch.sh doesn't validate patches before building (Jack Dintruff via jeagles) [atm] Fix issue with NN/DN re-registration. [bobby] MAPREDUCE-4379. Node Manager throws

[jira] [Created] (HDFS-3607) log a message when fuse_dfs is not built

Colin Patrick McCabe created HDFS-3607: -- Summary: log a message when fuse_dfs is not built Key: HDFS-3607 URL: https://issues.apache.org/jira/browse/HDFS-3607 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-3608) fuse_dfs: use inotify to detect changes in UID ticket cache

Colin Patrick McCabe created HDFS-3608: -- Summary: fuse_dfs: use inotify to detect changes in UID ticket cache Key: HDFS-3608 URL: https://issues.apache.org/jira/browse/HDFS-3608 Project: Hadoop

[jira] [Created] (HDFS-3609) libhdfs: don't force the URI to look like hdfs://hostname:port

Colin Patrick McCabe created HDFS-3609: -- Summary: libhdfs: don't force the URI to look like hdfs://hostname:port Key: HDFS-3609 URL: https://issues.apache.org/jira/browse/HDFS-3609 Project:

[jira] [Created] (HDFS-3610) fuse_dfs: Provide a way to use the default (configured) NN URI

Colin Patrick McCabe created HDFS-3610: -- Summary: fuse_dfs: Provide a way to use the default (configured) NN URI Key: HDFS-3610 URL: https://issues.apache.org/jira/browse/HDFS-3610 Project: