[GitHub] hama pull request: [HAMA-984] Support AWS S3 schema in Hadoop 2.6+

2016-02-25 Thread Cazen 
GitHub user Cazen opened a pull request:

https://github.com/apache/hama/pull/9

[HAMA-984] Support AWS S3 schema in Hadoop 2.6+



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/Cazen/hama HAMA-984

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hama/pull/9.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #9


commit 74b5214848b342a53d7d996c525b16e969850d91
Author: Cazen Lee 
Date:   2016-02-25T13:52:17Z

Add hadoop-aws dependency




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Commented] (HAMA-984) Support AWS S3 schema in Hadoop 2.6+

2016-02-25 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/HAMA-984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15167215#comment-15167215
 ] 

ASF GitHub Bot commented on HAMA-984:
-

GitHub user Cazen opened a pull request:

https://github.com/apache/hama/pull/9

[HAMA-984] Support AWS S3 schema in Hadoop 2.6+



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/Cazen/hama HAMA-984

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hama/pull/9.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #9


commit 74b5214848b342a53d7d996c525b16e969850d91
Author: Cazen Lee 
Date:   2016-02-25T13:52:17Z

Add hadoop-aws dependency




> Support AWS S3 schema in Hadoop 2.6+
> 
>
> Key: HAMA-984
> URL: https://issues.apache.org/jira/browse/HAMA-984
> Project: Hama
>  Issue Type: Improvement
>  Components: build 
>Reporter: Cazen Lee
>
> Hadoop 2.6+ does not contain AWS S3 related filesystem by default.
> So, IOException(No FileSystem for scheme) occurred while trying to access S3 
> via s3 or s3n schema.
> I know it's not a Hama bug but it will be helpful to Hama users who using AWS 
> S3 because it can be used by previous version(includes 1.x) without manual 
> setting. Of course, we can also guide through the changes, without 
> modification any source code.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HAMA-984) Support AWS S3 schema in Hadoop 2.6+

2016-02-25 Thread Cazen Lee (JIRA) 
Cazen Lee created HAMA-984:
--

 Summary: Support AWS S3 schema in Hadoop 2.6+
 Key: HAMA-984
 URL: https://issues.apache.org/jira/browse/HAMA-984
 Project: Hama
  Issue Type: Improvement
  Components: build 
Reporter: Cazen Lee


Hadoop 2.6+ does not contain AWS S3 related filesystem by default.

So, IOException(No FileSystem for scheme) occurred while trying to access S3 
via s3 or s3n schema.

I know it's not a Hama bug but it will be helpful to Hama users who using AWS 
S3 because it can be used by previous version(includes 1.x) without manual 
setting. Of course, we can also guide through the changes, without modification 
any source code.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Does Hama supportting AWS S3 schema?

2016-02-25 Thread Edward J. Yoon 
Yes, it sounds great. To support S3 as Input or Output for Hama BSP
jobs, I guess you'll need to implement our own S3 in/out formatters.

The rests e.g., hadoop-version, auth, uri, etc. must be the
configuration or build option issue.

Please feel free to open JIRA ticket, and enjoy to contribute your patches!

Thanks.


On Thu, Feb 25, 2016 at 5:22 PM, Cazen Lee  wrote:
> Additional information:
> NativeS3Filesystem is not under default hadoop 2.6 and upper's classpath
> I think it will works again with hadoop-aws in pom
>
> --
> cazen@gmail.com
> cazen@samsung.com
> http://www.cazen.co.kr
>
> Good day this is Cazen
>
> Is there are any plan to support S3?
>
> I think it will be very helpful if we apply it because S3 is most famous
> and easy to use.
>
> If sounds good, could I create Jira issue for futher discussion?
>
> Any advice is welcome.
>
> --
> cazen@gmail.com
> cazen@samsung.com
> http://www.cazen.co.kr



-- 
Best Regards, Edward J. Yoon

Fwd: Does Hama supportting AWS S3 schema?

2016-02-25 Thread Cazen Lee 
Additional information:
NativeS3Filesystem is not under default hadoop 2.6 and upper's classpath
I think it will works again with hadoop-aws in pom

--
cazen@gmail.com
cazen@samsung.com
http://www.cazen.co.kr

Good day this is Cazen

Is there are any plan to support S3?

I think it will be very helpful if we apply it because S3 is most famous
and easy to use.

If sounds good, could I create Jira issue for futher discussion?

Any advice is welcome.

--
cazen@gmail.com
cazen@samsung.com
http://www.cazen.co.kr

Does Hama supportting AWS S3 schema?

2016-02-25 Thread Cazen Lee 
Good day this is Cazen

Is there are any plan to support S3?

I think it will be very helpful if we apply it because S3 is most famous
and easy to use.

If sounds good, could I create Jira issue for futher discussion?

Any advice is welcome.

--
cazen@gmail.com
cazen@samsung.com
http://www.cazen.co.kr