Apache MSDN Offer is Back
A few months ago, we learned that the offer for ASF committers to get an MSDN license had gone away. I'm happy to report that as of a few weeks ago, that offer is back in place. For more details, committers can check out https://svn.apache.org/repos/private/committers and read donated-licenses/msdn.txt. --Chris Nauroth
[jira] [Created] (HDFS-10656) Optimize conversion of byte arrays back to path string
Daryn Sharp created HDFS-10656:
--
Summary: Optimize conversion of byte arrays back to path string
Key: HDFS-10656
URL: https://issues.apache.org/jira/browse/HDFS-10656
Project: Hadoop HDFS
Issue Type: Sub-task
Components: hdfs
Reporter: Daryn Sharp
Assignee: Daryn Sharp
{{DFSUtil.byteArray2PathString}} generates excessive object allocation.
# each byte array is encoded to a string (copy)
# string appended to a builder which extracts the chars from the intermediate
string (copy) and adds to its own char array
# builder's char array is re-alloced if over 16 chars (copy)
# builder's toString creates another string (copy)
Instead of allocating all these objects and performing multiple byte/char
encoding/decoding conversions, the byte array can be built in-place with a
single final conversion to a string.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Re: [DISCUSS] Official Docker Image at release time
On Tue, Jul 19, 2016 at 8:12 AM, Sean Busbey wrote: > FWIW, there is a "blessed" apache area on docker hub now, and it's > just an INFRA request to point out the needed Dockerfile in the repo. > > PMCs can also request write access to bintray hosting of docker images > for PMC members. > > Info on INFRA-8441, example on INFRA-12019. > > A Docker image that starts up a pseudo distributed instance would be > great for new folks. I don't know if it's worth the investment to > build images that do more complex multi-instance deployments (though > there is some fledgling work in HBase for tooling that would do this > for us). I am with Sean on this one. To make it truly useful outside of a Quickstart VM use case the community image has to deal with configuration management in a much more explicit way. Just sticking java bits into a Docker container won't really solve much. Thanks, Roman. - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10655) Fix path related byte array conversion bugs
Daryn Sharp created HDFS-10655:
--
Summary: Fix path related byte array conversion bugs
Key: HDFS-10655
URL: https://issues.apache.org/jira/browse/HDFS-10655
Project: Hadoop HDFS
Issue Type: Sub-task
Reporter: Daryn Sharp
Assignee: Daryn Sharp
{{DFSUtil.bytes2ByteArray}} does not always properly handle runs of multiple
separators, nor does it handle relative paths correctly.
{{DFSUtil.byteArray2PathString}} does not rebuild the path correctly unless the
specified range is the entire component array.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10654) Move building of httpfs dependency analysis under "docs" profile
Andrew Wang created HDFS-10654: -- Summary: Move building of httpfs dependency analysis under "docs" profile Key: HDFS-10654 URL: https://issues.apache.org/jira/browse/HDFS-10654 Project: Hadoop HDFS Issue Type: Bug Components: build, httpfs Affects Versions: 2.6.4 Reporter: Andrew Wang Assignee: Andrew Wang Priority: Minor When built with "-Pdist" but not "-Pdocs", httpfs still generates a share/docs directory since the dependency report is run unconditionally. Let's move it under the "docs" profile like the rest of the site. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Re: [DISCUSS] Official Docker Image at release time
FWIW, there is a "blessed" apache area on docker hub now, and it's just an INFRA request to point out the needed Dockerfile in the repo. PMCs can also request write access to bintray hosting of docker images for PMC members. Info on INFRA-8441, example on INFRA-12019. A Docker image that starts up a pseudo distributed instance would be great for new folks. I don't know if it's worth the investment to build images that do more complex multi-instance deployments (though there is some fledgling work in HBase for tooling that would do this for us). On Tue, Jul 19, 2016 at 2:46 AM, Tsuyoshi Ozawa wrote: > Hi developers, > > Klaus mentioned the availability of an official docker image of Apache > Hadoop. Is it time that we start to distribute an official docker > image at release time? > > http://mail-archives.apache.org/mod_mbox/hadoop-user/201607.mbox/%3CSG2PR04MB162977CFE150444FA022510FB6370%40SG2PR04MB1629.apcprd04.prod.outlook.com%3E > > Thoughts? > > Thanks, > - Tsuyoshi > > - > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org > -- busbey - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10653) Optimize conversion from path string to components
Daryn Sharp created HDFS-10653: -- Summary: Optimize conversion from path string to components Key: HDFS-10653 URL: https://issues.apache.org/jira/browse/HDFS-10653 Project: Hadoop HDFS Issue Type: Sub-task Components: hdfs Affects Versions: 2.0.0-alpha Reporter: Daryn Sharp Assignee: Daryn Sharp Converting a path String to a byte[][] currently requires an unnecessary intermediate conversion from String to String[]. Removing this will reduce excessive object allocation and byte copying. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[DISCUSS] Official Docker Image at release time
Hi developers, Klaus mentioned the availability of an official docker image of Apache Hadoop. Is it time that we start to distribute an official docker image at release time? http://mail-archives.apache.org/mod_mbox/hadoop-user/201607.mbox/%3CSG2PR04MB162977CFE150444FA022510FB6370%40SG2PR04MB1629.apcprd04.prod.outlook.com%3E Thoughts? Thanks, - Tsuyoshi - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
