[jira] [Commented] (HBASE-4565) Maven HBase build broken on cygwin with copynativelib.sh call.
[
https://issues.apache.org/jira/browse/HBASE-4565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13240448#comment-13240448
]
Suraj Varma commented on HBASE-4565:
@Laxman - Yes, please go ahead.
@Lars - Ok, no problem.
Maven HBase build broken on cygwin with copynativelib.sh call.
--
Key: HBASE-4565
URL: https://issues.apache.org/jira/browse/HBASE-4565
Project: HBase
Issue Type: Bug
Components: build
Affects Versions: 0.92.0
Environment: cygwin (on xp and win7)
Reporter: Suraj Varma
Assignee: Suraj Varma
Labels: build, maven
Fix For: 0.96.0
Attachments: HBASE-4565-0.92.patch, HBASE-4565-v2.patch,
HBASE-4565-v3-0.92.patch, HBASE-4565-v3.patch, HBASE-4565.patch
This is broken in both 0.92 as well as trunk pom.xml
Here's a sample maven log snippet from trunk (from Mayuresh on user mailing
list)
[INFO] [antrun:run {execution: package}]
[INFO] Executing tasks
main:
[mkdir] Created dir:
D:\workspace\mkshirsa\hbase-trunk\target\hbase-0.93-SNAPSHOT\hbase-0.93-SNAPSHOT\lib\native\${build.platform}
[exec] ls: cannot access D:workspacemkshirsahbase-trunktarget/nativelib:
No such file or directory
[exec] tar (child): Cannot connect to D: resolve failed
[INFO]
[ERROR] BUILD ERROR
[INFO]
[INFO] An Ant BuildException has occured: exec returned: 3328
There are two issues:
1) The ant run task below doesn't resolve the windows file separator returned
by the project.build.directory - this causes the above resolve failed.
!-- Using Unix cp to preserve symlinks, using script to handle wildcards --
echo file=${project.build.directory}/copynativelibs.sh
if [ `ls ${project.build.directory}/nativelib | wc -l` -ne 0]; then
2) The tar argument value below also has a similar issue in that the path arg
doesn't resolve right.
!-- Using Unix tar to preserve symlinks --
exec executable=tar failonerror=yes
dir=${project.build.directory}/${project.artifactId}-${project.version}
arg value=czf/
arg
value=/cygdrive/c/workspaces/hbase-0.92-svn/target/${project.artifactId}-${project.version}.tar.gz/
arg value=./
/exec
In both cases, the fix would probably be to use a cross-platform way to
handle the directory locations.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-4565) Maven HBase build broken on cygwin with copynativelib.sh call.
[
https://issues.apache.org/jira/browse/HBASE-4565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13179550#comment-13179550
]
Suraj Varma commented on HBASE-4565:
Ah - looks like it is out of sync with 0.92 and trunk now with the
hbase-security pom updates. I'll rebase and put out a new patch version.
Maven HBase build broken on cygwin with copynativelib.sh call.
--
Key: HBASE-4565
URL: https://issues.apache.org/jira/browse/HBASE-4565
Project: HBase
Issue Type: Bug
Components: build
Affects Versions: 0.92.0
Environment: cygwin (on xp and win7)
Reporter: Suraj Varma
Assignee: Suraj Varma
Labels: build, maven
Fix For: 0.94.0
Attachments: HBASE-4565-0.92.patch, HBASE-4565-v2.patch,
HBASE-4565-v3-0.92.patch, HBASE-4565-v3.patch, HBASE-4565.patch
This is broken in both 0.92 as well as trunk pom.xml
Here's a sample maven log snippet from trunk (from Mayuresh on user mailing
list)
[INFO] [antrun:run {execution: package}]
[INFO] Executing tasks
main:
[mkdir] Created dir:
D:\workspace\mkshirsa\hbase-trunk\target\hbase-0.93-SNAPSHOT\hbase-0.93-SNAPSHOT\lib\native\${build.platform}
[exec] ls: cannot access D:workspacemkshirsahbase-trunktarget/nativelib:
No such file or directory
[exec] tar (child): Cannot connect to D: resolve failed
[INFO]
[ERROR] BUILD ERROR
[INFO]
[INFO] An Ant BuildException has occured: exec returned: 3328
There are two issues:
1) The ant run task below doesn't resolve the windows file separator returned
by the project.build.directory - this causes the above resolve failed.
!-- Using Unix cp to preserve symlinks, using script to handle wildcards --
echo file=${project.build.directory}/copynativelibs.sh
if [ `ls ${project.build.directory}/nativelib | wc -l` -ne 0]; then
2) The tar argument value below also has a similar issue in that the path arg
doesn't resolve right.
!-- Using Unix tar to preserve symlinks --
exec executable=tar failonerror=yes
dir=${project.build.directory}/${project.artifactId}-${project.version}
arg value=czf/
arg
value=/cygdrive/c/workspaces/hbase-0.92-svn/target/${project.artifactId}-${project.version}.tar.gz/
arg value=./
/exec
In both cases, the fix would probably be to use a cross-platform way to
handle the directory locations.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-4565) Maven HBase build broken on cygwin with copynativelib.sh call.
[
https://issues.apache.org/jira/browse/HBASE-4565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13127365#comment-13127365
]
Suraj Varma commented on HBASE-4565:
Update: I haven't been able to get it to work in a cross-platform way as yet.
The best I've been able to do is to exec cygpath -u ${project.build.directory}
to get a POSIX directory ... however, this would involve replacing the
${project.build.directory} with a new variable for cygwin.
The workaround for now is to manually update the path to
/cygdrive/c/path/to/project/build/directory wherever it execs out to shell.
I'll continue to look into other options.
Maven HBase build broken on cygwin with copynativelib.sh call.
--
Key: HBASE-4565
URL: https://issues.apache.org/jira/browse/HBASE-4565
Project: HBase
Issue Type: Bug
Components: build
Affects Versions: 0.92.0
Environment: cygwin (on xp and win7)
Reporter: Suraj Varma
Assignee: Suraj Varma
Labels: build, maven
Fix For: 0.92.0
This is broken in both 0.92 as well as trunk pom.xml
Here's a sample maven log snippet from trunk (from Mayuresh on user mailing
list)
[INFO] [antrun:run {execution: package}]
[INFO] Executing tasks
main:
[mkdir] Created dir:
D:\workspace\mkshirsa\hbase-trunk\target\hbase-0.93-SNAPSHOT\hbase-0.93-SNAPSHOT\lib\native\${build.platform}
[exec] ls: cannot access D:workspacemkshirsahbase-trunktarget/nativelib:
No such file or directory
[exec] tar (child): Cannot connect to D: resolve failed
[INFO]
[ERROR] BUILD ERROR
[INFO]
[INFO] An Ant BuildException has occured: exec returned: 3328
There are two issues:
1) The ant run task below doesn't resolve the windows file separator returned
by the project.build.directory - this causes the above resolve failed.
!-- Using Unix cp to preserve symlinks, using script to handle wildcards --
echo file=${project.build.directory}/copynativelibs.sh
if [ `ls ${project.build.directory}/nativelib | wc -l` -ne 0]; then
2) The tar argument value below also has a similar issue in that the path arg
doesn't resolve right.
!-- Using Unix tar to preserve symlinks --
exec executable=tar failonerror=yes
dir=${project.build.directory}/${project.artifactId}-${project.version}
arg value=czf/
arg
value=/cygdrive/c/workspaces/hbase-0.92-svn/target/${project.artifactId}-${project.version}.tar.gz/
arg value=./
/exec
In both cases, the fix would probably be to use a cross-platform way to
handle the directory locations.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-4565) Maven HBase build broken on cygwin with copynativelib.sh call.
[
https://issues.apache.org/jira/browse/HBASE-4565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13126722#comment-13126722
]
Suraj Varma commented on HBASE-4565:
Working on one ... assigning this to myself.
Maven HBase build broken on cygwin with copynativelib.sh call.
--
Key: HBASE-4565
URL: https://issues.apache.org/jira/browse/HBASE-4565
Project: HBase
Issue Type: Bug
Components: build
Affects Versions: 0.92.0
Environment: cygwin (on xp and win7)
Reporter: Suraj Varma
Assignee: Suraj Varma
Labels: build, maven
Fix For: 0.92.0
This is broken in both 0.92 as well as trunk pom.xml
Here's a sample maven log snippet from trunk (from Mayuresh on user mailing
list)
[INFO] [antrun:run {execution: package}]
[INFO] Executing tasks
main:
[mkdir] Created dir:
D:\workspace\mkshirsa\hbase-trunk\target\hbase-0.93-SNAPSHOT\hbase-0.93-SNAPSHOT\lib\native\${build.platform}
[exec] ls: cannot access D:workspacemkshirsahbase-trunktarget/nativelib:
No such file or directory
[exec] tar (child): Cannot connect to D: resolve failed
[INFO]
[ERROR] BUILD ERROR
[INFO]
[INFO] An Ant BuildException has occured: exec returned: 3328
There are two issues:
1) The ant run task below doesn't resolve the windows file separator returned
by the project.build.directory - this causes the above resolve failed.
!-- Using Unix cp to preserve symlinks, using script to handle wildcards --
echo file=${project.build.directory}/copynativelibs.sh
if [ `ls ${project.build.directory}/nativelib | wc -l` -ne 0]; then
2) The tar argument value below also has a similar issue in that the path arg
doesn't resolve right.
!-- Using Unix tar to preserve symlinks --
exec executable=tar failonerror=yes
dir=${project.build.directory}/${project.artifactId}-${project.version}
arg value=czf/
arg
value=/cygdrive/c/workspaces/hbase-0.92-svn/target/${project.artifactId}-${project.version}.tar.gz/
arg value=./
/exec
In both cases, the fix would probably be to use a cross-platform way to
handle the directory locations.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-4388) Second start after migration from 90 to trunk crashes
[ https://issues.apache.org/jira/browse/HBASE-4388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13124204#comment-13124204 ] Suraj Varma commented on HBASE-4388: @Ted Yu: This was a standalone install on cygwin. I had a 0.90.x hbase root dir which i was pointing to from 0.92.0-SNAPSHOT plus the patch. Procedure was to simply do start-hbase.sh on the 0.92 install, the master died each time with the NegativeArraySizeException. By explicitly catching this exception in HRegionInfo090x#readFields(DataInput) method rethrowing as IOException (similar to EOFException), I was able to get past this and complete the migration successfully. I'm attaching the master log from when it threw the error during migration. Second start after migration from 90 to trunk crashes - Key: HBASE-4388 URL: https://issues.apache.org/jira/browse/HBASE-4388 Project: HBase Issue Type: Bug Components: master, migration Affects Versions: 0.92.0 Reporter: Todd Lipcon Assignee: stack Priority: Blocker Fix For: 0.92.0 Attachments: 4388-v2.txt, 4388-v3.txt, 4388.txt, meta.tgz I started a trunk cluster to upgrade from 90, inserted a ton of data, then did a clean shutdown. When I started again, I got the following exception: 11/09/13 12:29:09 INFO master.HMaster: Meta has HRI with HTDs. Updating meta now. 11/09/13 12:29:09 FATAL master.HMaster: Unhandled exception. Starting shutdown. java.lang.NegativeArraySizeException: -102 at org.apache.hadoop.hbase.util.Bytes.readByteArray(Bytes.java:147) at org.apache.hadoop.hbase.HTableDescriptor.readFields(HTableDescriptor.java:606) at org.apache.hadoop.hbase.migration.HRegionInfo090x.readFields(HRegionInfo090x.java:641) at org.apache.hadoop.hbase.util.Writables.getWritable(Writables.java:133) at org.apache.hadoop.hbase.util.Writables.getWritable(Writables.java:103) at org.apache.hadoop.hbase.util.Writables.getHRegionInfoForMigration(Writables.java:228) at org.apache.hadoop.hbase.catalog.MetaEditor.getHRegionInfoForMigration(MetaEditor.java:350) at org.apache.hadoop.hbase.catalog.MetaEditor$1.visit(MetaEditor.java:273) at org.apache.hadoop.hbase.catalog.MetaReader.fullScan(MetaReader.java:633) at org.apache.hadoop.hbase.catalog.MetaReader.fullScan(MetaReader.java:255) at org.apache.hadoop.hbase.catalog.MetaReader.fullScan(MetaReader.java:235) at org.apache.hadoop.hbase.catalog.MetaEditor.updateMetaWithNewRegionInfo(MetaEditor.java:284) at org.apache.hadoop.hbase.catalog.MetaEditor.migrateRootAndMeta(MetaEditor.java:298) at org.apache.hadoop.hbase.master.HMaster.updateMetaWithNewHRI(HMaster.java:529) at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:472) at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:309) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-4388) Second start after migration from 90 to trunk crashes
[ https://issues.apache.org/jira/browse/HBASE-4388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13123820#comment-13123820 ] Suraj Varma commented on HBASE-4388: Sorry - I meant 4388-v3 not 4288-v3 ... Second start after migration from 90 to trunk crashes - Key: HBASE-4388 URL: https://issues.apache.org/jira/browse/HBASE-4388 Project: HBase Issue Type: Bug Components: master, migration Affects Versions: 0.92.0 Reporter: Todd Lipcon Assignee: stack Priority: Blocker Fix For: 0.92.0 Attachments: 4388-v2.txt, 4388-v3.txt, 4388.txt, meta.tgz I started a trunk cluster to upgrade from 90, inserted a ton of data, then did a clean shutdown. When I started again, I got the following exception: 11/09/13 12:29:09 INFO master.HMaster: Meta has HRI with HTDs. Updating meta now. 11/09/13 12:29:09 FATAL master.HMaster: Unhandled exception. Starting shutdown. java.lang.NegativeArraySizeException: -102 at org.apache.hadoop.hbase.util.Bytes.readByteArray(Bytes.java:147) at org.apache.hadoop.hbase.HTableDescriptor.readFields(HTableDescriptor.java:606) at org.apache.hadoop.hbase.migration.HRegionInfo090x.readFields(HRegionInfo090x.java:641) at org.apache.hadoop.hbase.util.Writables.getWritable(Writables.java:133) at org.apache.hadoop.hbase.util.Writables.getWritable(Writables.java:103) at org.apache.hadoop.hbase.util.Writables.getHRegionInfoForMigration(Writables.java:228) at org.apache.hadoop.hbase.catalog.MetaEditor.getHRegionInfoForMigration(MetaEditor.java:350) at org.apache.hadoop.hbase.catalog.MetaEditor$1.visit(MetaEditor.java:273) at org.apache.hadoop.hbase.catalog.MetaReader.fullScan(MetaReader.java:633) at org.apache.hadoop.hbase.catalog.MetaReader.fullScan(MetaReader.java:255) at org.apache.hadoop.hbase.catalog.MetaReader.fullScan(MetaReader.java:235) at org.apache.hadoop.hbase.catalog.MetaEditor.updateMetaWithNewRegionInfo(MetaEditor.java:284) at org.apache.hadoop.hbase.catalog.MetaEditor.migrateRootAndMeta(MetaEditor.java:298) at org.apache.hadoop.hbase.master.HMaster.updateMetaWithNewHRI(HMaster.java:529) at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:472) at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:309) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
