[
https://issues.apache.org/jira/browse/PHOENIX-990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14016077#comment-14016077
]
James Taylor commented on PHOENIX-990:
--------------------------------------
For building Phoenix, it's pretty standard Maven stuff. Take a look here:
http://phoenix.apache.org/building.html
For generating a table with 5-10M rows, you can use our performance script as
documented here: http://phoenix.apache.org/tuning.html#Measuring_Performance
Use can use bin/sqlline.py, our bundled terminal client (), to run a query like
this: SELECT HOST FROM PERFORMANCE_5000000 ORDER BY DOMAIN or you can just add
this query to the performance.py script as an alternative.
If you need help repro-ing [~mujtaba] would be able to help.
> OOM caused by order by query returning all rows
> -----------------------------------------------
>
> Key: PHOENIX-990
> URL: https://issues.apache.org/jira/browse/PHOENIX-990
> Project: Phoenix
> Issue Type: Bug
> Affects Versions: 3.0.0
> Reporter: Mujtaba Chohan
> Assignee: Praveen Murugesan
>
> OOM error with the following stack trace with large number of rows for query
> with order by returning all rows without limit or aggregation (ex. select *
> from table order by col1). Created a local perf. test to verify it when this
> gets fixed. Also performance.py script can be used to generate a few mil.
> rows.
> Originally reported by @zenmehra.
> Stack:
> ERROR org.apache.hadoop.hbase.regionserver.HRegionServer: Failed openScanner
> org.apache.hadoop.hbase.DoNotRetryIOException:
> PERFORMANCE_5000000,,1400524730456.c62cccdac8cffd098d236f5e282564bb.:
> java.io.IOException: Map failed
> at
> org.apache.phoenix.util.ServerUtil.throwIOException(ServerUtil.java:73)
> at
> org.apache.phoenix.coprocessor.ScanRegionObserver.getTopNScanner(ScanRegionObserver.java:221)
> at
> org.apache.phoenix.coprocessor.ScanRegionObserver.doPostScannerOpen(ScanRegionObserver.java:197)
> at
> org.apache.phoenix.coprocessor.BaseScannerRegionObserver.postScannerOpen(BaseScannerRegionObserver.java:66)
> at
> org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.postScannerOpen(RegionCoprocessorHost.java:1316)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.internalOpenScanner(HRegionServer.java:2573)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:2541)
> at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
> org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:323)
> at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1426)
> Caused by: java.lang.RuntimeException: java.io.IOException: Map failed
> at
> org.apache.phoenix.iterate.MappedByteBufferSortedQueue.offer(MappedByteBufferSortedQueue.java:73)
> at
> org.apache.phoenix.iterate.MappedByteBufferSortedQueue.offer(MappedByteBufferSortedQueue.java:43)
> at java.util.AbstractQueue.add(AbstractQueue.java:68)
> at
> org.apache.phoenix.iterate.OrderedResultIterator.getResultIterator(OrderedResultIterator.java:224)
> at
> org.apache.phoenix.iterate.OrderedResultIterator.next(OrderedResultIterator.java:169)
> at
> org.apache.phoenix.coprocessor.ScanRegionObserver.getTopNScanner(ScanRegionObserver.java:216)
> ... 10 more
> Caused by: java.io.IOException: Map failed
> at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:748)
> at
> org.apache.phoenix.iterate.MappedByteBufferSortedQueue$MappedByteBufferPriorityQueue.writeResult(MappedByteBufferSortedQueue.java:299)
> at
> org.apache.phoenix.iterate.MappedByteBufferSortedQueue.offer(MappedByteBufferSortedQueue.java:65)
> ... 15 more
> Caused by: java.lang.OutOfMemoryError: Map failed
> at sun.nio.ch.FileChannelImpl.map0(Native Method)
> at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:745)
--
This message was sent by Atlassian JIRA
(v6.2#6252)
