Thanks Taylor for you kind reply. Actually I'm using the phoenix console (i.e. ./sqlline.py xxxx). Is auto commit on the default behaviour? Or how should I set this in the console?
On Tue, Mar 31, 2015 at 10:05 AM, James Taylor <[email protected]> wrote: > I suspect you may not have auto commit on, in which case Phoenix would > attempt to buffer the results of the select in memory so that you > could commit it when you choose. Try setting auto commit on > (connection.setAutoCommit(true)) for your connection before issuing > the UPSERT SELECT statement. > > On Mon, Mar 30, 2015 at 6:48 PM, 丁桂涛（桂花） <[email protected]> wrote: > > Hi all, > > > > I'm new to phoenix and found the UPSERT SELECT query ran very slowly and > > failed after about 1 hour (I have set phoenix.query.timeoutMs to > 6000000). > > > > Versions: > > > > Phoenix: 4.3.0 > > > > HBase: 0.98.5-hadoop2 > > > > Hive: 0.14.0 > > > > > > Work Flow: > > > > create HBase table in hbase shell: create 'H_TABLE', 'CF', {NUMREGIONS > => > > 21, SPLITALGO => 'HexStringSplit'} > > > > load data to HBase table in hive via > > org.apache.hadoop.hive.hbase.HBaseStorageHandler > > > > create Phoenix view mapping to the HBase table H_TABLE: create view > P_VIEW > > (... ...); > > > > create a locally indexed Phoenix table: create table P_TABLE (... ...) > > SALT_BUCKETS = 42; create local index idx on P_TABLE (...); > > > > insert data into P_TABLE: upsert into P_TABLE select * from P_VIEW; > There're > > total about 40M records and this query failed after about 1 hour. Below > is > > the error msg. Any suggestions? > > > > > > Error: (state=08000,code=101) > > [10/1869] > > org.apache.phoenix.exception.PhoenixIOException > > at > > > org.apache.phoenix.util.ServerUtil.parseServerException(ServerUtil.java:108) > > at > > > org.apache.phoenix.iterate.BaseResultIterators.getIterators(BaseResultIterators.java:589) > > at > > > org.apache.phoenix.iterate.ConcatResultIterator.getIterators(ConcatResultIterator.java:50) > > at > > > org.apache.phoenix.iterate.ConcatResultIterator.currentIterator(ConcatResultIterator.java:97) > > at > > > org.apache.phoenix.iterate.ConcatResultIterator.next(ConcatResultIterator.java:117) > > at > > > org.apache.phoenix.compile.UpsertCompiler$2.execute(UpsertCompiler.java:679) > > at > > > org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:280) > > at > > > org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:272) > > at org.apache.phoenix.call.CallRunner.run(CallRunner.java:53) > > at > > > org.apache.phoenix.jdbc.PhoenixStatement.executeMutation(PhoenixStatement.java:270) > > at > > > org.apache.phoenix.jdbc.PhoenixStatement.execute(PhoenixStatement.java:1063) > > at sqlline.Commands.execute(Commands.java:822) > > at sqlline.Commands.sql(Commands.java:732) > > at sqlline.SqlLine.dispatch(SqlLine.java:808) > > at sqlline.SqlLine.begin(SqlLine.java:681) > > at sqlline.SqlLine.start(SqlLine.java:398) > > at sqlline.SqlLine.main(SqlLine.java:292) > > Caused by: java.lang.UnsupportedOperationException > > at java.util.AbstractList.add(AbstractList.java:148) > > at java.util.AbstractList.add(AbstractList.java:108) > > at > > > org.apache.phoenix.iterate.BaseResultIterators.getIterators(BaseResultIterators.java:535) > > ... 15 more > > > > > > >
