Re: Phoenix Create table timeout

[Parveen Jain]

As for large tables my phoenix client is giving timeout, I was trying to create 
phoenix table using spark but it is also giving error.

Below is another link asked in stackoverflow for the same: 
http://stackoverflow.com/questions/38498096/create-table-in-phoenix-from-spark


<http://stackoverflow.com/questions/38498096/create-table-in-phoenix-from-spark>

Can anyone please suggest a wayout for creating a table where phoenix python 
client is giving timeout. I am more interested in knowing for creating a table 
using spark.
<http://stackoverflow.com/questions/38498096/create-table-in-phoenix-from-spark>

[http://cdn.sstatic.net/Sites/stackoverflow/img/apple-touch-i...@2.png?v=73d79a89bded]<http://stackoverflow.com/questions/38498096/create-table-in-phoenix-from-spark>

scala - create table in phoenix from spark - Stack 
Overflow<http://stackoverflow.com/questions/38498096/create-table-in-phoenix-from-spark>
stackoverflow.com
Hi I need to create a table in Phoenix from a spark job . I have tried 2 ways 
below but none of them work, seems this is still not supported. 1) 
Dataframe.write still ...



Regards,

Parveen Jain


From: Parveen Jain <parveenj...@live.com>
Sent: Friday, July 29, 2016 1:46:10 PM
To: user
Subject: Re: Phoenix Create table timeout


Hi Simon,

You are right that table is available even after timeout but I m not fully sure 
whether that is a valid table or not for my queries?  Any way out for this or I 
can use that table for normal queries ?


James,

 Let me know whatever support is required for getting it fixed. I can help for 
reproducing it(can provide config files).


Thanks,

Parveen Jain


From: James Taylor <jamestay...@apache.org>
Sent: Friday, July 29, 2016 4:39:03 AM
To: user
Subject: Re: Phoenix Create table timeout

Yes, a MR option would be great. I filed PHOENIX-3125 for this. Give our MR 
support, this would be a good initial contribution for someone.

Thanks,
James

On Thu, Jul 28, 2016 at 11:16 AM, Simon Wang 
<simon.w...@airbnb.com<mailto:simon.w...@airbnb.com>> wrote:
This isn’t a solution but I have encountered this problem before. It also 
seemed that the table becomes available in Phoenix even if the creation dies to 
an error. I am also interested in a workaround! (Maybe a MR job?

- Simon


On Jul 28, 2016, at 1:49 AM, Parveen Jain 
<parveenj...@live.com<mailto:parveenj...@live.com>> wrote:


Hi All,
 Just starting out with Phoenix and facing issues regarding time out.First 
Timeout I am getting is while creating table in phoenix which for an existing 
table in Hbase.

My HBase table has almost 100M rows and split across two nodes having two 
region servers. One server is octa core and another is 16 core.I am using only 
default settings of HBase and some time out settings for phoenix before 
starting it out. Can Anyone suggest from where I can start looking into ?

Regards,
Parveen Jain

Following is the error:
 CREATE TABLE "DATA_FOR_PHOENIX1"(pk VARCHAR PRIMARY 
KEY,"PARSED_DATA_COLUMN1".NAME0 VARCHAR,"PARSED_DATA_COLUMN1".NAME1 
VARCHAR,"PARSED_DATA_COLUMN1".NAME2 
VARCHAR,"VARCHAR,"PARSED_DATA_COLUMN1".NAME3 
VARCHAR,"PARSED_DATA_COLUMN1".NAME4 VARCHAR,"PARSED_DATA_COLUMN1".NAME5 
VARCHAR,"PARSED_DATA_COLUMN1".NAME6 VARCHAR) SALT_BUCKETS=16;

Error: Operation timed out (state=TIM01,code=6000)
java.sql.SQLTimeoutException: Operation timed out
at 
org.apache.phoenix.exception.SQLExceptionCode$14.newException(SQLExceptionCode.java:332)
at 
org.apache.phoenix.exception.SQLExceptionInfo.buildException(SQLExceptionInfo.java:145)
at 
org.apache.phoenix.iterate.BaseResultIterators.getIterators(BaseResultIterators.java:573)
at 
org.apache.phoenix.iterate.BaseResultIterators.getIterators(BaseResultIterators.java:562)
at 
org.apache.phoenix.iterate.BaseResultIterators.getIterators(BaseResultIterators.java:516)
at 
org.apache.phoenix.iterate.ConcatResultIterator.getIterators(ConcatResultIterator.java:50)
at 
org.apache.phoenix.iterate.ConcatResultIterator.currentIterator(ConcatResultIterator.java:97)
at 
org.apache.phoenix.iterate.ConcatResultIterator.next(ConcatResultIterator.java:117)
at 
org.apache.phoenix.iterate.BaseGroupedAggregatingResultIterator.next(BaseGroupedAggregatingResultIterator.java:64)
at 
org.apache.phoenix.iterate.UngroupedAggregatingResultIterator.next(UngroupedAggregatingResultIterator.java:39)
at 
org.apache.phoenix.compile.PostDDLCompiler$1.execute(PostDDLCompiler.java:228)
at 
org.apache.phoenix.query.ConnectionQueryServicesImpl.updateData(ConnectionQueryServicesImpl.java:2013)
at 
org.apache.phoenix.schema.MetaDataClient.createTable(MetaDataClient.java:787)
at 
org.apache.phoenix.compile.

Re: Phoenix Create table timeout

[James Taylor]

Yes, a MR option would be great. I filed PHOENIX-3125 for this. Give our MR
support, this would be a good initial contribution for someone.

Thanks,
James

On Thu, Jul 28, 2016 at 11:16 AM, Simon Wang  wrote:

> This isn’t a solution but I have encountered this problem before. It also
> seemed that the table becomes available in Phoenix even if the creation
> dies to an error. I am also interested in a workaround! (Maybe a MR job?
>
> - Simon
>
>
> On Jul 28, 2016, at 1:49 AM, Parveen Jain  wrote:
>
> Hi All,
>  Just starting out with Phoenix and facing issues regarding time out.First
> Timeout I am getting is while creating table in phoenix which for an
> existing table in Hbase.
>
> My HBase table has almost 100M rows and split across two nodes having two
> region servers. One server is octa core and another is 16 core.I am using
> only default settings of HBase and some time out settings for phoenix
> before starting it out. Can Anyone suggest from where I can start looking
> into ?
>
> Regards,
> Parveen Jain
>
> Following is the error:
>  CREATE TABLE "DATA_FOR_PHOENIX1"(pk VARCHAR PRIMARY
> KEY,"PARSED_DATA_COLUMN1".NAME0 VARCHAR,"PARSED_DATA_COLUMN1".NAME1
> VARCHAR,"PARSED_DATA_COLUMN1".NAME2
> VARCHAR,"VARCHAR,"PARSED_DATA_COLUMN1".NAME3
> VARCHAR,"PARSED_DATA_COLUMN1".NAME4 VARCHAR,"PARSED_DATA_COLUMN1".NAME5
> VARCHAR,"PARSED_DATA_COLUMN1".NAME6 VARCHAR) SALT_BUCKETS=16;
>
> Error: Operation timed out (state=TIM01,code=6000)
> java.sql.SQLTimeoutException: Operation timed out
> at
> org.apache.phoenix.exception.SQLExceptionCode$14.newException(SQLExceptionCode.java:332)
> at
> org.apache.phoenix.exception.SQLExceptionInfo.buildException(SQLExceptionInfo.java:145)
> at
> org.apache.phoenix.iterate.BaseResultIterators.getIterators(BaseResultIterators.java:573)
> at
> org.apache.phoenix.iterate.BaseResultIterators.getIterators(BaseResultIterators.java:562)
> at
> org.apache.phoenix.iterate.BaseResultIterators.getIterators(BaseResultIterators.java:516)
> at
> org.apache.phoenix.iterate.ConcatResultIterator.getIterators(ConcatResultIterator.java:50)
> at
> org.apache.phoenix.iterate.ConcatResultIterator.currentIterator(ConcatResultIterator.java:97)
> at
> org.apache.phoenix.iterate.ConcatResultIterator.next(ConcatResultIterator.java:117)
> at
> org.apache.phoenix.iterate.BaseGroupedAggregatingResultIterator.next(BaseGroupedAggregatingResultIterator.java:64)
> at
> org.apache.phoenix.iterate.UngroupedAggregatingResultIterator.next(UngroupedAggregatingResultIterator.java:39)
> at
> org.apache.phoenix.compile.PostDDLCompiler$1.execute(PostDDLCompiler.java:228)
> at
> org.apache.phoenix.query.ConnectionQueryServicesImpl.updateData(ConnectionQueryServicesImpl.java:2013)
> at
> org.apache.phoenix.schema.MetaDataClient.createTable(MetaDataClient.java:787)
> at
> org.apache.phoenix.compile.CreateTableCompiler$2.execute(CreateTableCompiler.java:186)
> at
> org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:305)
> at
> org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:297)
> at org.apache.phoenix.call.CallRunner.run(CallRunner.java:53)
> at
> org.apache.phoenix.jdbc.PhoenixStatement.executeMutation(PhoenixStatement.java:295)
> at
> org.apache.phoenix.jdbc.PhoenixStatement.execute(PhoenixStatement.java:1255)
> at sqlline.Commands.execute(Commands.java:822)
> at sqlline.Commands.sql(Commands.java:732)
> at sqlline.SqlLine.dispatch(SqlLine.java:808)
> at sqlline.SqlLine.begin(SqlLine.java:681)
> at sqlline.SqlLine.start(SqlLine.java:398)
> at sqlline.SqlLine.main(SqlLine.java:292)
>
>
>

Re: Phoenix Create table timeout

[Simon Wang]

This isn’t a solution but I have encountered this problem before. It also 
seemed that the table becomes available in Phoenix even if the creation dies to 
an error. I am also interested in a workaround! (Maybe a MR job?

- Simon

> On Jul 28, 2016, at 1:49 AM, Parveen Jain  wrote:
> 
> Hi All,
>  Just starting out with Phoenix and facing issues regarding time out.First 
> Timeout I am getting is while creating table in phoenix which for an existing 
> table in Hbase. 
> 
> My HBase table has almost 100M rows and split across two nodes having two 
> region servers. One server is octa core and another is 16 core.I am using 
> only default settings of HBase and some time out settings for phoenix before 
> starting it out. Can Anyone suggest from where I can start looking into ?
> 
> Regards,
> Parveen Jain
> 
> Following is the error:
>  CREATE TABLE "DATA_FOR_PHOENIX1"(pk VARCHAR PRIMARY 
> KEY,"PARSED_DATA_COLUMN1".NAME0 VARCHAR,"PARSED_DATA_COLUMN1".NAME1 
> VARCHAR,"PARSED_DATA_COLUMN1".NAME2 
> VARCHAR,"VARCHAR,"PARSED_DATA_COLUMN1".NAME3 
> VARCHAR,"PARSED_DATA_COLUMN1".NAME4 VARCHAR,"PARSED_DATA_COLUMN1".NAME5 
> VARCHAR,"PARSED_DATA_COLUMN1".NAME6 VARCHAR) SALT_BUCKETS=16;
> 
> Error: Operation timed out (state=TIM01,code=6000)
> java.sql.SQLTimeoutException: Operation timed out
> at 
> org.apache.phoenix.exception.SQLExceptionCode$14.newException(SQLExceptionCode.java:332)
> at 
> org.apache.phoenix.exception.SQLExceptionInfo.buildException(SQLExceptionInfo.java:145)
> at 
> org.apache.phoenix.iterate.BaseResultIterators.getIterators(BaseResultIterators.java:573)
> at 
> org.apache.phoenix.iterate.BaseResultIterators.getIterators(BaseResultIterators.java:562)
> at 
> org.apache.phoenix.iterate.BaseResultIterators.getIterators(BaseResultIterators.java:516)
> at 
> org.apache.phoenix.iterate.ConcatResultIterator.getIterators(ConcatResultIterator.java:50)
> at 
> org.apache.phoenix.iterate.ConcatResultIterator.currentIterator(ConcatResultIterator.java:97)
> at 
> org.apache.phoenix.iterate.ConcatResultIterator.next(ConcatResultIterator.java:117)
> at 
> org.apache.phoenix.iterate.BaseGroupedAggregatingResultIterator.next(BaseGroupedAggregatingResultIterator.java:64)
> at 
> org.apache.phoenix.iterate.UngroupedAggregatingResultIterator.next(UngroupedAggregatingResultIterator.java:39)
> at 
> org.apache.phoenix.compile.PostDDLCompiler$1.execute(PostDDLCompiler.java:228)
> at 
> org.apache.phoenix.query.ConnectionQueryServicesImpl.updateData(ConnectionQueryServicesImpl.java:2013)
> at 
> org.apache.phoenix.schema.MetaDataClient.createTable(MetaDataClient.java:787)
> at 
> org.apache.phoenix.compile.CreateTableCompiler$2.execute(CreateTableCompiler.java:186)
> at 
> org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:305)
> at 
> org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:297)
> at org.apache.phoenix.call.CallRunner.run(CallRunner.java:53)
> at 
> org.apache.phoenix.jdbc.PhoenixStatement.executeMutation(PhoenixStatement.java:295)
> at 
> org.apache.phoenix.jdbc.PhoenixStatement.execute(PhoenixStatement.java:1255)
> at sqlline.Commands.execute(Commands.java:822)
> at sqlline.Commands.sql(Commands.java:732)
> at sqlline.SqlLine.dispatch(SqlLine.java:808)
> at sqlline.SqlLine.begin(SqlLine.java:681)
> at sqlline.SqlLine.start(SqlLine.java:398)
> at sqlline.SqlLine.main(SqlLine.java:292)