Though I just upgraded to the most recent version. It's still failing but
seems to be making it one step farther. I see from the emails that there's
some issues with the current build so I'll just wait until that's all
resolved. The output from my most recent attempt is below if you have a use
for it.
Loading custom schemas OK (Took: 0 min 40 sec)
Started Loading functional-query data in background; pid 22229.
Loading functional-query data (logging to
/home/impdev/Impala/logs/data_loading/load-functional-query.log)...
Started Loading TPC-H data in background; pid 22230.
Started Loading TPC-DS data in background; pid 22231.
Loading TPC-DS data (logging to
/home/impdev/Impala/logs/data_loading/load-tpcds.log)...
Loading TPC-H data (logging to
/home/impdev/Impala/logs/data_loading/load-tpch.log)...
FAILED (Took: 25 min 51 sec)
'load-data tpch core' failed. Tail of log:
INVALIDATE METADATA tpch_kudu.region
(invalidate-tpch-core-impala-generated.sql):
INVALIDATE METADATA tpch_kudu.orders
(invalidate-tpch-core-impala-generated.sql):
INVALIDATE METADATA tpch_kudu.customer
(invalidate-tpch-core-impala-generated.sql):
(load-tpch-core-impala-generated-kudu-none-none.sql):
INSERT INTO TABLE tpch_kudu.lineitem SELECT * FROM tpch.lineitem
(load-tpch-core-impala-generated-parquet-none-none.sql):
INSERT OVERWRITE TABLE tpch_parquet.lineitem SELECT * FROM tpch.lineitem
(load-tpch-core-impala-generated-parquet-none-none.sql):
INSERT OVERWRITE TABLE tpch_parquet.part SELECT * FROM tpch.part
(load-tpch-core-impala-generated-parquet-none-none.sql):
INSERT OVERWRITE TABLE tpch_parquet.partsupp SELECT * FROM tpch.partsupp
(load-tpch-core-impala-generated-parquet-none-none.sql):
INSERT OVERWRITE TABLE tpch_parquet.supplier SELECT * FROM tpch.supplier
Data Loading from Impala failed with error: ImpalaBeeswaxException:
Query aborted:Kudu error(s) reported, first error: Timed out: Failed to
write batch of 21493 ops to tablet 5c5c917295d642edb9cdbe152f3283d9 after 4
attempt(s): GetTableLocations { table: 'impala::tpch_kudu.lineitem',
partition-key: (<start>), attempt: 1 } failed: Client connection
negotiation failed: client connection to 127.0.0.1:7051
Error in Kudu table 'impala::tpch_kudu.lineitem': Timed out: Failed to
write batch of 21537 ops to tablet e9f68f0ee8e945ebb7630947169a6c34 after 4
attempt(s): GetTableLocations { table: 'impala::tpch_kudu.lineitem',
partition-key: (HASH (l_orderkey): 2), attempt: 1 } failed: Client
connection negotiation failed: client connection to 127.0.0.1:7051 (1 of
21494 similar)
Traceback (most recent call last):
File "/home/impdev/Impala/bin/load-data.py", line 179, in
exec_impala_query_from_file
(load-tpch-core-impala-generated-parquet-none-none.sql):
INSERT OVERWRITE TABLE tpch_parquet.nation SELECT * FROM tpch.nation
result = impala_client.execute(query)
File "/home/impdev/Impala/tests/beeswax/impala_beeswax.py", line 173, in
execute
handle = self.__execute_query(query_string.strip(), user=user)
File "/home/impdev/Impala/tests/beeswax/impala_beeswax.py", line 341, in
__execute_query
self.wait_for_completion(handle)
File "/home/impdev/Impala/tests/beeswax/impala_beeswax.py", line 361, in
wait_for_completion
raise ImpalaBeeswaxException("Query aborted:" + error_log, None)
ImpalaBeeswaxException: ImpalaBeeswaxException:
Query aborted:Kudu error(s) reported, first error: Timed out: Failed to
write batch of 21493 ops to tablet 5c5c917295d642edb9cdbe152f3283d9 after 4
attempt(s): GetTableLocations { table: 'impala::tpch_kudu.lineitem',
partition-key: (<start>), attempt: 1 } failed: Client connection
negotiation failed: client connection to 127.0.0.1:7051
Error in Kudu table 'impala::tpch_kudu.lineitem': Timed out: Failed to
write batch of 21537 ops to tablet e9f68f0ee8e945ebb7630947169a6c34 after 4
attempt(s): GetTableLocations { table: 'impala::tpch_kudu.lineitem',
partition-key: (HASH (l_orderkey): 2), attempt: 1 } failed: Client
connection negotiation failed: client connection to 127.0.0.1:7051 (1 of
21494 similar)
On Fri, Feb 23, 2018 at 6:34 PM, Joseph Koshakow <kosh...@gmail.com> wrote:
> 8302608bdff15d6e8af324fc885dd0a8c2b44a5d
>
> On Fri, Feb 23, 2018 at 12:41 AM, Jim Apple <jbap...@cloudera.com> wrote:
>
>> What commit hash is checked out?
>>
>> On Thu, Feb 22, 2018 at 8:23 PM Joseph Koshakow <kosh...@gmail.com>
>> wrote:
>>
>> > Host OS is Ubunto 16.04.3 LTS. Docker OS is also Ubuntu 16.04 as per
>> > instructions. I have 202.61Gb of free space in the host environment
>> > (304.58Gb size total). I'm not sure how to check how much space is left
>> in
>> > docker containers but the size of the one created for this is 97.81 Gb.
>> >
>> > -Joe
>> >
>> > On Thu, Feb 22, 2018 at 11:15 PM, Jim Apple <jbap...@cloudera.com>
>> wrote:
>> >
>> > > What is the host OS? What is the docker OS? How much space is left on
>> > disk
>> > > in each environment?
>> > >
>> > > On Thu, Feb 22, 2018 at 8:05 PM, Joseph Koshakow <kosh...@gmail.com>
>> > > wrote:
>> > >
>> > > > Hi,
>> > > >
>> > > > I've been trying to set up my development environment using docker
>> by
>> > > > following the following instructions: https://cwiki.ap
>> > > > ache.org/confluence/display/IMPALA/Docker+for+Impala+Developers
>> > > > I'm able to get to the step where you run `source
>> > > > ~/Impala/bin/bootsrap_development.sh`. Everything runs fine until
>> I get
>> > > > to this part:
>> > > > Loading TPC-DS data (logging to /home/impdev/Impala/logs/data_
>> > > > loading/load-tpcds.log)...
>> > > >
>> > > > That hangs for about 30 minutes and then prints the following (Also
>> > > > attached) before hanging again indefinitely until I quit out. I've
>> > tried
>> > > > multiple times and even deleted the docker image and started over.
>> Any
>> > > > ideas?
>> > > >
>> > > > FAILED (Took: 26 min 21 sec)
>> > > > 'load-data tpch core' failed. Tail of log:
>> > > > INVALIDATE METADATA tpch_kudu.nation
>> > > >
>> > > > (invalidate-tpch-core-impala-generated.sql):
>> > > > INVALIDATE METADATA tpch_kudu.region
>> > > >
>> > > > (invalidate-tpch-core-impala-generated.sql):
>> > > > INVALIDATE METADATA tpch_kudu.orders
>> > > >
>> > > > (invalidate-tpch-core-impala-generated.sql):
>> > > > INVALIDATE METADATA tpch_kudu.customer
>> > > >
>> > > > (invalidate-tpch-core-impala-generated.sql):
>> > > >
>> > > >
>> > > > (load-tpch-core-impala-generated-parquet-none-none.sql):
>> > > > INSERT OVERWRITE TABLE tpch_parquet.lineitem SELECT * FROM
>> > tpch.lineitem
>> > > >
>> > > > (load-tpch-core-impala-generated-kudu-none-none.sql):
>> > > > INSERT INTO TABLE tpch_kudu.lineitem SELECT * FROM tpch.lineitem
>> > > >
>> > > > (load-tpch-core-impala-generated-parquet-none-none.sql):
>> > > > INSERT OVERWRITE TABLE tpch_parquet.part SELECT * FROM tpch.part
>> > > >
>> > > > (load-tpch-core-impala-generated-parquet-none-none.sql):
>> > > > INSERT OVERWRITE TABLE tpch_parquet.partsupp SELECT * FROM
>> > tpch.partsupp
>> > > >
>> > > > Data Loading from Impala failed with error: ImpalaBeeswaxException:
>> > > > Query aborted:Kudu error(s) reported, first error: Timed out:
>> Failed
>> > to
>> > > > write batch of 23532 ops to tablet 3b2c6a27489d43028912a69ca7be8b71
>> > > after
>> > > > 4 attempt(s): GetTableLocations { table:
>> 'impala::tpch_kudu.lineitem',
>> > > > partition-key: (HASH (l_orderkey): 1), attempt: 1 } failed:
>> > > > GetTableLocations RPC to 127.0.0.1:7051 timed out after 10.000s
>> (SENT)
>> > > >
>> > > > Error in Kudu table 'impala::tpch_kudu.lineitem': Timed out: Failed
>> to
>> > > > write batch of 23532 ops to tablet 3b2c6a27489d43028912a69ca7be8b71
>> > > after
>> > > > 4 attempt(s): GetTableLocations { table:
>> 'impala::tpch_kudu.lineitem',
>> > > > partition-key: (HASH (l_orderkey): 1), attempt: 1 } failed:
>> > > > GetTableLocations RPC to 127.0.0.1:7051 timed out after 10.000s
>> (SENT)
>> > > (1
>> > > > of 23532 similar)
>> > > >
>> > > >
>> > > > Traceback (most recent call last):
>> > > > (load-tpch-core-impala-generated-parquet-none-none.sql):
>> > > > INSERT OVERWRITE TABLE tpch_parquet.supplier SELECT * FROM
>> > tpch.supplier
>> > > > File "/home/impdev/Impala/bin/load-data.py", line 179, in
>> > > > exec_impala_query_from_file
>> > > >
>> > > > result = impala_client.execute(query)
>> > > > File "/home/impdev/Impala/tests/beeswax/impala_beeswax.py", line
>> 173,
>> > > > in execute
>> > > > handle = self.__execute_query(query_string.strip(), user=user)
>> > > > File "/home/impdev/Impala/tests/beeswax/impala_beeswax.py", line
>> 341,
>> > > > in __execute_query
>> > > > self.wait_for_completion(handle)
>> > > > File "/home/impdev/Impala/tests/beeswax/impala_beeswax.py", line
>> 361,
>> > > > in wait_for_completion
>> > > > raise ImpalaBeeswaxException("Query aborted:" + error_log, None)
>> > > > ImpalaBeeswaxException: ImpalaBeeswaxException:
>> > > > Query aborted:Kudu error(s) reported, first error: Timed out:
>> Failed
>> > to
>> > > > write batch of 23532 ops to tablet 3b2c6a27489d43028912a69ca7be8b71
>> > > after
>> > > > 4 attempt(s): GetTableLocations { table:
>> 'impala::tpch_kudu.lineitem',
>> > > > partition-key: (HASH (l_orderkey): 1), attempt: 1 } failed:
>> > > > GetTableLocations RPC to 127.0.0.1:7051 timed out after 10.000s
>> (SENT)
>> > > >
>> > > > Error in Kudu table 'impala::tpch_kudu.lineitem': Timed out: Failed
>> to
>> > > > write batch of 23532 ops to tablet 3b2c6a27489d43028912a69ca7be8b71
>> > > after
>> > > > 4 attempt(s): GetTableLocations { table:
>> 'impala::tpch_kudu.lineitem',
>> > > > partition-key: (HASH (l_orderkey): 1), attempt: 1 } failed:
>> > > > GetTableLocations RPC to 127.0.0.1:7051 timed out after 10.000s
>> (SENT)
>> > > (1
>> > > > of 23532 similar)
>> > > >
>> > > > Thanks,
>> > > > Joe Koshakow
>> > > >
>> > > >
>> > >
>> >
>>
>
>
