Hi Christoph,
thank you for quick ansswer.
This is DfsBroker.hadoop.log;
Sep 12, 2012 10:33:06 AM org.hypertable.AsyncComm.IOHandler DeliverEvent
INFO: [/172.16.200.52:60499 ; Wed Sep 12 10:33:06 EEST 2012] Connection
Established
Closed 0 input streams and 0 output streams
Sep 12, 2012 10:33:06 AM org.hypertable.DfsBroker.hadoop.ConnectionHandler
handle
INFO: [/172.16.200.52:60499 ; Wed Sep 12 10:33:06 EEST 2012] Disconnect - COMM
broken $
Closed 0 input streams and 0 output streams for client connection
/172.16.200.52:60499
Num CPUs=8
HdfsBroker.Port=38030
HdfsBroker.Reactors=8
HdfsBroker.Workers=20
HdfsBroker.Hadoop.ConfDir=/hadoop/conf
Adding hadoop configuration file /hadoop/conf/hdfs-site.xml
Adding hadoop configuration file /hadoop/conf/core-site.xml
HdfsBroker.dfs.client.read.shortcircuit=false
HdfsBroker.dfs.replication=2
HdfsBroker.Server.fs.default.name=hdfs://dfs1:9000
Sep 12, 2012 10:36:59 AM org.hypertable.AsyncComm.IOHandler DeliverEvent
INFO: [/172.16.200.52:50074 ; Wed Sep 12 10:36:59 EEST 2012] Connection
Established
Sep 12, 2012 10:36:59 AM org.hypertable.DfsBroker.hadoop.ConnectionHandler
handle
INFO: [/172.16.200.52:50074 ; Wed Sep 12 10:36:59 EEST 2012] Disconnect - COMM
broken $
Closed 0 input streams and 0 output streams for client connection
/172.16.200.52:50074
Sep 12, 2012 10:37:01 AM org.hypertable.AsyncComm.IOHandler DeliverEvent
INFO: [/172.16.200.52:57138 ; Wed Sep 12 10:37:01 EEST 2012] Connection
Established
Sep 12, 2012 10:37:01 AM org.hypertable.AsyncComm.IOHandlerData
handle_message_body
WARNING: Received response for non-pending event (id=0,version=1,total_len=38)
Sep 12, 2012 10:37:01 AM org.hypertable.DfsBroker.hadoop.HdfsBroker Exists
INFO: Testing for existence of file '/hypertable/servers/master/log/mml
Sep 12, 2012 10:37:01 AM org.hypertable.DfsBroker.hadoop.HdfsBroker Readdir
INFO: Readdir('/hypertable/servers/master/log/mml')
Sep 12, 2012 10:37:01 AM org.hypertable.DfsBroker.hadoop.HdfsBroker Length
INFO: Getting length of file '/hypertable/servers/master/log/mml/0' (accurate:
true)
Exception in thread "ApplicationQueueThread 3" java.lang.IllegalAccessError:
tried to $
at
org.hypertable.DfsBroker.hadoop.HdfsBroker.Length(HdfsBroker.java:399)
at
org.hypertable.DfsBroker.hadoop.RequestHandlerLength.run(RequestHandlerLeng$
at
org.hypertable.AsyncComm.ApplicationQueue$Worker.run(ApplicationQueue.java:$
at java.lang.Thread.run(Thread.java:679)
Sep 12, 2012 10:40:01 AM org.hypertable.DfsBroker.hadoop.ConnectionHandler
handle
INFO: [/172.16.200.52:57138 ; Wed Sep 12 10:40:01 EEST 2012] Disconnect - COMM
broken $
Closed 0 input streams and 0 output streams for client connection
/172.16.200.52:57138
Sep 12, 2012 11:37:33 AM org.hypertable.AsyncComm.IOHandler DeliverEvent
INFO: [/172.16.200.52:52875 ; Wed Sep 12 11:37:33 EEST 2012] Connection
Established
Closed 0 input streams and 0 output streams
java.nio.channels.ClosedByInterruptException
at
java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibl$
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:359)
at
org.hypertable.AsyncComm.IOHandlerData.SendBuf(IOHandlerData.java:241)
at
org.hypertable.AsyncComm.IOHandlerData.SendMessage(IOHandlerData.java:268)
at org.hypertable.AsyncComm.Comm.SendResponse(Comm.java:122)
at
org.hypertable.AsyncComm.ResponseCallback.response_ok(ResponseCallback.java$
at
org.hypertable.DfsBroker.hadoop.RequestHandlerShutdown.run(RequestHandlerSh$
at
org.hypertable.AsyncComm.ApplicationQueue$Worker.run(ApplicationQueue.java:$
at java.lang.Thread.run(Thread.java:679)
Num CPUs=8
HdfsBroker.Port=38030
HdfsBroker.Reactors=8
HdfsBroker.Workers=20
HdfsBroker.Hadoop.ConfDir=/hadoop/conf
Adding hadoop configuration file /hadoop/conf/hdfs-site.xml
Adding hadoop configuration file /hadoop/conf/core-site.xml
HdfsBroker.dfs.client.read.shortcircuit=false
HdfsBroker.dfs.replication=2
HdfsBroker.Server.fs.default.name=hdfs://dfs1:9000
Sep 12, 2012 11:38:39 AM org.hypertable.AsyncComm.IOHandler DeliverEvent
INFO: [/172.16.200.52:53823 ; Wed Sep 12 11:38:39 EEST 2012] Connection
Established
Sep 12, 2012 11:38:39 AM org.hypertable.DfsBroker.hadoop.ConnectionHandler
handle
INFO: [/172.16.200.52:53823 ; Wed Sep 12 11:38:39 EEST 2012] Disconnect - COMM
broken $
Closed 0 input streams and 0 output streams for client connection
/172.16.200.52:53823
Sep 12, 2012 11:38:40 AM org.hypertable.AsyncComm.IOHandler DeliverEvent
INFO: [/172.16.200.52:60824 ; Wed Sep 12 11:38:40 EEST 2012] Connection
Established
Sep 12, 2012 11:38:40 AM org.hypertable.DfsBroker.hadoop.ConnectionHandler
handle
INFO: [/172.16.200.52:60824 ; Wed Sep 12 11:38:40 EEST 2012] Disconnect - COMM
broken $
Closed 0 input streams and 0 output streams for client connection
/172.16.200.52:60824
Sep 12, 2012 11:39:11 AM org.hypertable.AsyncComm.IOHandler DeliverEvent
INFO: [/172.16.200.52:45029 ; Wed Sep 12 11:39:11 EEST 2012] Connection
Established
Sep 12, 2012 11:39:21 AM org.hypertable.DfsBroker.hadoop.HdfsBroker Mkdirs
INFO: Making directory '/hypertable/servers/rs1/log/user'
Sep 12, 2012 11:39:21 AM org.hypertable.DfsBroker.hadoop.HdfsBroker Exists
INFO: Testing for existence of file '/hypertable/servers/rs1/log/rsml
Sep 12, 2012 11:39:21 AM org.hypertable.DfsBroker.hadoop.HdfsBroker Readdir
INFO: Readdir('/hypertable/servers/rs1/log/rsml')
Sep 12, 2012 11:39:21 AM org.hypertable.DfsBroker.hadoop.HdfsBroker Length
INFO: Getting length of file '/hypertable/servers/rs1/log/rsml/0' (accurate:
true)
Exception in thread "ApplicationQueueThread 4" java.lang.IllegalAccessError:
tried to $
at
org.hypertable.DfsBroker.hadoop.HdfsBroker.Length(HdfsBroker.java:399)
at
org.hypertable.DfsBroker.hadoop.RequestHandlerLength.run(RequestHandlerLeng$
at
org.hypertable.AsyncComm.ApplicationQueue$Worker.run(ApplicationQueue.java:$
at java.lang.Thread.run(Thread.java:679)
Sep 12, 2012 11:40:02 AM org.hypertable.AsyncComm.IOHandler DeliverEvent
INFO: [/172.16.200.52:58580 ; Wed Sep 12 11:40:02 EEST 2012] Connection
Established
Sep 12, 2012 11:40:02 AM org.hypertable.AsyncComm.IOHandlerData
handle_message_body
WARNING: Received response for non-pending event (id=0,version=1,total_len=38)
Sep 12, 2012 11:40:02 AM org.hypertable.DfsBroker.hadoop.HdfsBroker Exists
INFO: Testing for existence of file '/hypertable/servers/master/log/mml
Sep 12, 2012 11:40:02 AM org.hypertable.DfsBroker.hadoop.HdfsBroker Readdir
INFO: Readdir('/hypertable/servers/master/log/mml')
Sep 12, 2012 11:40:02 AM org.hypertable.DfsBroker.hadoop.HdfsBroker Length
INFO: Getting length of file '/hypertable/servers/master/log/mml/0' (accurate:
true)
Exception in thread "ApplicationQueueThread 7" java.lang.IllegalAccessError:
org/apach$
at
org.hypertable.DfsBroker.hadoop.HdfsBroker.Length(HdfsBroker.java:399)
at org.hypertable.DfsBroker.hadoop.RequestHandlerLength.run(RequestHandlerLeng$
at
org.hypertable.AsyncComm.ApplicationQueue$Worker.run(ApplicationQueue.java:$
at java.lang.Thread.run(Thread.java:679)
Sep 12, 2012 11:42:21 AM org.hypertable.DfsBroker.hadoop.ConnectionHandler
handle
INFO: [/172.16.200.52:45029 ; Wed Sep 12 11:42:21 EEST 2012] Disconnect - COMM
broken $
Closed 0 input streams and 0 output streams for client connection
/172.16.200.52:45029
Sep 12, 2012 11:43:02 AM org.hypertable.DfsBroker.hadoop.ConnectionHandler
handle
INFO: [/172.16.200.52:58580 ; Wed Sep 12 11:43:02 EEST 2012] Disconnect - COMM
broken $
Closed 0 input streams and 0 output streams for client connection
/172.16.200.52:58580
________________________________
From: Christoph Rupp <[email protected]>
To: [email protected]
Sent: Wednesday, September 12, 2012 12:37 PM
Subject: Re: [hypertable-dev] "HYPERTABLE request timeout" Error
Hi,
the logs imply that the problem is caused by the DfsBroker - can you verify
that it's running and maybe check the DfsBroker logs and/or HDFS logs as well?
bye
Christoph
2012/9/12 Mehmet Ali Cetinkaya <[email protected]>
Hello,
>
>
>I have installed Hypertable and Hadoop. I wanna use HT on Hadoop cluster of 2
>machines.
>
>
>i'm using python for write data to HT and i inserted 2-3 million data. But now
>i have rangeserver crush error. it's timeout error when i write a "some"
>simple insert or select hql syntax.
>for example: i don't take a any error when use like a " select * from urls
>where row=^'test' " sythax. but it's "select domain:test_com_tr from urls
>cell_limit 200" not work.
>
>
>
>anyway, hyperspace, dfsbroker (hadoop) and rangeserver was succesfully started
>when restart ht. bu ht.master didn't start.
>
>
>and i don't wanna use cleandb. how can i start ht succesfully?
>
>
>regards,
>mali
>
>
>
>this is the log of Hypertable.Master.log file;
>
>
>root@dfs1:/opt/hypertable/current/log/archive/2012-09/12# tail -f
>Hypertable.Master.log
>lease-interval=1000000
>logging-level=warn
>pidfile=/opt/hypertable/current/run/Hypertable.Master.pid
>port=38050
>reactors=8
>timeout=180000
>verbose=true
>1347435601 ERROR Hypertable.Master : main
>(/root/src/hypertable/src/cc/Hypertable/Master/main.cc:255):
>Hypertable::Exception: Error getting length of DFS file:
>/hypertable/servers/master/log/mml/0 - HYPERTABLE request timeout
> at virtual int64_t
Hypertable::DfsBroker::Client::length(const Hypertable::String&, bool)
(/root/src/hypertable/src/cc/DfsBroker/Lib/Client.cc:451)
> at virtual int64_t Hypertable::DfsBroker::Client::length(const
>Hypertable::String&, bool)
>(/root/src/hypertable/src/cc/DfsBroker/Lib/Client.cc:445): Event: type=ERROR
>"HYPERTABLE request timeout" from=127.0.0.1:38030
>^X^Z
>[1]+ Stopped tail -f Hypertable.Master.log
>root@dfs1:/opt/hypertable/current/log/archive/2012-09/12#
>root@dfs1:/opt/hypertable/current/log/archive/2012-09/12#
>root@dfs1:/opt/hypertable/current/log/archive/2012-09/12# tail -f
>Hypertable.Master.log
>lease-interval=1000000
>logging-level=warn
>pidfile=/opt/hypertable/current/run/Hypertable.Master.pid
>port=38050
>reactors=8
>timeout=180000
>verbose=true
>1347435601 ERROR Hypertable.Master : main
(/root/src/hypertable/src/cc/Hypertable/Master/main.cc:255):
Hypertable::Exception: Error getting length of DFS file:
/hypertable/servers/master/log/mml/0 - HYPERTABLE request timeout
> at virtual int64_t Hypertable::DfsBroker::Client::length(const
>Hypertable::String&, bool)
>(/root/src/hypertable/src/cc/DfsBroker/Lib/Client.cc:451)
> at virtual int64_t Hypertable::DfsBroker::Client::length(const
>Hypertable::String&, bool)
>(/root/src/hypertable/src/cc/DfsBroker/Lib/Client.cc:445): Event: type=ERROR
>"HYPERTABLE request timeout" from=127.0.0.1:38030
>^Z
>[2]+ Stopped tail -f Hypertable.Master.log
>root@dfs1:/opt/hypertable/current/log/archive/2012-09/12#
>root@dfs1:/opt/hypertable/current/log/archive/2012-09/12#
>root@dfs1:/opt/hypertable/current/log/archive/2012-09/12#
>root@dfs1:/opt/hypertable/current/log/archive/2012-09/12#
>root@dfs1:/opt/hypertable/current/log/archive/2012-09/12#
>root@dfs1:/opt/hypertable/current/log/archive/2012-09/12#
>root@dfs1:/opt/hypertable/current/log/archive/2012-09/12#
>root@dfs1:/opt/hypertable/current/log/archive/2012-09/12#
>root@dfs1:/opt/hypertable/current/log/archive/2012-09/12# tail -f
>Hypertable.Master.loglease-interval=1000000
>logging-level=warn
>pidfile=/opt/hypertable/current/run/Hypertable.Master.pid
>port=38050
>reactors=8
>timeout=180000
>verbose=true
>1347435601 ERROR Hypertable.Master : main
>(/root/src/hypertable/src/cc/Hypertable/Master/main.cc:255):
>Hypertable::Exception: Error getting length of DFS file:
>/hypertable/servers/master/log/mml/0 - HYPERTABLE request timeout
> at virtual int64_t Hypertable::DfsBroker::Client::length(const
>Hypertable::String&, bool)
(/root/src/hypertable/src/cc/DfsBroker/Lib/Client.cc:451)
> at virtual int64_t Hypertable::DfsBroker::Client::length(const
>Hypertable::String&, bool)
>(/root/src/hypertable/src/cc/DfsBroker/Lib/Client.cc:445): Event: type=ERROR
>"HYPERTABLE request timeout" from=127.0.0.1:38030
>CPU cores
count=8
>CephBroker.MonAddr=10.0.1.245:6789
>DfsBroker.Local.Root=fs/local
>DfsBroker.Port=38030
>HdfsBroker.Hadoop.ConfDir=/hadoop/conf
>HdfsBroker.Workers=20
>Hyperspace.GracePeriod=200000
>Hyperspace.KeepAlive.Interval=30000
>Hyperspace.Lease.Interval=1000000
>Hyperspace.Replica.Dir=hyperspace
>Hyperspace.Replica.Host=[dfs1]
>Hyperspace.Replica.Port=38040
>Hypertable.Logging.Level=warn
>Hypertable.Master.Port=38050
>Hypertable.Master.Reactors=8
>Hypertable.RangeServer.MemoryLimit=5000000000
>Hypertable.RangeServer.MemoryLimit.Percentage=50
>Hypertable.RangeServer.Port=38060
>Hypertable.RangeServer.QueryCache.MaxMemory=5000000000
>Hypertable.RangeServer.Range.SplitSize=3000000000
>Hypertable.RangeServer.Scanner.BufferSize=3000000000
>Hypertable.RangeServer.Scanner.Ttl=14400000
>Hypertable.Request.Timeout=180000
>Hypertable.Verbose=true
>ThriftBroker.Port=38080
>dfs-port=38030
>grace-period=200000
>hs-host=[dfs1]
>hs-port=38040
>keepalive=30000
>lease-interval=1000000
>logging-level=warn
>pidfile=/opt/hypertable/current/run/Hypertable.Master.pid
>port=38050
>reactors=8
>timeout=180000
>verbose=true
>1347439382 ERROR Hypertable.Master : main
>(/root/src/hypertable/src/cc/Hypertable/Master/main.cc:255):
>Hypertable::Exception: Error getting length of DFS file:
>/hypertable/servers/master/log/mml/0 - HYPERTABLE request timeout
> at virtual int64_t Hypertable::DfsBroker::Client::length(const
>Hypertable::String&, bool)
>(/root/src/hypertable/src/cc/DfsBroker/Lib/Client.cc:451)
> at virtual int64_t Hypertable::DfsBroker::Client::length(const
>Hypertable::String&, bool)
>(/root/src/hypertable/src/cc/DfsBroker/Lib/Client.cc:445): Event: type=ERROR
>"HYPERTABLE request timeout" from=127.0.0.1:38030
> --
>You received this message because you are subscribed to the Google Groups
>"Hypertable Development" group.
>To post to this group, send email to [email protected].
>To unsubscribe from this group, send email to
>[email protected].
>For more options, visit this group at
>http://groups.google.com/group/hypertable-dev?hl=en.
>
--
You received this message because you are subscribed to the Google Groups
"Hypertable Development" group.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to
[email protected].
For more options, visit this group at
http://groups.google.com/group/hypertable-dev?hl=en.
--
You received this message because you are subscribed to the Google Groups
"Hypertable Development" group.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to
[email protected].
For more options, visit this group at
http://groups.google.com/group/hypertable-dev?hl=en.
