Ayush Gupta
2011-02-25 02:53:15 UTC
Hi! I'm having some trouble running queries from a java client against a
remote Thrift Hive server. Its all setup and quicker queries do run through
fine.
But queries which run longer than about 10 minutes disconnect the client
with a "TTransportException: Connection reset" exception.. The query
continues to run on the Hive server but since the client is disconnected the
results are "lost". The complete stack trace is below. Does this sound
familiar to anyone?
org.apache.thrift.transport.TTransportException: java.net.SocketException:
Connection reset
at
org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
at
org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:314)
at
org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:262)
at
org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:192)
at
org.apache.hadoop.hive.service.ThriftHive$Client.recv_execute(ThriftHive.java:72)
at
org.apache.hadoop.hive.service.ThriftHive$Client.execute(ThriftHive.java:57)
at
com.wordnik.analytics.data.ReportsRunner$.refreshReport(ReportsRunner.scala:105)
at
com.wordnik.analytics.data.ReportsRunner$.refreshDailyReport(ReportsRunner.scala:34)
at
com.wordnik.analytics.data.ReportsRunner.refreshDailyReport(ReportsRunner.scala)
at com.wordnik.analytics.util.Temp.main(Temp.java:11)
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:168)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:258)
at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
at
org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:125)
... 10 more
-ayush
remote Thrift Hive server. Its all setup and quicker queries do run through
fine.
But queries which run longer than about 10 minutes disconnect the client
with a "TTransportException: Connection reset" exception.. The query
continues to run on the Hive server but since the client is disconnected the
results are "lost". The complete stack trace is below. Does this sound
familiar to anyone?
org.apache.thrift.transport.TTransportException: java.net.SocketException:
Connection reset
at
org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
at
org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:314)
at
org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:262)
at
org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:192)
at
org.apache.hadoop.hive.service.ThriftHive$Client.recv_execute(ThriftHive.java:72)
at
org.apache.hadoop.hive.service.ThriftHive$Client.execute(ThriftHive.java:57)
at
com.wordnik.analytics.data.ReportsRunner$.refreshReport(ReportsRunner.scala:105)
at
com.wordnik.analytics.data.ReportsRunner$.refreshDailyReport(ReportsRunner.scala:34)
at
com.wordnik.analytics.data.ReportsRunner.refreshDailyReport(ReportsRunner.scala)
at com.wordnik.analytics.util.Temp.main(Temp.java:11)
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:168)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:258)
at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
at
org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:125)
... 10 more
-ayush