Hi Wail,
I am running the contents of
https://github.com/Nullification/asterixdb-spark-connector/blob/master/zeppelin-notebook/asterixdb-spark-example/note.json
using spark-shell and I get a 404 error when trying to access
/query/result/location?handle=%7B%22handle%22%3A%5B13%2C0%5D%7D HTTP/1.1. I
don’t know if this is an error with what I am doing, an AsterixDB error or an
error with asterixdb-spark-connector. Thank you for any help that you can
provide.
Below is the command that I used and the error (I removed everything else):
/opt/spark/bin/spark-shell --packages
org.apache.asterix:asterixdb-spark-connector_2.10:1.6.0 --conf
spark.asterix.connection.host=10.128.5.170 --conf
spark.asterix.connection.port=19002 --conf spark.asterix.frame.size=131072
…..
scala> val df = sqlContext.aql(aqlQuery,infer = true, printCaseClasses = true)
16/07/26 23:27:11 INFO SparkContextFunctions: spark.asterix.connection.host
10.128.5.170
16/07/26 23:27:11 INFO SparkContextFunctions: spark.asterix.connection.port
19002
16/07/26 23:27:11 INFO SparkContextFunctions: spark.asterix.frame.size 131072
16/07/26 23:27:11 INFO SparkContextFunctions: spark.asterix.frame.number 1
16/07/26 23:27:11 INFO SparkContextFunctions: spark.asterix.reader.number 2
16/07/26 23:27:11 INFO SparkContextFunctions: spark.asterix.prefetch.threshold 2
16/07/26 23:27:11 DEBUG RequestAddCookies: CookieSpec selected: best-match
16/07/26 23:27:11 DEBUG RequestAuthCache: Auth cache not set in the context
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection request:
[route: {}->http://10.128.5.170:19002][total kept alive: 0; route allocated:
0 of 2; total allocated: 0 of 20]
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection leased:
[id: 0][route: {}->http://10.128.5.170:19002][total kept alive: 0; route allo
cated: 1 of 2; total allocated: 1 of 20]
16/07/26 23:27:11 DEBUG MainClientExec: Opening connection
{}->http://10.128.5.170:19002
16/07/26 23:27:11 DEBUG HttpClientConnectionManager: Connecting to
/10.128.5.170:19002
16/07/26 23:27:11 DEBUG MainClientExec: Executing request POST
/aql?mode=asynchronous&schema-inferencer=Spark HTTP/1.1
16/07/26 23:27:11 DEBUG MainClientExec: Target auth state: UNCHALLENGED
16/07/26 23:27:11 DEBUG MainClientExec: Proxy auth state: UNCHALLENGED
16/07/26 23:27:11 DEBUG headers: http-outgoing-0 >> POST
/aql?mode=asynchronous&schema-inferencer=Spark HTTP/1.1
16/07/26 23:27:11 DEBUG headers: http-outgoing-0 >> Content-Length: 386
16/07/26 23:27:11 DEBUG headers: http-outgoing-0 >> Content-Type: text/plain;
charset=UTF-8
16/07/26 23:27:11 DEBUG headers: http-outgoing-0 >> Host: 10.128.5.170:19002
16/07/26 23:27:11 DEBUG headers: http-outgoing-0 >> Connection: Keep-Alive
16/07/26 23:27:11 DEBUG headers: http-outgoing-0 >> User-Agent:
Apache-HttpClient/4.3.2 (java 1.5)
16/07/26 23:27:11 DEBUG headers: http-outgoing-0 >> Accept-Encoding:
gzip,deflate
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> "POST
/aql?mode=asynchronous&schema-inferencer=Spark HTTP/1.1[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> "Content-Length: 386[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> "Content-Type: text/plain;
charset=UTF-8[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> "Host:
10.128.5.170:19002[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> "Connection:
Keep-Alive[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> "User-Agent:
Apache-HttpClient/4.3.2 (java 1.5)[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> "Accept-Encoding:
gzip,deflate[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> "[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> "[\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> " let $exampleSet
:= [[\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> " {"name" : "Ann",
"age" : 20, "salary" : 100000},[\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> " {"name" : "Bob",
"age" : 30, "salary" : 200000},[\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> " {"name" : "Cat",
"age" : 40, "salary" : 300000, "dependents" : [1, 2, 3]},[\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> " {"name" : "Cat",
"age" : 50, "salary" : 400000}[\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> " ][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> " for $x in
$exampleSet[\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> " return $x[\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> " "
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 << "HTTP/1.1 200 OK[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 << "Content-Type:
application/json;charset=utf-8[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 << "Transfer-Encoding:
chunked[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 << "Server:
Jetty(8.0.0.RC0)[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 << "[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 << "11[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 << "{"handle":[13,0]}[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 << "0[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 << "[\r][\n]"
16/07/26 23:27:11 DEBUG headers: http-outgoing-0 << HTTP/1.1 200 OK
16/07/26 23:27:11 DEBUG headers: http-outgoing-0 << Content-Type:
application/json;charset=utf-8
16/07/26 23:27:11 DEBUG headers: http-outgoing-0 << Transfer-Encoding: chunked
16/07/26 23:27:11 DEBUG headers: http-outgoing-0 << Server: Jetty(8.0.0.RC0)
16/07/26 23:27:11 DEBUG MainClientExec: Connection can be kept alive
indefinitely
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection [id:
0][route: {}->http://10.128.5.170:19002] can be kept alive indefinitely
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection
released: [id: 0][route: {}->http://10.128.5.170:19002][total kept alive: 1;
route al
located: 1 of 2; total allocated: 1 of 20]
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection manager
is shutting down
16/07/26 23:27:11 DEBUG DefaultManagedHttpClientConnection: http-outgoing-0:
Close connection
16/07/26 23:27:11 DEBUG DefaultManagedHttpClientConnection: http-outgoing-0:
Close connection
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection manager
shut down
16/07/26 23:27:11 INFO AsterixHttpAPI: Response Handle: {"handle":[13,0]}
16/07/26 23:27:11 INFO AsterixHttpAPI: Handle(JID:13,RSID:0)
16/07/26 23:27:11 DEBUG AsterixHttpAPI: Get status of:
%7B%22handle%22%3A%5B13%2C0%5D%7D
16/07/26 23:27:11 DEBUG RequestAddCookies: CookieSpec selected: best-match
16/07/26 23:27:11 DEBUG RequestAuthCache: Auth cache not set in the context
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection request:
[route: {}->http://10.128.5.170:19002][total kept alive: 0; route allocated:
0 of 2; total allocated: 0 of 20]
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection leased:
[id: 1][route: {}->http://10.128.5.170:19002][total kept alive: 0; route allo
cated: 1 of 2; total allocated: 1 of 20]
16/07/26 23:27:11 DEBUG MainClientExec: Opening connection
{}->http://10.128.5.170:19002
16/07/26 23:27:11 DEBUG HttpClientConnectionManager: Connecting to
/10.128.5.170:19002
16/07/26 23:27:11 DEBUG MainClientExec: Executing request GET
/query/status?handle=%7B%22handle%22%3A%5B13%2C0%5D%7D HTTP/1.1
16/07/26 23:27:11 DEBUG MainClientExec: Target auth state: UNCHALLENGED
16/07/26 23:27:11 DEBUG MainClientExec: Proxy auth state: UNCHALLENGED
16/07/26 23:27:11 DEBUG headers: http-outgoing-1 >> GET
/query/status?handle=%7B%22handle%22%3A%5B13%2C0%5D%7D HTTP/1.1
16/07/26 23:27:11 DEBUG headers: http-outgoing-1 >> Host: 10.128.5.170:19002
16/07/26 23:27:11 DEBUG headers: http-outgoing-1 >> Connection: Keep-Alive
16/07/26 23:27:11 DEBUG headers: http-outgoing-1 >> User-Agent:
Apache-HttpClient/4.3.2 (java 1.5)
16/07/26 23:27:11 DEBUG headers: http-outgoing-1 >> Accept-Encoding:
gzip,deflate
16/07/26 23:27:11 DEBUG wire: http-outgoing-1 >> "GET
/query/status?handle=%7B%22handle%22%3A%5B13%2C0%5D%7D HTTP/1.1[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-1 >> "Host:
10.128.5.170:19002[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-1 >> "Connection:
Keep-Alive[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-1 >> "User-Agent:
Apache-HttpClient/4.3.2 (java 1.5)[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-1 >> "Accept-Encoding:
gzip,deflate[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-1 >> "[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-1 << "HTTP/1.1 200 OK[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-1 << "Content-Type:
text/html;charset=UTF-8[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-1 << "Content-Length: 20[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-1 << "Server:
Jetty(8.0.0.RC0)[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-1 << "[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-1 << "{"status":"SUCCESS"}"
16/07/26 23:27:11 DEBUG headers: http-outgoing-1 << HTTP/1.1 200 OK
16/07/26 23:27:11 DEBUG headers: http-outgoing-1 << Content-Type:
text/html;charset=UTF-8
16/07/26 23:27:11 DEBUG headers: http-outgoing-1 << Content-Length: 20
16/07/26 23:27:11 DEBUG headers: http-outgoing-1 << Server: Jetty(8.0.0.RC0)
16/07/26 23:27:11 DEBUG MainClientExec: Connection can be kept alive
indefinitely
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection [id:
1][route: {}->http://10.128.5.170:19002] can be kept alive indefinitely
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection
released: [id: 1][route: {}->http://10.128.5.170:19002][total kept alive: 1;
route al
located: 1 of 2; total allocated: 1 of 20]
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection manager
is shutting down
16/07/26 23:27:11 DEBUG DefaultManagedHttpClientConnection: http-outgoing-1:
Close connection
16/07/26 23:27:11 DEBUG DefaultManagedHttpClientConnection: http-outgoing-1:
Close connection
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection manager
shut down
16/07/26 23:27:11 DEBUG AsterixHttpAPI: Get locations of:
%7B%22handle%22%3A%5B13%2C0%5D%7D
16/07/26 23:27:11 DEBUG RequestAddCookies: CookieSpec selected: best-match
16/07/26 23:27:11 DEBUG RequestAuthCache: Auth cache not set in the context
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection request:
[route: {}->http://10.128.5.170:19002][total kept alive: 0; route allocated:
0 of 2; total allocated: 0 of 20]
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection leased:
[id: 2][route: {}->http://10.128.5.170:19002][total kept alive: 0; route allo
cated: 1 of 2; total allocated: 1 of 20]
16/07/26 23:27:11 DEBUG MainClientExec: Opening connection
{}->http://10.128.5.170:19002
16/07/26 23:27:11 DEBUG HttpClientConnectionManager: Connecting to
/10.128.5.170:19002
16/07/26 23:27:11 DEBUG MainClientExec: Executing request GET
/query/result/location?handle=%7B%22handle%22%3A%5B13%2C0%5D%7D HTTP/1.1
16/07/26 23:27:11 DEBUG MainClientExec: Target auth state: UNCHALLENGED
16/07/26 23:27:11 DEBUG MainClientExec: Proxy auth state: UNCHALLENGED
16/07/26 23:27:11 DEBUG headers: http-outgoing-2 >> GET
/query/result/location?handle=%7B%22handle%22%3A%5B13%2C0%5D%7D HTTP/1.1
16/07/26 23:27:11 DEBUG headers: http-outgoing-2 >> Host: 10.128.5.170:19002
16/07/26 23:27:11 DEBUG headers: http-outgoing-2 >> Connection: Keep-Alive
16/07/26 23:27:11 DEBUG headers: http-outgoing-2 >> User-Agent:
Apache-HttpClient/4.3.2 (java 1.5)
16/07/26 23:27:11 DEBUG headers: http-outgoing-2 >> Accept-Encoding:
gzip,deflate
16/07/26 23:27:11 DEBUG wire: http-outgoing-2 >> "GET
/query/result/location?handle=%7B%22handle%22%3A%5B13%2C0%5D%7D
HTTP/1.1[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-2 >> "Host:
10.128.5.170:19002[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-2 >> "Connection:
Keep-Alive[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-2 >> "User-Agent:
Apache-HttpClient/4.3.2 (java 1.5)[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-2 >> "Accept-Encoding:
gzip,deflate[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-2 >> "[\r][\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "HTTP/1.1 404 Not
Found[\r][\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "Cache-Control:
must-revalidate,no-cache,no-store[\r][\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "Content-Type:
text/html;charset=ISO-8859-1[\r][\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "Content-Length: 1288[\r][\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "Server:
Jetty(8.0.0.RC0)[\r][\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "[\r][\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "<html>[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "<head>[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "<meta
http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "<title>Error 404 Not
Found</title>[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "</head>[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "<body>[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "<h2>HTTP ERROR: 404</h2>[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "<p>Problem accessing
/query/result/location. Reason:[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "<pre> Not
Found</pre></p>[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "<hr /><i><small>Powered by
Jetty://</small></i>[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "
[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "
[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "
[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "
[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "
[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "
[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "
[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "
[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "
[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "
[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "
[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "
[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "
[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "
[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "
[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "
[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "
[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "
[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "
[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "
[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "</body>[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "</html>[\n]"
16/07/26 23:27:12 DEBUG headers: http-outgoing-2 << HTTP/1.1 404 Not Found
16/07/26 23:27:12 DEBUG headers: http-outgoing-2 << Cache-Control:
must-revalidate,no-cache,no-store
16/07/26 23:27:12 DEBUG headers: http-outgoing-2 << Content-Type:
text/html;charset=ISO-8859-1
16/07/26 23:27:12 DEBUG headers: http-outgoing-2 << Content-Length: 1288
16/07/26 23:27:12 DEBUG headers: http-outgoing-2 << Server: Jetty(8.0.0.RC0)
16/07/26 23:27:12 DEBUG MainClientExec: Connection can be kept alive
indefinitely
16/07/26 23:27:12 DEBUG PoolingHttpClientConnectionManager: Connection [id:
2][route: {}->http://10.128.5.170:19002] can be kept alive indefinitely
16/07/26 23:27:12 DEBUG PoolingHttpClientConnectionManager: Connection
released: [id: 2][route: {}->http://10.128.5.170:19002][total kept alive: 1;
route al
located: 1 of 2; total allocated: 1 of 20]
16/07/26 23:27:12 DEBUG PoolingHttpClientConnectionManager: Connection manager
is shutting down
16/07/26 23:27:12 DEBUG DefaultManagedHttpClientConnection: http-outgoing-2:
Close connection
16/07/26 23:27:12 DEBUG DefaultManagedHttpClientConnection: http-outgoing-2:
Close connection
16/07/26 23:27:12 DEBUG PoolingHttpClientConnectionManager: Connection manager
shut down
16/07/26 23:27:12 INFO AsterixHttpAPI: Result Locations: <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 Not Found</title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /query/result/location. Reason:
<pre> Not Found</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
</body>
</html>
net.liftweb.json.JsonParser$ParseException: unknown token <
Near: <h
at net.liftweb.json.JsonParser$Parser.fail(JsonParser.scala:234)
at net.liftweb.json.JsonParser$Parser.nextToken(JsonParser.scala:321)
at net.liftweb.json.JsonParser$$anonfun$2.apply(JsonParser.scala:188)
at net.liftweb.json.JsonParser$$anonfun$2.apply(JsonParser.scala:141)
at net.liftweb.json.JsonParser$.parse(JsonParser.scala:80)
at net.liftweb.json.JsonParser$.parse(JsonParser.scala:45)
at net.liftweb.json.package$.parse(package.scala:41)
at net.liftweb.json.Serialization$.read(Serialization.scala:58)
at
org.apache.asterix.connector.AsterixHttpAPI.getResultLocations(AsterixHttpAPI.scala:129)
at
org.apache.asterix.connector.SparkContextFunctions.executeQuery(SparkContextFunctions.scala:103)
at
org.apache.asterix.connector.SparkContextFunctions.aql(SparkContextFunctions.scala:80)
at
org.apache.spark.sql.asterix.SQLContextFunctions.executeQuery(SQLContextFunctions.scala:103)
at
org.apache.spark.sql.asterix.SQLContextFunctions.aql(SQLContextFunctions.scala:84)
at
$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:35)
at
$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:40)
at
$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:42)
at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:44)
at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:46)
at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:48)
at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:50)
at $iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:52)
at $iwC$$iwC$$iwC$$iwC.<init>(<console>:54)
at $iwC$$iwC$$iwC.<init>(<console>:56)
at $iwC$$iwC.<init>(<console>:58)
at $iwC.<init>(<console>:60)
at <init>(<console>:62)
at .<init>(<console>:66)
at .<clinit>(<console>)
at .<init>(<console>:7)
at .<clinit>(<console>)
at $print(<console>)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.repl.SparkIMain$ReadEvalPrint.call(SparkIMain.scala:1065)
at
org.apache.spark.repl.SparkIMain$Request.loadAndRun(SparkIMain.scala:1346)
at
org.apache.spark.repl.SparkIMain.loadAndRunReq$1(SparkIMain.scala:840)
at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:871)
at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:819)
at
org.apache.spark.repl.SparkILoop.reallyInterpret$1(SparkILoop.scala:857)
at
org.apache.spark.repl.SparkILoop.interpretStartingWith(SparkILoop.scala:902)
at org.apache.spark.repl.SparkILoop.command(SparkILoop.scala:814)
at org.apache.spark.repl.SparkILoop.processLine$1(SparkILoop.scala:657)
at org.apache.spark.repl.SparkILoop.innerLoop$1(SparkILoop.scala:665)
at
org.apache.spark.repl.SparkILoop.org$apache$spark$repl$SparkILoop$$loop(SparkILoop.scala:670)
at
org.apache.spark.repl.SparkILoop$$anonfun$org$apache$spark$repl$SparkILoop$$process$1.apply$mcZ$sp(SparkILoop.scala:997)
at
org.apache.spark.repl.SparkILoop$$anonfun$org$apache$spark$repl$SparkILoop$$process$1.apply(SparkILoop.scala:945)
at
org.apache.spark.repl.SparkILoop$$anonfun$org$apache$spark$repl$SparkILoop$$process$1.apply(SparkILoop.scala:945)
at
scala.tools.nsc.util.ScalaClassLoader$.savingContextLoader(ScalaClassLoader.scala:135)
at
org.apache.spark.repl.SparkILoop.org$apache$spark$repl$SparkILoop$$process(SparkILoop.scala:945)
at org.apache.spark.repl.SparkILoop.process(SparkILoop.scala:1059)
at org.apache.spark.repl.Main$.main(Main.scala:31)
at org.apache.spark.repl.Main.main(Main.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)
at
org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
From: Wail Alkowaileet <[email protected]>
Reply-To: "[email protected]" <[email protected]>
Date: Monday, July 18, 2016 at 5:26 AM
To: "[email protected]" <[email protected]>,
"[email protected]" <[email protected]>
Subject: Re: Trio: AsterixDB, Spark and Zeppelin.
Sorry. Here's the link for the connecot:
https://github.com/Nullification/asterixdb-spark-connector
On Mon, Jul 18, 2016 at 2:34 PM, Wail Alkowaileet <[email protected]> wrote:
Dears,
Finally I finished cleaning and documenting the AsterixDB-Spark connector and
finalize Zeppelin interpreter for AQL and SQL++.
AsterixDB-Spark Connector:
• Supports both AQL and SQL++ queries.
• Much cleaner code now.
• Please if you have ANY problem with it, create an issue in the project repo.
• I'm working on a tutorial-video from the build to use it in Zeppelin.
• I recommend you to use Zeppelin. (you can import the connector example
notebook)
Source Code: https://github.com/Nullification/astreixdb-spark-connector
Apache Zeppelin with AsterixDB interpreter:
• Supports JSON-flattening (which will allow zeppelin to visualize results).
• See attached screenshots.
• Will try to initiate pull request to merge it to Zeppelin master.
Source Code: https://github.com/Nullification/zeppelin
Finally, I just submitted Schema Inferencer. I have work on some Sonar comments
and it should be ready soon.
Thanks!
--
Regards,
Wail Alkowaileet
--
Regards,
Wail Alkowaileet
