[jira] [Created] (ZEPPELIN-2451) Add JDBC config option for calling connection.commit after paragraph execution
Randy Gelhausen created ZEPPELIN-2451: - Summary: Add JDBC config option for calling connection.commit after paragraph execution Key: ZEPPELIN-2451 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2451 Project: Zeppelin Issue Type: Bug Components: Interpreters Reporter: Randy Gelhausen Assignee: Randy Gelhausen [ZEPPELIN-1645](https://issues.apache.org/jira/browse/ZEPPELIN-1645) added code to automatically call connection.commit() after JDBC paragraph execution, but some JDBC drivers do not support the connection.commit method, [calcite-druid](https://calcite.apache.org/docs/druid_adapter.html) for instance. The interpreter should have a zeppelin.jdbc.autocommit property which allows user to decide whether the interpreter should call commit after each paragraph execution. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (ZEPPELIN-2241) JDBC interpreter throws npe on connecting to any db that has a schema with "null" name
Randy Gelhausen created ZEPPELIN-2241:
-
Summary: JDBC interpreter throws npe on connecting to any db that
has a schema with "null" name
Key: ZEPPELIN-2241
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2241
Project: Zeppelin
Issue Type: Bug
Components: Interpreters
Reporter: Randy Gelhausen
Assignee: Randy Gelhausen
For example, Apache Phoenix has a default schema without a name. Any JDBC
command will throw a stacktrace on attempting to setup SQLCompleter's treemap.
I added logger statements to demonstrate the problem below:
INFO [2017-03-09 23:38:57,894] ({pool-2-thread-2}
SqlCompleter.java[initFromConnection]:363) - Completer initialized with 0
schemas, 0 tables and 281 keywords
INFO [2017-03-09 23:38:57,896] ({pool-2-thread-2}
JDBCInterpreter.java[interpret]:694) - Run SQL command 'select * from
system.catalog'
INFO [2017-03-09 23:38:57,896] ({pool-2-thread-2}
JDBCInterpreter.java[interpret]:703) - PropertyKey: default, SQL command:
'select * from system.catalog'
INFO [2017-03-09 23:38:58,445] ({pool-2-thread-2}
SqlCompleter.java[getSqlKeywordsCompletions]:219) - JDBC
DriverName:/phoenix-remote-jdbc-driver-sql.keywords
INFO [2017-03-09 23:38:58,526] ({pool-2-thread-2}
SqlCompleter.java[getSchemaNames]:114) - FOUND SCHEMA: null
INFO [2017-03-09 23:38:58,526] ({pool-2-thread-2}
SqlCompleter.java[getSchemaNames]:114) - FOUND SCHEMA: SYSTEM
INFO [2017-03-09 23:38:58,668] ({pool-2-thread-2}
SqlCompleter.java[initSchemas]:280) - Connection has 2 schemas
INFO [2017-03-09 23:38:58,668] ({pool-2-thread-2}
SqlCompleter.java[initSchemas]:281) - [null, SYSTEM]
ERROR [2017-03-09 23:38:58,669] ({pool-2-thread-2}
JDBCInterpreter.java[executeSql]:642) - Cannot run select * from system.catalog
java.lang.NullPointerException
at java.util.TreeMap.compare(TreeMap.java:1290)
at java.util.TreeMap.put(TreeMap.java:538)
at java.util.TreeSet.add(TreeSet.java:255)
at java.util.AbstractCollection.addAll(AbstractCollection.java:344)
at java.util.TreeSet.addAll(TreeSet.java:312)
at java.util.TreeSet.(TreeSet.java:160)
at
org.apache.zeppelin.jdbc.SqlCompleter.initSchemas(SqlCompleter.java:283)
at org.apache.zeppelin.jdbc.SqlCompleter.init(SqlCompleter.java:322)
at
org.apache.zeppelin.jdbc.SqlCompleter.initFromConnection(SqlCompleter.java:362)
at
org.apache.zeppelin.jdbc.JDBCInterpreter.createSqlCompleter(JDBCInterpreter.java:209)
at
org.apache.zeppelin.jdbc.JDBCInterpreter.getConnection(JDBCInterpreter.java:424)
at
org.apache.zeppelin.jdbc.JDBCInterpreter.executeSql(JDBCInterpreter.java:576)
at
org.apache.zeppelin.jdbc.JDBCInterpreter.interpret(JDBCInterpreter.java:704)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:94)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:495)
at org.apache.zeppelin.scheduler.Job.run(Job.java:181)
at
org.apache.zeppelin.scheduler.ParallelScheduler$JobRunner.run(ParallelScheduler.java:162)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (ZEPPELIN-1782) Expose all paragraph output as Angular variables
Randy Gelhausen created ZEPPELIN-1782:
-
Summary: Expose all paragraph output as Angular variables
Key: ZEPPELIN-1782
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1782
Project: Zeppelin
Issue Type: Improvement
Components: front-end, Interpreters
Reporter: Randy Gelhausen
I need to visualize data in different ways than the existing D3 graphs. I can
do this with Angular paragraphs with custom JavaScript, but
Spark is the only interpreter with capability to set Angular variables.
It's possible to write code for each Interpreter to set Angular variables, but
this is a large task.
A very nice new feature would be to expose each paragraph's text output to an
Angular variable with the ${paragraph_id}-output or similar. This way JDBC, or
Flink, or Hive, etc. results can easily be visualized with custom Javascript.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1645) JDBC Interpreter does not commit updates
Randy Gelhausen created ZEPPELIN-1645: - Summary: JDBC Interpreter does not commit updates Key: ZEPPELIN-1645 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1645 Project: Zeppelin Issue Type: Bug Components: Interpreters Reporter: Randy Gelhausen Assignee: Randy Gelhausen For changes to take effect for insert/update/upsert type statements, the JDBC API requires the connection property "AutoCommit" to be true, or for a user to call connection.commit method to flush changes. Since users may want to update records via Zeppelin notes, the JDBCInterpreter should commit at the end of each statement. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1459) Zeppelin JDBC URL properties mangled
Randy Gelhausen created ZEPPELIN-1459:
-
Summary: Zeppelin JDBC URL properties mangled
Key: ZEPPELIN-1459
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1459
Project: Zeppelin
Issue Type: Bug
Components: Interpreters
Reporter: Randy Gelhausen
I'm using Phoenix's thin client which needs to include a property at the end of
the JDBC URL.
I can set the driver up correctly in the Interpreter menu, and the first
paragraph runs successfully:
%jdbc(phoenix) select count(*) from system.catalog
But any paragraphs beyond the first fail with "No suitable driver found errors."
I added debug statements to dump the interpreter properties and found that
between paragraph 1 and 2, the "serialization=PROTOBUF" value at the end of
phoenix.url gets split into its own phoenix property.
select count(*) from system.catalog'
INFO [2016-09-19 12:15:45,558] ({pool-2-thread-2}
JDBCInterpreter.java[interpret]:462) - PropertyKey: phoenix, SQL command:
'select count(*) from system.catalog'
INFO [2016-09-19 12:15:45,561] ({pool-2-thread-2}
JDBCInterpreter.java[getConnection]:217) - PROPS: {user=phoenixuser,
url=jdbc:phoenix:thin:url=http://localhost:8765;serialization=PROTOBUF,
password=, hbase.client.retries.number=1,
driver=org.apache.calcite.avatica.remote.Driver}
INFO [2016-09-19 12:15:45,561] ({pool-2-thread-2}
JDBCInterpreter.java[getConnection]:218) -
org.apache.calcite.avatica.remote.Driver
INFO [2016-09-19 12:15:45,575] ({pool-2-thread-2}
JDBCInterpreter.java[getConnection]:223) - URL:
jdbc:phoenix:thin:url=http://localhost:8765;serialization=PROTOBUF, EMPTY AUTH
INFO [2016-09-19 12:15:45,745] ({pool-2-thread-2}
SqlCompleter.java[getSqlKeywordsCompletions]:142) - JDBC
DriverName:/phoenix-remote-jdbc-driver-sql.keywords
INFO [2016-09-19 12:15:45,916] ({pool-2-thread-2}
SchedulerFactory.java[jobFinished]:137) - Job remoteInterpretJob_1474301745528
finished by scheduler org.apache.zeppelin.jdbc.JDBCInterpreter2049516896
INFO [2016-09-19 12:15:58,598] ({pool-2-thread-2}
SchedulerFactory.java[jobStarted]:131) - Job remoteInterpretJob_1474301758598
started by scheduler org.apache.zeppelin.jdbc.JDBCInterpreter2049516896
INFO [2016-09-19 12:15:58,598] ({pool-2-thread-2}
JDBCInterpreter.java[interpret]:453) - Run SQL command '(phoenix)
select * from system.catalog'
INFO [2016-09-19 12:15:58,598] ({pool-2-thread-2}
JDBCInterpreter.java[interpret]:462) - PropertyKey: phoenix, SQL command:
'select * from system.catalog'
INFO [2016-09-19 12:15:58,599] ({pool-2-thread-2}
JDBCInterpreter.java[getConnection]:217) - PROPS: {serialization=PROTOBUF,
user=phoenixuser, url=http://localhost:8765, password=,
hbase.client.retries.number=1, driver=org.apache.calcite.avatica.remote.Driver}
INFO [2016-09-19 12:15:58,599] ({pool-2-thread-2}
JDBCInterpreter.java[getConnection]:218) -
org.apache.calcite.avatica.remote.Driver
INFO [2016-09-19 12:15:58,599] ({pool-2-thread-2}
JDBCInterpreter.java[getConnection]:223) - URL: http://localhost:8765, EMPTY
AUTH
ERROR [2016-09-19 12:15:58,600] ({pool-2-thread-2}
JDBCInterpreter.java[executeSql]:432) - Cannot run select * from system.catalog
java.sql.SQLException: No suitable driver found for http://localhost:8765
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1452) Include Phoenix 'thin client' instructions in docs
Randy Gelhausen created ZEPPELIN-1452: - Summary: Include Phoenix 'thin client' instructions in docs Key: ZEPPELIN-1452 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1452 Project: Zeppelin Issue Type: Bug Reporter: Randy Gelhausen Phoenix has thick and thin clients. The documentation for JDBC interpreter should include both. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1329) Zeppelin backend API broken or out of date with docs
Randy Gelhausen created ZEPPELIN-1329: - Summary: Zeppelin backend API broken or out of date with docs Key: ZEPPELIN-1329 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1329 Project: Zeppelin Issue Type: Bug Components: documentation, Interpreters Reporter: Randy Gelhausen https://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/displaysystem/back-end-angular.html#lets-make-it-simpler-and-more-intuitive The documentation there says: import org.apache.zeppelin.display.angular.notebookscope._ import AngularElem._ However, this throws an error: :42: error: object angular is not a member of package org.apache.zeppelin.display -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1041) Users can no longer highlight and copy/paste the contents of table cells
Randy Gelhausen created ZEPPELIN-1041: - Summary: Users can no longer highlight and copy/paste the contents of table cells Key: ZEPPELIN-1041 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1041 Project: Zeppelin Issue Type: Bug Components: GUI Reporter: Randy Gelhausen Double clicking, or click/drag to highlight and select text isn't working on table contents. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (ZEPPELIN-1033) Paragraph deletion and re-ordering broken
Randy Gelhausen created ZEPPELIN-1033: - Summary: Paragraph deletion and re-ordering broken Key: ZEPPELIN-1033 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1033 Project: Zeppelin Issue Type: Bug Components: GUI Reporter: Randy Gelhausen I just rebuilt from master and found that in both Firefox and Chrome, I can no longer remove paragraphs or re-order them via the gear icon next to each paragraph. See the attached gif for an example. Build args: mvn clean install -DskipTests -Drat.skip -Dspark.version=1.6.1 -Dhadoop.version=2.4.0 -Pspark-1.6 -Ppyspark -Phadoop-2.4 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
