Hyukjin Kwon created SPARK-46806: ------------------------------------ Summary: Improve error message for spark.table when argument type is wrong Key: SPARK-46806 URL: https://issues.apache.org/jira/browse/SPARK-46806 Project: Spark Issue Type: Test Components: PySpark Affects Versions: 4.0.0 Reporter: Hyukjin Kwon
{code} >>> spark.table(None) Traceback (most recent call last): File "<stdin>", line 1, in <module> File "/Users/hyukjin.kwon/workspace/forked/spark/python/pyspark/sql/session.py", line 1710, in table return DataFrame(self._jsparkSession.table(tableName), self) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/hyukjin.kwon/workspace/forked/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/java_gateway.py", line 1322, in __call__ File "/Users/hyukjin.kwon/workspace/forked/spark/python/pyspark/errors/exceptions/captured.py", line 215, in deco return f(*a, **kw) ^^^^^^^^^^^ File "/Users/hyukjin.kwon/workspace/forked/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/protocol.py", line 326, in get_return_value py4j.protocol.Py4JJavaError: An error occurred while calling o27.table. : java.lang.NullPointerException: Cannot invoke "String.length()" because "s" is null at org.antlr.v4.runtime.CharStreams.fromString(CharStreams.java:222) at org.antlr.v4.runtime.CharStreams.fromString(CharStreams.java:212) at org.apache.spark.sql.catalyst.parser.AbstractParser.parse(parsers.scala:58) at org.apache.spark.sql.execution.SparkSqlParser.parse(SparkSqlParser.scala:55) at org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parseMultipartIdentifier(AbstractSqlParser.scala:54) at org.apache.spark.sql.DataFrameReader.table(DataFrameReader.scala:681) at org.apache.spark.sql.SparkSession.table(SparkSession.scala:619) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244) at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:374) at py4j.Gateway.invoke(Gateway.java:282) {code} -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org