[ https://issues.apache.org/jira/browse/SPARK-22043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon reassigned SPARK-22043: ------------------------------------ Assignee: Hyukjin Kwon > Python profile, show_profiles() and dump_profiles(), should throw an error > with a better message > ------------------------------------------------------------------------------------------------ > > Key: SPARK-22043 > URL: https://issues.apache.org/jira/browse/SPARK-22043 > Project: Spark > Issue Type: Improvement > Components: PySpark > Affects Versions: 2.3.0 > Reporter: Hyukjin Kwon > Assignee: Hyukjin Kwon > Priority: Trivial > Fix For: 2.1.2, 2.2.1, 2.3.0 > > > I mistakenly missed {{spark.python.profile}} enabled today while profiling > and met this unfriendly messages: > {code} > >>> sc.show_profiles() > Traceback (most recent call last): > File "<stdin>", line 1, in <module> > File ".../spark/python/pyspark/context.py", line 1000, in show_profiles > self.profiler_collector.show_profiles() > AttributeError: 'NoneType' object has no attribute 'show_profiles' > >>> sc.dump_profiles("/tmp/abc") > Traceback (most recent call last): > File "<stdin>", line 1, in <module> > File ".../spark/python/pyspark/context.py", line 1005, in dump_profiles > self.profiler_collector.dump_profiles(path) > AttributeError: 'NoneType' object has no attribute 'dump_profiles' > {code} > It looks we should give better information that says {{spark.python.profile}} > should be enabled. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org