#35960: Improve most tracebacks with exception chaining
-------------------------------------+-------------------------------------
               Reporter:  Bartosz    |          Owner:  Bartosz Sławecki
  Sławecki                           |
                   Type:             |         Status:  assigned
  Cleanup/optimization               |
              Component:             |        Version:  dev
  Uncategorized                      |       Keywords:  exception handling,
               Severity:  Normal     |  exception chaining, exceptions
           Triage Stage:             |      Has patch:  0
  Unreviewed                         |
    Needs documentation:  0          |    Needs tests:  0
Patch needs improvement:  0          |  Easy pickings:  1
                  UI/UX:  1          |
-------------------------------------+-------------------------------------
 Hi! This is my first time using Django.

 During configuring my project, I happened to run into a combined traceback
 caused by the inavailability of `psycopg`—it's a typical traceback a
 developer using Django may get, so I'm posting it here with most lines
 truncated to emphasize the conjuctions between tracebacks:

 {{{
 Traceback (most recent call last):
   (...)
   File "/home/bswck/Projects/obiadomat/.venv/lib/python3.12/site-
 packages/psycopg/pq/__init__.py", line 109, in import_from_libpq
     raise ImportError(
 ImportError: no pq wrapper available.
 (...)

 During handling of the above exception, another exception occurred:

 Traceback (most recent call last):
   File "/home/bswck/Projects/obiadomat/.venv/lib/python3.12/site-
 packages/django/db/backends/postgresql/base.py", line 27, in <module>
     import psycopg2 as Database
 ModuleNotFoundError: No module named 'psycopg2'

 During handling of the above exception, another exception occurred:

 Traceback (most recent call last):
   (...)
   File "/home/bswck/Projects/obiadomat/.venv/lib/python3.12/site-
 packages/django/db/backends/postgresql/base.py", line 29, in <module>
     raise ImproperlyConfigured("Error loading psycopg2 or psycopg module")
 django.core.exceptions.ImproperlyConfigured: Error loading psycopg2 or
 psycopg module
 }}}

 As we read in the traceback, the `ImproperlyConfigured` exception occured
 during handling the exception `ModuleNotFoundError: No module named
 'psycopg2'`. While this is technically true, I think we'd be happy to
 improve this traceback to this:

 {{{
 Traceback (most recent call last):
   (...)
   File "/home/bswck/Projects/obiadomat/.venv/lib/python3.12/site-
 packages/psycopg/pq/__init__.py", line 109, in import_from_libpq
     raise ImportError(
 ImportError: no pq wrapper available.
 (...)

 During handling of the above exception, another exception occurred:

 Traceback (most recent call last):
   File "/home/bswck/Projects/obiadomat/.venv/lib/python3.12/site-
 packages/django/db/backends/postgresql/base.py", line 27, in <module>
     import psycopg2 as Database
 ModuleNotFoundError: No module named 'psycopg2'

 The above exception was the direct cause of the following exception:

 Traceback (most recent call last):
   (...)
   File "/home/bswck/Projects/obiadomat/.venv/lib/python3.12/site-
 packages/django/db/backends/postgresql/base.py", line 29, in <module>
     raise ImproperlyConfigured("Error loading psycopg2 or psycopg module")
 from e
 django.core.exceptions.ImproperlyConfigured: Error loading psycopg2 or
 psycopg module
 }}}

 ...where we instead read that the `ModuleNotFoundError: No module named
 'psycopg2'` exception was the reason we got the `ImproperlyConfigured`
 exception. I used exception chaining
 https://docs.python.org/3/tutorial/errors.html#exception-chaining for this
 demonstration.

 I flicked through the codebase @ the main branch and found a surprisingly
 large amount of breakpoints that could be improved with chained
 exceptions.

 I offer to create a series of PRs that will close this ticket. I want to
 distribute the work needed to add this improvement and make one PR per
 every Django component to ensure that each of these PRs is carefully
 reviewed and confirmed by the right people who specialize in certain areas
 and can easily decide where a reason could be hidden or not.

 Notes to self:
 No `from` clause in a `raise` statement means that the user gets a
 traceback with the ''during handling ..., another exception occured''
 conjuction between tracebacks. Hence, let's add the `from None` clause
 only to very obvious cases, like `KeyError`s from dictionary access, or
 some super-simple `AttributeError`s (we'd like to facilitate debugging in
 cases where, for instance, a specialized attribute error occured inside a
 property–`from None` would hide the original error and not be helpful). We
 wouldn't like to add `from None` to any
 `ImportError`/`ModuleNotFoundError` (`ImportError` subclass) handling
 blocks, as they may lose information in the message of a transitive
 exception that should be blamed.

 `from <captured exception variable name>` in the vast majority of clauses
 ensures that the tracebacks we get in the future versions of Django
 affected by the PR remain around the same as those from the past versions,
 so they are 'backward-compatible' in a sense (please don't read this
 sentence literally, YKWIM).

 Please LMK what you think about this suggested improvement!
-- 
Ticket URL: <https://code.djangoproject.com/ticket/35960>
Django <https://code.djangoproject.com/>
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To view this discussion visit 
https://groups.google.com/d/msgid/django-updates/0107019382fd03a8-28f37434-00b0-491b-aac5-c91a84e89279-000000%40eu-central-1.amazonses.com.

Reply via email to