Re: [Django] #36526: Document memory usage of bulk_update and ways to batch updates.

2026-03-28 Thread Django
#36526: Document memory usage of bulk_update and ways to batch updates.
-+-
 Reporter:  Anže Pečar   |Owner:  Natalia
 Type:   |  Bidart
  Cleanup/optimization   |   Status:  closed
Component:  Database layer   |  Version:  5.2
  (models, ORM)  |
 Severity:  Normal   |   Resolution:  fixed
 Keywords:   | Triage Stage:  Ready for
 |  checkin
Has patch:  1|  Needs documentation:  0
  Needs tests:  0|  Patch needs improvement:  0
Easy pickings:  0|UI/UX:  0
-+-
Comment (by GitHub ):

 In [changeset:"4fd9e85b6031e7ddf878b280f324da6b98f7b0ed" 4fd9e85b]:
 {{{#!CommitTicketReference repository=""
 revision="4fd9e85b6031e7ddf878b280f324da6b98f7b0ed"
 Refs #36526 -- Fixed bulk_update() batching example in docs.
 }}}
-- 
Ticket URL: 
Django 
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To view this discussion visit 
https://groups.google.com/d/msgid/django-updates/0107019d34a6fa2d-a50ff93b-62b4-449a-9e47-69ec830cc960-00%40eu-central-1.amazonses.com.


Re: [Django] #36526: Document memory usage of bulk_update and ways to batch updates.

2026-03-28 Thread Django
#36526: Document memory usage of bulk_update and ways to batch updates.
-+-
 Reporter:  Anže Pečar   |Owner:  Natalia
 Type:   |  Bidart
  Cleanup/optimization   |   Status:  closed
Component:  Database layer   |  Version:  5.2
  (models, ORM)  |
 Severity:  Normal   |   Resolution:  fixed
 Keywords:   | Triage Stage:  Ready for
 |  checkin
Has patch:  1|  Needs documentation:  0
  Needs tests:  0|  Patch needs improvement:  0
Easy pickings:  0|UI/UX:  0
-+-
Comment (by Jacob Walls ):

 In [changeset:"4a21ba2210ee5b1e650f6b0faa75c9d635c6cdbc" 4a21ba2]:
 {{{#!CommitTicketReference repository=""
 revision="4a21ba2210ee5b1e650f6b0faa75c9d635c6cdbc"
 [6.0.x] Refs #36526 -- Fixed bulk_update() batching example in docs.

 Backport of 4fd9e85b6031e7ddf878b280f324da6b98f7b0ed from main.
 }}}
-- 
Ticket URL: 
Django 
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To view this discussion visit 
https://groups.google.com/d/msgid/django-updates/0107019d349ea6e2-75d5541e-a794-4ef2-a690-2c90e6eab434-00%40eu-central-1.amazonses.com.


Re: [Django] #36526: Document memory usage of bulk_update and ways to batch updates.

2025-10-18 Thread Django
#36526: Document memory usage of bulk_update and ways to batch updates.
-+-
 Reporter:  Anže Pečar   |Owner:  Natalia
 Type:   |  Bidart
  Cleanup/optimization   |   Status:  assigned
Component:  Database layer   |  Version:  5.2
  (models, ORM)  |
 Severity:  Normal   |   Resolution:
 Keywords:   | Triage Stage:  Ready for
 |  checkin
Has patch:  1|  Needs documentation:  0
  Needs tests:  0|  Patch needs improvement:  0
Easy pickings:  0|UI/UX:  0
-+-
Changes (by Natalia Bidart):

 * needs_better_patch:  1 => 0
 * stage:  Accepted => Ready for checkin

-- 
Ticket URL: 
Django 
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To view this discussion visit 
https://groups.google.com/d/msgid/django-updates/01070199c5b8116d-f717dbca-033a-4575-bad4-afaa0dd6cb6c-00%40eu-central-1.amazonses.com.


Re: [Django] #36526: Document memory usage of bulk_update and ways to batch updates.

2025-10-18 Thread Django
#36526: Document memory usage of bulk_update and ways to batch updates.
-+-
 Reporter:  Anže Pečar   |Owner:  Natalia
 Type:   |  Bidart
  Cleanup/optimization   |   Status:  closed
Component:  Database layer   |  Version:  5.2
  (models, ORM)  |
 Severity:  Normal   |   Resolution:  fixed
 Keywords:   | Triage Stage:  Ready for
 |  checkin
Has patch:  1|  Needs documentation:  0
  Needs tests:  0|  Patch needs improvement:  0
Easy pickings:  0|UI/UX:  0
-+-
Changes (by nessita <124304+nessita@…>):

 * resolution:   => fixed
 * status:  assigned => closed

Comment:

 In [changeset:"608d3ebc8889863d43be1090d634b9507fe4a85e" 608d3eb]:
 {{{#!CommitTicketReference repository=""
 revision="608d3ebc8889863d43be1090d634b9507fe4a85e"
 Fixed #36526 -- Doc'd QuerySet.bulk_update() memory usage when batching.

 Thanks Simon Charette for the review.
 }}}
-- 
Ticket URL: 
Django 
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To view this discussion visit 
https://groups.google.com/d/msgid/django-updates/01070199c5b8b20e-86a2d49b-e324-4d27-b805-0f55a58f2177-00%40eu-central-1.amazonses.com.


Re: [Django] #36526: Document memory usage of bulk_update and ways to batch updates.

2025-10-17 Thread Django
#36526: Document memory usage of bulk_update and ways to batch updates.
-+-
 Reporter:  Anže Pečar   |Owner:  Natalia
 Type:   |  Bidart
  Cleanup/optimization   |   Status:  closed
Component:  Database layer   |  Version:  5.2
  (models, ORM)  |
 Severity:  Normal   |   Resolution:  fixed
 Keywords:   | Triage Stage:  Ready for
 |  checkin
Has patch:  1|  Needs documentation:  0
  Needs tests:  0|  Patch needs improvement:  0
Easy pickings:  0|UI/UX:  0
-+-
Comment (by Natalia <124304+nessita@…>):

 In [changeset:"953163e6106d6e0135214589d33503613ea35b4d" 953163e]:
 {{{#!CommitTicketReference repository=""
 revision="953163e6106d6e0135214589d33503613ea35b4d"
 [6.0.x] Fixed #36526 -- Doc'd QuerySet.bulk_update() memory usage when
 batching.

 Thanks Simon Charette for the review.

 Backport of 608d3ebc8889863d43be1090d634b9507fe4a85e from main.
 }}}
-- 
Ticket URL: 
Django 
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To view this discussion visit 
https://groups.google.com/d/msgid/django-updates/01070199c5bdcb5b-4011e619-860b-462e-bdf4-eaa6fa656829-00%40eu-central-1.amazonses.com.


Re: [Django] #36526: Document memory usage of bulk_update and ways to batch updates.

2025-10-17 Thread Django
#36526: Document memory usage of bulk_update and ways to batch updates.
-+-
 Reporter:  Anže Pečar   |Owner:  Natalia
 Type:   |  Bidart
  Cleanup/optimization   |   Status:  closed
Component:  Database layer   |  Version:  5.2
  (models, ORM)  |
 Severity:  Normal   |   Resolution:  fixed
 Keywords:   | Triage Stage:  Ready for
 |  checkin
Has patch:  1|  Needs documentation:  0
  Needs tests:  0|  Patch needs improvement:  0
Easy pickings:  0|UI/UX:  0
-+-
Comment (by Natalia <124304+nessita@…>):

 In [changeset:"80b9c8f5292dfa38469a1e85314cc45b8374eb22" 80b9c8f5]:
 {{{#!CommitTicketReference repository=""
 revision="80b9c8f5292dfa38469a1e85314cc45b8374eb22"
 [5.2.x] Fixed #36526 -- Doc'd QuerySet.bulk_update() memory usage when
 batching.

 Thanks Simon Charette for the review.

 Backport of 608d3ebc8889863d43be1090d634b9507fe4a85e from main.
 }}}
-- 
Ticket URL: 
Django 
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To view this discussion visit 
https://groups.google.com/d/msgid/django-updates/01070199c5be2719-b9a25772-190c-4179-8a26-e53a720415d9-00%40eu-central-1.amazonses.com.


Re: [Django] #36526: Document memory usage of bulk_update and ways to batch updates.

2025-09-25 Thread Django
#36526: Document memory usage of bulk_update and ways to batch updates.
-+-
 Reporter:  Anže Pečar   |Owner:  Natalia
 Type:   |  Bidart
  Cleanup/optimization   |   Status:  assigned
Component:  Database layer   |  Version:  5.2
  (models, ORM)  |
 Severity:  Normal   |   Resolution:
 Keywords:   | Triage Stage:  Accepted
Has patch:  1|  Needs documentation:  0
  Needs tests:  0|  Patch needs improvement:  1
Easy pickings:  0|UI/UX:  0
-+-
Changes (by Jacob Walls):

 * needs_better_patch:  0 => 1

-- 
Ticket URL: 
Django 
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To view this discussion visit 
https://groups.google.com/d/msgid/django-updates/01070199826032cd-55d9dff1-c887-4fe1-9b4a-d92300092cc5-00%40eu-central-1.amazonses.com.


Re: [Django] #36526: Document memory usage of bulk_update and ways to batch updates.

2025-08-28 Thread Django
#36526: Document memory usage of bulk_update and ways to batch updates.
-+-
 Reporter:  Anže Pečar   |Owner:  Natalia
 Type:   |  Bidart
  Cleanup/optimization   |   Status:  assigned
Component:  Database layer   |  Version:  5.2
  (models, ORM)  |
 Severity:  Normal   |   Resolution:
 Keywords:   | Triage Stage:  Accepted
Has patch:  1|  Needs documentation:  0
  Needs tests:  0|  Patch needs improvement:  0
Easy pickings:  0|UI/UX:  0
-+-
Comment (by Natalia Bidart):

 [https://github.com/django/django/pull/19792 PR]
-- 
Ticket URL: 
Django 
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To view this discussion visit 
https://groups.google.com/d/msgid/django-updates/01070198f257e7b2-de98ce1e-908a-4adf-8a3d-adb6c65effa5-00%40eu-central-1.amazonses.com.


Re: [Django] #36526: Document memory usage of bulk_update and ways to batch updates.

2025-08-28 Thread Django
#36526: Document memory usage of bulk_update and ways to batch updates.
-+-
 Reporter:  Anže Pečar   |Owner:  Natalia
 Type:   |  Bidart
  Cleanup/optimization   |   Status:  assigned
Component:  Database layer   |  Version:  5.2
  (models, ORM)  |
 Severity:  Normal   |   Resolution:
 Keywords:   | Triage Stage:  Accepted
Has patch:  1|  Needs documentation:  0
  Needs tests:  0|  Patch needs improvement:  0
Easy pickings:  0|UI/UX:  0
-+-
Changes (by Natalia Bidart):

 * needs_better_patch:  1 => 0
 * owner:  Jason Hall => Natalia Bidart
 * status:  new => assigned

-- 
Ticket URL: 
Django 
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To view this discussion visit 
https://groups.google.com/d/msgid/django-updates/01070198f256141c-c2a525c4-4674-49ce-952c-522e9955e9e5-00%40eu-central-1.amazonses.com.


Re: [Django] #36526: Document memory usage of bulk_update and ways to batch updates.

2025-08-28 Thread Django
#36526: Document memory usage of bulk_update and ways to batch updates.
-+-
 Reporter:  Anže Pečar   |Owner:  Jason
 Type:   |  Hall
  Cleanup/optimization   |   Status:  new
Component:  Database layer   |  Version:  5.2
  (models, ORM)  |
 Severity:  Normal   |   Resolution:
 Keywords:   | Triage Stage:  Accepted
Has patch:  1|  Needs documentation:  0
  Needs tests:  0|  Patch needs improvement:  1
Easy pickings:  0|UI/UX:  0
-+-
Comment (by Natalia Bidart):

 Replying to [comment:10 Anže Pečar]:
 > Natalia Bidart, I pointed out in my initial description that the two
 issues are related but I am still not fully convinced that they are
 duplicates. In my case I was updating a large number of objects for
 several hours and it wouldn't have made a difference if the query took an
 extra hour or two. What did make a difference was that the script was
 killed with a SIGTERM when the container ran out of memory. :(
 >
 > Could we reopen until we fully understand what the performance impact of
 the code changes proposed from Jason Hall? I made a quick benchmark
 earlier today and Jason's solution with the longer transaction ended up
 being 6% slower (29.76s vs 28s) but I wanted to also test it on a dataset
 with more columns as was the example in #31202.

 Thanks for the clarification. As Simon noted in the PR, performing the
 expression resolution while the transaction is open (which is known to
 take significant time) is likely to be more harmful than the memory
 overhead it incurs.

 Since manual batching already works around the memory issue, we don't plan
 to pursue changes to defer expression resolution within `bulk_update`
 other than what is covered in #31202. I'll work on a patch to
 improve/extend the docs.
-- 
Ticket URL: 
Django 
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To view this discussion visit 
https://groups.google.com/d/msgid/django-updates/01070198f25320a0-de5f2934-9aa3-4b54-8898-d4e475e51f45-00%40eu-central-1.amazonses.com.


Re: [Django] #36526: Document memory usage of bulk_update and ways to batch updates. (was: Documment memory usage of bulk_update and ways to batch updates.)

2025-08-28 Thread Django
#36526: Document memory usage of bulk_update and ways to batch updates.
-+-
 Reporter:  Anže Pečar   |Owner:  Jason
 Type:   |  Hall
  Cleanup/optimization   |   Status:  new
Component:  Database layer   |  Version:  5.2
  (models, ORM)  |
 Severity:  Normal   |   Resolution:
 Keywords:   | Triage Stage:  Accepted
Has patch:  1|  Needs documentation:  0
  Needs tests:  0|  Patch needs improvement:  1
Easy pickings:  0|UI/UX:  0
-+-
Changes (by Natalia Bidart):

 * summary:  Documment memory usage of bulk_update and ways to batch
 updates. => Document memory usage of bulk_update and ways to batch
 updates.

-- 
Ticket URL: 
Django 
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To view this discussion visit 
https://groups.google.com/d/msgid/django-updates/01070198f219dec1-1887e55c-b0d2-49f3-9070-f191de073c8a-00%40eu-central-1.amazonses.com.