Re: [Django] #22258: Show progress during dumpdata and loaddata

[Django]

#22258: Show progress during dumpdata and loaddata
-+-
 Reporter:  Gwildor  |Owner:  mrfuxi
 Type:  New feature  |   Status:  assigned
Component:  Core (Management |  Version:  master
  commands)  |
 Severity:  Normal   |   Resolution:
 Keywords:   | Triage Stage:  Accepted
Has patch:  1|  Needs documentation:  0
  Needs tests:  0|  Patch needs improvement:  0
Easy pickings:  0|UI/UX:  0
-+-
Changes (by claudep):

 * needs_tests:  1 => 0


--
Ticket URL: 
Django 
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-updates+unsubscr...@googlegroups.com.
To post to this group, send email to django-updates@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-updates/065.e9e0164c45c5d3e6cd7b6e93a1b36956%40djangoproject.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Django] #22258: Show progress during dumpdata and loaddata

[Django]

#22258: Show progress during dumpdata and loaddata
-+-
 Reporter:  Gwildor  |Owner:  mrfuxi
 Type:  New feature  |   Status:  assigned
Component:  Core (Management |  Version:  master
  commands)  |
 Severity:  Normal   |   Resolution:
 Keywords:   | Triage Stage:  Accepted
Has patch:  1|  Needs documentation:  0
  Needs tests:  1|  Patch needs improvement:  0
Easy pickings:  0|UI/UX:  0
-+-
Changes (by claudep):

 * has_patch:  0 => 1
 * needs_tests:  0 => 1


Comment:

 188a2418807f661eedfc675731521f2f46a3c49a (#21652) added progress
 information for loaddata.

 This PR is adding progress report for dumpdata:
 https://github.com/django/django/pull/5032

--
Ticket URL: 
Django 
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-updates+unsubscr...@googlegroups.com.
To post to this group, send email to django-updates@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-updates/065.8035122c38438745536e78fc30a4a3a3%40djangoproject.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Django] #22258: Show progress during dumpdata and loaddata

[Django]

#22258: Show progress during dumpdata and loaddata
-+-
 Reporter:  Gwildor  |Owner:  mrfuxi
 Type:  New feature  |   Status:  assigned
Component:  Core (Management |  Version:  master
  commands)  |   Resolution:
 Severity:  Normal   | Triage Stage:  Accepted
 Keywords:   |  Needs documentation:  0
Has patch:  0|  Patch needs improvement:  0
  Needs tests:  0|UI/UX:  0
Easy pickings:  0|
-+-
Changes (by mrfuxi):

 * owner:  nobody => mrfuxi
 * status:  new => assigned


Comment:

 I was thinking of adding some kind of utility to allow showing progress
 from any management command.

 As far as I looked (loading data) there is no clean way of showing % of
 progress because of generators/reading streams from files, so progress
 like during tests. For data load it might be possible to show proper
 progress bar.

--
Ticket URL: 
Django 
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-updates+unsubscr...@googlegroups.com.
To post to this group, send email to django-updates@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-updates/065.d1949c8bbb26553b807ec5ea45d4e17e%40djangoproject.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Django] #22258: Show progress during dumpdata and loaddata

[Django]

#22258: Show progress during dumpdata and loaddata
-+-
 Reporter:  Gwildor  |Owner:  nobody
 Type:  New feature  |   Status:  new
Component:  Core (Management |  Version:  master
  commands)  |   Resolution:
 Severity:  Normal   | Triage Stage:  Accepted
 Keywords:   |  Needs documentation:  0
Has patch:  0|  Patch needs improvement:  0
  Needs tests:  0|UI/UX:  0
Easy pickings:  0|
-+-

Comment (by anubhav9042):

 Well I am attaching a simple diff just for JSON. It does very simply does
 the job of displaying progress(random not actual), but we can think along
 similar lines like we could calculate total no. of objects and then print
 progress accurately depending upon no of objects serialized.

-- 
Ticket URL: 
Django 
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-updates+unsubscr...@googlegroups.com.
To post to this group, send email to django-updates@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-updates/065.d90a86daef6b400315843128f1ab0f70%40djangoproject.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Django] #22258: Show progress during dumpdata and loaddata

[Django]

#22258: Show progress during dumpdata and loaddata
-+-
 Reporter:  Gwildor  |Owner:  nobody
 Type:  New feature  |   Status:  new
Component:  Core (Management |  Version:  master
  commands)  |   Resolution:
 Severity:  Normal   | Triage Stage:  Accepted
 Keywords:   |  Needs documentation:  0
Has patch:  0|  Patch needs improvement:  0
  Needs tests:  0|UI/UX:  0
Easy pickings:  0|
-+-

Comment (by russellm):

 Before we get too carried away here, someone needs to explain how it's
 going to be implemented. json.dumps and lxml don't provide progress APIs
 AFAIK.

-- 
Ticket URL: 
Django 
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-updates+unsubscr...@googlegroups.com.
To post to this group, send email to django-updates@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-updates/065.0ae986151045a77fb9d2cdf2675d4b3f%40djangoproject.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Django] #22258: Show progress during dumpdata and loaddata

[Django]

#22258: Show progress during dumpdata and loaddata
-+-
 Reporter:  Gwildor  |Owner:  nobody
 Type:  New feature  |   Status:  new
Component:  Core (Management |  Version:  master
  commands)  |   Resolution:
 Severity:  Normal   | Triage Stage:  Accepted
 Keywords:   |  Needs documentation:  0
Has patch:  0|  Patch needs improvement:  0
  Needs tests:  0|UI/UX:  0
Easy pickings:  0|
-+-

Comment (by anubhav9042):

 We can add the patch given #22257, then as posted there:
 I think we can keep default as stdout and and for this, we can do the
 following:

 - When -o is not used, let the data be printed to stdout, as the data is
 printing people can see it and I don't think any progress display is
 required there.

 - When -o will be used, then we can display progress percentage or
 something like that.

 backwards compatibilty is there, also issue here is also addressed.
 thoughts?

-- 
Ticket URL: 
Django 
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-updates+unsubscr...@googlegroups.com.
To post to this group, send email to django-updates@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-updates/065.b19caaa86df69e413efda97fab0c2ad2%40djangoproject.com.
For more options, visit https://groups.google.com/d/optout.

Re: [Django] #22258: Show progress during dumpdata and loaddata

[Django]

#22258: Show progress during dumpdata and loaddata
-+-
 Reporter:  Gwildor  |Owner:  nobody
 Type:  New feature  |   Status:  new
Component:  Core (Management |  Version:  master
  commands)  |   Resolution:
 Severity:  Normal   | Triage Stage:  Accepted
 Keywords:   |  Needs documentation:  0
Has patch:  0|  Patch needs improvement:  0
  Needs tests:  0|UI/UX:  0
Easy pickings:  0|
-+-
Changes (by aaugustin):

 * needs_better_patch:   => 0
 * stage:  Unreviewed => Accepted
 * needs_tests:   => 0
 * needs_docs:   => 0


-- 
Ticket URL: 
Django 
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-updates+unsubscr...@googlegroups.com.
To post to this group, send email to django-updates@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-updates/065.72770d7b40cdcc3b4ede5f6ea562e293%40djangoproject.com.
For more options, visit https://groups.google.com/d/optout.

[Django] #22258: Show progress during dumpdata and loaddata

[Django]

#22258: Show progress during dumpdata and loaddata
+
 Reporter:  Gwildor |  Owner:  nobody
 Type:  New feature | Status:  new
Component:  Core (Management commands)  |Version:  master
 Severity:  Normal  |   Keywords:
 Triage Stage:  Unreviewed  |  Has patch:  0
Easy pickings:  0   |  UI/UX:  0
+
 In response of ticket #22251, I'm opening this as a separate issue like
 requested. You can read the need for this option there, but shortly
 speaking, the commands as they are now are not user friendly at all. The
 commands can go on for a very long time, depending on your database size,
 without giving any clue of its state and progress.

 If and when #22257 is implemented, the commands could start by collecting
 amount of rows to progress, and periodically printing the progress to the
 console. This way the user can make a fair estimate on when the commands
 are done and whether they are actually still running.

-- 
Ticket URL: 
Django 
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-updates+unsubscr...@googlegroups.com.
To post to this group, send email to django-updates@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-updates/050.75880ccb1034f97cd62a2ac7493ee97e%40djangoproject.com.
For more options, visit https://groups.google.com/d/optout.