Re: Model Generation for CSV, XLS Files

2021-05-18 Thread Akash T S 
Hi I need Help

On Thursday, November 26, 2020 at 11:54:51 PM UTC+5:30 muskan...@gmail.com 
wrote:

> I would like to tackle this singularly first if possible, especially for 
> gsoc. Hope you understand I appreciate your offer
>
>
> On Thu, 26 Nov, 2020, 9:25 pm Shoury Sharma,  wrote:
>
>> Hello!
>> I'm also looking forward for GSOC'21. If you prefer we could try merging 
>> this functionalities by submitting patches. 
>> Regards
>>
>> On Thu, 26 Nov, 2020, 1:22 am Muskan Vaswan,  wrote:
>>
>>> Hi everyone,
>>> I am Muskan and am very new to this community however not that new to 
>>> django itself. Contributing to django is something I would really like to 
>>> do, and I might also be participating in GSoc for the same. 
>>>
>>> I have an vague idea of what I want to fix, because I myself have used 
>>> django and just want to add things as a developer that I would've wanted as 
>>> a user. So my question is understanding based around this idea of mine. 
>>>
>>> *I want to know what functionality already exists that makes it easier 
>>> to directly load a large data set into a django model from a CSV file 
>>> (going with the simplest format or now).* When I had to do it as a user 
>>> it took me quite a while and was a lot more complicated than I had 
>>> expected, after being used to smooth transitions with load data. I could 
>>> not find any better methods to do it, if there indeed exists no other 
>>> methods, this is something I would like to work on So this is just to 
>>> confirm if my research was thorough enough (very possibly wasn't).
>>>
>>> Thank you! I'm excited to begin helping out!
>>>
>>> -- 
>>> You received this message because you are subscribed to the Google 
>>> Groups "Django developers (Contributions to Django itself)" group.
>>> To unsubscribe from this group and stop receiving emails from it, send 
>>> an email to django-develop...@googlegroups.com.
>>> To view this discussion on the web visit 
>>> https://groups.google.com/d/msgid/django-developers/a3946181-cd91-4b83-b9d6-d8d8f786b6acn%40googlegroups.com
>>>  
>>> 
>>> .
>>>
>> -- 
>> You received this message because you are subscribed to the Google Groups 
>> "Django developers (Contributions to Django itself)" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to django-develop...@googlegroups.com.
>>
> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/django-developers/CAO3iMDH0-a59q-7S75cCv2dREqNYk_5vr1V2WTg9nFb3b4qrRQ%40mail.gmail.com
>>  
>> 
>> .
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Django developers  (Contributions to Django itself)" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-developers+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-developers/196d317e-aa20-48df-bbdf-01eb4cfa8c75n%40googlegroups.com.

Re: Model Generation for CSV, XLS Files

2020-11-28 Thread Denis Urman 
The CSV module in the Python standard library has solved the issues
mentioned in this thread vis a vis format. No need to reinvent the wheel.
There are options and flags for field names and delimiters. Before relying
on a third party depencency, one must demonstrate the necessity. What edge
cases does CSV not account for and why is it our responsibility to solve
for them?

Serializing/deserializing from a CSV to a Model is trivial if the Models
are already written. We need to figure out how to handle arrays/sets for
normalized databases with foreign keys. For example in one of my projects,
an Invoice has a Vendor (many to one) Perhaps a flag for which attributes
to fetch for the reverse set and which set (list, dictionary, etc.) to
return them as?

I'd love to jump on this and come up with a RFC or something. I have a huge
amount of business logic related to (de)serialization in my app.

On Sat, Nov 28, 2020, 10:05 AM Muskan Vaswan  wrote:

> Alright Mariusz, (sorry for messing up your name) then I think that puts
> an end to this particular conversation, I appreciate your feedback and
> help, same goes for everyone. I'll try to make myself useful in some other
> way then!
>
> On Saturday, 28 November 2020 at 14:12:29 UTC+5:30 Mariusz Felisiak wrote:
>
>> Russ pointed out the need for a standardized format in csv files, and in
>>> turn Adam suggested that the first line begin the table name. I have a
>>> slightly different suggestion. It is a well known convention to put the
>>> column names as comma separated values in the first line of the csv file. I
>>> suggest we leave it at that.
>>>
>>> *-1*
>> I wouldn't call in a convention. I've imported thousands of CSV files in
>> dozens of different formats in my life. The lack of a standard is still a
>> strong argument against including it in Django. It's not something that we
>> want to maintain in Django. It sounds like a third-party package with a
>> custom serializer is the best way to proceed.
>>
>> Best,
>> Mariusz
>> *not Markzus ;)*
>>
> --
> You received this message because you are subscribed to the Google Groups
> "Django developers (Contributions to Django itself)" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to django-developers+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/django-developers/151f28cc-dd85-47f1-ad28-5f99aeea7539n%40googlegroups.com
> 
> .
>

-- 
You received this message because you are subscribed to the Google Groups 
"Django developers  (Contributions to Django itself)" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-developers+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-developers/CAK1R69rjc%2BG8pp3smP6EUbqEu-_AJXrKm2_ZMsO3if3KDLzTcA%40mail.gmail.com.

Re: Model Generation for CSV, XLS Files

2020-11-28 Thread Muskan Vaswan 
Alright Mariusz, (sorry for messing up your name) then I think that puts an 
end to this particular conversation, I appreciate your feedback and help, 
same goes for everyone. I'll try to make myself useful in some other way 
then! 

On Saturday, 28 November 2020 at 14:12:29 UTC+5:30 Mariusz Felisiak wrote:

> Russ pointed out the need for a standardized format in csv files, and in 
>> turn Adam suggested that the first line begin the table name. I have a 
>> slightly different suggestion. It is a well known convention to put the 
>> column names as comma separated values in the first line of the csv file. I 
>> suggest we leave it at that.  
>>
>> *-1*
> I wouldn't call in a convention. I've imported thousands of CSV files in 
> dozens of different formats in my life. The lack of a standard is still a 
> strong argument against including it in Django. It's not something that we 
> want to maintain in Django. It sounds like a third-party package with a 
> custom serializer is the best way to proceed.
>
> Best,
> Mariusz
> *not Markzus ;)*
>

-- 
You received this message because you are subscribed to the Google Groups 
"Django developers  (Contributions to Django itself)" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-developers+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-developers/151f28cc-dd85-47f1-ad28-5f99aeea7539n%40googlegroups.com.

Re: Model Generation for CSV, XLS Files

2020-11-28 Thread Mariusz Felisiak 


> Russ pointed out the need for a standardized format in csv files, and in 
> turn Adam suggested that the first line begin the table name. I have a 
> slightly different suggestion. It is a well known convention to put the 
> column names as comma separated values in the first line of the csv file. I 
> suggest we leave it at that.  
>
> *-1*
I wouldn't call in a convention. I've imported thousands of CSV files in 
dozens of different formats in my life. The lack of a standard is still a 
strong argument against including it in Django. It's not something that we 
want to maintain in Django. It sounds like a third-party package with a 
custom serializer is the best way to proceed.

Best,
Mariusz
*not Markzus ;)*

-- 
You received this message because you are subscribed to the Google Groups 
"Django developers  (Contributions to Django itself)" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-developers+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-developers/c4d09f33-8def-4eea-b161-6224366f5de9n%40googlegroups.com.

Re: Model Generation for CSV, XLS Files

2020-11-27 Thread Muskan Vaswan 


Hi Markzus, 

 

Issue #5253  that you pointed 
me to was indeed very helpful. What I suggested is along the lines of what 
Adam suggested and tried to accomplish 12 years ago, which clearly shows 
that there has been space for its implementation for a very long time. 

 

At the same time, all of the points brought up by Russ also made sense but 
I do think that we can resolve those issues to some extent. Allow me to 
address the little details one by one.

 

Russ pointed out the need for a standardized format in csv files, and in 
turn Adam suggested that the first line begin the table name. I have a 
slightly different suggestion. It is a well known convention to put the 
column names as comma separated values in the first line of the csv file. I 
suggest we leave it at that. 

The column names of the first line will correspond to the fieldnames of the 
model created by the user, which instead of being referenced in the file 
itself can be referenced as a command line argument. 

This of course operates under the assumption that only one table of data 
will be in a single file. Which isn't a very bold assumption to make. I'll 
elaborate on why in just a bit.

 

I'm going to try and do a better job of explain the context of the addition 
I speak of. Say you get your data off of a random site on the internet in 
the form of an Excel sheet. Now if you want to use it in django as a model, 
then right now this is what you'll have to do: Convert it to CSV from 
Excel. Write a script somethink like the one 
https://groups.google.com/g/django-developers/c/o1dFA31YwOk/m/XchFFWjnBQAJ 
talks about (This views file is the code I'm referring to) 
In
 
which we read line by line and create the objects with a python script and 
make model objects with it. Creating a sub app to only be able to upload 
your dataset into your model seems like a stretch. This process could be 
made seem less if we just made this on the backend of django, which is 
going to take effort but I do think that it will be useful to the user. 

So the whole could simply boil down to `*python manage.py loaddata 
dataset.csv .*`

 

If you consider this then the assumption that one table will correspond to 
a single csv file really is pretty reasonable I think. 

 

So I'm not suggesting that we re-open the issue, I do however think that 
for django which is so user friendly and time efficient, uploading a csv 
file into a table really shouldn't be so long a process. 

 Let me know if I made any sense..

On Friday, 27 November 2020 at 10:55:24 UTC+5:30 Mariusz Felisiak wrote:

> Hi,
>
> Please take a look at existing ticket #5253 
>  which was rejected. We 
> should reach a strong consensus on the mailing list to reopen a closed 
> ticket (see triaging guidelines with regards to wontfix tickets 
> ),
>  
> but I think that Russ' comment 
>  is still valid.
>
> Best,
> Mariusz
>

-- 
You received this message because you are subscribed to the Google Groups 
"Django developers  (Contributions to Django itself)" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-developers+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-developers/fce8a7f9-ef07-4ca1-b32c-d5dbc3345209n%40googlegroups.com.

Re: Model Generation for CSV, XLS Files

2020-11-27 Thread Paolo Melchiorre 
On Fri, Nov 27, 2020 at 5:51 AM Muskan Vaswan  wrote:
> I want to know what functionality already exists that makes it easier to 
> directly load a large data set into a django model from a CSV file (going 
> with the simplest format or now).

Hi Muskan,

In PostgreSQL I use the COPY FROM to load a large set of data directly
into the database table from a CSV file.
https://www.postgresql.org/docs/current/sql-copy.html

In a Django project I used Django Postgres Copy to load 1M lines CSV
file in 1 second:
https://github.com/california-civic-data-coalition/django-postgres-copy

I know my answer is not useful for other supported database backends,
I only tried to share my experience.

Best,
Paolo

-- 
Paolo Melchiorre

https://www.paulox.net

-- 
You received this message because you are subscribed to the Google Groups 
"Django developers  (Contributions to Django itself)" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-developers+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-developers/CAKFO%2Bx6SgAwv%2ByRoCKCYU_vWvuSYfxub_2x2HZESVECWuJ4OaA%40mail.gmail.com.

Re: Model Generation for CSV, XLS Files

2020-11-27 Thread Ryan Gedwill 
I recently developed a feature for my company that allows for mass upload
of users and a few other core models. I did use Django-rest-framework for
the core file upload piece which may not be in the scope of this group, but
it was fairly simple and if you wanted to do it for DSoC it'd be pretty
straightforward. The only part from DRF that would need to be replicated
would be de-serialization of the file.

On Thu, Nov 26, 2020 at 11:08 AM Jon Dufresne 
wrote:

> Is django-import-export at all along the lines of what you're looking for?
>
> https://github.com/django-import-export/django-import-export
>
> > django-import-export is a Django application and library for importing
> and exporting data with included admin integration.
> > ...
> > support multiple formats (Excel, CSV, JSON, ...)
>
> On Wed, Nov 25, 2020 at 11:53 AM Muskan Vaswan 
> wrote:
>
>> Hi everyone,
>> I am Muskan and am very new to this community however not that new to
>> django itself. Contributing to django is something I would really like to
>> do, and I might also be participating in GSoc for the same.
>>
>> I have an vague idea of what I want to fix, because I myself have used
>> django and just want to add things as a developer that I would've wanted as
>> a user. So my question is understanding based around this idea of mine.
>>
>> *I want to know what functionality already exists that makes it easier to
>> directly load a large data set into a django model from a CSV file (going
>> with the simplest format or now).* When I had to do it as a user it took
>> me quite a while and was a lot more complicated than I had expected, after
>> being used to smooth transitions with load data. I could not find any
>> better methods to do it, if there indeed exists no other methods, this is
>> something I would like to work on So this is just to confirm if my
>> research was thorough enough (very possibly wasn't).
>>
>> Thank you! I'm excited to begin helping out!
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Django developers (Contributions to Django itself)" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to django-developers+unsubscr...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/django-developers/a3946181-cd91-4b83-b9d6-d8d8f786b6acn%40googlegroups.com
>> 
>> .
>>
> --
> You received this message because you are subscribed to the Google Groups
> "Django developers (Contributions to Django itself)" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to django-developers+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/django-developers/CADhq2b4Mx902FKtRuB1KHke_7GKSX4e%2BmV%2Bij579WPVN6ec2rg%40mail.gmail.com
> 
> .
>

-- 
You received this message because you are subscribed to the Google Groups 
"Django developers  (Contributions to Django itself)" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-developers+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-developers/CALG8KeC0JMXtEvSG-HZAC0p0PPgFaoFgn5VwCHyHRo0cn3TatQ%40mail.gmail.com.

Re: Model Generation for CSV, XLS Files

2020-11-26 Thread Mariusz Felisiak 
Hi,

Please take a look at existing ticket #5253 
 which was rejected. We should 
reach a strong consensus on the mailing list to reopen a closed ticket (see 
triaging guidelines with regards to wontfix tickets 
),
 
but I think that Russ' comment 
 is still valid.

Best,
Mariusz

-- 
You received this message because you are subscribed to the Google Groups 
"Django developers  (Contributions to Django itself)" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-developers+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-developers/58c868e9-0818-45ca-8be9-537787f5d1b2n%40googlegroups.com.

Re: Model Generation for CSV, XLS Files

2020-11-26 Thread Muskan Vaswan 
Django-import- export is along the lines of what I want to implement, this 
is how i eventually managed to import a csv file as a user there are 
drawbacks to the library, the biggest one being its not the easiest to use 
without admin integration, which isn't always possible in large projects... 
I wanted to implement something similar to loaddata, but for .csv files, or 
.xls files rather than just the dumpdata.json  

```python manage.py dumpdata > dumped_data.json```
and ```python manage.py loaddata < dumped_data.json``` do an Excellent job 
of taking data from existing django models and re using them, I was 
thinking about adding a similar functionality for datasets into models. 

So something like ```*python manage.py loaddata datast.csv .*```
Do you think this would be helpful?

P.S. I'm very new to this so I'm not sure how to go about making a proposal 
in the community etc, so if I'm doing this wrong, please point me to the 
correct direction

On Friday, 27 November 2020 at 00:39:13 UTC+5:30 jon.du...@gmail.com wrote:

> Is django-import-export at all along the lines of what you're looking for?
>
> https://github.com/django-import-export/django-import-export
>
> > django-import-export is a Django application and library for importing 
> and exporting data with included admin integration.
> > ...
> > support multiple formats (Excel, CSV, JSON, ...)
>
> On Wed, Nov 25, 2020 at 11:53 AM Muskan Vaswan  
> wrote:
>
>> Hi everyone,
>> I am Muskan and am very new to this community however not that new to 
>> django itself. Contributing to django is something I would really like to 
>> do, and I might also be participating in GSoc for the same. 
>>
>> I have an vague idea of what I want to fix, because I myself have used 
>> django and just want to add things as a developer that I would've wanted as 
>> a user. So my question is understanding based around this idea of mine. 
>>
>> *I want to know what functionality already exists that makes it easier to 
>> directly load a large data set into a django model from a CSV file (going 
>> with the simplest format or now).* When I had to do it as a user it took 
>> me quite a while and was a lot more complicated than I had expected, after 
>> being used to smooth transitions with load data. I could not find any 
>> better methods to do it, if there indeed exists no other methods, this is 
>> something I would like to work on So this is just to confirm if my 
>> research was thorough enough (very possibly wasn't).
>>
>> Thank you! I'm excited to begin helping out!
>>
>> -- 
>>
> You received this message because you are subscribed to the Google Groups 
>> "Django developers (Contributions to Django itself)" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to django-develop...@googlegroups.com.
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/django-developers/a3946181-cd91-4b83-b9d6-d8d8f786b6acn%40googlegroups.com
>>  
>> 
>> .
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Django developers  (Contributions to Django itself)" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-developers+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-developers/10f21e35-9ff3-42c6-8798-dfd3cda0ecb7n%40googlegroups.com.

Re: Model Generation for CSV, XLS Files

2020-11-26 Thread Jon Dufresne 
Is django-import-export at all along the lines of what you're looking for?

https://github.com/django-import-export/django-import-export

> django-import-export is a Django application and library for importing
and exporting data with included admin integration.
> ...
> support multiple formats (Excel, CSV, JSON, ...)

On Wed, Nov 25, 2020 at 11:53 AM Muskan Vaswan 
wrote:

> Hi everyone,
> I am Muskan and am very new to this community however not that new to
> django itself. Contributing to django is something I would really like to
> do, and I might also be participating in GSoc for the same.
>
> I have an vague idea of what I want to fix, because I myself have used
> django and just want to add things as a developer that I would've wanted as
> a user. So my question is understanding based around this idea of mine.
>
> *I want to know what functionality already exists that makes it easier to
> directly load a large data set into a django model from a CSV file (going
> with the simplest format or now).* When I had to do it as a user it took
> me quite a while and was a lot more complicated than I had expected, after
> being used to smooth transitions with load data. I could not find any
> better methods to do it, if there indeed exists no other methods, this is
> something I would like to work on So this is just to confirm if my
> research was thorough enough (very possibly wasn't).
>
> Thank you! I'm excited to begin helping out!
>
> --
> You received this message because you are subscribed to the Google Groups
> "Django developers (Contributions to Django itself)" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to django-developers+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/django-developers/a3946181-cd91-4b83-b9d6-d8d8f786b6acn%40googlegroups.com
> 
> .
>

-- 
You received this message because you are subscribed to the Google Groups 
"Django developers  (Contributions to Django itself)" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-developers+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-developers/CADhq2b4Mx902FKtRuB1KHke_7GKSX4e%2BmV%2Bij579WPVN6ec2rg%40mail.gmail.com.

Re: Model Generation for CSV, XLS Files

2020-11-26 Thread Muskan Vaswan 
I would like to tackle this singularly first if possible, especially for
gsoc. Hope you understand I appreciate your offer


On Thu, 26 Nov, 2020, 9:25 pm Shoury Sharma,  wrote:

> Hello!
> I'm also looking forward for GSOC'21. If you prefer we could try merging
> this functionalities by submitting patches.
> Regards
>
> On Thu, 26 Nov, 2020, 1:22 am Muskan Vaswan, 
> wrote:
>
>> Hi everyone,
>> I am Muskan and am very new to this community however not that new to
>> django itself. Contributing to django is something I would really like to
>> do, and I might also be participating in GSoc for the same.
>>
>> I have an vague idea of what I want to fix, because I myself have used
>> django and just want to add things as a developer that I would've wanted as
>> a user. So my question is understanding based around this idea of mine.
>>
>> *I want to know what functionality already exists that makes it easier to
>> directly load a large data set into a django model from a CSV file (going
>> with the simplest format or now).* When I had to do it as a user it took
>> me quite a while and was a lot more complicated than I had expected, after
>> being used to smooth transitions with load data. I could not find any
>> better methods to do it, if there indeed exists no other methods, this is
>> something I would like to work on So this is just to confirm if my
>> research was thorough enough (very possibly wasn't).
>>
>> Thank you! I'm excited to begin helping out!
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Django developers (Contributions to Django itself)" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to django-developers+unsubscr...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/django-developers/a3946181-cd91-4b83-b9d6-d8d8f786b6acn%40googlegroups.com
>> 
>> .
>>
> --
> You received this message because you are subscribed to the Google Groups
> "Django developers (Contributions to Django itself)" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to django-developers+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/django-developers/CAO3iMDH0-a59q-7S75cCv2dREqNYk_5vr1V2WTg9nFb3b4qrRQ%40mail.gmail.com
> 
> .
>

-- 
You received this message because you are subscribed to the Google Groups 
"Django developers  (Contributions to Django itself)" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-developers+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-developers/CAOoM%2B4NyokLOnc-fgEGUUCyWK3eSeAV-%3DRN6oc0k7eZSQa_oUA%40mail.gmail.com.

Re: Model Generation for CSV, XLS Files

2020-11-26 Thread Muskan Vaswan 
Thank you all for your response, I really appreciate it. This seems to be a 
very active and helpful community already love django more!

On Thursday, 26 November 2020 at 21:25:30 UTC+5:30 shan...@gmail.com wrote:

> Hello!
> I'm also looking forward for GSOC'21. If you prefer we could try merging 
> this functionalities by submitting patches. 
> Regards
>
> On Thu, 26 Nov, 2020, 1:22 am Muskan Vaswan,  wrote:
>
>> Hi everyone,
>> I am Muskan and am very new to this community however not that new to 
>> django itself. Contributing to django is something I would really like to 
>> do, and I might also be participating in GSoc for the same. 
>>
>> I have an vague idea of what I want to fix, because I myself have used 
>> django and just want to add things as a developer that I would've wanted as 
>> a user. So my question is understanding based around this idea of mine. 
>>
>> *I want to know what functionality already exists that makes it easier to 
>> directly load a large data set into a django model from a CSV file (going 
>> with the simplest format or now).* When I had to do it as a user it took 
>> me quite a while and was a lot more complicated than I had expected, after 
>> being used to smooth transitions with load data. I could not find any 
>> better methods to do it, if there indeed exists no other methods, this is 
>> something I would like to work on So this is just to confirm if my 
>> research was thorough enough (very possibly wasn't).
>>
>> Thank you! I'm excited to begin helping out!
>>
>> -- 
>>
> You received this message because you are subscribed to the Google Groups 
>> "Django developers (Contributions to Django itself)" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to django-develop...@googlegroups.com.
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/django-developers/a3946181-cd91-4b83-b9d6-d8d8f786b6acn%40googlegroups.com
>>  
>> 
>> .
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Django developers  (Contributions to Django itself)" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-developers+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-developers/2dc59790-fa5b-44de-9d12-ca656e317745n%40googlegroups.com.

Re: Model Generation for CSV, XLS Files

2020-11-26 Thread Shoury Sharma 
Hello!
I'm also looking forward for GSOC'21. If you prefer we could try merging
this functionalities by submitting patches.
Regards

On Thu, 26 Nov, 2020, 1:22 am Muskan Vaswan,  wrote:

> Hi everyone,
> I am Muskan and am very new to this community however not that new to
> django itself. Contributing to django is something I would really like to
> do, and I might also be participating in GSoc for the same.
>
> I have an vague idea of what I want to fix, because I myself have used
> django and just want to add things as a developer that I would've wanted as
> a user. So my question is understanding based around this idea of mine.
>
> *I want to know what functionality already exists that makes it easier to
> directly load a large data set into a django model from a CSV file (going
> with the simplest format or now).* When I had to do it as a user it took
> me quite a while and was a lot more complicated than I had expected, after
> being used to smooth transitions with load data. I could not find any
> better methods to do it, if there indeed exists no other methods, this is
> something I would like to work on So this is just to confirm if my
> research was thorough enough (very possibly wasn't).
>
> Thank you! I'm excited to begin helping out!
>
> --
> You received this message because you are subscribed to the Google Groups
> "Django developers (Contributions to Django itself)" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to django-developers+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/django-developers/a3946181-cd91-4b83-b9d6-d8d8f786b6acn%40googlegroups.com
> 
> .
>

-- 
You received this message because you are subscribed to the Google Groups 
"Django developers  (Contributions to Django itself)" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-developers+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-developers/CAO3iMDH0-a59q-7S75cCv2dREqNYk_5vr1V2WTg9nFb3b4qrRQ%40mail.gmail.com.

Re: Model Generation for CSV, XLS Files

2020-11-26 Thread Philip Mutua 
Hi Musksan,

You need to implement some functionality to upload the CSV file and read it
then upload data into into database in bulk. You can django has a way to
add multiple objects using bulk_create. Here is a full example I hope it
will help.

https://github.com/pmutua/drf_csv_xlsx_file_upload

On Wed, 25 Nov 2020, 22:52 Muskan Vaswan,  wrote:

> Hi everyone,
> I am Muskan and am very new to this community however not that new to
> django itself. Contributing to django is something I would really like to
> do, and I might also be participating in GSoc for the same.
>
> I have an vague idea of what I want to fix, because I myself have used
> django and just want to add things as a developer that I would've wanted as
> a user. So my question is understanding based around this idea of mine.
>
> *I want to know what functionality already exists that makes it easier to
> directly load a large data set into a django model from a CSV file (going
> with the simplest format or now).* When I had to do it as a user it took
> me quite a while and was a lot more complicated than I had expected, after
> being used to smooth transitions with load data. I could not find any
> better methods to do it, if there indeed exists no other methods, this is
> something I would like to work on So this is just to confirm if my
> research was thorough enough (very possibly wasn't).
>
> Thank you! I'm excited to begin helping out!
>
> --
> You received this message because you are subscribed to the Google Groups
> "Django developers (Contributions to Django itself)" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to django-developers+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/django-developers/a3946181-cd91-4b83-b9d6-d8d8f786b6acn%40googlegroups.com
> 
> .
>

-- 
You received this message because you are subscribed to the Google Groups 
"Django developers  (Contributions to Django itself)" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-developers+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-developers/CAH5sparqCDyBVRB1Dhbd299DqXc%2BUzpNAKy%2BH0z_%3DsLTfwVE2A%40mail.gmail.com.

Re: Model Generation for CSV, XLS Files

2020-11-25 Thread Arvind Nedumaran 

Hi Muskan,

There isn’t anything that directly lets you load a CSV and generate 
models for it as far as I know (I may be wrong).


But check out the Django documentation’s HOWTO on integrating with 
legacy databases - 
https://docs.djangoproject.com/en/3.1/howto/legacy-databases/.


One possible solution for what you’re trying to do may be imagined as 
a flag for the ‘inspectdb’ command that lets you pass a CSV file? 
Just a thought.


Good luck with GSOC.

Onward,
Arvind

On 26 Nov 2020, at 0:30, Muskan Vaswan wrote:


Hi everyone,
I am Muskan and am very new to this community however not that new to
django itself. Contributing to django is something I would really like 
to

do, and I might also be participating in GSoc for the same.

I have an vague idea of what I want to fix, because I myself have used
django and just want to add things as a developer that I would've 
wanted as
a user. So my question is understanding based around this idea of 
mine.


*I want to know what functionality already exists that makes it easier 
to
directly load a large data set into a django model from a CSV file 
(going
with the simplest format or now).* When I had to do it as a user it 
took me
quite a while and was a lot more complicated than I had expected, 
after

being used to smooth transitions with load data. I could not find any
better methods to do it, if there indeed exists no other methods, this 
is

something I would like to work on So this is just to confirm if my
research was thorough enough (very possibly wasn't).

Thank you! I'm excited to begin helping out!

--
You received this message because you are subscribed to the Google 
Groups "Django developers  (Contributions to Django itself)" group.
To unsubscribe from this group and stop receiving emails from it, send 
an email to django-developers+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-developers/a3946181-cd91-4b83-b9d6-d8d8f786b6acn%40googlegroups.com.


--
You received this message because you are subscribed to the Google Groups "Django 
developers  (Contributions to Django itself)" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-developers+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-developers/158EA79E-91F4-4A65-83BD-73B5F81E94B8%40gmail.com.