Hi Sharad I'm sorry, I haven't ever worked with shapefiles or geopkg files so I'm afraid I don't have expertise in this area. I just had access to these data files, so I passed them on.
On Wed, 6 Dec 2023 at 8:19 am, Sharad Lele <[email protected]> wrote: > Hi Nikhil, Ujaval, and others who responded: > Shiv, my colleague who handles our webgis, tried importing the geopkg > version (which was storing and displaying Devanagari variable names in > QGIS) into postGIS. He says "I used the normal pguploader, shape2posrgis, > and ogr2ogr method". But reports that postGIS does not accept those > variables. > > Any workarounds? > > Sharad > > On Tue, 5 Dec 2023, 17:28 Sharad Lele (शरच्चंद्र लेले), < > [email protected]> wrote: > >> Ok, thanks, Nikhil. Let me see what works at our backend. >> >> Sharad >> >> On 05-Dec-23 16:51, Nikhil VJ wrote: >> >> Hi Sharad, >> >> If you have to import the data into a web-based backend, then your >> programmers will be most comfortable with: GeoJSON format. >> Because : It's a simple text/json format which can even be opened as raw >> text, and so there are many different ways to load it in a program and use >> data from it. >> And this will also support Devnagri columns (which become property keys >> here) same as geopackage. >> >> Another thing to look out for: Ensure that the database being used by the >> backend has the same UTF-8 encoding set. >> >> -- >> Cheers, >> Nikhil VJ >> https://nikhilvj.co.in >> >> >> On Mon, Dec 4, 2023 at 3:56 PM Sharad Lele <[email protected]> wrote: >> >>> Thanks, Ujaval. Yes saving as .geopkg works (saves the field names in >>> full and displays properly upon reopening). This is the only solution that >>> has worked so far. >>> >>> But I am not sure this is going to work for us in this particular >>> situation where we are then using the file in postGIS to display in a >>> webGIS. Let me ask our webGIS person. >>> >>> Sharad >>> >>> On Monday, December 4, 2023 at 3:10:18 PM UTC+5:30 Ujaval Gandhi wrote: >>> >>>> Use the geopackage format. It's a much better modern format without the >>>> limitations of shapefiles. The default encoding would be UTF-8 and it >>>> should work. Tested with a new geopackage layer and it is able to create >>>> column names and values in Devanagri script >>>> https://i.imgur.com/2prELf6.png >>>> <https://mailtrack.io/link/b7757e0a651e8afed7ee4756ff4cbf155cd0a533?url=https%3A%2F%2Fi.imgur.com%2F2prELf6.png&userId=8747767&signature=9f333ff36f736872> >>>> --- >>>> Ujaval Gandhi >>>> Spatial Thoughts >>>> www.spatialthoughts.com >>>> <https://mailtrack.io/link/43de97ab1302774e567fc413805c61bb36bd8af8?url=http%3A%2F%2Fwww.spatialthoughts.com&userId=8747767&signature=904253fcbc9b4da4> >>>> >>>> >>>> >>>> On Mon, Dec 4, 2023 at 2:36 PM Sharad Lele <[email protected]> wrote: >>>> >>>>> The shapefile encoding is set to UTF-8. But any edits to variable >>>>> names only last as long as I don't save the file. Save and reopening >>>>> results in going back to the same truncated/funny display as above [image: >>>>> Screenshot Layer properties.jpeg] >>>>> >>>>> On Monday, December 4, 2023 at 2:17:41 PM UTC+5:30 Dilawar Singh wrote: >>>>> >>>>>> I found this >>>>>> https://gis.stackexchange.com/questions/381308/how-to-change-qgis-3-default-encoding. >>>>>> >>>>>> >>>>>> The file you are loading may have a different encoding that QGIS3. >>>>>> You have to verify this manually and make sure that QGIS3 and file >>>>>> encoding >>>>>> is the same. >>>>>> >>>>>> I am guessing the while QGIS3 is using utf-8, the file that you are >>>>>> loading may be utf-16 encoded. Not sure if there are automated tools that >>>>>> can convert UTF-16 files to UTF8 file while preserving unicode ( >>>>>> https://superuser.com/questions/1786434/convert-utf-16-le-to-utf-8-in-windows-via-command-line >>>>>> ). >>>>>> >>>>>> best, >>>>>> Dilawar >>>>>> >>>>>> >>>>>> >>>>>> ---- On Mon, 04 Dec 2023 14:05:01 +0530 *Sharad Lele >>>>>> <[email protected]>* wrote --- >>>>>> >>>>>> Just to clarify/muddy the situation: I am able to enter long >>>>>> Devanagari text in the District/Jila column without any problems. It is >>>>>> the >>>>>> column/field name itself that I run into problems, which may have to do >>>>>> with the 8 characteri limit? >>>>>> >>>>>> [image: Screenshot QGIS devanagari field names.jpeg] >>>>>> >>>>>> >>>>>> On Monday, December 4, 2023 at 1:57:04 PM UTC+5:30 Sharad Lele wrote: >>>>>> >>>>>> Thanks, Dilawar. The article was very interesting/useful. But for a >>>>>> simpleton like me, the question then is: How do I ensure that QGIS3 in >>>>>> particular is using UTF-8 encoding every time? >>>>>> >>>>>> Sharad >>>>>> >>>>>> On Monday, December 4, 2023 at 1:31:28 PM UTC+5:30 Dilawar Singh >>>>>> wrote: >>>>>> >>>>>> The answer is not going to be simple. >>>>>> >>>>>> Make sure that every time you save or open the file, the application >>>>>> uses encoding utf-8. Microsoft uses another weird encoding called utf-16 >>>>>> ( >>>>>> https://en.wikipedia.org/wiki/UTF-16). Stay away from utf-16 it if >>>>>> you want to copy-paste anything from the web or web-based tools. >>>>>> >>>>>> Long answer: >>>>>> https://www.joelonsoftware.com/2003/10/08/the-absolute-minimum-every-software-developer-absolutely-positively-must-know-about-unicode-and-character-sets-no-excuses/ >>>>>> >>>>>> best, >>>>>> Dilawar >>>>>> >>>>>> >>>>>> >>>>>> ---- On Mon, 04 Dec 2023 13:24:28 +0530 *Sharad Lele >>>>>> <[email protected]>* wrote --- >>>>>> >>>>>> >>>>>> Hi folks, I am using QGIS and I want to create variable names in >>>>>> Devanagari (for instance जिला instead of District). If I create a new >>>>>> column in the attribute table and enter the column name in Devanagari >>>>>> using >>>>>> Microsoft Indic Language Tool on my computer, it seems to work (जिला is >>>>>> shown as the column name). But the moment I save the edits and reopen the >>>>>> attribute table, this gets truncated into something like जिल?. The last >>>>>> character is not really a question mark, something more complex. >>>>>> >>>>>> Any suggestions for making the column names appear and save properly >>>>>> in Devanagari? (The same would be true for Kannada or other scripts, I am >>>>>> sure). >>>>>> >>>>>> Sharad >>>>>> >>>>>> >>>>>> -- >>>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>>> more about us by visiting http://datameet.org >>>>>> --- >>>>>> You received this message because you are subscribed to the Google >>>>>> Groups "datameet" group. >>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>> send an email to [email protected]. >>>>>> To view this discussion on the web visit >>>>>> https://groups.google.com/d/msgid/datameet/b7074482-2d88-4762-8765-eb8b55bee3b0n%40googlegroups.com >>>>>> <https://groups.google.com/d/msgid/datameet/b7074482-2d88-4762-8765-eb8b55bee3b0n%40googlegroups.com?utm_medium=email&utm_source=footer> >>>>>> . >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>>> more about us by visiting http://datameet.org >>>>>> --- >>>>>> You received this message because you are subscribed to the Google >>>>>> Groups "datameet" group. >>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>> send an email to [email protected]. >>>>>> >>>>>> To view this discussion on the web visit >>>>>> https://groups.google.com/d/msgid/datameet/29ffbab3-117a-4a67-8988-ae253db7e2cbn%40googlegroups.com >>>>>> <https://groups.google.com/d/msgid/datameet/29ffbab3-117a-4a67-8988-ae253db7e2cbn%40googlegroups.com?utm_medium=email&utm_source=footer> >>>>>> . >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>> more about us by visiting http://datameet.org >>>>> --- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "datameet" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>> an email to [email protected]. >>>>> >>>> To view this discussion on the web visit >>>>> https://groups.google.com/d/msgid/datameet/bbcbdfe6-6f43-47a9-a84d-c1fd27f65af4n%40googlegroups.com >>>>> <https://groups.google.com/d/msgid/datameet/bbcbdfe6-6f43-47a9-a84d-c1fd27f65af4n%40googlegroups.com?utm_medium=email&utm_source=footer> >>>>> . >>>>> >>>> -- >>> Datameet is a community of Data Science enthusiasts in India. Know more >>> about us by visiting http://datameet.org >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "datameet" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected]. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/datameet/7a1d4771-a606-451b-8f1d-3d706fcbb360n%40googlegroups.com >>> <https://groups.google.com/d/msgid/datameet/7a1d4771-a606-451b-8f1d-3d706fcbb360n%40googlegroups.com?utm_medium=email&utm_source=footer> >>> . >>> >> -- >> Datameet is a community of Data Science enthusiasts in India. Know more >> about us by visiting http://datameet.org >> --- >> You received this message because you are subscribed to a topic in the >> Google Groups "datameet" group. >> To unsubscribe from this topic, visit >> https://groups.google.com/d/topic/datameet/HAOzs0y-lLU/unsubscribe. >> To unsubscribe from this group and all its topics, send an email to >> [email protected]. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/datameet/CAH7jeuMp_SN3Oy9Xagycx8yqAUC9RFE_hoNiSkfR16FWfbmnbg%40mail.gmail.com >> <https://groups.google.com/d/msgid/datameet/CAH7jeuMp_SN3Oy9Xagycx8yqAUC9RFE_hoNiSkfR16FWfbmnbg%40mail.gmail.com?utm_medium=email&utm_source=footer> >> . >> >> >> -- > Datameet is a community of Data Science enthusiasts in India. Know more > about us by visiting http://datameet.org > --- > You received this message because you are subscribed to the Google Groups > "datameet" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/datameet/CAPuYznFbmTB7s4J5uWxpALhEmH1r3otpjzNHp_9FkYbhGqip-w%40mail.gmail.com > <https://groups.google.com/d/msgid/datameet/CAPuYznFbmTB7s4J5uWxpALhEmH1r3otpjzNHp_9FkYbhGqip-w%40mail.gmail.com?utm_medium=email&utm_source=footer> > . > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAGiG-Az_fJP677EPDGrMYdH7uBhS%2B%3D9UqZ3Azyfhb8V6V7WCPQ%40mail.gmail.com.
