[weewx-user] Re: Weather Cat daily data in a PDF file - need help to process data

2017-04-23 Thread MRL
Thanks for the post. I have used SQLite and the DB Browser. I may do just do as you suggested. I would also like to import the data into weewx. It might make sense to put the data into a SQLite database before trying to import the data into weewx. I actually coded the python program to

[weewx-user] Re: Weather Cat daily data in a PDF file - need help to process data

2017-04-23 Thread Bob Weber
Glad you got a converter program going. What I have done is use "DB Browser for SQLite" (package sqlitebrowser) to import the csv files into a sqlite database. So it would be much easier if you wrote all the data out to one csv file (use the write append mode when you open the output file in

[weewx-user] Re: Weather Cat daily data in a PDF file - need help to process data

2017-04-23 Thread MRL
Thanks again Bob. I now have a python program to convert the Weather Cat txt file (generated from pdftotext) to a CSV file I am sure sure when I will attempt to convert 900 files. How do I deal with 900 import files or do I need to merge the files into larger files? Marc

[weewx-user] Re: Weather Cat daily data in a PDF file - need help to process data

2017-04-22 Thread MRL
Thanks Bob I have a script that processed the 4 days in April 2017 that I have converting to text files. Hard to believe pdftotext did a better job than Adobe Acrobat Standard 9 (very old). Now to code a python program to transform data. I am thinking of TempHi as temperature, DewPHi as

[weewx-user] Re: Weather Cat daily data in a PDF file - need help to process data

2017-04-21 Thread Bob Weber
That's great. pdftotext just copies the pdf text to the same file name but with a .txt extension. So a second for loop would run your conversion program to create the csv file(s) from each .txt file. You could just create individual csv files or just append to one single file. Either way

[weewx-user] Re: Weather Cat daily data in a PDF file - need help to process data

2017-04-21 Thread MRL
Thanks I will give it a try. I have Ubuntu 16.04.2 running in Virtual Box on my Mac I have about 900 PDF files to convert On Friday, April 21, 2017 at 1:37:14 PM UTC-4, Bob Weber wrote: > > I use Debian linux. It was easy to convert the pdf file to text with the > command "pdftotext -raw

[weewx-user] Re: Weather Cat daily data in a PDF file - need help to process data

2017-04-21 Thread Bob Weber
I use Debian linux. It was easy to convert the pdf file to text with the command "pdftotext -raw file.pdf". It produced a file like this: WeatherCat Daily Report For Jan 1, 2015 Hour TempHiTempLo HeatHi HeatLo ChillHi ChillLo DewPHi DewPLo HumHi HumLo PresHi PresLo R/hHi R/hLo Rain AvWsHi

[weewx-user] Re: Weather Cat daily data in a PDF file - need help to process data

2017-04-21 Thread MRL
Using an old copy of Adobe Acrobat I was able to convert the PDF file to a text file: WeatherCat Daily Report For Jan 1, 2015 Hour 0 TempHiTempLo25.3 24.2 HeatHi HeatLo 25.3 24.2 ChillHi ChillLo 25.3 24.2 DewPHi DewPLo 15.7 12.9 HumHi HumLo 69 60 PresHi 30.20 PresLo 30.18 R/hHi0.00