Re: [RE-wrenches] SD card data processing

[Mac Lewis]

My original stab at this works; its a script based in an open-source
language called R.  It easily handles the large data files.  It will merge
the files, based on device type, pull out error codes etc.  The problem is
that it is cmd line based and is a pain to customize when you are rusty
with code.  I'm looking for something with an easy GUI, and lots of feature
rich graphs that I can show clients without spending hours doing it.

Thanks

On Mon, Aug 7, 2017 at 1:34 PM, Chris Mason 
wrote:

> Probably over qualified.
>
> My consultant for setting up MySQL wind and solar data dumps is a high
>> school kid ;-)
>>
>>
> ___
> List sponsored by Redwood Alliance
>
> List Address: RE-wrenches@lists.re-wrenches.org
>
> Change listserver email address & settings:
> http://lists.re-wrenches.org/options.cgi/re-wrenches-re-wrenches.org
>
> List-Archive: http://www.mail-archive.com/re-wrenches@lists.re-wrenches.
> org/maillist.html
>
> List rules & etiquette:
> www.re-wrenches.org/etiquette.htm
>
> Check out or update participant bios:
> www.members.re-wrenches.org
>
>
>


-- 



Mac Lewis

*"Yo solo sé que no sé nada." -Sócrates*
___
List sponsored by Redwood Alliance

List Address: RE-wrenches@lists.re-wrenches.org

Change listserver email address & settings:
http://lists.re-wrenches.org/options.cgi/re-wrenches-re-wrenches.org

List-Archive: 
http://www.mail-archive.com/re-wrenches@lists.re-wrenches.org/maillist.html

List rules & etiquette:
www.re-wrenches.org/etiquette.htm

Check out or update participant bios:
www.members.re-wrenches.org

Re: [RE-wrenches] SD card data processing

[Dan Fink]

My consultant for setting up MySQL wind and solar data dumps is a high
school kid ;-)

Dan Fink
Professor of Solar Energy Technology, Ecotech Institute
IREC Certified Instructor™ for:
~ PV Installation Professional
~ Small Wind Installer
Executive Director, Buckville Energy
NABCEP Registered Continuing Education Providers™
970.672.4342



On Mon, Aug 7, 2017 at 1:22 PM, Chris Mason 
wrote:

> I would run MySQL on my computer and write a python script to import the
> data to MySQL, and use a front end package to graph the data - it's pretty
> easy to do.
> If that's more than you can handle, go to Guru.com and setup an account,
> describe what yo uwant done, and there's plenty of willing takers that will
> write the code to do it nicely.
>
> On Mon, Aug 7, 2017 at 3:15 PM, Dan Fink  wrote:
>
>>
>> Hi Mac -- yep, at about 50k data points Excel seizes up no matter how
>> fast your computer. You really need to use a database program after that
>> point.
>> I had a friend arrange a web API into MySQL on our server and it works
>> fine.
>>
>>
___
List sponsored by Redwood Alliance

List Address: RE-wrenches@lists.re-wrenches.org

Change listserver email address & settings:
http://lists.re-wrenches.org/options.cgi/re-wrenches-re-wrenches.org

List-Archive: 
http://www.mail-archive.com/re-wrenches@lists.re-wrenches.org/maillist.html

List rules & etiquette:
www.re-wrenches.org/etiquette.htm

Check out or update participant bios:
www.members.re-wrenches.org

Re: [RE-wrenches] SD card data processing

[Chris Mason]

I would run MySQL on my computer and write a python script to import the
data to MySQL, and use a front end package to graph the data - it's pretty
easy to do.
If that's more than you can handle, go to Guru.com and setup an account,
describe what yo uwant done, and there's plenty of willing takers that will
write the code to do it nicely.

On Mon, Aug 7, 2017 at 3:15 PM, Dan Fink  wrote:

>
> Hi Mac -- yep, at about 50k data points Excel seizes up no matter how fast
> your computer. You really need to use a database program after that point.
> I had a friend arrange a web API into MySQL on our server and it works
> fine.
>
> Dan Fink
> Professor of Solar Energy Technology, Ecotech Institute
> IREC Certified Instructor™ for:
> ~ PV Installation Professional
> ~ Small Wind Installer
> Executive Director, Buckville Energy
> NABCEP Registered Continuing Education Providers™
> 970.672.4342
>
>
>
> On Mon, Aug 7, 2017 at 9:17 AM, Mac Lewis  wrote:
>
>> Hi Wrenches,
>>
>> I am getting more and more zipped up SD card data emailed from clients
>> from their Outback Mate 3s, Sunny Islands and other systems that we have
>> out there.  The data can be very laborious to process and will crash Excel
>> most of the time because of the sheer quantity of data.  Also oftentimes,
>> you need to merge these data sets to get a true picture of how these power
>> systems are functioning.
>>
>> Do you have recommendations for 3rd party programs to help process and
>> analyse this data?  I am looking closely at WattPlot SunMate to use with
>> the Outback stuff.  Maybe there is a better way?  I'm interested in any
>> feedback about WattPlot products in general as well.
>>
>> Thanks in advance
>>
>> --
>>
>>
>>
>> Mac Lewis
>>
>> *"Yo solo sé que no sé nada." -Sócrates*
>>
>
>
> ___
> List sponsored by Redwood Alliance
>
> List Address: RE-wrenches@lists.re-wrenches.org
>
> Change listserver email address & settings:
> http://lists.re-wrenches.org/options.cgi/re-wrenches-re-wrenches.org
>
> List-Archive: http://www.mail-archive.com/re-wrenches@lists.re-wrenches.
> org/maillist.html
>
> List rules & etiquette:
> www.re-wrenches.org/etiquette.htm
>
> Check out or update participant bios:
> www.members.re-wrenches.org
>
>
>


-- 
Chris Mason
NABCEP Certified Solar PV Installer™
Solar Design Engineer
Generac Generators Industrial technician

www.cometsolar.com 
264.235.5670
869.662.5670
Skype: netconcepts
___
List sponsored by Redwood Alliance

List Address: RE-wrenches@lists.re-wrenches.org

Change listserver email address & settings:
http://lists.re-wrenches.org/options.cgi/re-wrenches-re-wrenches.org

List-Archive: 
http://www.mail-archive.com/re-wrenches@lists.re-wrenches.org/maillist.html

List rules & etiquette:
www.re-wrenches.org/etiquette.htm

Check out or update participant bios:
www.members.re-wrenches.org

Re: [RE-wrenches] SD card data processing

[Dan Fink]

Hi Mac -- yep, at about 50k data points Excel seizes up no matter how fast
your computer. You really need to use a database program after that point.
I had a friend arrange a web API into MySQL on our server and it works fine.

Dan Fink
Professor of Solar Energy Technology, Ecotech Institute
IREC Certified Instructor™ for:
~ PV Installation Professional
~ Small Wind Installer
Executive Director, Buckville Energy
NABCEP Registered Continuing Education Providers™
970.672.4342



On Mon, Aug 7, 2017 at 9:17 AM, Mac Lewis  wrote:

> Hi Wrenches,
>
> I am getting more and more zipped up SD card data emailed from clients
> from their Outback Mate 3s, Sunny Islands and other systems that we have
> out there.  The data can be very laborious to process and will crash Excel
> most of the time because of the sheer quantity of data.  Also oftentimes,
> you need to merge these data sets to get a true picture of how these power
> systems are functioning.
>
> Do you have recommendations for 3rd party programs to help process and
> analyse this data?  I am looking closely at WattPlot SunMate to use with
> the Outback stuff.  Maybe there is a better way?  I'm interested in any
> feedback about WattPlot products in general as well.
>
> Thanks in advance
>
> --
>
>
>
> Mac Lewis
>
> *"Yo solo sé que no sé nada." -Sócrates*
>
___
List sponsored by Redwood Alliance

List Address: RE-wrenches@lists.re-wrenches.org

Change listserver email address & settings:
http://lists.re-wrenches.org/options.cgi/re-wrenches-re-wrenches.org

List-Archive: 
http://www.mail-archive.com/re-wrenches@lists.re-wrenches.org/maillist.html

List rules & etiquette:
www.re-wrenches.org/etiquette.htm

Check out or update participant bios:
www.members.re-wrenches.org

[RE-wrenches] SD card data processing

[Mac Lewis]

Hi Wrenches,

I am getting more and more zipped up SD card data emailed from clients from
their Outback Mate 3s, Sunny Islands and other systems that we have out
there.  The data can be very laborious to process and will crash Excel most
of the time because of the sheer quantity of data.  Also oftentimes, you
need to merge these data sets to get a true picture of how these power
systems are functioning.

Do you have recommendations for 3rd party programs to help process and
analyse this data?  I am looking closely at WattPlot SunMate to use with
the Outback stuff.  Maybe there is a better way?  I'm interested in any
feedback about WattPlot products in general as well.

Thanks in advance

-- 



Mac Lewis

*"Yo solo sé que no sé nada." -Sócrates*
___
List sponsored by Redwood Alliance

List Address: RE-wrenches@lists.re-wrenches.org

Change listserver email address & settings:
http://lists.re-wrenches.org/options.cgi/re-wrenches-re-wrenches.org

List-Archive: 
http://www.mail-archive.com/re-wrenches@lists.re-wrenches.org/maillist.html

List rules & etiquette:
www.re-wrenches.org/etiquette.htm

Check out or update participant bios:
www.members.re-wrenches.org