Hi Dan,
The example's I spoke of aren't running through a JS engine, they are
being ran through Mongo itself to perform the queries. If you want to
run native JS server side, you'd be better off install NodeJs or
similar. There are a ton of PGP/MongoDB tutorials out there. The main
difference being, you'd be using MongoClient through an ODM most likely.
There's nothing to say one could not have multiple collections; one with
a full string such as the example I did, and another that has each field
broken out by field types. Breaking out the fields has a number of
advantages, particularly for analytics.
I'll tidy up the Bash script I use, and post it as a Gist. You could run
it through MSYS2, Cygwin, or WSL even, as all should have access to
Windows Local Servers. It would take a few changes for Path variables,
but nothing major. I have Apache running on my server as it hosts some
of testing environment. I'll may play around with a PHP form or two and
see how that goes.
73's
Greg, KI7MT
On 7/1/19 3:45 PM, Dan Malcolm wrote:
Because I want to search via my webserver, I have a separate PHP script that
does the search. Probably not as fast as MongoDB. I do get good cohesive
reports though. I get a report for example that will show me just one of my
QSO's, and will store results in a text file. That makes it useful to refer to
later, or to include in an email to my QSO partner.
All that said I would like to explore MongoDB. The idea that query via js
script may mean that I can still have private web access. I use IIS on Win10
and just the local machine can access it.
__________
Dan – K4SHQ
-----Original Message-----
From: Greg Beam [mailto:ki7m...@gmail.com]
Sent: Monday, July 1, 2019 3:47 PM
To: wsjt-devel@lists.sourceforge.net
Subject: Re: [wsjt-devel] ALL.TXT (again)
Hello All,
Here's an example from today's log:
Results: https://paste.ubuntu.com/p/382VVMth4S/
The query takes about (2) seconds or so using a $regex search on
7,390,224 logged events matching two callsigns; this is without being indexed
nor field splitting. It is one string per line imported to a one field document
in MongDB
I can post the script I used as a gist, if anyone is interested:
- Copies the ALL.TXT to $temp_file
- Converts it to CSV
- Generates two helper JS scripts
- Generates one example JS query
- Drops, then re-imports the alltext collection
- Runs the a sample Query.
Note: for incremental (daily) updates, there is no need to drop the collection
(alltext) before inserting new events. I just do that for performance testing.
It's a simple one-line query command that would work on Win/Linux/Mac:
mongo < example.js
You can, if desired, write any number of commands to perform stats, lookup(s),
whatever, and use the same easy method to query the DB.
However, as this is a single sting entry, much of the analytical value would be
missing, as the fields / categories are not captured.
73's
Greg, KI7MT
_______________________________________________
wsjt-devel mailing list
wsjt-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/wsjt-devel
