[2/5] metron git commit: METRON-1776: Update public web site to point at 0.6.0 new release
http://git-wip-us.apache.org/repos/asf/metron/blob/0bea5bdb/current-book/metron-platform/metron-solr/index.html
--
diff --git a/current-book/metron-platform/metron-solr/index.html
b/current-book/metron-platform/metron-solr/index.html
new file mode 100644
index 000..1afb245
--- /dev/null
+++ b/current-book/metron-platform/metron-solr/index.html
@@ -0,0 +1,300 @@
+
+
+http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en">
+
+
+
+
+
+Metron – Solr in Metron
+
+
+
+
+
+ $( document ).ready( function() { $( '.carousel' ).carousel( {
interval: 3500 } ) } );
+
+
+
+
+
+http://metron.apache.org/";
id="bannerLeft">
+
+
+
+
+
+
+ http://www.apache.org"; class="externalLink"
title="Apache">Apache/
+ http://metron.apache.org/"; class="externalLink"
title="Metron">Metron/
+ Documentation/
+Solr in Metron
+|
Last Published: 2018-09-12
+ Version: 0.6.0
+
+
+
+
+
+
+ User Documentation
+Metron
+
+CONTRIBUTING
+Upgrading
+Analytics
+Docker
+Performance
+Deployment
+Alerts
+Config
+Rest
+Platform
+
+Performance-tuning-guide
+Common
+Data-management
+Elasticsearch
+Enrichment
+Indexing
+Job
+Management
+Parsers
+Pcap-backend
+Solr
+Writer
+
+
+Sensors
+Stellar-3rd-party-example
+Stellar-common
+Stellar-zeppelin
+Use-cases
+
+
+
+
+
+
+
+
+
+http://maven.apache.org/"; title="Built by Maven"
class="poweredBy">
+
+
+
+
+
+Solr in Metron
+
+
+Table of Contents
+
+
+Introduction
+Configuration
+Installing
+Schemas
+Collections
+
+
+Introduction
+Metron ships with Solr 6.6.2 support. Solr Cloud can be used as the
real-time portion of the datastore resulting from metron-indexing.
+
+Configuration
+
+The Indexing Topology
+Solr is a viable option for the random access topology and,
similar to the Elasticsearch Writer, can be configured via the global config.
The following settings are possible as part of the global config:
+
+
+solr.zookeeper
+
+
+The zookeeper quorum associated with the SolrCloud instance. This is a
required field with no default.
+
+
+solr.commitPerBatch
+
+
+This is a boolean which defines whether the writer commits every batch.
The default is true.
+WARNING: If you set this to false, then commits will
happen based on the SolrClient’s internal mechanism and worker failure
may result data being acknowledged in storm but not written in Solr.
+
+
+solr.commit.soft
+
+
+This is a boolean which defines whether the writer makes a soft commit or
a durable commit. See https://lucene.apache.org/solr/guide/6_6/near-real-time-searching.html#NearRealTimeSearching-AutoCommits";>here
The default is false.
+WARNING: If you set this to true, then commits will happen
based on the SolrClient’s internal mechanism and worker failure
may result data being acknowledged in storm but not written in Solr.
+
+
+solr.commit.waitSearcher
+
+
+This is a boolean which defines whether the writer blocks the commit until
the data is available to search. See https://lucene.apache.org/solr/guide/6_6/near-real-time-searching.html#NearRealTimeSearching-AutoCommits";>here
The default is true.
+WARNING: If you set this to false, then commits will
happen based on the SolrClient’s internal mechanism and worker failure
may result data being acknowledged in storm but not written in Solr.
+
+
+solr.commit.waitFlush
+
+
+This is a boolean which defines whether the writer blocks the commit until
the data is flushed. See https://lucene.apache.org/solr/guide/6_6/near-real-time-searching.html#NearRealTimeSearching-AutoCommits";>here
The default is true.
+WARNING: If you set this to false, then commits will
happen based on the SolrClient’s internal mechanism and worker failure
may result data being acknowledged in storm but not written in Solr.
+
+
+solr.collection
+
+
+The default solr collection (if unspecified, the name is metron).
By default, sensors will write to a collection associated with the index name
in the indexing config for that sensor. If that index name is the empty
string, then the default collection will be used.
+
+
+solr.http.config
+
+
+This is a map which allows users to configure the Solr client’s
HTTP client.
+Possible fields here are:
+
+
+socketTimeout : Socket timeout measured in ms, closes a socket if
read takes longer than x ms to complete throws
java.net.SocketTimeoutException: Read timed out exception
+connTimeout : Connection timeout measures in ms, closes a socket
if connection cannot be established within x ms with a
java.net.SocketTimeoutException: Connection timed out
+maxConection
[2/5] metron git commit: METRON-1776 Update public web site to point at 0.6.0 new release (justinleet) closes apache/metron#1195
http://git-wip-us.apache.org/repos/asf/metron/blob/a97e575f/site/current-book/metron-platform/metron-pcap-backend/index.html -- diff --git a/site/current-book/metron-platform/metron-pcap-backend/index.html b/site/current-book/metron-platform/metron-pcap-backend/index.html index 5206fd0..e1c3000 100644 --- a/site/current-book/metron-platform/metron-pcap-backend/index.html +++ b/site/current-book/metron-platform/metron-pcap-backend/index.html @@ -1,13 +1,13 @@ http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> - + Metron – Metron PCAP Backend @@ -32,8 +32,8 @@ http://metron.apache.org/"; class="externalLink" title="Metron">Metron/ Documentation/ Metron PCAP Backend -| Last Published: 2018-06-07 - Version: 0.5.0 +| Last Published: 2018-09-12 + Version: 0.6.0 @@ -55,15 +55,16 @@ Platform Performance-tuning-guide -Api Common Data-management Elasticsearch Enrichment Indexing +Job Management Parsers Pcap-backend +Solr Writer @@ -227,12 +228,14 @@ limitations under the License. -nr,--num_reducersThe number of reducers to use. Default is 10. -h,--help Display help + -ps,--print_status Print the status of the job as it runs -ir,--include_reverse Indicates if filter should check swapped src/dest addresses and IPs -p,--protocol IP Protocol -sa,--ip_src_addr Source IP address -sp,--ip_src_port Source port -st,--start_time (required) Packet start time range. + -yq,--yarn_queue Yarn queue this job will be submitted to @@ -250,8 +253,10 @@ limitations under the License. -nr,--num_reducers The number of reducers to use. Default is 10. -h,--help Display help + -ps,--print_status Print the status of the job as it runs -q,--query Query string to use as a filter -st,--start_time (required) Packet start time range. + -yq,--yarn_queue Yarn queue this job will be submitted to The Query filter’s --query argument specifies the Stellar expression to execute on each packet. To interact with the packet, a few variables are exposed: http://git-wip-us.apache.org/repos/asf/metron/blob/a97e575f/site/current-book/metron-platform/metron-solr/index.html -- diff --git a/site/current-book/metron-platform/metron-solr/index.html b/site/current-book/metron-platform/metron-solr/index.html new file mode 100644 index 000..1afb245 --- /dev/null +++ b/site/current-book/metron-platform/metron-solr/index.html @@ -0,0 +1,300 @@ + + +http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> + + + + + +Metron – Solr in Metron + + + + + + $( document ).ready( function() { $( '.carousel' ).carousel( { interval: 3500 } ) } ); + + + + + +http://metron.apache.org/"; id="bannerLeft"> + + + + + + + http://www.apache.org"; class="externalLink" title="Apache">Apache/ + http://metron.apache.org/"; class="externalLink" title="Metron">Metron/ + Documentation/ +Solr in Metron +| Last Published: 2018-09-12 + Version: 0.6.0 + + + + + + + User Documentation +Metron + +CONTRIBUTING +Upgrading +Analytics +Docker +Performance +Deployment +Alerts +Config +Rest +Platform + +Performance-tuning-guide +Common +Data-management +Elasticsearch +Enrichment +Indexing +Job +Management +Parsers +Pcap-backend +Solr +Writer + + +Sensors +Stellar-3rd-party-example +Stellar-common +Stellar-zeppelin +Use-cases + + + + + + + + + +http://maven.apache.org/"; title="Built by Maven" class="poweredBy"> + + + + + +Solr in Metron + + +Table of Contents + + +Introduction +Configuration +Installing +Schemas +Collections + + +Introduction +Metron ships with Solr 6.6.2 support. Solr Cloud can be used as the real-time portion of the datastore resulting from metron-indexing. + +Configuration + +The Indexing Topology +Solr is a viable option for the random access topology and, similar to the Elasticsearch Writer, can be configured via the global config. The following settings are possible as part of the global config: + + +solr.zookeeper + + +The zooke
