[
https://issues.apache.org/jira/browse/SOLR-13621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joel Bernstein updated SOLR-13621:
----------------------------------
Description:
Streaming Expressions and Math Expressions are now mature on the query side.
This includes the ability to query, transform, analyze and visualize data.
It's now time to build the log parsing and loading capabilities.
The design is to have stream sources that read from a file system and stream
decorators that parse different log formats. The data can be further
transformed and joined with other data by stream decorators and sent to any
Solr Cloud collection with the update Stream.
This design also allows Streaming Expressions to perform regex filtering,
aggregations, analysis and visualizations over raw text files. Because of
Streaming Expression built in paralyzation capabilities this allows Solr Cloud
to behave like a massively parallel *grep* engine.
This ticket will track the sub-tickets for the different log formats that will
be supported.
was:
Streaming Expressions and Math Expressions are now mature on the query side.
This includes the ability to query, transform, analyze and visualize data.
It's now time to build the log parsing and loading capabilities.
The design is to have stream sources that read from a file system and stream
decorators that parse different log formats. The data can be further
transformed and joined with other data by stream decorators and sent to any
Solr Cloud collection with the update Stream.
This design also allows Streaming Expressions to perform regex filtering,
aggregations, analysis and visualizations over raw text files.
This ticket will track the sub-tickets for the different log formats that will
be supported.
> Log parsing and loading framework for Streaming Expressions
> -----------------------------------------------------------
>
> Key: SOLR-13621
> URL: https://issues.apache.org/jira/browse/SOLR-13621
> Project: Solr
> Issue Type: New Feature
> Security Level: Public(Default Security Level. Issues are Public)
> Components: streaming expressions
> Reporter: Joel Bernstein
> Assignee: Joel Bernstein
> Priority: Major
>
> Streaming Expressions and Math Expressions are now mature on the query side.
> This includes the ability to query, transform, analyze and visualize data.
> It's now time to build the log parsing and loading capabilities.
> The design is to have stream sources that read from a file system and stream
> decorators that parse different log formats. The data can be further
> transformed and joined with other data by stream decorators and sent to any
> Solr Cloud collection with the update Stream.
> This design also allows Streaming Expressions to perform regex filtering,
> aggregations, analysis and visualizations over raw text files. Because of
> Streaming Expression built in paralyzation capabilities this allows Solr
> Cloud to behave like a massively parallel *grep* engine.
> This ticket will track the sub-tickets for the different log formats that
> will be supported.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
