[GitHub] incubator-metron issue #467: METRON-743: Sort the files when reading results...
Github user kylerichardson commented on the issue: https://github.com/apache/incubator-metron/pull/467 @mmiklavc I ran into the same issue with installing pycapa on quick-dev. My solution was to tweak the playbook to rule the pycapa role as part of the sensor-stubs tag. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-metron issue #467: METRON-743: Sort the files when reading results...
Github user mmiklavc commented on the issue:
https://github.com/apache/incubator-metron/pull/467
Also +1 on this. Ran the script above.
Just a note, the Vagrant quick-dev install for pcap doesn't work via
`vagrant --ansible-tags="pycapa" provision`. Not sure what others have done
here, but I ended up installing manually using the following procedure.
```
# set env vars
export PYCAPA_HOME=/opt/pycapa
export PYTHON27_HOME=/opt/rh/python27/root
# Install these packages via yum (RHEL, CentOS)
yum -y install epel-release centos-release-scl
yum -y install "@Development tools" python27 python27-scldevel
python27-python-virtualenv libpcap-devel libselinux-python
# Setup directories
mkdir $PYCAPA_HOME && chmod 755 $PYCAPA_HOME
# Create virtualenv
export LD_LIBRARY_PATH="/opt/rh/python27/root/usr/lib64"
${PYTHON27_HOME}/usr/bin/virtualenv pycapa-venv
# Copy pycapa
# copy incubator-metron/metron-sensors/pycapa from the Metron source tree
into $PYCAPA_HOME on the node you would like to install pycapa on.
# Build it
cd ${PYCAPA_HOME}/pycapa
# activate the virtualenv
source ${PYCAPA_HOME}/pycapa-venv/bin/activate
pip install -r requirements.txt
python setup.py install
# Run it
cd ${PYCAPA_HOME}/pycapa-venv/bin
pycapa --producer --topic pcap -i eth1 -k node1:6667
```
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-metron issue #467: METRON-743: Sort the files when reading results...
Github user kylerichardson commented on the issue: https://github.com/apache/incubator-metron/pull/467 +1 passes unit and integration tests, ran through @cestella's test script successfully Thanks for your patience and for fixing! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-metron issue #467: METRON-743: Sort the files when reading results...
Github user cestella commented on the issue: https://github.com/apache/incubator-metron/pull/467 Ok, I ran this up and tested it and I got the results I expect, but I'd like some independent confirmation by @kylerichardson --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-metron issue #467: METRON-743: Sort the files when reading results...
Github user ottobackwards commented on the issue: https://github.com/apache/incubator-metron/pull/467 Thank you for clarifying, that makes sense. Sorry to confuse the issue --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-metron issue #467: METRON-743: Sort the files when reading results...
Github user ottobackwards commented on the issue: https://github.com/apache/incubator-metron/pull/467 There are two things here I *think* 1. The test assumptions and the failure on some platforms ( if this is indeed the problem ) 2. What this means for the real use of the pcap query system I think we can address the test first, and may have to discuss the 2. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-metron issue #467: METRON-743: Sort the files when reading results...
Github user ottobackwards commented on the issue: https://github.com/apache/incubator-metron/pull/467 What are the performance penalties of doing this? Part of the discussion in [HADOOP-12009](https://issues.apache.org/jira/browse/HADOOP-12009) that lead to the clarification of this behavior in the spec was about why they don't do this themselves for the performance penalty. Could you get OOM errors or other issues running large queries that would have worked before? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
