[jira] [Closed] (SPARK-8327) Ganglia failed to start while starting standalone on EC 2 spark with spark-ec2
[
https://issues.apache.org/jira/browse/SPARK-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vladimir Vladimirov closed SPARK-8327.
--
Resolution: Not A Problem
> Ganglia failed to start while starting standalone on EC 2 spark with
> spark-ec2
> ---
>
> Key: SPARK-8327
> URL: https://issues.apache.org/jira/browse/SPARK-8327
> Project: Spark
> Issue Type: Bug
> Components: EC2
>Affects Versions: 1.3.1
>Reporter: Vladimir Vladimirov
>Priority: Minor
>
> exception shown
> {code}
> [FAILED] Starting httpd: httpd: Syntax error on line 199 of
> /etc/httpd/conf/httpd.conf: Cannot load modules/libphp-5.5.so into server:
> /etc/httpd/modules/libphp-5.5.so: cannot open shared object file: No such
> file or directory [FAILED]
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-10535) Support for recommendUsersForProducts and recommendProductsForUsers in matrix factorization model for PySpark
Vladimir Vladimirov created SPARK-10535: --- Summary: Support for recommendUsersForProducts and recommendProductsForUsers in matrix factorization model for PySpark Key: SPARK-10535 URL: https://issues.apache.org/jira/browse/SPARK-10535 Project: Spark Issue Type: Improvement Components: MLlib, PySpark Affects Versions: 1.4.1 Reporter: Vladimir Vladimirov Scala and Java API provides recommendUsersForProducts recommendProductsForUsers methods, but PySpark MLlib API doesn't have them. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-10535) Support for recommendUsersForProducts and recommendProductsForUsers in matrix factorization model for PySpark
[ https://issues.apache.org/jira/browse/SPARK-10535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Vladimirov updated SPARK-10535: Affects Version/s: 1.5.0 > Support for recommendUsersForProducts and recommendProductsForUsers in > matrix factorization model for PySpark > -- > > Key: SPARK-10535 > URL: https://issues.apache.org/jira/browse/SPARK-10535 > Project: Spark > Issue Type: Improvement > Components: MLlib, PySpark >Affects Versions: 1.4.1, 1.5.0 >Reporter: Vladimir Vladimirov > > Scala and Java API provides recommendUsersForProducts > recommendProductsForUsers methods, but PySpark MLlib API doesn't have them. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-8338) Ganglia fails to start
[
https://issues.apache.org/jira/browse/SPARK-8338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vladimir Vladimirov updated SPARK-8338:
---
Summary: Ganglia fails to start (was: Ganglia fails to run because of
httpd.conf configuration mismatch)
Ganglia fails to start
--
Key: SPARK-8338
URL: https://issues.apache.org/jira/browse/SPARK-8338
Project: Spark
Issue Type: Bug
Components: EC2
Affects Versions: 1.4.0
Reporter: Vladimir Vladimirov
Priority: Minor
Exception
{code}
Starting httpd: httpd: Syntax error on line 154 of
/etc/httpd/conf/httpd.conf: Cannot load /etc/httpd/modules/mod_authz_core.so
into server: /etc/httpd/modules/mod_authz_core.so: cannot open shared object
file: No such file or directory
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8338) Ganglia fails to run because of httpd.conf configuration mismatch
[
https://issues.apache.org/jira/browse/SPARK-8338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14659218#comment-14659218
]
Vladimir Vladimirov commented on SPARK-8338:
The following PR resolves the issue
https://github.com/mesos/spark-ec2/pull/133
Ganglia fails to run because of httpd.conf configuration mismatch
-
Key: SPARK-8338
URL: https://issues.apache.org/jira/browse/SPARK-8338
Project: Spark
Issue Type: Bug
Components: EC2
Affects Versions: 1.4.0
Reporter: Vladimir Vladimirov
Priority: Minor
Exception
{code}
Starting httpd: httpd: Syntax error on line 154 of
/etc/httpd/conf/httpd.conf: Cannot load /etc/httpd/modules/mod_authz_core.so
into server: /etc/httpd/modules/mod_authz_core.so: cannot open shared object
file: No such file or directory
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-8528) Add applicationId to SparkContext object in pyspark
[ https://issues.apache.org/jira/browse/SPARK-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Vladimirov updated SPARK-8528: --- Description: It is available in Scala API. Our use case - we want to log applicationId (YARN in hour case) to request help with troubleshooting from the DevOps if our app had failed. was: It is available in Scala API. Our use case - we want to log applicationId (YARN in hour case) to request help with troubleshooting from the DevOps Add applicationId to SparkContext object in pyspark --- Key: SPARK-8528 URL: https://issues.apache.org/jira/browse/SPARK-8528 Project: Spark Issue Type: Improvement Components: PySpark Affects Versions: 1.4.0 Reporter: Vladimir Vladimirov Priority: Minor It is available in Scala API. Our use case - we want to log applicationId (YARN in hour case) to request help with troubleshooting from the DevOps if our app had failed. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-8528) Add applicationId to SparkContext object in pyspark
[ https://issues.apache.org/jira/browse/SPARK-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Vladimirov updated SPARK-8528: --- Description: It is available in Scala API. Our use case - we want to log applicationId (YARN in hour case) to request help with troubleshooting from the DevOps was:It is available in Scala API Add applicationId to SparkContext object in pyspark --- Key: SPARK-8528 URL: https://issues.apache.org/jira/browse/SPARK-8528 Project: Spark Issue Type: Improvement Components: PySpark Affects Versions: 1.4.0 Reporter: Vladimir Vladimirov Priority: Minor It is available in Scala API. Our use case - we want to log applicationId (YARN in hour case) to request help with troubleshooting from the DevOps -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-8528) Add applicationId to SparkContext object in pyspark
[ https://issues.apache.org/jira/browse/SPARK-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Vladimirov updated SPARK-8528: --- Description: It is available in Scala API Add applicationId to SparkContext object in pyspark --- Key: SPARK-8528 URL: https://issues.apache.org/jira/browse/SPARK-8528 Project: Spark Issue Type: Improvement Components: PySpark Affects Versions: 1.4.0 Reporter: Vladimir Vladimirov Priority: Minor It is available in Scala API -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-8528) Add applicationId to SparkContext object in pyspark
Vladimir Vladimirov created SPARK-8528: -- Summary: Add applicationId to SparkContext object in pyspark Key: SPARK-8528 URL: https://issues.apache.org/jira/browse/SPARK-8528 Project: Spark Issue Type: Improvement Components: PySpark Affects Versions: 1.4.0 Reporter: Vladimir Vladimirov Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-8327) Ganglia failed to start while starting standalone on EC 2 spark with spark-ec2
[
https://issues.apache.org/jira/browse/SPARK-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vladimir Vladimirov updated SPARK-8327:
---
Affects Version/s: (was: 1.4.0)
Ganglia failed to start while starting standalone on EC 2 spark with
spark-ec2
---
Key: SPARK-8327
URL: https://issues.apache.org/jira/browse/SPARK-8327
Project: Spark
Issue Type: Bug
Components: EC2
Affects Versions: 1.3.1
Reporter: Vladimir Vladimirov
Priority: Minor
exception shown
{code}
[FAILED] Starting httpd: httpd: Syntax error on line 199 of
/etc/httpd/conf/httpd.conf: Cannot load modules/libphp-5.5.so into server:
/etc/httpd/modules/libphp-5.5.so: cannot open shared object file: No such
file or directory [FAILED]
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-8338) Ganglia fails to run because of broken httpd.conf configuration
Vladimir Vladimirov created SPARK-8338:
--
Summary: Ganglia fails to run because of broken httpd.conf
configuration
Key: SPARK-8338
URL: https://issues.apache.org/jira/browse/SPARK-8338
Project: Spark
Issue Type: Bug
Components: EC2
Affects Versions: 1.4.0
Reporter: Vladimir Vladimirov
Exception
{code}
Starting httpd: httpd: Syntax error on line 154 of /etc/httpd/conf/httpd.conf:
Cannot load /etc/httpd/modules/mod_authz_core.so into server:
/etc/httpd/modules/mod_authz_core.so: cannot open shared object file: No such
file or directory
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Comment Edited] (SPARK-8338) Ganglia fails to run because of broken httpd.conf configuration
[
https://issues.apache.org/jira/browse/SPARK-8338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14584344#comment-14584344
]
Vladimir Vladimirov edited comment on SPARK-8338 at 6/13/15 12:59 AM:
--
There are several possible solutions
- downgrade httpd.conf to Feb 2013 commit
(https://github.com/mesos/spark-ec2/commit/1a1c65c15f23dc3be5a45a43f7cd1bf1378d6436)
- remove old ganglia and related packages and instal new ones (ganglia-web 3.5)
(and reinstall configuration)
- recreate AMI to have newer ganglia 3.5 or 3.6 (ganglia 3.3 dated Apr 2013)
was (Author: vvladymyrov):
There are several possible solutions
- downgrade httpd.conf (and potentially ganglia configuration too)
- remove old ganglia and related packages and instal new ones (ganglia-web 3.5)
(and reinstall configuration)
- recreate AMI to have newer ganglia (ganglia 3.3 dated Apr 2013)
Ganglia fails to run because of broken httpd.conf configuration
---
Key: SPARK-8338
URL: https://issues.apache.org/jira/browse/SPARK-8338
Project: Spark
Issue Type: Bug
Components: EC2
Affects Versions: 1.4.0
Reporter: Vladimir Vladimirov
Exception
{code}
Starting httpd: httpd: Syntax error on line 154 of
/etc/httpd/conf/httpd.conf: Cannot load /etc/httpd/modules/mod_authz_core.so
into server: /etc/httpd/modules/mod_authz_core.so: cannot open shared object
file: No such file or directory
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-8338) Ganglia fails to run because of httpd.conf configuration mismatch
[
https://issues.apache.org/jira/browse/SPARK-8338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vladimir Vladimirov updated SPARK-8338:
---
Summary: Ganglia fails to run because of httpd.conf configuration mismatch
(was: Ganglia fails to run because of broken httpd.conf configuration)
Ganglia fails to run because of httpd.conf configuration mismatch
-
Key: SPARK-8338
URL: https://issues.apache.org/jira/browse/SPARK-8338
Project: Spark
Issue Type: Bug
Components: EC2
Affects Versions: 1.4.0
Reporter: Vladimir Vladimirov
Priority: Minor
Exception
{code}
Starting httpd: httpd: Syntax error on line 154 of
/etc/httpd/conf/httpd.conf: Cannot load /etc/httpd/modules/mod_authz_core.so
into server: /etc/httpd/modules/mod_authz_core.so: cannot open shared object
file: No such file or directory
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8338) Ganglia fails to run because of broken httpd.conf configuration
[
https://issues.apache.org/jira/browse/SPARK-8338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14584344#comment-14584344
]
Vladimir Vladimirov commented on SPARK-8338:
There are several possible solutions
- downgrade httpd.conf (and potentially ganglia configuration too)
- remove old ganglia and related packages and instal new ones (ganglia-web 3.5)
(and reinstall configuration)
- recreate AMI to have newer ganglia (ganglia 3.3 dated Apr 2013)
Ganglia fails to run because of broken httpd.conf configuration
---
Key: SPARK-8338
URL: https://issues.apache.org/jira/browse/SPARK-8338
Project: Spark
Issue Type: Bug
Components: EC2
Affects Versions: 1.4.0
Reporter: Vladimir Vladimirov
Exception
{code}
Starting httpd: httpd: Syntax error on line 154 of
/etc/httpd/conf/httpd.conf: Cannot load /etc/httpd/modules/mod_authz_core.so
into server: /etc/httpd/modules/mod_authz_core.so: cannot open shared object
file: No such file or directory
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8338) Ganglia fails to run because of broken httpd.conf configuration
[
https://issues.apache.org/jira/browse/SPARK-8338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14584341#comment-14584341
]
Vladimir Vladimirov commented on SPARK-8338:
Same exception happens for both branch-1.3 (default) and branch-1.4 of the
mesos/spark-ec2
Root cause - AMI contains preinstall ganglia-web 3.3 with httpd22 - its modules
doesn't match templates/httpd.conf which is written for newer httpd24.
Ganglia fails to run because of broken httpd.conf configuration
---
Key: SPARK-8338
URL: https://issues.apache.org/jira/browse/SPARK-8338
Project: Spark
Issue Type: Bug
Components: EC2
Affects Versions: 1.4.0
Reporter: Vladimir Vladimirov
Exception
{code}
Starting httpd: httpd: Syntax error on line 154 of
/etc/httpd/conf/httpd.conf: Cannot load /etc/httpd/modules/mod_authz_core.so
into server: /etc/httpd/modules/mod_authz_core.so: cannot open shared object
file: No such file or directory
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-8338) Ganglia fails to run because of broken httpd.conf configuration
[
https://issues.apache.org/jira/browse/SPARK-8338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vladimir Vladimirov updated SPARK-8338:
---
Priority: Minor (was: Major)
Ganglia fails to run because of broken httpd.conf configuration
---
Key: SPARK-8338
URL: https://issues.apache.org/jira/browse/SPARK-8338
Project: Spark
Issue Type: Bug
Components: EC2
Affects Versions: 1.4.0
Reporter: Vladimir Vladimirov
Priority: Minor
Exception
{code}
Starting httpd: httpd: Syntax error on line 154 of
/etc/httpd/conf/httpd.conf: Cannot load /etc/httpd/modules/mod_authz_core.so
into server: /etc/httpd/modules/mod_authz_core.so: cannot open shared object
file: No such file or directory
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8338) Ganglia fails to run because of httpd.conf configuration mismatch
[
https://issues.apache.org/jira/browse/SPARK-8338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14584379#comment-14584379
]
Vladimir Vladimirov commented on SPARK-8338:
Here are PRs for branches 1.3 and 1.4 that uninstalls old ganglia and installs
newer one
https://github.com/mesos/spark-ec2/pull/122
https://github.com/mesos/spark-ec2/pull/121
Ganglia fails to run because of httpd.conf configuration mismatch
-
Key: SPARK-8338
URL: https://issues.apache.org/jira/browse/SPARK-8338
Project: Spark
Issue Type: Bug
Components: EC2
Affects Versions: 1.4.0
Reporter: Vladimir Vladimirov
Priority: Minor
Exception
{code}
Starting httpd: httpd: Syntax error on line 154 of
/etc/httpd/conf/httpd.conf: Cannot load /etc/httpd/modules/mod_authz_core.so
into server: /etc/httpd/modules/mod_authz_core.so: cannot open shared object
file: No such file or directory
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8327) Ganglia failed to start while starting standalone on EC 2 spark with spark-ec2
[
https://issues.apache.org/jira/browse/SPARK-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583418#comment-14583418
]
Vladimir Vladimirov commented on SPARK-8327:
Root cause:
ganglia/init.sh script doesn't specify rpm package version for ganglia-web - so
yum install some version of the package and it's dependencies. So when newer
ganglia become available with newer version of required packages - configs in
templates could become invalid (i.e. libphp55.so is not available but
libphp56.so does, or mod_authz_core.so is missing )
Ganglia failed to start while starting standalone on EC 2 spark with
spark-ec2
---
Key: SPARK-8327
URL: https://issues.apache.org/jira/browse/SPARK-8327
Project: Spark
Issue Type: Bug
Components: EC2
Affects Versions: 1.3.1, 1.4.0
Reporter: Vladimir Vladimirov
Priority: Minor
exception with spark 1.4.0
{code}
Stopping httpd:[FAILED]
Starting httpd: httpd: Syntax error on line 154 of
/etc/httpd/conf/httpd.conf: Cannot load /etc/httpd/modules/mod_authz_core.so
into server: /etc/httpd/modules/mod_authz_core.so: cannot open shared object
file: No such file or directory
[FAILED]
{code}
Exception with spark 1.3.1
{code}
[FAILED] Starting httpd: httpd: Syntax error on line 199 of
/etc/httpd/conf/httpd.conf: Cannot load modules/libphp-5.5.so into server:
/etc/httpd/modules/libphp-5.5.so: cannot open shared object file: No such
file or directory [FAILED]
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Comment Edited] (SPARK-8327) Ganglia failed to start while starting standalone on EC 2 spark with spark-ec2
[
https://issues.apache.org/jira/browse/SPARK-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583418#comment-14583418
]
Vladimir Vladimirov edited comment on SPARK-8327 at 6/12/15 4:05 PM:
-
Root cause:
ganglia/init.sh script doesn't specify rpm package version for ganglia-web - so
yum install some version of the package and it's dependencies. So when newer
ganglia become available with newer version of required packages - configs in
templates could become invalid (i.e. libphp55.so is not available but
libphp56.so does)
was (Author: vvladymyrov):
Root cause:
ganglia/init.sh script doesn't specify rpm package version for ganglia-web - so
yum install some version of the package and it's dependencies. So when newer
ganglia become available with newer version of required packages - configs in
templates could become invalid (i.e. libphp55.so is not available but
libphp56.so does, or mod_authz_core.so is missing )
Ganglia failed to start while starting standalone on EC 2 spark with
spark-ec2
---
Key: SPARK-8327
URL: https://issues.apache.org/jira/browse/SPARK-8327
Project: Spark
Issue Type: Bug
Components: EC2
Affects Versions: 1.3.1, 1.4.0
Reporter: Vladimir Vladimirov
Priority: Minor
exception shown
{code}
[FAILED] Starting httpd: httpd: Syntax error on line 199 of
/etc/httpd/conf/httpd.conf: Cannot load modules/libphp-5.5.so into server:
/etc/httpd/modules/libphp-5.5.so: cannot open shared object file: No such
file or directory [FAILED]
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-8327) Ganglia failed to start while starting standalone on EC 2 spark with spark-ec2
[
https://issues.apache.org/jira/browse/SPARK-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vladimir Vladimirov updated SPARK-8327:
---
Description:
exception shown
{code}
[FAILED] Starting httpd: httpd: Syntax error on line 199 of
/etc/httpd/conf/httpd.conf: Cannot load modules/libphp-5.5.so into server:
/etc/httpd/modules/libphp-5.5.so: cannot open shared object file: No such file
or directory [FAILED]
{code}
was:
exception with spark 1.4.0
{code}
Stopping httpd:[FAILED]
Starting httpd: httpd: Syntax error on line 154 of /etc/httpd/conf/httpd.conf:
Cannot load /etc/httpd/modules/mod_authz_core.so into server:
/etc/httpd/modules/mod_authz_core.so: cannot open shared object file: No such
file or directory
[FAILED]
{code}
Exception with spark 1.3.1
{code}
[FAILED] Starting httpd: httpd: Syntax error on line 199 of
/etc/httpd/conf/httpd.conf: Cannot load modules/libphp-5.5.so into server:
/etc/httpd/modules/libphp-5.5.so: cannot open shared object file: No such file
or directory [FAILED]
{code}
Ganglia failed to start while starting standalone on EC 2 spark with
spark-ec2
---
Key: SPARK-8327
URL: https://issues.apache.org/jira/browse/SPARK-8327
Project: Spark
Issue Type: Bug
Components: EC2
Affects Versions: 1.3.1, 1.4.0
Reporter: Vladimir Vladimirov
Priority: Minor
exception shown
{code}
[FAILED] Starting httpd: httpd: Syntax error on line 199 of
/etc/httpd/conf/httpd.conf: Cannot load modules/libphp-5.5.so into server:
/etc/httpd/modules/libphp-5.5.so: cannot open shared object file: No such
file or directory [FAILED]
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-8327) Ganglia failed to start while starting standalone on EC 2 spark with spark-ec2
Vladimir Vladimirov created SPARK-8327:
--
Summary: Ganglia failed to start while starting standalone on EC 2
spark with spark-ec2
Key: SPARK-8327
URL: https://issues.apache.org/jira/browse/SPARK-8327
Project: Spark
Issue Type: Bug
Components: EC2
Affects Versions: 1.4.0, 1.3.1
Reporter: Vladimir Vladimirov
Priority: Minor
exception with spark 1.4.0
{code}
Stopping httpd:[FAILED]
Starting httpd: httpd: Syntax error on line 154 of /etc/httpd/conf/httpd.conf:
Cannot load /etc/httpd/modules/mod_authz_core.so into server:
/etc/httpd/modules/mod_authz_core.so: cannot open shared object file: No such
file or directory
[FAILED]
{code}
Exception with spark 1.3.1
{code}
[FAILED] Starting httpd: httpd: Syntax error on line 199 of
/etc/httpd/conf/httpd.conf: Cannot load modules/libphp-5.5.so into server:
/etc/httpd/modules/libphp-5.5.so: cannot open shared object file: No such file
or directory [FAILED]
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8327) Ganglia failed to start while starting standalone on EC 2 spark with spark-ec2
[
https://issues.apache.org/jira/browse/SPARK-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583400#comment-14583400
]
Vladimir Vladimirov commented on SPARK-8327:
There is a fix for spark 1.3.1 in this pull request
https://github.com/mesos/spark-ec2/pull/118
I'm working on a fix for spark 1.4.0
Ganglia failed to start while starting standalone on EC 2 spark with
spark-ec2
---
Key: SPARK-8327
URL: https://issues.apache.org/jira/browse/SPARK-8327
Project: Spark
Issue Type: Bug
Components: EC2
Affects Versions: 1.3.1, 1.4.0
Reporter: Vladimir Vladimirov
Priority: Minor
exception with spark 1.4.0
{code}
Stopping httpd:[FAILED]
Starting httpd: httpd: Syntax error on line 154 of
/etc/httpd/conf/httpd.conf: Cannot load /etc/httpd/modules/mod_authz_core.so
into server: /etc/httpd/modules/mod_authz_core.so: cannot open shared object
file: No such file or directory
[FAILED]
{code}
Exception with spark 1.3.1
{code}
[FAILED] Starting httpd: httpd: Syntax error on line 199 of
/etc/httpd/conf/httpd.conf: Cannot load modules/libphp-5.5.so into server:
/etc/httpd/modules/libphp-5.5.so: cannot open shared object file: No such
file or directory [FAILED]
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-3278) Isotonic regression
[ https://issues.apache.org/jira/browse/SPARK-3278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355119#comment-14355119 ] Vladimir Vladimirov commented on SPARK-3278: Martin. This would be really nice. Is it possible to run isotonic regression on the data I'll provide? (~150-200M records). The answers I'm looking for - how long it would take to train the model on this data set, how much resources it would take on a cluster and confirm that it won't blow spark. I'll export values in format float1, float2 per line - similar to how it is described in the doc http://people.apache.org/~pwendell/spark-1.3.0-rc1-docs/mllib-isotonic-regression.html ? Where float1 - is between 0 and 1. And float2 - is 0 or 1 Isotonic regression --- Key: SPARK-3278 URL: https://issues.apache.org/jira/browse/SPARK-3278 Project: Spark Issue Type: New Feature Components: MLlib Reporter: Xiangrui Meng Assignee: Martin Zapletal Fix For: 1.3.0 Add isotonic regression for score calibration. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-3278) Isotonic regression
[ https://issues.apache.org/jira/browse/SPARK-3278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353252#comment-14353252 ] Vladimir Vladimirov commented on SPARK-3278: Had anyone benchmarked the performance of Spark Isotonic Regression implementation on big datasets (100 M, 1000M) ? Isotonic regression --- Key: SPARK-3278 URL: https://issues.apache.org/jira/browse/SPARK-3278 Project: Spark Issue Type: New Feature Components: MLlib Reporter: Xiangrui Meng Assignee: Martin Zapletal Fix For: 1.3.0 Add isotonic regression for score calibration. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-5633) pyspark saveAsTextFile support for compression codec
Vladimir Vladimirov created SPARK-5633: -- Summary: pyspark saveAsTextFile support for compression codec Key: SPARK-5633 URL: https://issues.apache.org/jira/browse/SPARK-5633 Project: Spark Issue Type: Improvement Components: PySpark Affects Versions: 1.2.0 Reporter: Vladimir Vladimirov Priority: Minor Scala and Java API allows to provide compression codec with saveAsTextFile(path, codec) PySpark saveAsTextFile API does not support passing codec class. This story is about adding saveAsTextFile(path, codec) support into pyspark. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-5633) pyspark saveAsTextFile support for compression codec
[
https://issues.apache.org/jira/browse/SPARK-5633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308128#comment-14308128
]
Vladimir Vladimirov commented on SPARK-5633:
Here is a workaround before proposed functionality will be accepted:
{code}
def saveAsTextFileCompressed(t, path,
codec=org.apache.hadoop.io.compress.GzipCodec):
def func(split, iterator):
for x in iterator:
if not isinstance(x, basestring):
x = unicode(x)
if isinstance(x, unicode):
x = x.encode(utf-8)
yield x
keyed = t.mapPartitionsWithIndex(func)
keyed._bypass_serializer = True
codecClass = SparkContext._jvm.java.lang.Class.forName(codec)
keyed._jrdd.map(t.ctx._jvm.BytesToString()).saveAsTextFile(path, codecClass)
{code}
pyspark saveAsTextFile support for compression codec
Key: SPARK-5633
URL: https://issues.apache.org/jira/browse/SPARK-5633
Project: Spark
Issue Type: Improvement
Components: PySpark
Affects Versions: 1.2.0
Reporter: Vladimir Vladimirov
Priority: Minor
Scala and Java API allows to provide compression codec with
saveAsTextFile(path, codec)
PySpark saveAsTextFile API does not support passing codec class.
This story is about adding saveAsTextFile(path, codec) support into pyspark.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-5633) pyspark saveAsTextFile support for compression codec
[ https://issues.apache.org/jira/browse/SPARK-5633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308077#comment-14308077 ] Vladimir Vladimirov commented on SPARK-5633: Here is pull request that adds mentioned functionality https://github.com/apache/spark/pull/4403 pyspark saveAsTextFile support for compression codec Key: SPARK-5633 URL: https://issues.apache.org/jira/browse/SPARK-5633 Project: Spark Issue Type: Improvement Components: PySpark Affects Versions: 1.2.0 Reporter: Vladimir Vladimirov Priority: Minor Scala and Java API allows to provide compression codec with saveAsTextFile(path, codec) PySpark saveAsTextFile API does not support passing codec class. This story is about adding saveAsTextFile(path, codec) support into pyspark. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
