Re: PostgreSQL JDBC driver configuration?

2017-09-21 Thread Brian Chiu 
Hi Moella,

I have wriiten a Dcokerfile for pio0.11.0+postgres, without hdfs, hbase, ES.
https://github.com/BrianOn99/docker-predictionio

For simplicity I pulled JDBC 42.0.0 because the was the default one
specified in the config (that is not good practice).  To use
postgresql-42.1.4.jar you need to modify
PredictionIO-0.11.0-incubating/conf/pio-env.sh

I am not sure which of your step is wrong, but you can start with my
setup and fine tune it.

Please note that the Dockerfile is not pushed to dockerhub and you
need to build it your self.  And it is not ready for production use.
For a big data application postgreSQL does not scale well with
predictionIO.

If you cannot use docker just get a ubuntu machine and run those
command in Dockerfile.

Brian

On Thu, Sep 21, 2017 at 6:52 PM, Noelia Osés Fernández
 wrote:
> Hi all,
>
> I'm having trouble because I can't seem to get PIO to work with PostgreSQL.
> I've seen the following report:
>
> https://issues.apache.org/jira/browse/PIO-49
>
> PIO-49: PostgreSQL JDBC driver is no longer bundled with the core assembly.
> If you are using PostgreSQL, you must download the JDBC driver and update
> your configuration to point to the correct JDBC driver file.
>
> However, it doesn't say how to update the configuration. How is this done?
>
> When I do 'pio status' I get the following message:
>
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
> [jar:file:/home/VICOMTECH/noses/PredictionIO/apache-predictionio-0.11.0-incubating/PredictionIO-0.11.0-incubating/lib/spark/pio-data-hdfs-assembly-0.11.0-incubating.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/home/VICOMTECH/noses/PredictionIO/apache-predictionio-0.11.0-incubating/PredictionIO-0.11.0-incubating/lib/pio-assembly-0.11.0-incubating.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> [INFO] [Management$] Inspecting PredictionIO...
> [INFO] [Management$] PredictionIO 0.11.0-incubating is installed at
> /home/VICOMTECH/noses/PredictionIO/apache-predictionio-0.11.0-incubating/PredictionIO-0.11.0-incubating
> [INFO] [Management$] Inspecting Apache Spark...
> [INFO] [Management$] Apache Spark is installed at
> /home/VICOMTECH/noses/spark-2.2.0-bin-hadoop2.7
> [INFO] [Management$] Apache Spark 2.2.0 detected (meets minimum requirement
> of 1.3.0)
> [INFO] [Management$] Inspecting storage backend connections...
> [INFO] [Storage$] Verifying Meta Data Backend (Source: PGSQL)...
> [ERROR] [Management$] Unable to connect to all storage backends
> successfully.
> The following shows the error message from the storage backend.
>
> No suitable driver found for jdbc:postgresql://localhost/pio
> (java.sql.SQLException)
>
> Dumping configuration of initialized storage backend sources.
> Please make sure they are correct.
>
> Source Name: PGSQL; Type: jdbc; Configuration: URL ->
> jdbc:postgresql://localhost/pio, PASSWORD -> pio, TYPE -> jdbc, USERNAME ->
> pio
>
>
> Any help pointing towards the correct configuration of the JDBC driver for
> PostgreSQL to work with PIO will be much appreciated! (I have alreade
> downloaded postgresql-42.1.4.jar)
>
> Thank you very much!
> Noelia

Re: PostgreSQL JDBC driver configuration?

2017-09-21 Thread Noelia Osés Fernández 
Thank you Naoki!

I found out that I also had to set the POSTGRES_JDBC_DRIVER variable to the
path of the jar in the pio-env.sh file. I've done that and it's working now.

Thanks!

Regards!

On 21 September 2017 at 16:40, Naoki Takezoe  wrote:

> You have to put the jar file of PostgreSQL JDBC driver in PIO_HOME/lib by
> hand.
>
> 2017/09/21 19:52 "Noelia Osés Fernández" :
>
> Hi all,
>>
>> I'm having trouble because I can't seem to get PIO to work with
>> PostgreSQL.
>> I've seen the following report:
>>
>>
>>
>>
>> *https://issues.apache.org/jira/browse/PIO-49
>> PIO-49: PostgreSQL JDBC
>> driver is no longer bundled with the core assembly. If you are using
>> PostgreSQL, you must download the JDBC driver and update your configuration
>> to point to the correct JDBC driver file.*
>> However, it doesn't say how to update the configuration. How is this done?
>>
>> When I do 'pio status' I get the following message:
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> *SLF4J: Class path contains multiple SLF4J bindings.SLF4J: Found binding
>> in
>> [jar:file:/home/VICOMTECH/noses/PredictionIO/apache-predictionio-0.11.0-incubating/PredictionIO-0.11.0-incubating/lib/spark/pio-data-hdfs-assembly-0.11.0-incubating.jar!/org/slf4j/impl/StaticLoggerBinder.class]SLF4J:
>> Found binding in
>> [jar:file:/home/VICOMTECH/noses/PredictionIO/apache-predictionio-0.11.0-incubating/PredictionIO-0.11.0-incubating/lib/pio-assembly-0.11.0-incubating.jar!/org/slf4j/impl/StaticLoggerBinder.class]SLF4J:
>> See http://www.slf4j.org/codes.html#multiple_bindings
>>  for an
>> explanation.SLF4J: Actual binding is of type
>> [org.slf4j.impl.Log4jLoggerFactory][INFO] [Management$] Inspecting
>> PredictionIO...[INFO] [Management$] PredictionIO 0.11.0-incubating is
>> installed at
>> /home/VICOMTECH/noses/PredictionIO/apache-predictionio-0.11.0-incubating/PredictionIO-0.11.0-incubating[INFO]
>> [Management$] Inspecting Apache Spark...[INFO] [Management$] Apache Spark
>> is installed at /home/VICOMTECH/noses/spark-2.2.0-bin-hadoop2.7[INFO]
>> [Management$] Apache Spark 2.2.0 detected (meets minimum requirement of
>> 1.3.0)[INFO] [Management$] Inspecting storage backend connections...[INFO]
>> [Storage$] Verifying Meta Data Backend (Source: PGSQL)...[ERROR]
>> [Management$] Unable to connect to all storage backends successfully.The
>> following shows the error message from the storage backend.No suitable
>> driver found for jdbc:postgresql://localhost/pio
>> (java.sql.SQLException)Dumping configuration of initialized storage backend
>> sources.Please make sure they are correct.Source Name: PGSQL; Type: jdbc;
>> Configuration: URL -> jdbc:postgresql://localhost/pio, PASSWORD -> pio,
>> TYPE -> jdbc, USERNAME -> pio*
>>
>> Any help pointing towards the correct configuration of the JDBC driver
>> for PostgreSQL to work with PIO will be much appreciated! (I have alreade
>> downloaded postgresql-42.1.4.jar)
>>
>> Thank you very much!
>> Noelia
>>
>


-- 


Noelia Osés Fernández, PhD
Senior Researcher |
Investigadora Senior

no...@vicomtech.org
+[34] 943 30 92 30
Data Intelligence for Energy and
Industrial Processes | Inteligencia
de Datos para Energía y Procesos
Industriales





member of:   

Legal Notice - Privacy policy

Re: PostgreSQL JDBC driver configuration?

2017-09-21 Thread Naoki Takezoe 
You have to put the jar file of PostgreSQL JDBC driver in PIO_HOME/lib by
hand.

2017/09/21 19:52 "Noelia Osés Fernández" :

> Hi all,
>
> I'm having trouble because I can't seem to get PIO to work with PostgreSQL.
> I've seen the following report:
>
>
>
>
> *https://issues.apache.org/jira/browse/PIO-49
> PIO-49: PostgreSQL JDBC
> driver is no longer bundled with the core assembly. If you are using
> PostgreSQL, you must download the JDBC driver and update your configuration
> to point to the correct JDBC driver file.*
> However, it doesn't say how to update the configuration. How is this done?
>
> When I do 'pio status' I get the following message:
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> *SLF4J: Class path contains multiple SLF4J bindings.SLF4J: Found binding
> in
> [jar:file:/home/VICOMTECH/noses/PredictionIO/apache-predictionio-0.11.0-incubating/PredictionIO-0.11.0-incubating/lib/spark/pio-data-hdfs-assembly-0.11.0-incubating.jar!/org/slf4j/impl/StaticLoggerBinder.class]SLF4J:
> Found binding in
> [jar:file:/home/VICOMTECH/noses/PredictionIO/apache-predictionio-0.11.0-incubating/PredictionIO-0.11.0-incubating/lib/pio-assembly-0.11.0-incubating.jar!/org/slf4j/impl/StaticLoggerBinder.class]SLF4J:
> See http://www.slf4j.org/codes.html#multiple_bindings
>  for an
> explanation.SLF4J: Actual binding is of type
> [org.slf4j.impl.Log4jLoggerFactory][INFO] [Management$] Inspecting
> PredictionIO...[INFO] [Management$] PredictionIO 0.11.0-incubating is
> installed at
> /home/VICOMTECH/noses/PredictionIO/apache-predictionio-0.11.0-incubating/PredictionIO-0.11.0-incubating[INFO]
> [Management$] Inspecting Apache Spark...[INFO] [Management$] Apache Spark
> is installed at /home/VICOMTECH/noses/spark-2.2.0-bin-hadoop2.7[INFO]
> [Management$] Apache Spark 2.2.0 detected (meets minimum requirement of
> 1.3.0)[INFO] [Management$] Inspecting storage backend connections...[INFO]
> [Storage$] Verifying Meta Data Backend (Source: PGSQL)...[ERROR]
> [Management$] Unable to connect to all storage backends successfully.The
> following shows the error message from the storage backend.No suitable
> driver found for jdbc:postgresql://localhost/pio
> (java.sql.SQLException)Dumping configuration of initialized storage backend
> sources.Please make sure they are correct.Source Name: PGSQL; Type: jdbc;
> Configuration: URL -> jdbc:postgresql://localhost/pio, PASSWORD -> pio,
> TYPE -> jdbc, USERNAME -> pio*
>
> Any help pointing towards the correct configuration of the JDBC driver for
> PostgreSQL to work with PIO will be much appreciated! (I have alreade
> downloaded postgresql-42.1.4.jar)
>
> Thank you very much!
> Noelia
>

PostgreSQL JDBC driver configuration?

2017-09-21 Thread Noelia Osés Fernández 
Hi all,

I'm having trouble because I can't seem to get PIO to work with PostgreSQL.
I've seen the following report:




*https://issues.apache.org/jira/browse/PIO-49
PIO-49: PostgreSQL JDBC
driver is no longer bundled with the core assembly. If you are using
PostgreSQL, you must download the JDBC driver and update your configuration
to point to the correct JDBC driver file.*
However, it doesn't say how to update the configuration. How is this done?

When I do 'pio status' I get the following message:






















*SLF4J: Class path contains multiple SLF4J bindings.SLF4J: Found binding in
[jar:file:/home/VICOMTECH/noses/PredictionIO/apache-predictionio-0.11.0-incubating/PredictionIO-0.11.0-incubating/lib/spark/pio-data-hdfs-assembly-0.11.0-incubating.jar!/org/slf4j/impl/StaticLoggerBinder.class]SLF4J:
Found binding in
[jar:file:/home/VICOMTECH/noses/PredictionIO/apache-predictionio-0.11.0-incubating/PredictionIO-0.11.0-incubating/lib/pio-assembly-0.11.0-incubating.jar!/org/slf4j/impl/StaticLoggerBinder.class]SLF4J:
See http://www.slf4j.org/codes.html#multiple_bindings
 for an
explanation.SLF4J: Actual binding is of type
[org.slf4j.impl.Log4jLoggerFactory][INFO] [Management$] Inspecting
PredictionIO...[INFO] [Management$] PredictionIO 0.11.0-incubating is
installed at
/home/VICOMTECH/noses/PredictionIO/apache-predictionio-0.11.0-incubating/PredictionIO-0.11.0-incubating[INFO]
[Management$] Inspecting Apache Spark...[INFO] [Management$] Apache Spark
is installed at /home/VICOMTECH/noses/spark-2.2.0-bin-hadoop2.7[INFO]
[Management$] Apache Spark 2.2.0 detected (meets minimum requirement of
1.3.0)[INFO] [Management$] Inspecting storage backend connections...[INFO]
[Storage$] Verifying Meta Data Backend (Source: PGSQL)...[ERROR]
[Management$] Unable to connect to all storage backends successfully.The
following shows the error message from the storage backend.No suitable
driver found for jdbc:postgresql://localhost/pio
(java.sql.SQLException)Dumping configuration of initialized storage backend
sources.Please make sure they are correct.Source Name: PGSQL; Type: jdbc;
Configuration: URL -> jdbc:postgresql://localhost/pio, PASSWORD -> pio,
TYPE -> jdbc, USERNAME -> pio*

Any help pointing towards the correct configuration of the JDBC driver for
PostgreSQL to work with PIO will be much appreciated! (I have alreade
downloaded postgresql-42.1.4.jar)

Thank you very much!
Noelia