This is my POJO class. Can you please tell me what changes should I make into
this.
Thank you,
Jaikit Jilka
----- Original Message -----
From: "Pradeep A. Dalvi" <p...@apache.org>
To: "users" <users@apex.apache.org>
Sent: Tuesday, June 28, 2016 4:56:57 PM
Subject: Re: Jdbcoutputoperator implementation
By adding a string member variable to POJO class. Use that member
variable to send the data to JdbcPOJOOutputOperator.
On Tue, Jun 28, 2016 at 4:34 PM, Jaikit Jilka <jji...@leadferret.com> wrote:
> So how to convert a java string into POJO?
>
> ----- Original Message -----
> From: "Pradeep A. Dalvi" <p...@apache.org>
> To: "users" <users@apex.apache.org>
> Sent: Tuesday, June 28, 2016 4:30:09 PM
> Subject: Re: Jdbcoutputoperator implementation
>
> JdbcPOJOOutputOperator expects data as POJO, whose class name is
> specified using Context.PortContext.TUPLE_CLASS i.e.
> com.mycompany.test.PojoEvent here. Previous operator is probably
> sending String to JdbcPOJOOutputOperator.
>
> On Tue, Jun 28, 2016 at 4:16 PM, Jaikit Jilka <jji...@leadferret.com> wrote:
>> Hello,
>>
>> I am taking data from a .txt file and spliting words and inserting it into
>> database.
>>
>> ----- Original Message -----
>> From: "Pradeep A. Dalvi" <p...@apache.org>
>> To: "users" <users@apex.apache.org>
>> Sent: Tuesday, June 28, 2016 4:12:31 PM
>> Subject: Re: Jdbcoutputoperator implementation
>>
>> What is the type of data emitted by previous operator to
>> JdbcPOJOOutputOperator?
>>
>> On Tue, Jun 28, 2016 at 3:46 PM, Jaikit Jilka <jji...@leadferret.com> wrote:
>>> Hello,
>>>
>>> I am getting an error as follow:
>>>
>>> Stopped running due to an exception. java.lang.ClassCastException:
>>> java.lang.String cannot be cast to com.mycompany.test.PojoEvent
>>> at SC.get(Unknown Source)
>>> at
>>> com.datatorrent.lib.db.jdbc.JdbcPOJOOutputOperator.setStatementParameters(JdbcPOJOOutputOperator.java:175)
>>> at
>>> com.datatorrent.lib.db.jdbc.AbstractJdbcTransactionableOutputOperator.processBatch(AbstractJdbcTransactionableOutputOperator.java:114)
>>> at
>>> com.datatorrent.lib.db.jdbc.AbstractJdbcTransactionableOutputOperator.endWindow(AbstractJdbcTransactionableOutputOperator.java:93)
>>> at
>>> com.datatorrent.stram.engine.GenericNode.processEndWindow(GenericNode.java:145)
>>> at
>>> com.datatorrent.stram.engine.GenericNode.run(GenericNode.java:351)
>>> at
>>> com.datatorrent.stram.engine.StreamingContainer$2.run(StreamingContainer.java:1388)
>>>
>>> I am not sure where to check the cast mismatch. I am inserting a value in
>>> the database.
>>>
>>> Thank You,
>>>
>>> Jaikit Jilka
>>>
>>> ----- Original Message -----
>>> From: "Pradeep A. Dalvi" <p...@apache.org>
>>> To: "users" <users@apex.apache.org>
>>> Sent: Friday, June 24, 2016 4:45:18 PM
>>> Subject: Re: Jdbcoutputoperator implementation
>>>
>>> What are errors/exceptions seen in JdbcOutput container logs?
>>> Are you setting Context.PortContext.TUPLE_CLASS to POJO class being used?
>>>
>>> --
>>> prad
>>>
>>> On Fri, Jun 24, 2016 at 2:13 PM, Jaikit Jilka <jji...@leadferret.com> wrote:
>>>> Hello,
>>>>
>>>> I resolved that error and now I can launch the application, But now the
>>>> container which has jdbcoperator is getting killed. I am attaching the
>>>> dt.log file of container which is running but does not have any operator.
>>>>
>>>> Thank You,
>>>>
>>>> Jaikit Jilka
>>>>
>>>> ----- Original Message -----
>>>> From: "Pradeep A. Dalvi" <p...@apache.org>
>>>> To: "users" <users@apex.apache.org>
>>>> Sent: Friday, June 24, 2016 11:41:47 AM
>>>> Subject: Re: Jdbcoutputoperator implementation
>>>>
>>>> Yes, because it is not yet released. Compile & install latest malhar
>>>> in local ~/.m2 directory.
>>>> For that, git clone Malhar library repository. And do 'mvn clean
>>>> install' in that malhar clone.
>>>>
>>>> On Fri, Jun 24, 2016 at 11:31 AM, Jaikit Jilka <jji...@leadferret.com>
>>>> wrote:
>>>>> Hello,
>>>>>
>>>>> When I change my malher version in POM.xml to the latest i.e
>>>>> 3.5.0-SNAPSHOT it gives me an build time error : Failure to find
>>>>> org.apache.apex:malhar-library:jar:3.5.0-SNAPSHOT in
>>>>> https://www.datatorrent.com/maven/content/repositories/snapshots/.
>>>>>
>>>>> Thank You,
>>>>>
>>>>> Jaikit Jilka
>>>>>
>>>>> ----- Original Message -----
>>>>> From: "Pradeep A. Dalvi" <p...@apache.org>
>>>>> To: "users" <users@apex.apache.org>
>>>>> Sent: Friday, June 24, 2016 11:13:42 AM
>>>>> Subject: Re: Jdbcoutputoperator implementation
>>>>>
>>>>> This issue was in 3.4 malhar and fixed later on. Fix is present in
>>>>> master branch. You can use latest malhar.
>>>>> For reference:
>>>>> https://github.com/apache/apex-malhar/blob/master/library/src/main/java/com/datatorrent/lib/db/jdbc/AbstractJdbcTransactionableOutputOperator.java#L142
>>>>>
>>>>> On Fri, Jun 24, 2016 at 10:59 AM, Jaikit Jilka <jji...@leadferret.com>
>>>>> wrote:
>>>>>> Hello,
>>>>>>
>>>>>> I am setting UpdateCommand to empty string from properties.xml file
>>>>>> still I am getting the same error
>>>>>>
>>>>>> <property>
>>>>>>
>>>>>> <name>dt.application.MyWordCountApplication.operator.JdbcOutput.prop.setupdateCommand</name>
>>>>>> <value> </value>
>>>>>> </property>
>>>>>>
>>>>>> error:
>>>>>>
>>>>>> An error occurred trying to launch the application. Server message:
>>>>>> javax.validation.ConstraintViolationException: Operator JdbcOutput
>>>>>> violates constraints
>>>>>> [ConstraintViolationImpl{rootBean=JdbcPOJOOutputOperator{name=null},
>>>>>> propertyPath='updateCommand', message='may not be null',
>>>>>> leafBean=JdbcPOJOOutputOperator{name=null}, value=null}] at
>>>>>> com.datatorrent.stram.plan.logical.LogicalPlan.validate(LogicalPlan.java:1680)
>>>>>> at com.datatorrent.stram.StramClient.<init>(StramClient.java:161) at
>>>>>> com.datatorrent.stram.client.StramAppLauncher.launchApp(StramAppLauncher.java:509)
>>>>>> at
>>>>>> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:2050)
>>>>>> at com.datatorrent.stram.cli.DTCli.launchAppPackage(DTCli.java:3456) at
>>>>>> com.datatorrent.stram.cli.DTCli.access$7100(DTCli.java:106) at
>>>>>> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:1895)
>>>>>> at com.datatorrent.stram.cli.DTCli$3.run(DTCli.java:1449)
>>>>>>
>>>>>> Thank You,
>>>>>>
>>>>>> Jaikit Jilka
>>>>>>
>>>>>> ----- Original Message -----
>>>>>> From: "Munagala Ramanath" <r...@datatorrent.com>
>>>>>> To: "users" <users@apex.apache.org>
>>>>>> Sent: Thursday, June 23, 2016 3:32:42 PM
>>>>>> Subject: Re: Jdbcoutputoperator implementation
>>>>>>
>>>>>> Please look at:
>>>>>>
>>>>>> http://docs.datatorrent.com/beginner/ and
>>>>>> http://docs.datatorrent.com/application_packages/
>>>>>>
>>>>>> for examples on how to set properties from XML files.
>>>>>>
>>>>>> Ram
>>>>>>
>>>>>> On Thu, Jun 23, 2016 at 3:25 PM, Jaikit Jilka <jji...@leadferret.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Hello,
>>>>>>>
>>>>>>> How to pass an empty string for updatecommand in properties.xml.
>>>>>>> When I change my malhar version to 3.5.0-SNAPSHOT it gives me a complie
>>>>>>> time error -Failure to find
>>>>>>> org.apache.apex:malhar-library:jar:3.5.0-SNAPSHOT in
>>>>>>> https://www.datatorrent.com/maven/content/repositories/snapshots/
>>>>>>>
>>>>>>> Thank You,
>>>>>>>
>>>>>>> Jaikit Jilka
>>>>>>>
>>>>>>> ----- Original Message -----
>>>>>>> From: "Pradeep A. Dalvi" <p...@apache.org>
>>>>>>> To: "users" <users@apex.apache.org>
>>>>>>> Sent: Thursday, June 23, 2016 12:43:40 PM
>>>>>>> Subject: Re: Jdbcoutputoperator implementation
>>>>>>>
>>>>>>> Hi Jaikit,
>>>>>>>
>>>>>>> This constraint violation exception was enforced from
>>>>>>> AbstractJdbcTransactionableOutputOperator. In 3.3/3.4 malhar library,
>>>>>>> updateCommand parameter has constraint set to @NotNull on getter
>>>>>>> method.
>>>>>>>
>>>>>>> You could do either of following to solve this:
>>>>>>> 1. Set updateCommand from properties.xml to empty string
>>>>>>> 2. Use master branch of Malhar
>>>>>>> 3. Remove @NotNull on getUpdateCommand in
>>>>>>> AbstractJdbcTransactionableOutputOperator
>>>>>>>
>>>>>>> Cheers,
>>>>>>> Pradeep A. Dalvi
>>>>>>>
>>>>>>> On Thu, Jun 23, 2016 at 11:36 AM, Jaikit Jilka <jji...@leadferret.com>
>>>>>>> wrote:
>>>>>>> > Hi Devendra,
>>>>>>> >
>>>>>>> > I tried to run your application. I followed all steps mentioned but I
>>>>>>> > am
>>>>>>> getting following error.
>>>>>>> >
>>>>>>> > An error occurred trying to launch the application. Server message:
>>>>>>> javax.validation.ConstraintViolationException: Operator JdbcOutput
>>>>>>> violates
>>>>>>> constraints
>>>>>>> [ConstraintViolationImpl{rootBean=JdbcPOJOOutputOperator{name=null},
>>>>>>> propertyPath='updateCommand', message='may not be null',
>>>>>>> leafBean=JdbcPOJOOutputOperator{name=null}, value=null}] at
>>>>>>> com.datatorrent.stram.plan.logical.LogicalPlan.validate(LogicalPlan.java:1680)
>>>>>>> at com.datatorrent.stram.StramClient.<init>(StramClient.java:161) at
>>>>>>> com.datatorrent.stram.client.StramAppLauncher.launchApp(StramAppLauncher.java:509)
>>>>>>> at
>>>>>>> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:2050)
>>>>>>> at com.datatorrent.stram.cli.DTCli.launchAppPackage(DTCli.java:3456) at
>>>>>>> com.datatorrent.stram.cli.DTCli.access$7100(DTCli.java:106) at
>>>>>>> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:1895)
>>>>>>> at
>>>>>>> com.datatorrent.stram.cli.DTCli$3.run(DTCli.java:1449)
>>>>>>> >
>>>>>>> > Thank you,
>>>>>>> >
>>>>>>> > Jaikit Jilka
>>>>>>> >
>>>>>>> > ----- Original Message -----
>>>>>>> > From: "Devendra Tagare" <devend...@datatorrent.com>
>>>>>>> > To: "users" <users@apex.apache.org>
>>>>>>> > Sent: Thursday, June 23, 2016 10:32:17 AM
>>>>>>> > Subject: Re: Jdbcoutputoperator implementation
>>>>>>> >
>>>>>>> > Hi Jalkit,
>>>>>>> >
>>>>>>> > The JdbcPOJOOutputOperator is being configured with the
>>>>>>> > JdbcTransactionalStore which requires an additional dt_meta table.
>>>>>>> >
>>>>>>> > The table schema is here -
>>>>>>> >
>>>>>>> https://github.com/devtagare/examples/blob/SPOI-8251/tutorials/jdbcToJdbc/src/test/resources/example.sql
>>>>>>> >
>>>>>>> > You can find an example application which uses the
>>>>>>> > JdbcPOJOOutputOperator
>>>>>>> > here -
>>>>>>> >
>>>>>>> https://github.com/devtagare/examples/tree/SPOI-8251/tutorials/jdbcToJdbc
>>>>>>> >
>>>>>>> > Thanks,
>>>>>>> > Dev
>>>>>>> >
>>>>>>> > On Thu, Jun 23, 2016 at 10:17 AM, Jaikit Jilka <jji...@leadferret.com>
>>>>>>> > wrote:
>>>>>>> >
>>>>>>> >> Hello,
>>>>>>> >>
>>>>>>> >> I am currently working on an application which simply read data from
>>>>>>> .txt
>>>>>>> >> file and slpits the words and inserts them into mysql. But I am
>>>>>>> >> getting
>>>>>>> >> error. I am using jdbcpojooutputoperator from malhar library. But I
>>>>>>> >> am
>>>>>>> >> getting an error on ActiveFieldInfos which says it is protected in
>>>>>>> >> jdbcpojoinputoperator and also I do not know what to do in
>>>>>>> Application.java
>>>>>>> >> file. I am attaching both the file here. Kindly help me resolve the
>>>>>>> issue.
>>>>>>> >>
>>>>>>> >> Thank You,
>>>>>>> >>
>>>>>>> >> Jaikit Jilka
>>>>>>>/*
* To change this license header, choose License Headers in Project Properties.
* To change this template file, choose Tools | Templates
* and open the template in the editor.
*/
package com.mycompany.test;
/**
*
* @author jjilka
*/
public class PojoEvent
{
@Override
public String toString()
{
return "PojoEvent [ word=" + word + "]";
}
//private int count;
private String word;
public String getName()
{
return word;
}
public void setName(String word)
{
this.word = word;
}
}
