Re: TimeBasedDedupOperator failing with NullPointer

[Vivek Bhide]

Hi Bhupesh,

Please find the details below

Dedup operator configuration :
<property>
        
<name>dt.application.KafkaDedupOutputOperatorTest.operator.dedupeOperator.prop.keyExpression
                </name>
                <value>{$.id} + {$.name}</value>
        </property>
        <property>
        
<name>dt.application.KafkaDedupOutputOperatorTest.operator.dedupeOperator.prop.timeExpression
                </name>
                <value>eventTime.getTime()</value>
        </property>
        <property>
        
<name>dt.application.KafkaDedupOutputOperatorTest.operator.dedupeOperator.prop.bucketSpan
                </name>
                <value>87</value>
        </property>
        <property>
        
<name>dt.application.KafkaDedupOutputOperatorTest.operator.dedupeOperator.prop.expireBefore
                </name>
                <value>7500</value>
        </property>
        <property>
        
<name>dt.application.KafkaDedupOutputOperatorTest.operator.dedupeOperator.port.input.attr.TUPLE_CLASS
                </name>
                
<value>com.tgt.outputdeduptest.kafkaoutputdedup.object.InputPojo</value>
        </property>
        <property>
        
<name>dt.application.KafkaDedupOutputOperatorTest.operator.dedupeOperator.attr.VCORES</name>
                <value>4</value>
        </property>

Sample Input :

{"id":0,"name":"BU7UK7QXP1ZCEJYNNO5D","eventTime":"Mar 22, 2018 1:18:07 PM"}
{"id":1,"name":"YMPT9HZTLW11G2DUEZ0H","eventTime":"Mar 22, 2018 1:18:07 PM"}
{"id":2,"name":"ERYVJYK92JPEM9BOPJXN","eventTime":"Mar 22, 2018 1:18:07 PM"}
{"id":3,"name":"IBXHQXWH32J1IRVPGYKD","eventTime":"Mar 22, 2018 1:18:07 PM"}
{"id":4,"name":"JJZMUAF15TPSFCDP4LLS","eventTime":"Mar 22, 2018 1:18:07 PM"}
{"id":5,"name":"O24TIRQDJNHATCB4F3M9","eventTime":"Mar 22, 2018 1:18:07 PM"}
{"id":6,"name":"UVBBY64LJJRFDWK0B8TB","eventTime":"Mar 22, 2018 1:18:07 PM"}
{"id":7,"name":"09FSAVBJB9EX0PNBUPPG","eventTime":"Mar 22, 2018 1:18:07 PM"}
{"id":8,"name":"TLLCY18P0HVJZUYVPP0E","eventTime":"Mar 22, 2018 1:18:07 PM"}
{"id":9,"name":"RF3WNOHE48JQRZBCZNWL","eventTime":"Mar 22, 2018 1:18:07 PM"}
{"id":10,"name":"KLBCMSC783SXC2MYFYF5","eventTime":"Mar 22, 2018 1:18:07
PM"}

I am sure that there is no instance when the input tuple is NULL. I have
also attached the InputPojo java file for reference.
InputPojo.java
<http://apache-apex-users-list.78494.x6.nabble.com/file/t127/InputPojo.java>  

Regards
Vivek



--
Sent from: http://apache-apex-users-list.78494.x6.nabble.com/