Hi,

I have a spark table as shown below.

CREATE TEMPORARY TABLE APIHourlyTrafficSummary using CarbonAnalytics
options (tableName
"org_wso2telco_analytics_hub_stream_traffic_summary_per_hour",
schema "
year INT -i,
month INT -i,
day INT -i,
hour INT -i,
eventTimeStamp STRING -i,
api STRING -i,
serviceProvider STRING -i,
apiPublisher STRING -i,
applicationName STRING -i,
operatorId STRING -i,
isSuccess BOOLEAN -i,
msisdn STRING -i,
direction STRING -i,
totalCount INTEGER -i,
serviceProviderId STRING -i,
operatorName STRING -i,
apiPublisherID STRING -i,
apiID STRING -i,
department STRING -i,
applicationId STRING -i",
primaryKeys
"year,month,day,hour,eventTimeStamp,api,serviceProvider,apiPublisher,applicationName,operatorId,isSuccess,msisdn,direction"
);

I want to add incrementalParams as mentioned in the following [1].

[1] https://docs.wso2.com/display/DAS310/Incremental+Processing

Therefore I have added the line as below.

        CREATE TEMPORARY TABLE APIHourlyTrafficSummary using
CarbonAnalytics options (tableName
"org_wso2telco_analytics_hub_stream_traffic_summary_per_hour",
        schema "
        year INT -i,
        month INT -i,
        day INT -i,
        hour INT -i,
        eventTimeStamp STRING -i,
        api STRING -i,
        serviceProvider STRING -i,
        apiPublisher STRING -i,
        applicationName STRING -i,
        operatorId STRING -i,
        isSuccess BOOLEAN -i,
        msisdn STRING -i,
        direction STRING -i,
        totalCount INTEGER -i,
        serviceProviderId STRING -i,
        operatorName STRING -i,
        apiPublisherID STRING -i,
        apiID STRING -i,
        department STRING -i,
        applicationId STRING -i",
       * incrementalParams "APIHourlyTrafficSummary, 0",*
        primaryKeys
"year,month,day,hour,eventTimeStamp,api,serviceProvider,apiPublisher,applicationName,operatorId,isSuccess,msisdn,direction"
        );

But executing the script throws an error. looks like a syntax error. What
am I doing wrong here?

-- 
Shazni Nazeer
Associate Technical Lead | WSO2

Mob : +94 777737331
LinkedIn : http://lk.linkedin.com/in/shazninazeer
Blog : http://shazninazeer.blogspot.com

<http://wso2.com/signature>
_______________________________________________
Dev mailing list
[email protected]
http://wso2.org/cgi-bin/mailman/listinfo/dev

Reply via email to