Thanks for responding Bill, However I am using JsonLoader that is in the Piggybank with Pig-0.10.0.
It doesnt need any schema and converts Json data as map ( org.apache.pig.piggybank.storage.JsonLoader() as (json:map[]) ) and I extract data from there using keys. I have processed huge amount of data without any problem and no schema was required. Regards, Vivek On Mon, Sep 24, 2012 at 2:03 PM, Bill Graham <billgra...@gmail.com> wrote: > This loader only works for data stored using JsonStorage. From the > javadocs: > > A loader for data stored using > JsonStorage< > http://pig.apache.org/docs/r0.10.0/api/org/apache/pig/builtin/JsonStorage.html > >. > This is not a generic JSON loader. It depends on the schema being stored > with the data when conceivably you could write a loader that determines the > schema from the JSON. > > Was this data produced via JsonStorage? If not, you'll need to write a > custom loader. > > On Mon, Sep 24, 2012 at 12:04 PM, Deepak Tiwari <dtiwari...@gmail.com > >wrote: > > > Hi, > > > > I am try to parse this data using Pig parser > > org.apache.pig.piggybank.storage.JsonLoader > > > > > > > {"geo":{"type":"Polygon","coordinates":[[[-91.3061478,-30.2688069],[-91.012471,-60.2688069],[-91.012471,-69.9306357],[-91.3061478,-29.9306357]]]}, > > > > I need to extract this array > > > > > [[[-91.3061478,-30.2688069],[-91.012471,-60.2688069],[-91.012471,-69.9306357],[-91.3061478,-29.9306357]]] > > > > I am getting this error while accessing flatten(geo#'coordinates') , I > > think that's the limitation ( "only standard Pig type is supported") of > the > > the parser, but wondering if someone has any workaround > > > > "java.lang.RuntimeException: Unexpected data type > > org.codehaus.jackson.node.DoubleNode found in stream. Note only standard > > Pig type is supported when you output from UDF/LoadFunc" > > > > > > Thanks very much, > > > > Deepak > > > > > > -- > *Note that I'm no longer using my Yahoo! email address. Please email me at > billgra...@gmail.com going forward.* >
