What does "SET" do for Solr? Pig pre-processes all the set commands in the entire script before executing any query, and values are overwritten if the same key is set more than once. In your example, you have two set commands. If you're thinking that different values will be applied in each section, that's not the case. e) will overwrite a).
On Thu, Jan 15, 2015 at 7:46 PM, Vishnu Viswanath < [email protected]> wrote: > Hi All, > > I am in indexing data into solr using pig script. > I have two such scripts, and I tried combining these two scripts into a > single one. > > i.e., i have script 1 that does > -------------------- > a)SET solr collection info for collection 1 > b)LOAD data > c)FILTER data for SOLR collection number 1 > d)STORE data to solr > > > and script 2 that does > ------------------- > a)SET solr collection info for collection 2 > b)LOAD data > c)FILTER data for SOLR collection number 2 > d)STORE data to solr > > > combined script looks something like > -------------- > a)SET solr collection info for collection 1 > b)LOAD data > c)FILTER data from (b) for SOLR collection number 1 > d)STORE data to solr > e)SET solr collection info for collection 2 > f)FILTER data from (b) for SOLR collection number 2 > g)STORE data to solr > > But the store function fails when I run the combined script where as it > runs fine if I run scripts 1 and 2 separately. > > Any idea? > > Regards, > Vishnu >
