Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Pig Wiki" for change 

The following page has been changed by Shravan Narayanamurthy:

+ = Infrastructure =
+ This involves the actual Map & Reduce classes that will be run on Hadoop. 
There will be a static Map and Reduce class which can execute a portion of the 
physical plan. The physical plan to be executed will be configured through job 
conf. The infrastructure will also add some new operators to enable processing. 
The operators that will be added by the infrastructure will be Start Map, End 
Map, Start Reduce, End Reduce and Splits and Split Readers. So a map would just 
call (End Map).next() till there are values to be returned and adds them to the 
collector. The Start Map operator's next method is configured by the 
infrastructure to return the key, value passed to the map function. Similarly, 
for the Reduce phase. Splits and Split Readers will be added wherever there is 
+ The above example would translate as follows:
+ attachment:infra.png

Reply via email to