[jira] Commented: (PIG-856) PERFORMANCE: reduce number of replicas

2009-06-23 Thread Amr Awadallah (JIRA)
[ https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12723412#action_12723412 ] Amr Awadallah commented on PIG-856: --- Please keep in mind that when running on a loaded syst

[jira] Commented: (PIG-856) PERFORMANCE: reduce number of replicas

2009-06-23 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12723269#action_12723269 ] Milind Bhandarkar commented on PIG-856: --- Replication of 2 is 17% faster than replication

[jira] Commented: (PIG-856) PERFORMANCE: reduce number of replicas

2009-06-18 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721599#action_12721599 ] Milind Bhandarkar commented on PIG-856: --- +1 to Sathosh to documenting Knobs. Better to a

[jira] Commented: (PIG-856) PERFORMANCE: reduce number of replicas

2009-06-18 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721596#action_12721596 ] Santhosh Srinivasan commented on PIG-856: - Essentially, are we adding more knobs to tu

[jira] Commented: (PIG-856) PERFORMANCE: reduce number of replicas

2009-06-18 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721594#action_12721594 ] Milind Bhandarkar commented on PIG-856: --- +1 to both Alan and Olga. Default should still

[jira] Commented: (PIG-856) PERFORMANCE: reduce number of replicas

2009-06-18 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721592#action_12721592 ] Santhosh Srinivasan commented on PIG-856: - Would that be through a configuration param

[jira] Commented: (PIG-856) PERFORMANCE: reduce number of replicas

2009-06-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721593#action_12721593 ] Olga Natkovich commented on PIG-856: Yes, I agree - we should let users choose, I was thin

[jira] Commented: (PIG-856) PERFORMANCE: reduce number of replicas

2009-06-18 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721590#action_12721590 ] Alan Gates commented on PIG-856: My $0.02, based on the assumption that we see a significant p

[jira] Commented: (PIG-856) PERFORMANCE: reduce number of replicas

2009-06-18 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721581#action_12721581 ] Milind Bhandarkar commented on PIG-856: --- +1. I will file a separate Jira (if replication

[jira] Commented: (PIG-856) PERFORMANCE: reduce number of replicas

2009-06-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721577#action_12721577 ] Olga Natkovich commented on PIG-856: If a job fails, the store connected to this job will

[jira] Commented: (PIG-856) PERFORMANCE: reduce number of replicas

2009-06-18 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721574#action_12721574 ] Milind Bhandarkar commented on PIG-856: --- +1 on seeing performance differences. But, is t

[jira] Commented: (PIG-856) PERFORMANCE: reduce number of replicas

2009-06-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721570#action_12721570 ] Olga Natkovich commented on PIG-856: Hi Milind, yes, these are very good points. I was h

[jira] Commented: (PIG-856) PERFORMANCE: reduce number of replicas

2009-06-18 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721565#action_12721565 ] Milind Bhandarkar commented on PIG-856: --- Olga, setting dfs.replication for the whole pi

[jira] Commented: (PIG-856) PERFORMANCE: reduce number of replicas

2009-06-18 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721558#action_12721558 ] Olga Natkovich commented on PIG-856: The number of replicas can be set via dfs.replication