[CONF] Apache Samza > SEP-11: Host affinity in standalone.

[Shanthoosh Venkataraman (Confluence)]

Title: Message Title

Shanthoosh Venkataraman edited a page

SEP-11: Host affinity in standalone. ... Code Block language java // '+' denotes addition, '-' denotes deletion. public interface TaskNameGrouper { + @deprecated Set<ContainerModel> group(Set<TaskModel> tasks); + @deprecated default Set<ContainerModel> group(Set<TaskModel> tasks, List<String> containersIds) { return group(tasks); } + Set<ContainerModel> group(Set<TaskModel> currentGenerationTaskModels, List<String> currentGenerationProcessorIds, Set<ContainerModel> previousGenerationContainerModels); } public interface BalancingTaskNameGrouper extends TaskNameGrouper { + @deprecated Set<ContainerModel> balance(Set<TaskModel> tasks, LocalityManager localityManager); } public class ContainerModel { - @Deprecated - private final int containerId; private final String processorId; private final Map<TaskName, TaskModel> tasks; + // New field added denoting the physical hostname. + private final String hostName;   + interface LocationIdProvider { LocationId getLocationId(); } + public class LocalityInfo { + // In case of containerized environments, LocationId is a combination of multiple fields (like sliceId, containerId, hostname) instead of simple physical hostname, + // Using a class to represent that, rather than a primitive string. This will be provided by execution environment. + private Map<String, LocationId> taskLocality; + public Map<String, LocationId> getTaskLocality(); } + public interface LocalityManager { // returns processorId to host mapping. + public Map<String,LocalityInfo String> readProcessorLocality(); // writes the provided processordId to host mapping to underlying storage. + public boolean writeProcessorLocality(Map<String, String> processorLocalityLocalityInfo localityInfo); } Here are few reasons supporting the modification of TaskNameGrouper interface and removing LocalityManager from interface methods: ... View page • Add comment • Like

Stop watching space • Manage notifications This message was sent by Atlassian Confluence 5.8.17