org.apache.storm.scheduler.blacklist.strategies

Class DefaultBlacklistStrategy

java.lang.Object

org.apache.storm.scheduler.blacklist.strategies.DefaultBlacklistStrategy

All Implemented Interfaces:

IBlacklistStrategy

Direct Known Subclasses:

RasBlacklistStrategy

public class DefaultBlacklistStrategy
extends Object
implements IBlacklistStrategy

The default strategy used for blacklisting hosts.

Field Summary

Fields

Modifier and Type	Field and Description
static int	DEFAULT_BLACKLIST_SCHEDULER_RESUME_TIME
static int	DEFAULT_BLACKLIST_SCHEDULER_TOLERANCE_COUNT

Constructor Summary

Constructors

Constructor and Description
DefaultBlacklistStrategy()

Method Summary

Modifier and Type	Method and Description
protected Map<String,Set<String>>	createHostToSupervisorMap(List<String> blacklistedNodeIds, Cluster cluster)
Set<String>	getBlacklist(List<Map<String,Set<Integer>>> supervisorsWithFailures, List<Map<String,Integer>> sendAssignmentFailureCount, Cluster cluster, Topologies topologies) Get blacklist by blacklist strategy.
void	prepare(Map<String,Object> conf)
protected Set<String>	releaseBlacklistWhenNeeded(Cluster cluster, List<String> blacklistedNodeIds) Decide when/if to release blacklisted hosts.
void	resumeFromBlacklist() resume supervisors form blacklist.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEFAULT_BLACKLIST_SCHEDULER_RESUME_TIME

public static final int DEFAULT_BLACKLIST_SCHEDULER_RESUME_TIME

See Also:

Constant Field Values

DEFAULT_BLACKLIST_SCHEDULER_TOLERANCE_COUNT

public static final int DEFAULT_BLACKLIST_SCHEDULER_TOLERANCE_COUNT

See Also:

Constant Field Values

Constructor Detail

DefaultBlacklistStrategy

public DefaultBlacklistStrategy()

Method Detail

prepare

public void prepare(Map<String,Object> conf)

Specified by:

prepare in interface IBlacklistStrategy

getBlacklist

public Set<String> getBlacklist(List<Map<String,Set<Integer>>> supervisorsWithFailures,
                                List<Map<String,Integer>> sendAssignmentFailureCount,
                                Cluster cluster,
                                Topologies topologies)

Description copied from interface: IBlacklistStrategy

Get blacklist by blacklist strategy.

Specified by:

getBlacklist in interface IBlacklistStrategy

Parameters:

supervisorsWithFailures - bad supervisors buffered in sliding window

sendAssignmentFailureCount - supervisors with failed assignment calls in sliding window

cluster - the cluster these topologies are running in. `cluster` contains everything user need to develop a new scheduling logic. e.g. supervisors information, available slots, current assignments for all the topologies etc. User can set the new assignment for topologies using cluster.setAssignmentById()`

topologies - all the topologies in the cluster, some of them need schedule. Topologies object here only contain static information about topologies. Information like assignments, slots are all in the `cluster` object.

Returns:

blacklisted supervisors' id set

resumeFromBlacklist

public void resumeFromBlacklist()

Description copied from interface: IBlacklistStrategy

resume supervisors form blacklist. Blacklist is just a temporary list for supervisors, or there will be less and less available resources. This will be called every time before getBlacklist() and schedule.

Specified by:

resumeFromBlacklist in interface IBlacklistStrategy

releaseBlacklistWhenNeeded

protected Set<String> releaseBlacklistWhenNeeded(Cluster cluster,
                                                 List<String> blacklistedNodeIds)

Decide when/if to release blacklisted hosts.

Parameters:

cluster - the current state of the cluster.

blacklistedNodeIds - the current set of blacklisted node ids sorted by earliest

Returns:

the set of nodes to be released.

createHostToSupervisorMap

protected Map<String,Set<String>> createHostToSupervisorMap(List<String> blacklistedNodeIds,
                                                            Cluster cluster)