1、Backtracking and Branch-and-Bound,2,Expected Outcomes,Describe the ideas of backtracking and branch and bound techniques Solve some difficult problems by the backtracking technique,3,Exact Solutions,exhaustive search (brute force) Generate ALL candidate solutions and identify one with a desired prop

2、erty useful only for small instances Improvement over exhaustive search: backtracking and branch-and-bound The idea construct candidate solutions one component at a time based on a certain rule. If no potential values of the remaining components can lead to a solution, the remaining components are n

3、ot generated at all. Difference Apply to different problems (non-optimization and optimization problems) The way a new component is generated. Advantage and disadvantages cut down on the search space provide fast solutions for some instances the worst case is still exponential,4,Backtracking,Constru

4、ct the state space tree: Root represents an initial state Nodes reflect specific choices made for a solutions components. Promising and nonpromising nodes leaves Explore the state space tree using depth-first search “Prune” non-promising nodes dfs stops exploring subtree rooted at nodes leading to n

5、o solutions and. “backtracks” to its parent node,5,Example: The n-Queen problem,Place n queens on an n by n chess board so that no two of them are on the same row, column, or diagonal,6,State Space Tree of the Four-queens Problem,7,The m-Coloring Problem and Hamiltonian Problem,2-color 3-color Hamil

6、tonian Circuit (use alphabet order to break the ties),8,Comments,Exhaustive search and backtracking Exhaustive search is guaranteed to be very slow in every problem instance. Backtracking provides the hope to solve some problem instances of nontrivial sizes by pruning non-promising branches of the s

7、tate-space tree. The success of backtracking varies from problem to problem and from instance to instance. Backtracking possibly generates all possible candidates in an exponentially growing state-space tree. But still it provides a systematic technique to do so.,9,Branch and Bound,An enhancement of

8、 backtracking Similarity A state space tree is used to solve a problem. Difference The branch-and-bound algorithm does not limit us to any particular way of traversing the tree and is used only for optimization problems The backtracking algorithm requires the using of DFS traversal and is used for n

9、onoptimization problems.,10,Branch and Bound,The idea Set up a bounding function, which is used to compute a bound (for the value of the objective function) at a node on a state-space tree and determine if it is promising Promising (if the bound is better than the value of the best soluton so far):

10、expand beyond the node. Nonpromising (if the bound is no better than the value of the best solution so far): not expand beyond the node (pruning the state-space tree).,11,Traveling Salesman Problem,An obvious way to construct the state-space tree A node: a node in the state-space tree; a vertex: a v

11、ertex in the graph. A node that is not a leaf represents all the tours that start with the path stored at that node; each leaf represents a tour (or nonpromising node). Branch-and-bound: we need to determine a lower bound for each node For example, to determine a lower bound for node 1, 2 means to d

12、etermine a lower bound on the length of any tour that starts with edge 12. Expand each promising node, and stop when all the promising nodes have been expanded. During this procedure, prune all the nonpromising nodes. Promising node: the nodes lower bound is less than current minimum tour length. No

13、npromising node: the nodes lower bound is NO less than current minimum tour length.,12,Traveling Salesman ProblemBounding Function 1,Because a tour must leave every vertex exactly once, a lower bound on the length of a tour is the sum of the minimum (lower bound)cost of leaving every vertex. The low

14、er bound on the cost of leaving vertex v1 is given by the minimum of all the nonzero entries in row 1 of the adjacency matrix. The lower bound on the cost of leaving vertex vn is given by the minimum of all the nonzero entries in row n of the adjacency matrix. Note: This is not to say that there is

15、a tour with this length. Rather, it says that there can be no shorter tour. Assume that the tour starts with v1.,13,Traveling Salesman ProblemBounding Function 2,Because every vertex must be entered and exited exactly once, a lower bound on the length of a tour is the sum of the minimum cost of ente

16、ring and leaving every vertex. For a given edge (u, v), think of half of its weight as the the exiting cost of u, and half of its weight as the entering cost of v. The total length of a tour = the total cost of visiting( entering and exiting) every vertex exactly once. The lower bound of the length of a tour = the lower bound of the total cost of visiting (entering and exiting ) every vertex exactly once. Calculation: for each vertex, pick top two shortest adja