In evolutionary computation, Minimum Population Search (MPS) is a computational method that optimizes a problem by iteratively trying to improve a set of candidate solutions with regard to a given measure of quality. It solves a problem by evolving a small population of candidate solutions by means of relatively simple arithmetical operations.

MPS is a metaheuristic as it makes few or no assumptions about the problem being optimized and can search very large spaces of candidate solutions. For problems where finding the precise global optimum is less important than finding an acceptable local optimum in a fixed amount of time, using a metaheuristic such as MPS may be preferable to alternatives such as brute-force search or gradient descent.

MPS is used for multidimensional real-valued functions but does not use the gradient of the problem being optimized, which means MPS does not require for the optimization problem to be differentiable as is required by classic optimization methods such as gradient descent and quasi-newton methods. MPS can therefore also be used on optimization problems that are not even continuous, are noisy, change over time, etc.

Background

In a similar way to Differential evolution, MPS uses difference vectors between the members of the population in order to generate new solutions. It attempts to provide an efficient use of function evaluations by maintaining a small population size. If the population size is smaller than the dimensionality of the search space, then the solutions generated through difference vectors will be constrained to the ${\displaystyle n-1}$ dimensional hyperplane. A smaller population size will lead to a more restricted subspace. With a population size equal to the dimensionality of the problem ${\displaystyle (n=d)}$, the “line/hyperplane points” in MPS will be generated within a ${\displaystyle d-1}$ dimensional hyperplane. Taking a step orthogonal to this hyperplane will allow the search process to cover all the dimensions of the search space.^[1]

Population size is a fundamental parameter in the performance of population-based heuristics. Larger populations promote exploration, but they also allow fewer generations, and this can reduce the chance of convergence. Searching with a small population can increase the chances of convergence and the efficient use of function evaluations, but it can also induce the risk of premature convergence. If the risk of premature convergence can be avoided, then a population-based heuristic could benefit from the efficiency and faster convergence rate of a smaller population. To avoid premature convergence, it is important to have a diversified population. By including techniques for explicitly increasing diversity and exploration, it is possible to have smaller populations with less risk of premature convergence.^[1]

Algorithm

A basic variant of the MPS algorithm works by having a population of size equal to the dimension of the problem. New solutions are generated by exploring the hyperplane defined by the current solutions (by means of difference vectors) and performing an additional orthogonal step in order to avoid getting caught in this hyperplane. The step sizes are controlled by the Thresheld Convergence technique, which gradually reduces step sizes as the search process advances.

An outline for the algorithm is given below:

• Generate the first initial population. Allowing these solutions to lie near the bounds of the search space generally gives good results: ${\displaystyle s_{k}=(rs_{1}*bound_{1}/2,rs_{2}*bound_{2}/2,...,rs_{n}*bound_{n}/2)}$ where ${\displaystyle s_{k}}$ is the ${\displaystyle k}$-th population member, ${\displaystyle rs_{i}}$ are random numbers which can be −1 or 1, and the ${\displaystyle bound_{i}}$ are the lower and upper bounds on each dimension.
• While a stop condition is not reached:
• Update threshold convergence values (${\displaystyle min\_step}$ and ${\displaystyle max\_step}$)
• Calculate the centroid of the current population (${\displaystyle x_{c}}$)
• For each member of the population (${\displaystyle x_{i}}$), generate a new offspring as follows:
  • Uniformly generate a scaling factor (${\displaystyle F_{i}}$) between ${\displaystyle -max\_step}$ and ${\displaystyle max\_step}$
  • Generate a vector (${\displaystyle x_{o}}$) orthogonal to the difference vector between ${\displaystyle x_{i}}$ and ${\displaystyle x_{c}}$
  • Calculate a scaling factor for the orthogonal vector:
    • ${\displaystyle min\_orth=sqrt(max(min\_step^{2}-F_{i}^{2},0))}$
    • ${\displaystyle max\_orth=sqrt(max(max\_step^{2}-F_{i}^{2},0))}$
    • ${\displaystyle orth\_step=uniform(min\_orth,max\_orth)}$
  • Generate the new solution by adding the difference and the orthogonal vectors to the original solution
    • ${\displaystyle new\_solution=x_{i}+F_{i}*(x_{i}-x_{c})*orth\_step*x_{o}}$
• Pick the best members between the old population and the new one by discarding the least fit members.
• Return the single best solution or the best population found as the final result.

References

External links

• Reference implementations