Optimization Algorithms

A couple self implemented optimization algorithms in matlab

List of Algorithms

Applicable on Functions
1. Gradient based:
  - Gradient descent with variable step size
  - Stochatic gradient descent
  - Newton procedure
  - Newton procedure simplified
  - Newton procedure subdued
  - Newton procedure global
2. Metaheuristic:
  - Simulated annealing
  - Firefly algorithm
3. Other:
  - Downhill simplex procedure
Applicable on Graphs
1. Metaheuristic:
  - Simulated annealing for graph
  - Ant algorithm

Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
+PlotFunctions		+PlotFunctions
+TestFunctions		+TestFunctions
AntAlgorithm.m		AntAlgorithm.m
ArmijoStepsize.m		ArmijoStepsize.m
DownhillSimplexProcedure.m		DownhillSimplexProcedure.m
FireflyAlgorithm.m		FireflyAlgorithm.m
Gradient.m		Gradient.m
GradientDescentVariable.m		GradientDescentVariable.m
Hessian.m		Hessian.m
NewtonProcedure.m		NewtonProcedure.m
NewtonProcedureGlobal.m		NewtonProcedureGlobal.m
NewtonProcedureSimplified.m		NewtonProcedureSimplified.m
NewtonProcedureSubdued.m		NewtonProcedureSubdued.m
README.md		README.md
RouteLength.m		RouteLength.m
SGD.m		SGD.m
SimulatedAnnealing.m		SimulatedAnnealing.m
SimulatedAnnealingForGraph.m		SimulatedAnnealingForGraph.m
StochasticGradient.m		StochasticGradient.m
TestGradientAlgorithms.m		TestGradientAlgorithms.m
TestGraphAlgorithms.m		TestGraphAlgorithms.m
TestMetaheuristicAlgorithms.m		TestMetaheuristicAlgorithms.m
TestOtherAlgorithms.m		TestOtherAlgorithms.m