S
- State classA
- Action classpublic abstract class DTMDP<S extends State,A extends Action> extends InfiniteMDP<S,A>
PolicyIterationSolver
,
ValueIterationSolver
Constructor and Description |
---|
DTMDP(S initial)
Creates a new infinite horizon discrete time (MDP) Problem.
|
DTMDP(States<S> initial)
Creates a new infinite horizon discrete time (MDP) Problem.
|
Modifier and Type | Method and Description |
---|---|
ValueFunction<S> |
getSteadyStateProbabilities() |
abstract double |
immediateCost(S i,
A a)
Cost incurred when taking action a from state i
|
abstract double |
prob(S i,
S j,
A a)
Probability of going from state i to state j by taking the
action a
|
abstract States<S> |
reachable(S i,
A a)
Set of states that can be reached from this state i, after
taking the action a.
|
void |
setProbabilitySolver(ProbabilitySolver<S,A> solv) |
Solution<S,A> |
solve(double interestRate)
Solves the problem with the given interest rate
|
feasibleActions, getAllStates, getNumStates, getSolver
debug, debug, debug, getDebugLevel, getOptimalPolicy, getOptimalValueFunction, getReporter, isFinite, isSolved, operation, printSolution, printSolution, setDebugLevel, setReporter, setSolver, solve
public DTMDP(States<S> initial)
initial
- set of initial states for the exploration
algorithmpublic DTMDP(S initial)
initial
- An initial state for the exploration algorithmpublic abstract double immediateCost(S i, A a)
i
- Current Statea
- Current Actionpublic abstract double prob(S i, S j, A a)
i
- Current state.j
- Destination Statea
- Actionpublic abstract States<S> reachable(S i, A a)
i
- Current Statea
- Action takenpublic ValueFunction<S> getSteadyStateProbabilities() throws SolverException
SolverException
public void setProbabilitySolver(ProbabilitySolver<S,A> solv)
solv
- Sets the solver that solves the steady state
probabilities.public final Solution<S,A> solve(double interestRate) throws SolverException
interestRate
- the interest rate parameter to solve the
problem.SolverException