Continuous-time Markov decision processes (MDPs), also known as controlled Markov chains, are use...