https://markov-chains.com/
Markov chains course
markov chainscourse
https://actu.epfl.ch/news/markov-chains-to-investigate-the-sensitivity-of-fr/
Markov chains to investigate the sensitivity of friction isolators - EPFL
markov chainsinvestigatesensitivityfrictionisolators
https://research.tue.nl/en/publications/efficient-sensitivity-analysis-for-parametric-robust-markov-chain/
Efficient Sensitivity Analysis for Parametric Robust Markov Chains - Research portal Eindhoven...
sensitivity analysismarkov chainsresearch portalefficientparametric
https://alirezakazemipour.github.io/posts/2025/09/mrkv-chns/
Some cool things about finite Markov chains and thereof - Alireza Kazemipour
Sep 23, 2025 - In this post, I wanna summarize Sections 1.5 and 1.6 of Introduction to Stochastic Processes and kinda blew my mind.
cool thingsmarkov chainsfinite
https://it.mathworks.com/help/econ/discrete-time-markov-chains.html
Discrete-Time Markov Chains - MATLAB & Simulink
Markov chains are discrete-state Markov processes described by a right-stochastic transition matrix and represented by a directed graph.
markov chainsdiscretetimematlabsimulink
https://research.tue.nl/nl/publications/computing-expected-hitting-times-for-imprecise-markov-chains/
Computing Expected Hitting Times for Imprecise Markov Chains - Onderzoeksportaal Eindhoven...
markov chainscomputingexpectedhittingtimes
https://www.gsb.stanford.edu/faculty-research/publications/data-uncertainty-markov-chains-application-cost-effectiveness
Data Uncertainty in Markov Chains: Application to Cost-effectiveness Analyses of Medical...
Cost-effectiveness studies of medical innovations often suffer from data inadequacy. When Markov chains are used as a modeling framework for such studies, this...
markov chains
https://handbook.monash.edu/2025/units/mth4240
MTH4240 - Mixing of finite Markov Chains - Monash University
This is the official site of the Monash University Handbook for course and unit information.
markov chainsmixingfinitemonashuniversity
https://moodle.epfl.ch/course/section.php?id=252671
Week: Week 9 (November 11, NM) | Markov chains and algorithmic applications | Moodle
markov chainsweeknovembernm
https://portal.fis.tum.de/en/publications/verification-of-open-interactive-markov-chains-2/fingerprints/?sortBy=alphabetically
Verification of open interactive Markov chains - Fingerprint - Technical University of Munich
markov chainstechnical universityverificationopeninteractive
https://research.tue.nl/nl/publications/two-dimensional-markov-chains-with-geometric-jumps/
Two-dimensional Markov chains with geometric jumps - Onderzoeksportaal Eindhoven University of...
two dimensionalmarkov chains
https://ee-damp.github.io/Elective%20Reviews/Probability/EE621_2023/
EE 621 - Markov Chains and Queuing Systems
N V Navaneeth Rajesh, 2026(B.Tech)
markov chainseequeuingsystems
https://journal.r-project.org/articles/RJ-2024-006/
GenMarkov: Modeling Generalized Multivariate Markov Chains in R
This article proposes a new generalization of the Multivariate Markov Chains (MMC) model. The future values of a Markov chain commonly depend on only the past...
markov chainsmodelinggeneralizedmultivariate
https://edu.epfl.ch/studyplan/fr/master/informatique-cybersecurity/coursebook/markov-chains-and-algorithmic-applications-COM-516
Markov chains and algorithmic applications - COM-516 - EPFL
The study of random walks finds many applications in computer science and communications. The goal of the course is to get familiar with the theory of random...
markov chainsalgorithmicapplicationsepfl
https://ch.mathworks.com/company/technical-articles/exploring-risk-contagion-using-graph-theory-and-markov-chains.html
Exploring Risk Contagion Using Graph Theory and Markov Chains - MATLAB & Simulink
This article shows how MATLAB can be used to analyze aspects of risk contagion using advanced mathematical and statistical techniques.
graph theorymarkov chainsexploringriskcontagion
https://www.eecs.mit.edu/tag/markov-chains/
Tag: Markov chains - MIT EECS
markov chainstagmiteecs
https://www.ideals.illinois.edu/items/73174
Rational inattention in control of Markov chains | IDEALS
in controlmarkov chainsrationalinattentionideals
https://edu.epfl.ch/studyplan/en/master/data-science/coursebook/markov-chains-and-algorithmic-applications-COM-516
Markov chains and algorithmic applications - COM-516 - EPFL
The study of random walks finds many applications in computer science and communications. The goal of the course is to get familiar with the theory of random...
markov chainsalgorithmicapplicationsepfl
https://www.mis.mpg.de/events/event/branching-markov-chains
Branching Markov Chains in Oberseminar Statistical Mechanics: MPI MIS
markov chainsstatistical mechanicsbranchingoberseminarmpi
https://researchportalplus.anu.edu.au/en/publications/continuous-time-tracking-algorithms-involving-two-time-scale-mark/fingerprints/?sortBy=alphabetically
Continuous-time tracking algorithms involving two-time-scale Markov chains - Fingerprint - The...
time trackingmarkov chainscontinuousalgorithmsinvolving
https://ocw.mit.edu/courses/6-041sc-probabilistic-systems-analysis-and-applied-probability-fall-2013/pages/unit-iii/lecture-17/
Lecture 17: Markov Chains - II | Probabilistic Systems Analysis and Applied Probability |...
This section provides materials for a lecture on Markov chains. It includes the list of lecture topics, lecture video, lecture slides, readings, recitation...
markov chainssystems analysislectureii
https://markov-chains-reu.math.uconn.edu/2021-2/
2022 | Markov Chains REU | Department of Mathematics | University of Connecticut
Jul 27, 2021 - This page is being updated... An Implementation of a Maximal Coupling Algorithm for Markov Chains Alan Boles (U Tennessee, Knoxville), Leila Dahlia (UIC), ...
department of mathematicsmarkov chainsreuuniversityconnecticut
https://moodle.epfl.ch/course/section.php?id=252673
Week: Week 11 (November 25, NM) | Markov chains and algorithmic applications | Moodle
markov chainsweeknovembernm
https://moodle.epfl.ch/course/section.php?id=252664
Week: Week 2 (September 16, OL) | Markov chains and algorithmic applications | Moodle
markov chainsweekseptemberol
https://www.ideals.illinois.edu/items/107114
Variance-reduced simulation of lattice Markov chains | IDEALS
markov chainsvariancereducedsimulationlattice
https://scholars.uky.edu/en/publications/molecular-computation-of-complex-markov-chains-with-self-loop-sta/
Molecular computation of complex Markov chains with self-loop state transitions - University of...
markov chains
https://research.monash.edu/en/publications/towards-tensor-representation-of-controlled-coupled-markov-chains/
Towards tensor representation of controlled coupled markov chains - Monash University
markov chainstowardstensorrepresentationcontrolled
https://moodle.epfl.ch/course/section.php?id=252663
Week: Week 1 (September 9, OL) | Markov chains and algorithmic applications | Moodle
markov chainsweekseptemberol
https://cordis.europa.eu/project/id/679660/results
Dynamics of Multiple, Interacting and Concurrent Markov Chains | DYNAMICMARCH | Project | Results |...
Deliverables, publications, datasets, software, exploitable results
markov chainsdynamicsmultipleinteracting
https://conservancy.umn.edu/items/b2ef9338-34b3-4547-b156-10e6d8846393
Martin capacity for Markov chains and random walks in varying dimensions
markov chainsrandom walksmartincapacity
https://moodle.epfl.ch/course/section.php?id=252676
Week: Week 14 (December 16) | Markov chains and algorithmic applications | Moodle
markov chainsweekdecemberalgorithmicapplications
https://handbook.monash.edu/2022/units/mth5230
MTH5230 - Markov chains and random walks - Monash University
This is the official site of the Monash University Handbook for course and unit information.
markov chainsrandom walksmonashuniversity
https://cs.uwaterloo.ca/~r5olivei/courses/2025-spring-cs466/lecture-notes/lecture10/
Fundamental Theorem of Markov Chains, PageRank | Rafael Oliveira
May 25, 2024 - In this lecture, we will prove the Fundamental Theorem of Markov Chains and discuss the PageRank algorithm. In order to prove the Fundamental Theorem of Markov...
markov chainsfundamentaltheorempagerankrafael
https://repository.gatech.edu/entities/publication/b828f702-5a8e-4641-b14c-617d69493273
Quantum Approximate Markov Chains and the Locality of Entanglement Spectrum
In this talk I will show that quantum many-body states satisfying an area law for entanglement have a local entanglement spectrum, i.e. the entanglement...
markov chainsand thequantumapproximatelocality
https://portal.fis.tum.de/en/publications/verification-of-open-interactive-markov-chains-2/
Verification of open interactive Markov chains - Technical University of Munich
markov chainstechnical universityverificationopeninteractive
https://www.stat.ubc.ca/events/bayesian-analysis-continuous-time-markov-chains-applications-phylogenetics
Bayesian analysis of continuous time Markov chains with applications to phylogenetics | UBC...
bayesian analysismarkov chains
https://experts.colorado.edu/display/pubid_382487
Coin-Turning, Random Walks and Inhomogeneous Markov Chains | CU Experts | CU Boulder
random walksmarkov chainscointurning
https://handbook.monash.edu/2024/units/mth5230
MTH5230 - Markov chains and random walks - Monash University
This is the official site of the Monash University Handbook for course and unit information.
markov chainsrandom walksmonashuniversity
https://handbook.monash.edu/2026/units/mth5230
MTH5230 - Markov chains and random walks - Monash University
This is the official site of the Monash University Handbook for course and unit information.
markov chainsrandom walksmonashuniversity
https://math.asu.edu/node/9551
Algorithmic Programmable Matter: From Local Markov Chains to "Dumb" Robots | School of Mathematical...
CAM/DoMSS Seminar andResearch Innovations in Mathematical SciencesMonday, November 1012:00pm MST/AZECA 221
https://pure.psu.edu/en/publications/rapid-mixing-of-global-markov-chains-via-spectral-independence-th/
Rapid Mixing of Global Markov Chains via Spectral Independence: The Unbounded Degree Case - Penn...
https://scholars.uky.edu/es/publications/reduced-rank-multinomial-logistic-regression-in-markov-chains-wit/
Reduced rank multinomial logistic regression in Markov chains with application to cognitive data -
https://research.birmingham.ac.uk/en/publications/mamadroid-detecting-android-malware-by-building-markov-chains-of--2/
MaMaDroid: Detecting Android Malware by Building Markov Chains of Behavioral Models (Extended...
android malwareby building
https://stanford.edu/~boyd/papers/feat_dep_mkv_chn.html
Fitting Feature-Dependent Markov Chains
fittingfeaturedependentmarkovchains
https://arxiv.org/abs/2305.19473
[2305.19473] Chain of Log-Concave Markov Chains
Abstract page for arXiv paper 2305.19473: Chain of Log-Concave Markov Chains
chainlogconcavemarkov
https://vivo.colorado.edu/display/pubid_239834
Application of Markov chains and Monte Carlo simulations for developing pavement performance models...
monte carlo simulations
https://wanderers-library.wikidot.com/jack-manganese-s-author-page
Application of Cartesian-Normal Markov Chains to Problems in Forensic Ontology - The Wanderers'...
A collection of extraordinary stories, hidden from ordinary eyes.
https://collaborate.princeton.edu/en/publications/relative-frequencies-of-non-homogeneous-markov-chains-in-simulate/fingerprints/
Relative frequencies of non-homogeneous Markov chains in simulated annealing and related algorithms...
https://dev.to/miguelmj/building-and-using-markov-chains-ai-for-text-generation-part-ii-1172
Building and using Markov chains - AI for text generation - Part II - DEV Community
In the previous post we saw some theory behind Markov chains. In this one we're going to define the... Tagged with ai, machinelearning, nlp.
https://research.ibm.com/publications/simulation-of-database-valued-markov-chains-using-simsql
Simulation of database-valued Markov chains using SimSQL for SIGMOD 2013 - IBM Research
Simulation of database-valued Markov chains using SimSQL for SIGMOD 2013 by Zhuhua Cai et al.
https://scholars.duke.edu/publication/801246
Scholars@Duke publication: Decompositional analysis of Kronecker structured Markov chains
scholarsdukepublicationanalysiskronecker
https://experts.umn.edu/en/publications/decentralized-search-on-spheres-using-small-world-markov-chains-e/fingerprints/
Decentralized search on spheres using small-world Markov chains: Expected hitting times and...
https://ocw.mit.edu/courses/6-231-dynamic-programming-and-stochastic-control-fall-2015/resources/mit6_231f15_lec13/
6.231 Fall 2015 Lecture 13: Control of Continuous-Time Markov Chains: Semi-Markov Problems, Problem...
This resource contains the information regarding 6.231 fall 2015 lecture 13: Control of continuous-time markov chains: semi-markov problems, problem...
https://eprints.soton.ac.uk/36179/
Modelling the purchase dynamics of insurance customers using Markov chains - ePrints Soton
https://arxiv.org/abs/1210.1116
[1210.1116] Stochastic Comparisons between hitting times for Markov Chains and words' occurrences
Abstract page for arXiv paper 1210.1116: Stochastic Comparisons between hitting times for Markov Chains and words' occurrences
https://research.utwente.nl/en/publications/multi-terminal-binary-decision-diagrams-to-represent-and-analyse-/
Multi terminal Binary Decision Diagrams to Represent and Analyse Continuous Time Markov Chains -...
https://iccl.inf.tu-dresden.de/web/Inproceedings3811621714/en
Model Checking Action- and State-Labelled Markov Chains - International Center for Computational...
Christel Baier, Lucia Cloth, Boudewijn R. Haverkort, Matthias Kuntz, Markus Siegle. Model Checking Action- and State-Labelled Markov Chains. International...
model checking
https://web.stanford.edu/~glynn/papers/1997/GMeyn97.html
Tightness for Non-irreducible Markov Chains
tightnessnonmarkovchains
https://collaborate.princeton.edu/en/publications/hoeffdings-inequality-for-general-markov-chains-and-its-applicati/
Hoeffding's inequality for general markov chains and its applications to statistical learning -...
https://research.ibm.com/publications/exponential-bounds-and-stopping-rules-for-mcmc-and-general-markov-chains
Exponential bounds and stopping rules for MCMC and general Markov chains for ValueTools 2006 - IBM...
Exponential bounds and stopping rules for MCMC and general Markov chains for ValueTools 2006 by I. Kontoyiannis et al.
https://stanford.edu/~boyd/papers/symmetry.html
Symmetry Analysis of Reversible Markov Chains
symmetryanalysisreversiblemarkovchains
https://data.bnf.fr/ark:/12148/cb124136988
Doeblin conference : 50 years after Doeblin Development in the theory of Markov chains, Markov...
Toutes les informations de la Bibliotheque Nationale de France sur : Doeblin conference : 50 years after Doeblin Development in the theory of Markov chains,...
https://www.ccdc.ucsb.edu/publications/12210
Robotic Surveillance and Markov Chains With Minimal Weighted Kemeny Constant | Center for Control,...
https://research.google/pubs/understanding-self-attention-through-prompt-conditioned-markov-chains/
Understanding Self-Attention through Prompt-Conditioned Markov Chains
understandingselfattentionpromptconditioned
https://research.ibm.com/publications/the-weight-per-symbol-polytope-and-scaffolds-of-invariants-associated-with-markov-chains
The weight-per-symbol polytope and scaffolds of invariants associated with Markov chains for...
The weight-per-symbol polytope and scaffolds of invariants associated with Markov chains for Ergodic Theory and Dynamical Systems by Brian Marcus et al.
https://cran.wustl.edu/web/packages/simmer/vignettes/simmer-07-ctmc.html
Continuous-Time Markov Chains
continuoustimemarkovchains
https://amsdottorato.unibo.it/id/eprint/1547/
Markov exchangeable data and mixtures of Markov Chains
markovdatamixtureschains
https://www.coursera.org/learn/discrete-time-markov-chains-monte-carlo-methods/reviews
Learner Reviews & Feedback for Discrete-Time Markov Chains and Monte Carlo Methods Course | Coursera
Find helpful learner reviews, feedback, and ratings for Discrete-Time Markov Chains and Monte Carlo Methods from University of Colorado Boulder. Read stories...