Sunday, August 21, 2016
Changepoint Detection : Theoretical Background
Introduction
Changepoints are abrupt variations in the generative parameters of sequential data. Changepoint detection is the process of identifying such abrupt variations and it has been useful in a wide range of applications such as EEG analysis, DNA segmentation, econometrics etc.
Bayesian ways of change point detection focus on segmentation and techniques to generate samples from the posterior distribution over changepoint locations.
Let's try to understand this without a lot of complex mathematical notations. When we are given a data set that varies according to time ( e.g:  a time series ), there might be sudden changes. Because of these changes the data set can be partitioned and separately analysed. Therefore if we assume that within a partition there is a relationship between data points, we can perform a regression to calculate regression coefficients. (Provided that we have an idea about the change points)
However this does not capture the uncertainty involved with the change points. This is where change point distributions come in to play. Following the Bayesian change point model, and by using a constrained HMM (Hidden Markov Model ) we are able to calculate the posterior distribution.
Therefore the posterior distribution can be calculated with a modified forward backward algorithm. The algorithm can be further improved to compute the most probable change point configuration.
The references below provide more insight to the postCP package.
[1] Luong, T.M., Rozenholc, Y. and Nuel, G., 2013. Fast estimation of posterior probabilities in changepoint analysis through a constrained hidden Markov model. Computational Statistics & Data Analysis, 68, pp.129140.
However this does not capture the uncertainty involved with the change points. This is where change point distributions come in to play. Following the Bayesian change point model, and by using a constrained HMM (Hidden Markov Model ) we are able to calculate the posterior distribution.
Therefore the posterior distribution can be calculated with a modified forward backward algorithm. The algorithm can be further improved to compute the most probable change point configuration.
The references below provide more insight to the postCP package.
[1] Luong, T.M., Rozenholc, Y. and Nuel, G., 2013. Fast estimation of posterior probabilities in changepoint analysis through a constrained hidden Markov model. Computational Statistics & Data Analysis, 68, pp.129140.
Subscribe to:
Post Comments
(
Atom
)
About Me
Blog Archive
Popular Posts

In building the required libraries for a docker container, using a maven project, the libraries have to be copied to a separate location an...

Introduction The project aimed at improving the postCP package and making it available on CRAN again. The snag that prevented the pac...

It was quite a daunting task at the beginning to start with Kubernetes 1.7 alpha release because I knew that I was bound to face with diffi...

It all began when I started searching for a Google Summer of Code project last year (November, 2015) . While I was searching through the we...

Recently for a project, I used a Raspberry Pi. Although mostly it's preferred to use raspbian as an operating system, I chose to use U...

Introduction Changepoints are abrupt variations in the generative parameters of sequential data. Changepoint detection is the process o...

Since I'm on vacation, I thought of planning my project using the free time. As the next step, I thought of developing the front end of...

Last week we were assigned projects for our 4th semester and I was selected for the energy sector. As a part of it, when I was exploring t...
Powered by Blogger.
Labels
#GSOC
(3)
#Tech
(3)
#postCP
(3)
#Kubernetes
(2)
#Rgsoc
(2)
#docker
(2)
#CentOS
(1)
#Cluster
(1)
#Pi
(1)
#R
(1)
#Ubuntu
(1)
#dockermavenplugin
(1)
#fabric8
(1)
#raspberryPi
(1)
Air Conditioning
(1)
Embedded
(1)
Micro Controllers
(1)
Power consumption
(1)
Smart Systems
(1)
Tech
(1)
© Malith's Perspective 2016 . Powered by Bootstrap , Blogger templates and RWD Testing Tool
No comments :
Post a Comment