Malith's Perspective

Sunday, August 21, 2016

Changepoint Detection : Theoretical Background

Posted by Unknown at 9:08:00 PM Labels: #GSOC , #postCP , #R-gsoc , #Tech

Introduction 

Changepoints are abrupt variations in the generative parameters of sequential data. Changepoint detection is the process of identifying such abrupt variations and it has been useful in a wide range of applications such as EEG analysis, DNA segmentation, econometrics etc. 

Bayesian ways of  change point detection focus on segmentation and techniques to generate samples from the posterior distribution over changepoint locations. 

Let's try to understand this without a lot of complex mathematical notations. When we are given a data set that varies according to time ( e.g: - a time series ), there might be sudden changes. Because of these changes the data set can be partitioned and separately analysed. Therefore if we assume that within a partition there is a relationship between data points, we can perform a regression to calculate regression coefficients. (Provided that we have an idea about the change points)

However this does not capture the uncertainty involved with the change points. This is where change point distributions come in to play. Following the Bayesian change point model, and by using a constrained HMM (Hidden Markov Model ) we are able to calculate the posterior distribution.

Therefore the posterior distribution can be calculated with a modified forward backward algorithm. The algorithm can be further improved to compute the most probable change point configuration.

The references below provide more insight to the postCP package.

[1] Luong, T.M., Rozenholc, Y. and Nuel, G., 2013. Fast estimation of posterior probabilities in change-point analysis through a constrained hidden Markov model. Computational Statistics & Data Analysis, 68, pp.129-140.

Tweet

No related post available

No comments :

Post a Comment

Newer Post Older Post Home
Subscribe to: Post Comments ( Atom )

R-bloggers

  • Mock Them All: Simulate to Better Test with testthat
  • Spatial machine learning with caret
  • Notes on DEseq2 design
  • Using LLMs with ellmer workshop by Hadley Wickham
  • Multi-language pipelines with rixpress

Navigation

  • Home
  • Twitter

About Me

Unknown
View my complete profile

Blog Archive

  • 2017 (2)
    • May (2)
  • 2016 (4)
    • August (4)
      • Changepoint Detection : Theoretical Background
      • My Experience with GSOC and R
      • postCP change point detection with GSOC
      • Conquering Raspberry Pi with Ubuntu 14.04 : Resolv...
  • 2014 (2)
    • December (2)

Popular Posts

  • Using fabric8 docker-maven-plugin to automate docker builds
    In building the required libraries for a docker container, using a maven project, the libraries have to be copied to a separate location an...
  • postCP change point detection with GSOC
    Introduction The project aimed at improving the postCP package and making it available on CRAN again. The snag that prevented the pac...
  • My Experience with GSOC and R
    It all began when I started searching for a Google Summer of Code project last year (November, 2015) . While I was searching through the we...
  • Gauge Meters; A daunting task
    Since I'm on vacation, I thought of planning my project using the free time. As the next step, I thought of developing the front end of...
  • Changepoint Detection : Theoretical Background
    Introduction  Changepoints are abrupt variations in the generative parameters of sequential data. Changepoint detection is the process o...
  • Conquering Raspberry Pi with Ubuntu 14.04 : Resolving issues with Partitioning
    Recently for a project, I used a Raspberry Pi. Although mostly it's preferred to use raspbian as an operating system, I chose to use U...
  • Setting up Kubernetes 1.7 on a CentOS 7.1 cluster
    It was quite a daunting task at the beginning to start with Kubernetes 1.7 alpha release because I knew that I was bound to face with diffi...
  • Air Conditioning? Big Deal?
    Last week we were assigned projects for our 4th semester and I was selected for the energy sector. As a part of it, when I was exploring t...
Powered by Blogger.

Labels

#GSOC (3) #Tech (3) #postCP (3) #Kubernetes (2) #R-gsoc (2) #docker (2) #CentOS (1) #Cluster (1) #Pi (1) #R (1) #Ubuntu (1) #docker-maven-plugin (1) #fabric8 (1) #raspberryPi (1) Air Conditioning (1) Embedded (1) Micro Controllers (1) Power consumption (1) Smart Systems (1) Tech (1)

© Malith's Perspective 2016 . Powered by Bootstrap , Blogger templates and RWD Testing Tool