Wang, T;
Samworth, RJ;
(2018)
High dimensional change point estimation via sparse projection.
Journal of the Royal Statistical Society. Series B: Statistical Methodology
, 80
(1)
pp. 57-83.
10.1111/rssb.12243.
Preview |
Text
Wang_et_al-2018-Journal_of_the_Royal_Statistical_Society%3A_Series_B_%28Statistical_Methodology%29.pdf - Published Version Download (2MB) | Preview |
Abstract
Change points are a very common feature of ‘big data’ that arrive in the form of a data stream. We study high dimensional time series in which, at certain time points, the mean structure changes in a sparse subset of the co-ordinates. The challenge is to borrow strength across the co-ordinates to detect smaller changes than could be observed in any individual component series. We propose a two-stage procedure called inspect for estimation of the change points: first, we argue that a good projection direction can be obtained as the leading left singular vector of the matrix that solves a convex optimization problem derived from the cumulative sum transformation of the time series. We then apply an existing univariate change point estimation algorithm to the projected series. Our theory provides strong guarantees on both the number of estimated change points and the rates of convergence of their locations, and our numerical studies validate its highly competitive empirical performance for a wide range of data-generating mechanisms. Software implementing the methodology is available in the R package InspectChangepoint.
Type: | Article |
---|---|
Title: | High dimensional change point estimation via sparse projection |
Open access status: | An open access version is available from UCL Discovery |
DOI: | 10.1111/rssb.12243 |
Publisher version: | http://dx.doi.org/10.1111/rssb.12243 |
Language: | English |
Additional information: | © 2017 The Authors Journal of the Royal Statistical Society: Series B (Statistical Methodology) Published by John Wiley & Sons Ltd on behalf of the Royal Statistical Society. This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited. |
Keywords: | Change point estimation; Convex optimization; Dimension reduction; Piecewise stationary; Segmentation; Sparsity |
UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences > Dept of Statistical Science |
URI: | https://discovery-pp.ucl.ac.uk/id/eprint/10055406 |
Archive Staff Only
![]() |
View Item |