a research paper about FDSLRM modeling with supplementary materials - software, notebooks
Authors: Jozef Hanč, Martina Hančová, Andrej Gajdoš
Faculty of Science, P. J. Šafárik University in Košice, Slovakia
emails: [email protected]
EBLUP-NE for electricity consumption 1
Python-based computational tools - SageMath
Table of Contents
Data and model - data and model description of empirical data
Natural estimators - EBLUPNE based on NE
NN-DOOLSE, MLE - EBLUPNE based on nonnegative DOOLSE (same as MLE)
NN-MDOOLSE, REMLE - EBLUPNE based on nonnegative MDOOLSE (same as REMLE)
To get back to the contents, use the Home key.
SageMath - precision and functions
SageMath is a free Python-based mathematics software, an open source alternative to the well-known commercial computer algebra systems Mathematica or Maple, which is built on top of SciPy ecosystem, Maxima, R, GAP, FLINT and many others open-source packages; http://www.sagemath.org/
In this FDSLRM application, we model the econometric time series data set, representing the hours observations of the consumption of the electric energy in some department store. The number of time series observations is . The data was adapted from Štulajter & Witkovský, 2004 and the FDSLRM model from Gajdoš et al 2017.
The consumption data can be fitted by the following Gaussian orthogonal FDSLRM:
where
stage of EBLUP-NE
using formula (3.10) from Hancova et al 2019.
where are NE, are initial estimates for EBLUP-NE
KKT algorithm
using the the KKT algorithm (tab.3, Hancova et al 2019)
stage of EBLUP-NE
stage of EBLUP-NE
References
This notebook belongs to suplementary materials of the paper submitted to Statistical Papers and available at https://arxiv.org/abs/1905.07771.
Hančová, M., Vozáriková, G., Gajdoš, A., Hanč, J. (2019). Estimating variance components in time series linear regression models using empirical BLUPs and convex optimization, https://arxiv.org/, 2019.
Abstract of the paper
We propose a two-stage estimation method of variance components in time series models known as FDSLRMs, whose observations can be described by a linear mixed model (LMM). We based estimating variances, fundamental quantities in a time series forecasting approach called kriging, on the empirical (plug-in) best linear unbiased predictions of unobservable random components in FDSLRM.
The method, providing invariant non-negative quadratic estimators, can be used for any absolutely continuous probability distribution of time series data. As a result of applying the convex optimization and the LMM methodology, we resolved two problems theoretical existence and equivalence between least squares estimators, non-negative (M)DOOLSE, and maximum likelihood estimators, (RE)MLE, as possible starting points of our method and a practical lack of computational implementation for FDSLRM. As for computing (RE)MLE in the case of observed time series values, we also discovered a new algorithm of order , which at the default precision is times more accurate and times faster than the best current Python(or R)-based computational packages, namely CVXPY, CVXR, nlme, sommer and mixed.
We illustrate our results on three real data sets electricity consumption, tourism and cyber security which are easily available, reproducible, sharable and modifiable in the form of interactive Jupyter notebooks.
Gajdoš, A., Hančová, M., Hanč, J. (2017). Kriging Methodology and Its Development in Forecasting Econometric Time Series. Statistica: Statistics and Economy Journal, 2017, Vol. 97, No. 1, pp. 59–73
Štulajter, F., Witkovský, V. (2004). Estimation of Variances in Orthogonal Finite Discrete Spectrum Linear Regression Models. Metrika, 2004, Vol. 60, No. 2, pp. 105–118