-
Notifications
You must be signed in to change notification settings - Fork 7
/
A-rev-policies.qmd
144 lines (68 loc) · 10.3 KB
/
A-rev-policies.qmd
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
# SA: Revision policies {.unnumbered #a-rev-pol}
## In this chapter
The sections below describe:
- how to update seasonally adjusted series when new data is available
- what is a revision policy in a seasonal adjustment context
- the description of all the revision policies available in JDemetra+
- how to implement a revision policy using the Graphical User Interface, R or the Cruncher.
## Revision Policies
### Definition and context
When raw data has been modified (extended and/or revised), the previous seasonal adjustment estimation needs updating. It can be redone from scratch (complete re-estimation) or update keeping fixed a predefined set of parameters already estimated. [Eurostat's Guidelines on seasonal adjustment (2015)](https://ec.europa.eu/eurostat/documents/3859598/6830795/KS-GQ-15-001-EN-N.pdf) recommend not to perform a complete re-estimation of the parameters on an infra-annual basis. The set of constraints on the parameters is called "revision policy" or "refresh policy".
### Overview {#a-rev-pol-ov}
In X13-ARIMA and TRAMO-SEATS revision policies are ways to impose constraints on the pre-adjustment phase, while the decomposition phase (X-11 or Seats) will be entirely re-run on new data. The changes induced by X-11 re-estimation stem only from a revised linerarized series, while in Seats they are also induced by the arima model possible coefficient and/ or order changes.
The table below lists the available policies as well as their name for implementation with the graphical user interface (GUI), the cruncher or rjd3x13 ans rjd3tramoseats packages.
![](All_images/Rev_Policies.png)
## Implementation in GUI
To refresh results from previous estimation open your workspace, then SAprocessing click on a series to highlight it (or select several series), then right-click and choose *Refresh*, the following panel is displayed.
![](All_images/Rev_Policies_GUI.png)
### Display in results panel
Sections below detail, though an example, the changes in results display brought about by the use of a given revision policy.
#### Concurrent
Concurrent adjustment means that the model, filters, outliers, regression parameters and transformation type are all re-identified and the respective parameters and factors re-estimated every time new observations are available. This option in JDemetra+ means that a completely new model is identified, and the previous results are not taken into account, excepted for the user-defined parameters.
The picture below presents the initial model (on the left) and the results of the refreshment procedure with the *Concurrent adjustment* option (on the right). The transformation type has changed from none to log. The ARIMA model has been re-identified (it has changed from (0,1,1)(1,1,0) to (1,1,0)(0,1,1)). In contrast to the initial model, in the updated model trading day effects and a leap year effect are no longer included. Also the automatically identified outliers are not the same in both models.
![](All_images/UG_PCA_image2.jpg)
#### Partial concurrent adjustment → Fixed model
The *Partial concurrent adjustment → Fixed model* strategy means that the ARIMA model, outliers and other regression parameters are not re-identified and the values of the parameters are fixed. In particular, no new outliers or calendar variables are added to the model as well as no changes neither in the calendar variables nor in the outliers' types are allowed. The transformation type remains unchanged.
The picture below presents the initial model (on the left) and the results of the refreshment procedure with the *Partial concurrent adjustment → Fixed model* option (on the right). The parameters of the ARIMA part are not estimated and their values are the same as before. The trading days and outliers are fixed too and no new regression effects are identified.
![](All_images/UDimage23.jpg)
#### Partial concurrent adjustment → Estimate regression coefficients
The *Partial current adjustment → Estimate regression coefficients* option means that the ARIMA model, outliers and other regression parameters are not re-identified. The coefficients of the ARIMA model are fixed, other coefficients are re-estimated. In particular, no new outliers or calendar variables are added to the model as well as no changes neither in the calendar variables nor in the outliers' types are allowed. The transformation type remains unchanged.
The picture below presents the initial model (on the left) and the results of the refreshment procedure with the *Partial concurrent adjustment* *→ Estimate regression coefficients* option (on the right). The number of estimated parameters is 16 in the initial model and 14 in the revised model (the parameters of the ARIMA model are not estimated.
![](All_images/UDimage24.jpg)
**The *Partial concurrent adjustment→ Estimate regression coefficients* revision policy results**
#### Partial concurrent adjustment → Estimate regression coefficients + Arima parameters
The *Partial concurrent adjustment → Estimate regression coefficients + Arima parameters* strategy means that the ARIMA model, outliers and other regression parameters are not re-identified. All parameters of the Reg-ARIMA model are re-estimated but the explanatory variables remain the same. The transformation type remains unchanged.
The picture below presents the initial model (on the left) and the results of the refreshment procedure with the *Partial* *concurrent adjustment → Estimate regression coefficient + Arima parameters* option (on the right). The parameters of the ARIMA part have been re-estimated and their values have been updated. Also regression coefficients have been re-estimated and the number of estimated coefficients in the revised model is the same as in the initial model (i.e. 16 estimated coefficients). The structure of the model remains unchanged while all coefficients have been updated.
![](All_images/UDimage25.jpg)
#### Partial concurrent adjustment → Estimate regression coefficients + outliers
The *Partial concurrent adjustment → Estimate regression coefficients + outliers* option means that the ARIMA model and regression parameters, except outliers, are not re-identified. The parameters of these variables, however, are re-estimated. All outliers are re-identified, i.e. the previous outcome of the outlier detection procedure is not taken into account and all outliers are identified and estimated once again. The transformation type remains unchanged.
The picture below presents the initial model (on the left) and the results of the refreshment procedure with the *Partial concurrent adjustment → Estimate regression coefficients + outliers* option (on the right). The parameters of the ARIMA part have been re-estimated and their values have been updated. Also regression coefficients for the calendar variables have been re-estimated. In the revised model there is no *Prespecified outliers* section. Instead, the outliers were re-identified.
![](All_images/UDimage27.jpg)
#### Partial concurrent adjustment → Estimate regression coefficients + Arima model
The *Partial concurrent adjustment → Estimate regression coefficients + Arima model* option means that the ARIMA model, outliers and regression variables (except the calendar variables) are re-identified. All parameters are re-estimated. The transformation type remains unchanged.
The picture below presents the initial model (on the left) and the results of the refreshment procedure with the *Partial concurrent adjustment → Estimate regression coefficients + Arima model* option (on the right). The ARIMA part has been re-identified (a change from (2,1,0)(0,1,1) to (0,1,1)(1,1,1)). Also the regression coefficients for the calendar variables have been re-estimated. In the revised model there is no *Prespecified outliers* section. Therefore, the outliers were re-identified.
![](All_images/UG_PCA_image1.jpg)
#### Partial concurrent adjustment → Estimate regression coefficients + Last outliers
The *Partial concurrent adjustment → Estimate regression coefficients + Last outliers* strategy means that the ARIMA model, outliers (except for the last year of the sample) and other regression parameters are not re-identified. All parameters of the Reg-ARIMA model are re-estimated. The software tests for outliers in the last year of the data span and will include in the model those which are statistically significant. The transformation type remains unchanged.
The picture below presents the initial model (on the left) and the results of the refreshment procedure with the *Partial* *concurrent adjustment → Estimate regression coefficients + Last outliers* option (on the right). The parameters of the ARIMA part have been re-estimated and their values have been updated. Also the regression coefficients have been re-estimated. The number of estimated coefficients in the revised model is larger than the initial model because an additional outlier has been identified in the last year of the data span.
![](All_images/UDimage26.jpg)
## Implementation with the cruncher
In a production process, it might be suitable to use the [cruncher](T-Production-tools-cruncher-QR.qmd) in order to automatically update workspaces. When using an R package (`rjwsacruncher`` or `JDCruncher`) to do so, you will just need to specify the policy's name as shown below. Available policies and names are detailed in the #Overview section.
```{r, eval = FALSE}
cruncher_and_param(
workspace = "D:/my_folder/my_ws.xml",
rename_multi_documents = FALSE,
policy = "stochastic", # name of the revision policy
log = my_log_file.txt
)
```
## Implementation in R
Implementing refresh policies is a new v3.x feature. Two options are available
- using rjd3x13 or rjd3tramoseats directly on TS objects in R
- refreshing a workspace with rjd3workspace
<!-- add explanations here -->
When performing seasonal adjustment directly in R with `rjd3x13` or `rjd3tramoseats`, you will need to refresh the "result_spec" yielded by the previous estimation with the selected policy.
Available policies and names are detailed in [here](#a-rev-pol-ov).
More explanations and full documentation of
- `rjd3x13::x13_refresh` function can be found [here](https://rjdverse.github.io/rjd3x13/reference/refresh.html)
- `rjd3tramoseats::tramoseats_refresh` function can be found [here](https://rjdverse.github.io/rjd3tramoseats/reference/refresh.html)