FSReda enables to monitor several quantities in each step of the forward search

Example of use of FSReda based on a starting point coming from LMS.

n=200; p=3; randn('state', 123456); X=randn(n,p); % Uncontaminated data y=randn(n,1); % Contaminated data ycont=y; ycont(1:5)=ycont(1:5)+6; [out]=LXS(y,X,'nsamp',1000); out=FSReda(y,X,out.bs);

Example of use of function FSReda using a random start and traditional t-stat monitoring.

n=200; p=3; randn('state', 123456); X=randn(n,p); % Uncontaminated data y=randn(n,1); % Contaminated data ycont=y; ycont(1:5)=ycont(1:5)+6; out=FSReda(y,X,0,'tstat','trad');

xx=load('wool.txt'); X=xx(:,1:3); y=log(xx(:,4)); [out]=LXS(y,X,'nsamp',0); [out]=FSReda(y,X,out.bs,'tstat','scal');

n=100; p=8; state=1; randn('state', state); X=randn(n,p); y=randn(n,1); y(1:10)=y(1:10)+5; % Run the forward search with Exploratory Data Analysis purposes % LMS using 10000 subsamples [outLXS]=LXS(y,X,'nsamp',10000); % Forward Search [out]=FSReda(y,X,outLXS.bs); %The monitoring residuals plot shows a set of positive residuals which %starting from the central part of the search tend to have a residual much %larger than that of the other units. resfwdplot(out); %The minimum deletion residual from m=90 starts going above the 99% threshold. mdrplot(out); %The curve which monitors the normality test shows a sudden big increase with the outliers are included figure; lwdenv=2; xlimx=[10 100]; subplot(2,2,1); plot(out.nor(:,1),out.nor(:,2)); title('Asimmetry test'); xlim(xlimx); quant=chi2inv(0.99,1); v=axis; line([v(1),v(2)],[quant,quant],'color','r','LineWidth',lwdenv); subplot(2,2,2) plot(out.nor(:,1),out.nor(:,3)) title('Kurtosis test'); xlim(xlimx); v=axis; line([v(1),v(2)],[quant,quant],'color','r','LineWidth',lwdenv); subplot(2,2,3:4) plot(out.nor(:,1),out.nor(:,4)); xlim(xlimx); quant=chi2inv(0.99,2); v=axis; line([v(1),v(2)],[quant,quant],'color','r','LineWidth',lwdenv); title('Normality test'); xlabel('Subset size m');

Total estimated time to complete LMS: 0.04 seconds

% House price data load hprice.txt; n=size(hprice,1); y=hprice(:,1); X=hprice(:,2:5); outFSR=FSR(y,X,'plots',0,'msg',0); dout=n-length(outFSR.ListOut); % init = point to start monitoring diagnostics along the FS init=20; [outLXS]=LXS(y,X,'nsamp',10000); outEDA=FSReda(y,X,outLXS.bs,'conflev',[0.95 0.99],'init',init); p=size(X,2)+1; % Set font size, line width and line style figure; lwd=2.5; FontSize=14; linst={'-','--',':','-.','--',':'}; nr=3; nc=2; xlimL=init; % lower value fo xlim xlimU=n+1; % upper value of xlim close all for j=1:p subplot(nr,nc,j); hold('on') % plot 95% and 99% HPD trajectories plot(outEDA.Bols(:,1),outEDA.betaINT(:,1:2,j),'LineStyle',linst{4},'LineWidth',lwd,'Color','b') plot(outEDA.Bols(:,1),outEDA.betaINT(:,3:4,j),'LineStyle',linst{4},'LineWidth',lwd,'Color','r') % plot estimate of beta1_j plot(outEDA.Bols(:,1),outEDA.Bols(:,j+1)','LineStyle',linst{1},'LineWidth',lwd,'Color','k') % Set ylim ylimU=max(outEDA.betaINT(:,4,j)); ylimL=min(outEDA.betaINT(:,3,j)); ylim([ylimL ylimU]) % Set xlim xlim([xlimL xlimU]); % Add vertical line in correspondence of the step prior to the % entry of the first outlier line([dout; dout],[ylimL; ylimU],'Color','r','LineWidth',lwd); ylabel(['$\hat{\beta_' num2str(j-1) '}$'],'Interpreter','LaTeX','FontSize',20,'rot',-360); set(gca,'FontSize',FontSize); if j>(nr-1)*nc xlabel('Subset size m','FontSize',FontSize); end end % Subplot associated with the monitoring of sigma^2 subplot(nr,nc,6); hold('on') % 99% plot(outEDA.sigma2INT(:,1),outEDA.sigma2INT(:,4:5),'LineStyle',linst{4},'LineWidth',lwd,'Color','r') % 95% plot(outEDA.sigma2INT(:,1),outEDA.sigma2INT(:,2:3),'LineStyle',linst{2},'LineWidth',lwd,'Color','b') % Plot rescaled S2 plot(outEDA.S2(:,1),outEDA.S2(:,4),'LineWidth',lwd,'Color','k') ylabel('$\hat{\sigma}^2$','Interpreter','LaTeX','FontSize',20,'rot',-360); set(gca,'FontSize',FontSize); % Set ylim ylimU=max(outEDA.sigma2INT(:,5)); ylimL=min(outEDA.sigma2INT(:,4)); ylim([ylimL ylimU]) % Set xlim xlim([xlimL xlimU]); % Add vertical line in correspondence of the step prior to the % entry of the first outlier line([dout; dout],[ylimL; ylimU],'Color','r','LineWidth',lwd); xlabel('Subset size m','FontSize',FontSize); % Add multiple title suplabel(['Housing data; confidence intervals of the parameters monitored in the interval ['... num2str(xlimL) ',' num2str(xlimU) ... ']'],'t'); disp(['The vertical lines are located in the' ... ' step prior to the inclusion of the first outlier'])

Total estimated time to complete LMS: 0.18 seconds ------------------------------ Warning: Number of subsets without full rank equal to 38.3% m=100 m=200 m=300 m=400 m=500 The vertical lines are located in the step prior to the inclusion of the first outlier

% Load the data clearvars;close all; load('multiple_regression.txt'); y=multiple_regression(:,4); X=multiple_regression(:,1:3); % yX plot yXplot(y,X) % Robust analysis % LMS using 1000 subsamples [out]=LXS(y,X,'nsamp',10000); % Forward Search [out]=FSReda(y,X,out.bs); out1=out; % Create scaled squared residuals out1.RES=out.RES.^2; resfwdplot(out1,'databrush',1);

load('loyalty.mat'); y = loyalty{:,end}; X = loyalty{:,1}; tit = sprintf('Loyalty data'); xla = 'Number of visits'; yla = 'Amount spent (in Euros)'; n = size(X, 1); p = size(X, 2); % LXS and FSReda [outLXS]=LXS(y,X,'nsamp',1000); [out] = FSReda(y, X, outLXS.bs, 'intercept', false, 'wREML', true); % plot solution overwriting the RES output for simplicity out.RES = out.wREML; resfwdplot(out); ylabel('REML weights FS');

Total estimated time to complete LMS: 0.01 seconds m=100 m=200 m=300 m=400 m=500

`y`

— Response variable.
Vector.Response variable, specified as a vector of length n, where n is the number of observations. Each entry in y is the response for the corresponding row of X.

Missing values (NaN's) and infinite values (Inf's) are allowed, since observations (rows) with missing or infinite values will automatically be excluded from the computations.

**
Data Types: **`single| double`

`X`

— Data matrix of explanatory variables (also called 'regressors')
of dimension (n x p-1).
Rows of X represent observations, and
columns represent variables.Missing values (NaN's) and infinite values (Inf's) are allowed, since observations (rows) with missing or infinite values will automatically be excluded from the computations.

**
Data Types: **`single| double`

`bsb`

— list of units forming the initial
subset.
Vector or scalar.If bsb=0 (default) then the procedure starts with p units randomly chosen else if bsb is not 0 the search will start with m0=length(bsb).

**
Data Types: **`single| double`

Specify optional comma-separated pairs of `Name,Value`

arguments.
`Name`

is the argument name and `Value`

is the corresponding value. `Name`

must appear
inside single quotes (`' '`

).
You can specify several name and value pair arguments in any order as ```
Name1,Value1,...,NameN,ValueN
```

.

```
'conflev',[0.90 0.93]
```

,```
'init',100 starts monitoring from step m=100
```

,```
'intercept',false
```

,```
'nocheck',true
```

,```
'tstat','trad'
```

,```
'wREML', true
```

`conflev`

—confidence levels to be used to compute confidence interval
for the elements of $\beta$ and for $\sigma^2$.vector.The default value of conflev is [0.95 0.99] that is 95% and 99% confidence intervals are computed.

**Example: **```
'conflev',[0.90 0.93]
```

**Data Types: **`double`

`init`

—Search initialization.scalar.It specifies the point where to initialize the search and start monitoring required diagnostics. if init is not specified it will be set equal to : p+1, if the sample size is smaller than 40;

min(3*p+1,floor(0.5*(n+p+1))), otherwise.

**Example: **```
'init',100 starts monitoring from step m=100
```

**Data Types: **`double`

`intercept`

—Indicator for constant term.true (default) | false.Indicator for the constant term (intercept) in the fit, specified as the comma-separated pair consisting of 'Intercept' and either true to include or false to remove the constant term from the model.

**Example: **```
'intercept',false
```

**Data Types: **`boolean`

`nocheck`

—Check input arguments.boolean.If nocheck is equal to true no check is performed on matrix y and matrix X. Notice that y and X are left unchanged. In other words the additional column of ones for the intercept is not added. As default nocheck=false. The controls on h, alpha and nsamp still remain

**Example: **```
'nocheck',true
```

**Data Types: **`boolean`

`tstat`

—the kind of t-statistics which have to be monitored.character.tstat = 'trad' implies monitoring of traditional t statistics (out.Tols). In this case the estimate of $\sigma^2$ at step m is based on $s^2_m$ (notice that $s^2_m<<\sigma^2$ when m/n is small) tstat = 'scal' (default) implies monitoring of rescaled t statistics In this case the estimate of $\sigma^2$ at step m is based on $s^2_m / var_{truncnorm(m/n)}$ where $var_{truncnorm(m/n)}$ is the variance of the truncated normal distribution.

**Example: **```
'tstat','trad'
```

**Data Types: **`char`

`wREML`

—compute REML weights for unit excluded from FS at each step.false (default) | true.If weak==true REML weights are computed.

**Example: **```
'wREML', true
```

**Data Types: **```
boolean
Data Types - double
```

`out`

— description
StructureStructure which contains the following fields

Value | Description |
---|---|

`RES` |
n x (n-init+1) = matrix containing the monitoring of scaled residuals: 1st row = residual for first unit; ...; nth row = residual for nth unit. |

`LEV` |
(n+1) x (n-init+1) = matrix containing the monitoring of leverage: 1st row = leverage for first unit: ...; nth row = leverage for nth unit. |

`BB` |
n x (n-init+1) matrix containing the information about the units belonging to the subset at each step of the forward search: 1st col = indexes of the units forming subset in the initial step; ...; last column = units forming subset in the final step (all units). |

`mdr` |
n-init x 3 matrix which contains the monitoring of minimum deletion residual or (m+1)ordered residual at each step of the forward search: 1st col = fwd search index (from init to n-1); 2nd col = minimum deletion residual; 3rd col = (m+1)-ordered residual. Remark: these quantities are stored with sign, that is the min deletion residual is stored with negative sign if it corresponds to a negative residual. |

`msr` |
n-init+1 x 3 = matrix which contains the monitoring of maximum studentized residual or m-th ordered residual: 1st col = fwd search index (from init to n); 2nd col = maximum studentized residual; 3rd col = (m)-ordered studentized residual. |

`nor` |
(n-init+1) x 4 matrix containing the monitoring of normality test in each step of the forward search: 1st col = fwd search index (from init to n); 2nd col = Asymmetry test; 3rd col = Kurtosis test; 4th col = Normality test. |

`Bols` |
(n-init+1) x (p+1) matrix containing the monitoring of estimated beta coefficients in each step of the forward search. |

`S2` |
(n-init+1) x 5 matrix containing the monitoring of S2 or R2, F test, in each step of the forward search: 1st col = fwd search index (from init to n); 2nd col = monitoring of S2; 3rd col = monitoring of R2; 4th col = monitoring of rescaled S2. In this case the estimated of $\sigma^2$ at step m is divided by the consistency factor (to make the estimate asymptotically unbiased). 5th col = monitoring of F test. Note that an asymptotic unbiased estimate of sigma2 is used. |

`coo` |
(n-init+1) x 3 matrix containing the monitoring of Cook or modified Cook distance in each step of the forward search: 1st col = fwd search index (from init to n); 2nd col = monitoring of Cook distance; 3rd col = monitoring of modified Cook distance. |

`Tols` |
(n-init+1) x (p+1) matrix containing the monitoring of estimated t-statistics (as specified in option input 'tstat'. in each step of the forward search |

`Un` |
(n-init) x 11 Matrix which contains the unit(s) included in the subset at each step of the fwd search. REMARK: in every step the new subset is compared with the old subset. Un contains the unit(s) present in the new subset but not in the old one Un(1,2) for example contains the unit included in step init+1 Un(end,2) contains the units included in the final step of the search. |

`betaINT` |
Confidence intervals for the elements of $\beta$. betaINT is a (n-init+1)-by-2*length(confint)-by-p 3D array. Each third dimension refers to an element of beta: betaINT(:,:,1) is associated with first element of beta; ...; betaINT(:,:,p) is associated with last element of beta. The first two columns contain the lower and upper confidence limits associated with conflev(1). Columns three and four contain the lower and upper confidence limits associated with conflev(2); ...; The last two columns contain the lower and upper confidence limits associated with conflev(end). For example betaint(:,3:4,5) contain the lower and upper confidence limits for the fifth element of beta using confidence level specified in the second element of input option conflev. |

`sigma2INT` |
confidence interval for $\sigma^2$. 1st col = fwd search index; 2nd col = lower confidence limit based on conflev(1); 3rd col = upper confidence limit based on conflev(1); 4th col = lower confidence limit based on conflev(2); 5th col = upper confidence limit based on conflev(2); ... penultimate col = lower confidence limit based on conflev(end); last col = upper confidence limit based on conflev(end); |

`y` |
A vector with n elements that contains the response variable which has been used |

`X` |
Data matrix of explanatory variables which has been used (it also contains the column of ones if input option intercept was missing or equal to 1) |

`class` |
'FSReda'. |

`wREML` |
Singularly optimal REML weights for the units excluded for the search at each step. Present only if wREML == true. n x (n-init+1) = matrix containing the monitoring of singlular REML weights: 1st row = weight for first unit; ...; nth row = weight for nth unit. |

Atkinson, A.C. and Riani, M. (2000), "Robust Diagnostic Regression Analysis", Springer Verlag, New York.