STEPDISC LDA - wavenois dataset#
[1]:
#disable warnings
from warnings import simplefilter, filterwarnings
simplefilter(action='ignore', category=FutureWarning)
filterwarnings("ignore")
weveform dataset#
[2]:
#vins dataset
from discrimintools.datasets import load_dataset
D = load_dataset("wavenoise")
print(D.info())
<class 'pandas.core.frame.DataFrame'>
RangeIndex: 5000 entries, 0 to 4999
Data columns (total 62 columns):
# Column Non-Null Count Dtype
--- ------ -------------- -----
0 V01 5000 non-null float64
1 V02 5000 non-null float64
2 V03 5000 non-null float64
3 V04 5000 non-null float64
4 V05 5000 non-null float64
5 V06 5000 non-null float64
6 V07 5000 non-null float64
7 V08 5000 non-null float64
8 V09 5000 non-null float64
9 V10 5000 non-null float64
10 V11 5000 non-null float64
11 V12 5000 non-null float64
12 V13 5000 non-null float64
13 V14 5000 non-null float64
14 V15 5000 non-null float64
15 V16 5000 non-null float64
16 V17 5000 non-null float64
17 V18 5000 non-null float64
18 V19 5000 non-null float64
19 V20 5000 non-null float64
20 V21 5000 non-null float64
21 noisy1 5000 non-null float64
22 noisy2 5000 non-null float64
23 noisy3 5000 non-null float64
24 noisy4 5000 non-null float64
25 noisy5 5000 non-null float64
26 noisy6 5000 non-null float64
27 noisy7 5000 non-null float64
28 noisy8 5000 non-null float64
29 noisy9 5000 non-null float64
30 noisy10 5000 non-null float64
31 noisy11 5000 non-null float64
32 noisy12 5000 non-null float64
33 noisy13 5000 non-null float64
34 noisy14 5000 non-null float64
35 noisy15 5000 non-null float64
36 noisy16 5000 non-null float64
37 noisy17 5000 non-null float64
38 noisy18 5000 non-null float64
39 noisy19 5000 non-null float64
40 noisy20 5000 non-null float64
41 noisy21 5000 non-null float64
42 noisy22 5000 non-null float64
43 noisy23 5000 non-null float64
44 noisy24 5000 non-null float64
45 noisy25 5000 non-null float64
46 noisy26 5000 non-null float64
47 noisy27 5000 non-null float64
48 noisy28 5000 non-null float64
49 noisy29 5000 non-null float64
50 noisy30 5000 non-null float64
51 noisy31 5000 non-null float64
52 noisy32 5000 non-null float64
53 noisy33 5000 non-null float64
54 noisy34 5000 non-null float64
55 noisy35 5000 non-null float64
56 noisy36 5000 non-null float64
57 noisy37 5000 non-null float64
58 noisy38 5000 non-null float64
59 noisy39 5000 non-null float64
60 noisy40 5000 non-null float64
61 classe 5000 non-null object
dtypes: float64(61), object(1)
memory usage: 2.4+ MB
None
Instanciation and training#
[3]:
from discrimintools import DISCRIM, STEPDISC
#split into X and y
y, X = D["classe"], D.drop(columns=["classe"])
clf = DISCRIM().fit(X,y)
clf2 = STEPDISC(method="forward",alpha=0.01,verbose=True)
clf2.fit(clf)
====================== Step 1 forward selection results =======================
Wilks' Lambda Partial R-Square F Value Num DF Den DF \
V01 0.999400 0.000600 1.499319 2 4997
V02 0.947882 0.052118 137.375321 2 4997
V03 0.853547 0.146453 428.697599 2 4997
V04 0.750799 0.249201 829.286754 2 4997
V05 0.668073 0.331927 1241.358322 2 4997
... ... ... ... ... ...
noisy36 0.999648 0.000352 0.879410 2 4997
noisy37 0.999953 0.000047 0.116597 2 4997
noisy38 0.999103 0.000897 2.243096 2 4997
noisy39 0.999906 0.000094 0.234189 2 4997
noisy40 0.999725 0.000275 0.687115 2 4997
Pr>F
V01 2.233827e-01
V02 8.338596e-59
V03 1.484031e-172
V04 9.916918e-312
V05 0.000000e+00
... ...
noisy36 4.150918e-01
noisy37 8.899463e-01
noisy38 1.062363e-01
noisy39 7.912206e-01
noisy40 5.030725e-01
[61 rows x 6 columns]
Variable V07 will enter
====================== Step 2 forward selection results =======================
Wilks' Lambda Partial R-Square F Value Num DF Den DF \
V01 0.619365 0.000554 1.384327 2 4996
V02 0.612597 0.011475 28.996684 2 4996
V03 0.597780 0.035385 91.633051 2 4996
V04 0.574247 0.073360 197.760422 2 4996
V05 0.549123 0.113900 321.096081 2 4996
V06 0.563788 0.090236 247.767527 2 4996
V08 0.546247 0.118541 335.938914 2 4996
V09 0.486789 0.214486 682.085061 2 4996
V10 0.449081 0.275334 949.106739 2 4996
V11 0.427781 0.309706 1120.746845 2 4996
V12 0.488193 0.212222 672.942236 2 4996
V13 0.548674 0.114625 323.403876 2 4996
V14 0.578911 0.065833 176.040399 2 4996
V15 0.525618 0.151829 447.161973 2 4996
V16 0.517493 0.164940 493.402981 2 4996
V17 0.488494 0.211736 670.988372 2 4996
V18 0.521675 0.158192 469.424258 2 4996
V19 0.569384 0.081207 220.784397 2 4996
V20 0.604223 0.024987 64.017907 2 4996
V21 0.619593 0.000187 0.466257 2 4996
noisy1 0.619481 0.000367 0.917607 2 4996
noisy2 0.619461 0.000399 0.996427 2 4996
noisy3 0.619642 0.000106 0.265768 2 4996
noisy4 0.619236 0.000762 1.905187 2 4996
noisy5 0.619502 0.000332 0.830535 2 4996
noisy6 0.618573 0.001832 4.585712 2 4996
noisy7 0.619551 0.000254 0.633688 2 4996
noisy8 0.619688 0.000032 0.080499 2 4996
noisy9 0.619608 0.000162 0.404177 2 4996
noisy10 0.619661 0.000077 0.192623 2 4996
noisy11 0.619677 0.000051 0.128133 2 4996
noisy12 0.619690 0.000030 0.075222 2 4996
noisy13 0.619623 0.000137 0.342534 2 4996
noisy14 0.619607 0.000163 0.408343 2 4996
noisy15 0.619596 0.000181 0.451833 2 4996
noisy16 0.619375 0.000539 1.346263 2 4996
noisy17 0.619628 0.000129 0.322286 2 4996
noisy18 0.619327 0.000615 1.537296 2 4996
noisy19 0.619654 0.000088 0.220637 2 4996
noisy20 0.619389 0.000516 1.288388 2 4996
noisy21 0.619663 0.000072 0.180626 2 4996
noisy22 0.619520 0.000303 0.758272 2 4996
noisy23 0.619481 0.000367 0.917764 2 4996
noisy24 0.619696 0.000020 0.051060 2 4996
noisy25 0.619437 0.000438 1.094940 2 4996
noisy26 0.619040 0.001078 2.695879 2 4996
noisy27 0.619241 0.000754 1.884764 2 4996
noisy28 0.619565 0.000231 0.575980 2 4996
noisy29 0.619209 0.000806 2.014925 2 4996
noisy30 0.619544 0.000265 0.662126 2 4996
noisy31 0.619346 0.000584 1.459371 2 4996
noisy32 0.619666 0.000068 0.171036 2 4996
noisy33 0.619705 0.000006 0.014292 2 4996
noisy34 0.619324 0.000620 1.550116 2 4996
noisy35 0.619579 0.000209 0.521791 2 4996
noisy36 0.619552 0.000253 0.631739 2 4996
noisy37 0.619594 0.000184 0.458946 2 4996
noisy38 0.619317 0.000631 1.577970 2 4996
noisy39 0.619664 0.000072 0.178695 2 4996
noisy40 0.619462 0.000398 0.994029 2 4996
Pr>F
V01 2.505883e-01
V02 3.015988e-13
V03 8.256642e-40
V04 2.208161e-83
V05 6.477769e-132
V06 2.534059e-103
V08 1.301576e-137
V09 1.241469e-262
V10 0.000000e+00
V11 0.000000e+00
V12 1.649871e-259
V13 8.388496e-133
V14 1.319245e-74
V15 2.244696e-179
V16 2.820622e-196
V17 7.693564e-259
V18 1.518983e-187
V19 1.311377e-92
V20 3.529088e-28
V21 6.273733e-01
noisy1 3.995412e-01
noisy2 3.692698e-01
noisy3 7.666277e-01
noisy4 1.489029e-01
noisy5 4.358761e-01
noisy6 1.023945e-02
noisy7 5.306740e-01
noisy8 9.226569e-01
noisy9 6.675475e-01
noisy10 8.247991e-01
noisy11 8.797390e-01
noisy12 9.275387e-01
noisy13 7.099859e-01
noisy14 6.647729e-01
noisy15 6.364866e-01
noisy16 2.603053e-01
noisy17 7.245063e-01
noisy18 2.150632e-01
noisy19 8.020156e-01
noisy20 2.758064e-01
noisy21 8.347532e-01
noisy22 4.685289e-01
noisy23 3.994786e-01
noisy24 9.502223e-01
noisy25 3.346400e-01
noisy26 6.758118e-02
noisy27 1.519729e-01
noisy28 5.621908e-01
noisy29 1.334387e-01
noisy30 5.157990e-01
noisy31 2.324814e-01
noisy32 8.427963e-01
noisy33 9.858096e-01
noisy34 2.123253e-01
noisy35 5.934889e-01
noisy36 5.317087e-01
noisy37 6.319763e-01
noisy38 2.064965e-01
noisy39 8.363664e-01
noisy40 3.701559e-01
Variable V11 will enter
====================== Step 3 forward selection results =======================
Wilks' Lambda Partial R-Square F Value Num DF Den DF \
V01 0.427754 0.000063 0.156192 2 4995
V02 0.425291 0.005820 14.620050 2 4995
V03 0.420212 0.017693 44.984645 2 4995
V04 0.411207 0.038744 100.662544 2 4995
V05 0.400474 0.063835 170.298833 2 4995
V06 0.395797 0.074766 201.818375 2 4995
V08 0.391465 0.084893 231.688779 2 4995
V09 0.388643 0.091490 251.507787 2 4995
V10 0.387979 0.093042 256.211713 2 4995
V12 0.399923 0.065121 173.969601 2 4995
V13 0.400911 0.062813 167.389966 2 4995
V14 0.399780 0.065457 174.930215 2 4995
V15 0.388174 0.092586 254.827469 2 4995
V16 0.392113 0.083379 227.180826 2 4995
V17 0.387570 0.093999 259.118248 2 4995
V18 0.397961 0.069709 187.143294 2 4995
V19 0.416187 0.027104 69.577775 2 4995
V20 0.423642 0.009675 24.399558 2 4995
V21 0.427747 0.000080 0.199518 2 4995
noisy1 0.427606 0.000409 1.022999 2 4995
noisy2 0.427582 0.000466 1.164285 2 4995
noisy3 0.427706 0.000175 0.437877 2 4995
noisy4 0.427676 0.000245 0.611952 2 4995
noisy5 0.427574 0.000485 1.211535 2 4995
noisy6 0.426998 0.001831 4.582515 2 4995
noisy7 0.427630 0.000353 0.880752 2 4995
noisy8 0.427697 0.000196 0.488885 2 4995
noisy9 0.427761 0.000046 0.115280 2 4995
noisy10 0.427756 0.000059 0.148360 2 4995
noisy11 0.427775 0.000015 0.038229 2 4995
noisy12 0.427766 0.000035 0.086864 2 4995
noisy13 0.427716 0.000152 0.380181 2 4995
noisy14 0.427534 0.000577 1.442777 2 4995
noisy15 0.427697 0.000196 0.488664 2 4995
noisy16 0.427614 0.000391 0.977484 2 4995
noisy17 0.427742 0.000090 0.225782 2 4995
noisy18 0.427467 0.000735 1.836254 2 4995
noisy19 0.427740 0.000095 0.237163 2 4995
noisy20 0.427499 0.000660 1.648980 2 4995
noisy21 0.427775 0.000014 0.035537 2 4995
noisy22 0.427679 0.000239 0.595854 2 4995
noisy23 0.427759 0.000051 0.126337 2 4995
noisy24 0.427733 0.000113 0.282431 2 4995
noisy25 0.427649 0.000308 0.768409 2 4995
noisy26 0.427474 0.000719 1.795987 2 4995
noisy27 0.427458 0.000755 1.888051 2 4995
noisy28 0.427586 0.000455 1.136616 2 4995
noisy29 0.427480 0.000705 1.761312 2 4995
noisy30 0.427696 0.000199 0.498218 2 4995
noisy31 0.427531 0.000585 1.462165 2 4995
noisy32 0.427744 0.000087 0.216627 2 4995
noisy33 0.427778 0.000007 0.018063 2 4995
noisy34 0.427473 0.000720 1.800151 2 4995
noisy35 0.427628 0.000357 0.891138 2 4995
noisy36 0.427779 0.000004 0.009607 2 4995
noisy37 0.427670 0.000260 0.650232 2 4995
noisy38 0.427422 0.000840 2.098824 2 4995
noisy39 0.427762 0.000044 0.110896 2 4995
noisy40 0.427654 0.000298 0.744063 2 4995
Pr>F
V01 8.553990e-01
V02 4.667721e-07
V03 4.337878e-20
V04 1.383090e-43
V05 2.835734e-72
V06 5.162213e-85
V08 5.972003e-97
V09 8.472143e-105
V10 1.184664e-106
V12 9.146657e-74
V13 4.324868e-71
V14 3.726587e-74
V15 4.158794e-106
V16 3.708333e-95
V17 8.498714e-108
V18 4.223974e-79
V19 1.570396e-30
V20 2.849930e-11
V21 8.191322e-01
noisy1 3.595904e-01
noisy2 3.122305e-01
noisy3 6.454299e-01
noisy4 5.423321e-01
noisy5 2.978275e-01
noisy6 1.027218e-02
noisy7 4.145353e-01
noisy8 6.133394e-01
noisy9 8.911192e-01
noisy10 8.621248e-01
noisy11 9.624929e-01
noisy12 9.168034e-01
noisy13 6.837571e-01
noisy14 2.363693e-01
noisy15 6.134746e-01
noisy16 3.763285e-01
noisy17 7.979003e-01
noisy18 1.595210e-01
noisy19 7.888713e-01
noisy20 1.923506e-01
noisy21 9.650871e-01
noisy22 5.511308e-01
noisy23 8.813203e-01
noisy24 7.539610e-01
noisy25 4.638050e-01
noisy26 1.660707e-01
noisy27 1.514746e-01
noisy28 3.209861e-01
noisy29 1.719260e-01
noisy30 6.076424e-01
noisy31 2.318332e-01
noisy32 8.052379e-01
noisy33 9.820988e-01
noisy34 1.653811e-01
noisy35 4.102538e-01
noisy36 9.904395e-01
noisy37 5.219687e-01
noisy38 1.227087e-01
noisy39 8.950339e-01
noisy40 4.752319e-01
Variable V17 will enter
====================== Step 4 forward selection results =======================
Wilks' Lambda Partial R-Square F Value Num DF Den DF \
V01 0.387504 1.711376e-04 0.427404 2 4994
V02 0.385389 5.628529e-03 14.133989 2 4994
V03 0.380927 1.714107e-02 43.547696 2 4994
V04 0.373370 3.663905e-02 94.967229 2 4994
V05 0.363948 6.094905e-02 162.067642 2 4994
V06 0.362018 6.592817e-02 176.241942 2 4994
V08 0.367907 5.073410e-02 133.453704 2 4994
V09 0.370067 4.516272e-02 118.105258 2 4994
V10 0.366487 5.439740e-02 143.644181 2 4994
V12 0.363478 6.216270e-02 165.508733 2 4994
V13 0.363876 6.113584e-02 162.596677 2 4994
V14 0.369900 4.559245e-02 119.282747 2 4994
V15 0.369633 4.628052e-02 121.170275 2 4994
V16 0.372711 3.834003e-02 99.551878 2 4994
V18 0.373828 3.545626e-02 91.788774 2 4994
V19 0.383111 1.150590e-02 29.064653 2 4994
V20 0.385789 4.594747e-03 11.526043 2 4994
V21 0.387539 8.028552e-05 0.200489 2 4994
noisy1 0.387420 3.883477e-04 0.970081 2 4994
noisy2 0.387391 4.627725e-04 1.156078 2 4994
noisy3 0.387534 9.478758e-05 0.236707 2 4994
noisy4 0.387443 3.294460e-04 0.822898 2 4994
noisy5 0.387445 3.223367e-04 0.805134 2 4994
noisy6 0.386860 1.832903e-03 4.585163 2 4994
noisy7 0.387393 4.571500e-04 1.142026 2 4994
noisy8 0.387538 8.440269e-05 0.210771 2 4994
noisy9 0.387570 7.886329e-07 0.001969 2 4994
noisy10 0.387566 1.200279e-05 0.029971 2 4994
noisy11 0.387561 2.360774e-05 0.058950 2 4994
noisy12 0.387564 1.659845e-05 0.041447 2 4994
noisy13 0.387527 1.110974e-04 0.277441 2 4994
noisy14 0.387400 4.401333e-04 1.099497 2 4994
noisy15 0.387492 2.006592e-04 0.501147 2 4994
noisy16 0.387420 3.882499e-04 0.969837 2 4994
noisy17 0.387499 1.847543e-04 0.461417 2 4994
noisy18 0.387302 6.923979e-04 1.730115 2 4994
noisy19 0.387454 3.011054e-04 0.752087 2 4994
noisy20 0.387303 6.884434e-04 1.720227 2 4994
noisy21 0.387557 3.322708e-05 0.082971 2 4994
noisy22 0.387481 2.300103e-04 0.574468 2 4994
noisy23 0.387550 5.170950e-05 0.129125 2 4994
noisy24 0.387515 1.434645e-04 0.358282 2 4994
noisy25 0.387466 2.693682e-04 0.672794 2 4994
noisy26 0.387392 4.602935e-04 1.149882 2 4994
noisy27 0.387324 6.350490e-04 1.586725 2 4994
noisy28 0.387402 4.334429e-04 1.082776 2 4994
noisy29 0.387376 5.024096e-04 1.255147 2 4994
noisy30 0.387511 1.540897e-04 0.384821 2 4994
noisy31 0.387374 5.052499e-04 1.262247 2 4994
noisy32 0.387546 6.133157e-05 0.153154 2 4994
noisy33 0.387557 3.382348e-05 0.084460 2 4994
noisy34 0.387277 7.553429e-04 1.887517 2 4994
noisy35 0.387432 3.576234e-04 0.893305 2 4994
noisy36 0.387567 9.239368e-06 0.023071 2 4994
noisy37 0.387471 2.565791e-04 0.640842 2 4994
noisy38 0.387274 7.639881e-04 1.909137 2 4994
noisy39 0.387550 5.153167e-05 0.128681 2 4994
noisy40 0.387478 2.383177e-04 0.595221 2 4994
Pr>F
V01 6.522240e-01
V02 7.568221e-07
V03 1.780330e-19
V04 3.320648e-41
V05 6.380073e-69
V06 1.095340e-74
V08 3.447749e-57
V09 7.649496e-51
V10 2.210634e-61
V12 2.525637e-70
V13 3.882338e-69
V14 2.485770e-51
V15 4.105577e-52
V16 4.025140e-43
V18 7.109656e-40
V19 2.820195e-13
V20 1.013493e-05
V21 8.183370e-01
noisy1 3.791238e-01
noisy2 3.148023e-01
noisy3 7.892313e-01
noisy4 4.392167e-01
noisy5 4.470859e-01
noisy6 1.024507e-02
noisy7 3.192552e-01
noisy8 8.099665e-01
noisy9 9.980327e-01
noisy10 9.704735e-01
noisy11 9.427546e-01
noisy12 9.594005e-01
noisy13 7.577320e-01
noisy14 3.331193e-01
noisy15 6.058661e-01
noisy16 3.792164e-01
noisy17 6.304167e-01
noisy18 1.773702e-01
noisy19 4.714353e-01
noisy20 1.791315e-01
noisy21 9.203793e-01
noisy22 5.630416e-01
noisy23 8.788668e-01
noisy24 6.988938e-01
noisy25 5.103273e-01
noisy26 3.167579e-01
noisy27 2.046977e-01
noisy28 3.387335e-01
noisy29 2.851237e-01
noisy30 6.805925e-01
noisy31 2.831077e-01
noisy32 8.580013e-01
noisy33 9.190097e-01
noisy34 1.515554e-01
noisy35 4.093661e-01
noisy36 9.771933e-01
noisy37 5.268917e-01
noisy38 1.483164e-01
noisy39 8.792571e-01
noisy40 5.514797e-01
Variable V06 will enter
====================== Step 5 forward selection results =======================
Wilks' Lambda Partial R-Square F Value Num DF Den DF \
V01 0.361935 2.301600e-04 0.574727 2 4993
V02 0.361130 2.452798e-03 6.138466 2 4993
V03 0.358750 9.028683e-03 22.745468 2 4993
V04 0.355024 1.931946e-02 49.181188 2 4993
V05 0.349629 3.422379e-02 88.467370 2 4993
V08 0.349494 3.459477e-02 89.460710 2 4993
V09 0.346628 4.251214e-02 110.843776 2 4993
V10 0.342042 5.517993e-02 145.802029 2 4993
V12 0.346279 4.347752e-02 113.475243 2 4993
V13 0.349346 3.500371e-02 90.556590 2 4993
V14 0.353037 2.480969e-02 63.513130 2 4993
V15 0.350356 3.221537e-02 83.102868 2 4993
V16 0.351378 2.939267e-02 75.600920 2 4993
V18 0.350624 3.147535e-02 81.131854 2 4993
V19 0.358433 9.904929e-03 24.975030 2 4993
V20 0.360505 4.179394e-03 10.477647 2 4993
V21 0.361989 8.068275e-05 0.201441 2 4993
noisy1 0.361868 4.157077e-04 1.038246 2 4993
noisy2 0.361858 4.438309e-04 1.108516 2 4993
noisy3 0.361979 1.093467e-04 0.273014 2 4993
noisy4 0.361911 2.955536e-04 0.738068 2 4993
noisy5 0.361900 3.275752e-04 0.818059 2 4993
noisy6 0.361323 1.919695e-03 4.801737 2 4993
noisy7 0.361796 6.155738e-04 1.537727 2 4993
noisy8 0.361989 8.036623e-05 0.200650 2 4993
noisy9 0.362018 2.777834e-07 0.000693 2 4993
noisy10 0.362006 3.537316e-05 0.088312 2 4993
noisy11 0.362003 4.258839e-05 0.106326 2 4993
noisy12 0.362013 1.456345e-05 0.036358 2 4993
noisy13 0.361941 2.140175e-04 0.534409 2 4993
noisy14 0.361859 4.407164e-04 1.100734 2 4993
noisy15 0.361936 2.287619e-04 0.571235 2 4993
noisy16 0.361882 3.770300e-04 0.941610 2 4993
noisy17 0.361955 1.765341e-04 0.440795 2 4993
noisy18 0.361771 6.841664e-04 1.709191 2 4993
noisy19 0.361930 2.432620e-04 0.607451 2 4993
noisy20 0.361762 7.088420e-04 1.770879 2 4993
noisy21 0.362011 2.171636e-05 0.054216 2 4993
noisy22 0.361976 1.181146e-04 0.294908 2 4993
noisy23 0.361997 5.987228e-05 0.149480 2 4993
noisy24 0.361978 1.114005e-04 0.278142 2 4993
noisy25 0.361950 1.893659e-04 0.472841 2 4993
noisy26 0.361831 5.170489e-04 1.291480 2 4993
noisy27 0.361766 6.966159e-04 1.740314 2 4993
noisy28 0.361917 2.809628e-04 0.701621 2 4993
noisy29 0.361865 4.227272e-04 1.055785 2 4993
noisy30 0.361961 1.581973e-04 0.395002 2 4993
noisy31 0.361795 6.180078e-04 1.543811 2 4993
noisy32 0.361989 8.068471e-05 0.201446 2 4993
noisy33 0.362004 3.907251e-05 0.097548 2 4993
noisy34 0.361693 8.984748e-04 2.245060 2 4993
noisy35 0.361927 2.519472e-04 0.629145 2 4993
noisy36 0.362015 8.267511e-06 0.020640 2 4993
noisy37 0.361938 2.210491e-04 0.551971 2 4993
noisy38 0.361713 8.423683e-04 2.104745 2 4993
noisy39 0.362002 4.472585e-05 0.111663 2 4993
noisy40 0.361972 1.281333e-04 0.319926 2 4993
Pr>F
V01 5.628959e-01
V02 2.174553e-03
V03 1.467227e-10
V04 7.055802e-22
V05 1.754667e-38
V08 6.724145e-39
V09 7.929010e-48
V10 2.877784e-62
V12 6.390328e-49
V13 2.334879e-39
V14 5.776054e-28
V15 3.137419e-36
V16 4.510884e-33
V18 2.115016e-35
V19 1.612046e-11
V20 2.878311e-05
V21 8.175587e-01
noisy1 3.541516e-01
noisy2 3.301297e-01
noisy3 7.610936e-01
noisy4 4.780889e-01
noisy5 4.413463e-01
noisy6 8.253443e-03
noisy7 2.149708e-01
noisy8 8.182050e-01
noisy9 9.993068e-01
noisy10 9.154764e-01
noisy11 8.991331e-01
noisy12 9.642951e-01
noisy13 5.860490e-01
noisy14 3.327077e-01
noisy15 5.648645e-01
noisy16 3.900686e-01
noisy17 6.435495e-01
noisy18 1.811181e-01
noisy19 5.447777e-01
noisy20 1.702901e-01
noisy21 9.472280e-01
noisy22 7.446131e-01
noisy23 8.611594e-01
noisy24 7.572007e-01
noisy25 6.232568e-01
noisy26 2.749554e-01
noisy27 1.755717e-01
noisy28 4.958299e-01
noisy29 3.479970e-01
noisy30 6.736997e-01
noisy31 2.136677e-01
noisy32 8.175547e-01
noisy33 9.070602e-01
noisy34 1.060281e-01
noisy35 5.330898e-01
noisy36 9.795716e-01
noisy37 5.758489e-01
noisy38 1.219848e-01
noisy39 8.943478e-01
noisy40 7.262177e-01
Variable V10 will enter
====================== Step 6 forward selection results =======================
Wilks' Lambda Partial R-Square F Value Num DF Den DF \
V01 0.341999 1.273618e-04 0.317936 2 4992
V02 0.341281 2.225135e-03 5.566323 2 4992
V03 0.339271 8.101130e-03 20.385568 2 4992
V04 0.335774 1.832506e-02 46.593182 2 4992
V05 0.330921 3.251370e-02 83.881500 2 4992
V08 0.331730 3.014889e-02 77.590897 2 4992
V09 0.332380 2.824897e-02 72.559148 2 4992
V12 0.330616 3.340731e-02 86.266580 2 4992
V13 0.330782 3.292169e-02 84.969902 2 4992
V14 0.333729 2.430351e-02 62.172566 2 4992
V15 0.333749 2.424772e-02 62.026299 2 4992
V16 0.335210 1.997627e-02 50.877095 2 4992
V18 0.334681 2.152170e-02 54.899703 2 4992
V19 0.339795 6.571029e-03 16.509775 2 4992
V20 0.340972 3.130098e-03 7.837257 2 4992
V21 0.342039 9.385104e-06 0.023425 2 4992
noisy1 0.341897 4.247550e-04 1.060639 2 4992
noisy2 0.341864 5.220424e-04 1.303698 2 4992
noisy3 0.341989 1.559770e-04 0.389379 2 4992
noisy4 0.341940 2.976086e-04 0.743052 2 4992
noisy5 0.341940 3.003487e-04 0.749896 2 4992
noisy6 0.341372 1.959882e-03 4.901473 2 4992
noisy7 0.341825 6.358146e-04 1.588003 2 4992
noisy8 0.342026 4.720890e-05 0.117839 2 4992
noisy9 0.342042 1.368661e-07 0.000342 2 4992
noisy10 0.342028 4.247661e-05 0.106026 2 4992
noisy11 0.342017 7.372448e-05 0.184030 2 4992
noisy12 0.342036 1.883501e-05 0.047013 2 4992
noisy13 0.341968 2.170985e-04 0.541996 2 4992
noisy14 0.341955 2.563311e-04 0.639966 2 4992
noisy15 0.341960 2.394618e-04 0.597840 2 4992
noisy16 0.341898 4.213949e-04 1.052245 2 4992
noisy17 0.341999 1.253463e-04 0.312904 2 4992
noisy18 0.341838 5.980637e-04 1.493660 2 4992
noisy19 0.342016 7.752674e-05 0.193522 2 4992
noisy20 0.341908 3.913387e-04 0.977164 2 4992
noisy21 0.342038 1.303940e-05 0.032547 2 4992
noisy22 0.341995 1.387991e-04 0.346491 2 4992
noisy23 0.342038 1.345854e-05 0.033593 2 4992
noisy24 0.342017 7.258455e-05 0.181184 2 4992
noisy25 0.341978 1.888195e-04 0.471383 2 4992
noisy26 0.341901 4.132296e-04 1.031848 2 4992
noisy27 0.341807 6.883048e-04 1.719192 2 4992
noisy28 0.341991 1.510287e-04 0.377025 2 4992
noisy29 0.341897 4.260994e-04 1.063998 2 4992
noisy30 0.341986 1.650753e-04 0.412096 2 4992
noisy31 0.341820 6.493280e-04 1.621776 2 4992
noisy32 0.341973 2.024150e-04 0.505330 2 4992
noisy33 0.342028 4.290138e-05 0.107086 2 4992
noisy34 0.341742 8.792729e-04 2.196596 2 4992
noisy35 0.341990 1.529562e-04 0.381837 2 4992
noisy36 0.342041 2.905079e-06 0.007251 2 4992
noisy37 0.341973 2.040360e-04 0.509378 2 4992
noisy38 0.341801 7.068494e-04 1.765544 2 4992
noisy39 0.342027 4.609859e-05 0.115067 2 4992
noisy40 0.342015 7.975406e-05 0.199082 2 4992
Pr>F
V01 7.276644e-01
V02 3.848294e-03
V03 1.522715e-09
V04 8.941005e-21
V05 1.477330e-36
V08 6.544146e-34
V09 8.655756e-32
V12 1.471607e-37
V13 5.155323e-37
V14 2.135996e-27
V15 2.463665e-27
V16 1.338249e-22
V18 2.604891e-24
V19 7.136827e-08
V20 3.996273e-04
V21 9.768469e-01
noisy1 3.463125e-01
noisy2 2.716182e-01
noisy3 6.774978e-01
noisy4 4.757124e-01
noisy5 4.724691e-01
noisy6 7.471447e-03
noisy7 2.044365e-01
noisy8 8.888416e-01
noisy9 9.996584e-01
noisy10 8.994032e-01
noisy11 8.319166e-01
noisy12 9.540753e-01
noisy13 5.816207e-01
noisy14 5.273534e-01
noisy15 5.500379e-01
noisy16 3.492304e-01
noisy17 7.313347e-01
noisy18 2.246496e-01
noisy19 8.240581e-01
noisy20 3.764491e-01
noisy21 9.679774e-01
noisy22 7.071825e-01
noisy23 9.669652e-01
noisy24 8.342872e-01
noisy25 6.241666e-01
noisy26 3.564240e-01
noisy27 1.793169e-01
noisy28 6.859187e-01
noisy29 3.451518e-01
noisy30 6.622832e-01
noisy31 1.976517e-01
noisy32 6.033373e-01
noisy33 8.984501e-01
noisy34 1.112884e-01
noisy35 6.826261e-01
noisy36 9.927751e-01
noisy37 6.009005e-01
noisy38 1.712005e-01
noisy39 8.913084e-01
noisy40 8.194892e-01
Variable V12 will enter
====================== Step 7 forward selection results =======================
Wilks' Lambda Partial R-Square F Value Num DF Den DF \
V01 0.330558 0.000173 0.431199 2 4991
V02 0.330077 0.001630 4.074043 2 4991
V03 0.328809 0.005464 13.709093 2 4991
V04 0.326082 0.013713 34.695706 2 4991
V05 0.322588 0.024281 62.100190 2 4991
V08 0.320897 0.029396 75.578757 2 4991
V09 0.321587 0.027309 70.062969 2 4991
V13 0.322300 0.025153 64.387804 2 4991
V14 0.323640 0.021100 53.790472 2 4991
V15 0.322624 0.024171 61.811849 2 4991
V16 0.324009 0.019984 50.886476 2 4991
V18 0.323643 0.021088 53.759327 2 4991
V19 0.328460 0.006521 16.380108 2 4991
V20 0.329664 0.002879 7.206083 2 4991
V21 0.330613 0.000008 0.020558 2 4991
noisy1 0.330449 0.000504 1.259345 2 4991
noisy2 0.330473 0.000431 1.075726 2 4991
noisy3 0.330566 0.000150 0.373977 2 4991
noisy4 0.330526 0.000271 0.676531 2 4991
noisy5 0.330522 0.000283 0.705617 2 4991
noisy6 0.329989 0.001895 4.738850 2 4991
noisy7 0.330487 0.000390 0.972454 2 4991
noisy8 0.330573 0.000128 0.319926 2 4991
noisy9 0.330614 0.000005 0.011367 2 4991
noisy10 0.330583 0.000099 0.246525 2 4991
noisy11 0.330608 0.000024 0.059464 2 4991
noisy12 0.330603 0.000038 0.093822 2 4991
noisy13 0.330541 0.000225 0.562008 2 4991
noisy14 0.330536 0.000242 0.603998 2 4991
noisy15 0.330542 0.000222 0.554095 2 4991
noisy16 0.330484 0.000399 0.995349 2 4991
noisy17 0.330575 0.000122 0.304697 2 4991
noisy18 0.330460 0.000470 1.172912 2 4991
noisy19 0.330584 0.000094 0.235801 2 4991
noisy20 0.330479 0.000414 1.034643 2 4991
noisy21 0.330609 0.000018 0.046062 2 4991
noisy22 0.330570 0.000137 0.342890 2 4991
noisy23 0.330606 0.000030 0.074719 2 4991
noisy24 0.330577 0.000117 0.292058 2 4991
noisy25 0.330557 0.000178 0.443421 2 4991
noisy26 0.330471 0.000439 1.095334 2 4991
noisy27 0.330389 0.000686 1.712867 2 4991
noisy28 0.330583 0.000099 0.248294 2 4991
noisy29 0.330519 0.000292 0.728289 2 4991
noisy30 0.330558 0.000173 0.432200 2 4991
noisy31 0.330421 0.000588 1.467836 2 4991
noisy32 0.330547 0.000208 0.518712 2 4991
noisy33 0.330599 0.000050 0.125144 2 4991
noisy34 0.330280 0.001014 2.531880 2 4991
noisy35 0.330575 0.000121 0.303235 2 4991
noisy36 0.330610 0.000017 0.042017 2 4991
noisy37 0.330571 0.000134 0.335025 2 4991
noisy38 0.330378 0.000720 1.797769 2 4991
noisy39 0.330598 0.000052 0.130667 2 4991
noisy40 0.330581 0.000103 0.257582 2 4991
Pr>F
V01 6.497540e-01
V02 1.706508e-02
V03 1.154810e-06
V04 1.085510e-15
V05 2.292634e-27
V08 4.611003e-33
V09 9.802847e-31
V13 2.462591e-28
V14 7.714474e-24
V15 3.037566e-27
V16 1.326136e-22
V18 7.953296e-24
V19 8.118105e-08
V20 7.498040e-04
V21 9.796515e-01
noisy1 2.839300e-01
noisy2 3.411291e-01
noisy3 6.880121e-01
noisy4 5.084242e-01
noisy5 4.938530e-01
noisy6 8.788106e-03
noisy7 3.782257e-01
noisy8 7.262177e-01
noisy9 9.886973e-01
noisy10 7.815213e-01
noisy11 9.422701e-01
noisy12 9.104464e-01
noisy13 5.700996e-01
noisy14 5.466617e-01
noisy15 5.746277e-01
noisy16 3.696678e-01
noisy17 7.373602e-01
noisy18 3.095497e-01
noisy19 7.899464e-01
noisy20 3.554296e-01
noisy21 9.549835e-01
noisy22 7.097330e-01
noisy23 9.280051e-01
noisy24 7.467383e-01
noisy25 6.418621e-01
noisy26 3.345082e-01
noisy27 1.804539e-01
noisy28 7.801399e-01
noisy29 4.827854e-01
noisy30 6.491037e-01
noisy31 2.305231e-01
noisy32 5.953190e-01
noisy33 8.823725e-01
noisy34 7.961150e-02
noisy35 7.384390e-01
noisy36 9.588541e-01
noisy37 7.153364e-01
noisy38 1.657754e-01
noisy39 8.775132e-01
noisy40 7.729287e-01
Variable V08 will enter
====================== Step 8 forward selection results =======================
Wilks' Lambda Partial R-Square F Value Num DF Den DF \
V01 0.320840 0.000176 0.438631 2 4990
V02 0.320494 0.001255 3.135853 2 4990
V03 0.319479 0.004420 11.076385 2 4990
V04 0.317050 0.011989 30.274482 2 4990
V05 0.314653 0.019456 49.506124 2 4990
V09 0.314342 0.020426 52.024306 2 4990
V13 0.314178 0.020938 53.356470 2 4990
V14 0.316401 0.014011 35.455293 2 4990
V15 0.316191 0.014665 37.133574 2 4990
V16 0.317101 0.011828 29.864681 2 4990
V18 0.315768 0.015983 40.525951 2 4990
V19 0.319474 0.004434 11.111847 2 4990
V20 0.320233 0.002068 5.170261 2 4990
V21 0.320888 0.000028 0.068686 2 4990
noisy1 0.320710 0.000583 1.454932 2 4990
noisy2 0.320772 0.000389 0.972076 2 4990
noisy3 0.320825 0.000223 0.555779 2 4990
noisy4 0.320797 0.000312 0.778007 2 4990
noisy5 0.320805 0.000286 0.713744 2 4990
noisy6 0.320346 0.001717 4.292339 2 4990
noisy7 0.320761 0.000423 1.055114 2 4990
noisy8 0.320856 0.000129 0.321316 2 4990
noisy9 0.320885 0.000037 0.092735 2 4990
noisy10 0.320861 0.000112 0.279873 2 4990
noisy11 0.320888 0.000028 0.069749 2 4990
noisy12 0.320881 0.000048 0.120959 2 4990
noisy13 0.320853 0.000135 0.337456 2 4990
noisy14 0.320821 0.000235 0.586774 2 4990
noisy15 0.320823 0.000231 0.576685 2 4990
noisy16 0.320759 0.000430 1.073300 2 4990
noisy17 0.320861 0.000112 0.278490 2 4990
noisy18 0.320751 0.000456 1.137572 2 4990
noisy19 0.320852 0.000138 0.345306 2 4990
noisy20 0.320781 0.000362 0.903960 2 4990
noisy21 0.320892 0.000015 0.037318 2 4990
noisy22 0.320816 0.000252 0.629174 2 4990
noisy23 0.320886 0.000034 0.084548 2 4990
noisy24 0.320859 0.000118 0.293512 2 4990
noisy25 0.320841 0.000175 0.437059 2 4990
noisy26 0.320780 0.000364 0.909193 2 4990
noisy27 0.320606 0.000907 2.264457 2 4990
noisy28 0.320881 0.000051 0.126961 2 4990
noisy29 0.320803 0.000292 0.729864 2 4990
noisy30 0.320846 0.000159 0.395750 2 4990
noisy31 0.320706 0.000595 1.484943 2 4990
noisy32 0.320843 0.000169 0.420564 2 4990
noisy33 0.320882 0.000045 0.111972 2 4990
noisy34 0.320562 0.001043 2.603873 2 4990
noisy35 0.320843 0.000168 0.419258 2 4990
noisy36 0.320890 0.000020 0.050895 2 4990
noisy37 0.320864 0.000104 0.259065 2 4990
noisy38 0.320667 0.000717 1.791135 2 4990
noisy39 0.320873 0.000073 0.182855 2 4990
noisy40 0.320855 0.000131 0.327155 2 4990
Pr>F
V01 6.449433e-01
V02 4.354834e-02
V03 1.585745e-05
V04 8.532761e-14
V05 5.132023e-22
V09 4.349748e-23
V13 1.179989e-23
V14 5.132671e-16
V15 9.815812e-17
V16 1.279218e-13
V18 3.477065e-18
V19 1.530737e-05
V20 5.713569e-03
V21 9.336211e-01
noisy1 2.335153e-01
noisy2 3.783686e-01
noisy3 5.736609e-01
noisy4 4.593764e-01
noisy5 4.898570e-01
noisy6 1.372342e-02
noisy7 3.482304e-01
noisy8 7.252092e-01
noisy9 9.114368e-01
noisy10 7.558912e-01
noisy11 9.326285e-01
noisy12 8.860727e-01
noisy13 7.135997e-01
noisy14 5.561567e-01
noisy15 5.617952e-01
noisy16 3.419573e-01
noisy17 7.569379e-01
noisy18 3.206796e-01
noisy19 7.080209e-01
noisy20 4.050293e-01
noisy21 9.633704e-01
noisy22 5.330741e-01
noisy23 9.189293e-01
noisy24 7.456530e-01
noisy25 6.459582e-01
noisy26 4.029160e-01
noisy27 1.039932e-01
noisy28 8.807709e-01
noisy29 4.820259e-01
noisy30 6.731962e-01
noisy31 2.266152e-01
noisy32 6.566994e-01
noisy33 8.940713e-01
noisy34 7.408701e-02
noisy35 6.575579e-01
noisy36 9.503793e-01
noisy37 7.717835e-01
noisy38 1.668779e-01
noisy39 8.328945e-01
noisy40 7.209878e-01
Variable V13 will enter
====================== Step 9 forward selection results =======================
Wilks' Lambda Partial R-Square F Value Num DF Den DF \
V01 0.314120 0.000186 0.463155 2 4989
V02 0.313925 0.000806 2.011949 2 4989
V03 0.313160 0.003241 8.110556 2 4989
V04 0.311501 0.008522 21.440360 2 4989
V05 0.309931 0.013519 34.186301 2 4989
V09 0.307701 0.020616 52.508903 2 4989
V14 0.310870 0.010529 26.542808 2 4989
V15 0.309899 0.013619 34.440668 2 4989
V16 0.310622 0.011318 28.556829 2 4989
V18 0.309221 0.015778 39.990150 2 4989
V19 0.312810 0.004355 10.909919 2 4989
V20 0.313529 0.002067 5.166154 2 4989
V21 0.314148 0.000095 0.237432 2 4989
noisy1 0.313975 0.000648 1.616657 2 4989
noisy2 0.314066 0.000357 0.891076 2 4989
noisy3 0.314099 0.000253 0.631729 2 4989
noisy4 0.314056 0.000388 0.969228 2 4989
noisy5 0.314088 0.000286 0.714381 2 4989
noisy6 0.313669 0.001621 4.050166 2 4989
noisy7 0.314057 0.000384 0.957910 2 4989
noisy8 0.314128 0.000158 0.394916 2 4989
noisy9 0.314166 0.000037 0.092400 2 4989
noisy10 0.314125 0.000169 0.422556 2 4989
noisy11 0.314171 0.000024 0.058852 2 4989
noisy12 0.314161 0.000056 0.138605 2 4989
noisy13 0.314128 0.000160 0.400253 2 4989
noisy14 0.314103 0.000238 0.592932 2 4989
noisy15 0.314119 0.000189 0.471924 2 4989
noisy16 0.314034 0.000458 1.142549 2 4989
noisy17 0.314144 0.000107 0.267330 2 4989
noisy18 0.314025 0.000486 1.213654 2 4989
noisy19 0.314134 0.000140 0.349291 2 4989
noisy20 0.314072 0.000338 0.842680 2 4989
noisy21 0.314175 0.000010 0.026033 2 4989
noisy22 0.314086 0.000294 0.733350 2 4989
noisy23 0.314170 0.000026 0.064850 2 4989
noisy24 0.314149 0.000091 0.227980 2 4989
noisy25 0.314141 0.000119 0.296616 2 4989
noisy26 0.314095 0.000264 0.659171 2 4989
noisy27 0.313872 0.000973 2.430639 2 4989
noisy28 0.314158 0.000064 0.160504 2 4989
noisy29 0.314102 0.000242 0.602664 2 4989
noisy30 0.314115 0.000200 0.497782 2 4989
noisy31 0.313972 0.000657 1.640128 2 4989
noisy32 0.314125 0.000168 0.419324 2 4989
noisy33 0.314163 0.000047 0.116188 2 4989
noisy34 0.313837 0.001084 2.707430 2 4989
noisy35 0.314148 0.000095 0.237225 2 4989
noisy36 0.314171 0.000024 0.059484 2 4989
noisy37 0.314137 0.000132 0.328855 2 4989
noisy38 0.313953 0.000716 1.788385 2 4989
noisy39 0.314153 0.000081 0.201915 2 4989
noisy40 0.314129 0.000155 0.387084 2 4989
Pr>F
V01 6.293219e-01
V02 1.338363e-01
V03 3.043296e-04
V04 5.350053e-10
V05 1.794297e-15
V09 2.706271e-23
V14 3.415877e-12
V15 1.396121e-15
V16 4.659921e-13
V18 5.891699e-18
V19 1.871602e-05
V20 5.737042e-03
V21 7.886592e-01
noisy1 1.986654e-01
noisy2 4.102794e-01
noisy3 5.317145e-01
noisy4 3.794473e-01
noisy5 4.895453e-01
noisy6 1.747679e-02
noisy7 3.837645e-01
noisy8 6.737579e-01
noisy9 9.117421e-01
noisy10 6.553932e-01
noisy11 9.428469e-01
noisy12 8.705753e-01
noisy13 6.701721e-01
noisy14 5.527432e-01
noisy15 6.238291e-01
noisy16 3.190882e-01
noisy17 7.654317e-01
noisy18 2.971973e-01
noisy19 7.052049e-01
noisy20 4.306163e-01
noisy21 9.743029e-01
noisy22 4.803492e-01
noisy23 9.372088e-01
noisy24 7.961487e-01
noisy25 7.433427e-01
noisy26 5.173252e-01
noisy27 8.808480e-02
noisy28 8.517188e-01
noisy29 5.473912e-01
noisy30 6.079075e-01
noisy31 1.940599e-01
noisy32 6.575143e-01
noisy33 8.903101e-01
noisy34 6.680602e-02
noisy35 7.888227e-01
noisy36 9.422513e-01
noisy37 7.197632e-01
noisy38 1.673372e-01
noisy39 8.171709e-01
noisy40 6.790546e-01
Variable V09 will enter
====================== Step 10 forward selection results =======================
Wilks' Lambda Partial R-Square F Value Num DF Den DF \
V01 0.307653 0.000156 0.390207 2 4988
V02 0.307442 0.000842 2.100965 2 4988
V03 0.306687 0.003295 8.243827 2 4988
V04 0.305112 0.008413 21.160805 2 4988
V05 0.303547 0.013500 34.129072 2 4988
V14 0.304858 0.009238 23.254819 2 4988
V15 0.304936 0.008986 22.614900 2 4988
V16 0.305592 0.006854 17.212961 2 4988
V18 0.304013 0.011986 30.255480 2 4988
V19 0.306710 0.003220 8.057447 2 4988
V20 0.307299 0.001306 3.262589 2 4988
V21 0.307674 0.000088 0.218603 2 4988
noisy1 0.307501 0.000649 1.619491 2 4988
noisy2 0.307557 0.000468 1.167729 2 4988
noisy3 0.307641 0.000195 0.485974 2 4988
noisy4 0.307575 0.000409 1.021680 2 4988
noisy5 0.307620 0.000264 0.658283 2 4988
noisy6 0.307219 0.001566 3.910589 2 4988
noisy7 0.307589 0.000365 0.911072 2 4988
noisy8 0.307672 0.000095 0.237325 2 4988
noisy9 0.307683 0.000058 0.145464 2 4988
noisy10 0.307642 0.000190 0.474910 2 4988
noisy11 0.307694 0.000022 0.055517 2 4988
noisy12 0.307664 0.000122 0.303768 2 4988
noisy13 0.307651 0.000162 0.403944 2 4988
noisy14 0.307622 0.000255 0.637025 2 4988
noisy15 0.307639 0.000202 0.502979 2 4988
noisy16 0.307547 0.000500 1.248113 2 4988
noisy17 0.307680 0.000067 0.168096 2 4988
noisy18 0.307557 0.000467 1.165524 2 4988
noisy19 0.307658 0.000139 0.346854 2 4988
noisy20 0.307618 0.000269 0.670234 2 4988
noisy21 0.307699 0.000006 0.013950 2 4988
noisy22 0.307592 0.000354 0.882879 2 4988
noisy23 0.307690 0.000035 0.087521 2 4988
noisy24 0.307679 0.000072 0.179083 2 4988
noisy25 0.307663 0.000125 0.311029 2 4988
noisy26 0.307613 0.000285 0.709834 2 4988
noisy27 0.307373 0.001067 2.662845 2 4988
noisy28 0.307681 0.000064 0.160284 2 4988
noisy29 0.307633 0.000221 0.550364 2 4988
noisy30 0.307635 0.000215 0.535394 2 4988
noisy31 0.307456 0.000795 1.983500 2 4988
noisy32 0.307639 0.000201 0.501214 2 4988
noisy33 0.307673 0.000092 0.228401 2 4988
noisy34 0.307368 0.001082 2.701154 2 4988
noisy35 0.307670 0.000102 0.255071 2 4988
noisy36 0.307693 0.000025 0.061319 2 4988
noisy37 0.307660 0.000135 0.335914 2 4988
noisy38 0.307472 0.000745 1.859616 2 4988
noisy39 0.307656 0.000145 0.361562 2 4988
noisy40 0.307651 0.000163 0.407426 2 4988
Pr>F
V01 6.769377e-01
V02 1.224465e-01
V03 2.664745e-04
V04 7.059063e-10
V05 1.898597e-15
V14 8.858392e-11
V15 1.670075e-10
V16 3.549647e-08
V18 8.695101e-14
V19 3.208749e-04
V20 3.837086e-02
V21 8.036486e-01
noisy1 1.981035e-01
noisy2 3.111575e-01
noisy3 6.151271e-01
noisy4 3.600650e-01
noisy5 5.177843e-01
noisy6 2.009013e-02
noisy7 4.021599e-01
noisy8 7.887437e-01
noisy9 8.646243e-01
noisy10 6.219690e-01
noisy11 9.459968e-01
noisy12 7.380461e-01
noisy13 6.677030e-01
noisy14 5.289066e-01
noisy15 6.047569e-01
noisy16 2.871355e-01
noisy17 8.452776e-01
noisy18 3.118441e-01
noisy19 7.069258e-01
noisy20 5.116348e-01
noisy21 9.861469e-01
noisy22 4.136551e-01
noisy23 9.162011e-01
noisy24 8.360423e-01
noisy25 7.327069e-01
noisy26 4.917756e-01
noisy27 6.984864e-02
noisy28 8.519063e-01
noisy29 5.767751e-01
noisy30 5.854724e-01
noisy31 1.376954e-01
noisy32 6.058251e-01
noisy33 7.958136e-01
noisy34 6.722619e-02
noisy35 7.748715e-01
noisy36 9.405236e-01
noisy37 7.147006e-01
noisy38 1.558403e-01
noisy39 6.966057e-01
noisy40 6.653829e-01
Variable V05 will enter
====================== Step 11 forward selection results =======================
Wilks' Lambda Partial R-Square F Value Num DF Den DF \
V01 0.303500 0.000155 0.386613 2 4987
V02 0.303364 0.000603 1.503709 2 4987
V03 0.302787 0.002503 6.256544 2 4987
V04 0.301610 0.006381 16.012392 2 4987
V14 0.301451 0.006905 17.336992 2 4987
V15 0.301065 0.008178 20.559541 2 4987
V16 0.301619 0.006351 15.937724 2 4987
V18 0.299975 0.011768 29.693829 2 4987
V19 0.302601 0.003116 7.793267 2 4987
V20 0.303152 0.001300 3.246492 2 4987
V21 0.303522 0.000081 0.202669 2 4987
noisy1 0.303337 0.000692 1.727830 2 4987
noisy2 0.303388 0.000524 1.308499 2 4987
noisy3 0.303505 0.000139 0.346297 2 4987
noisy4 0.303429 0.000390 0.972615 2 4987
noisy5 0.303465 0.000270 0.672613 2 4987
noisy6 0.303035 0.001686 4.209989 2 4987
noisy7 0.303433 0.000376 0.936696 2 4987
noisy8 0.303523 0.000080 0.199458 2 4987
noisy9 0.303529 0.000061 0.152378 2 4987
noisy10 0.303478 0.000227 0.567113 2 4987
noisy11 0.303534 0.000044 0.110078 2 4987
noisy12 0.303512 0.000115 0.286291 2 4987
noisy13 0.303502 0.000150 0.373768 2 4987
noisy14 0.303470 0.000253 0.631239 2 4987
noisy15 0.303473 0.000245 0.611490 2 4987
noisy16 0.303397 0.000494 1.231972 2 4987
noisy17 0.303529 0.000060 0.149330 2 4987
noisy18 0.303378 0.000557 1.389900 2 4987
noisy19 0.303507 0.000133 0.332849 2 4987
noisy20 0.303458 0.000293 0.731147 2 4987
noisy21 0.303539 0.000026 0.065900 2 4987
noisy22 0.303425 0.000402 1.003077 2 4987
noisy23 0.303532 0.000049 0.122393 2 4987
noisy24 0.303524 0.000076 0.189175 2 4987
noisy25 0.303492 0.000182 0.454978 2 4987
noisy26 0.303456 0.000299 0.745862 2 4987
noisy27 0.303203 0.001132 2.826742 2 4987
noisy28 0.303527 0.000066 0.165409 2 4987
noisy29 0.303479 0.000224 0.558618 2 4987
noisy30 0.303487 0.000197 0.490714 2 4987
noisy31 0.303307 0.000790 1.970844 2 4987
noisy32 0.303486 0.000200 0.498965 2 4987
noisy33 0.303516 0.000101 0.252561 2 4987
noisy34 0.303243 0.001002 2.500401 2 4987
noisy35 0.303516 0.000102 0.254104 2 4987
noisy36 0.303543 0.000013 0.033534 2 4987
noisy37 0.303505 0.000138 0.345028 2 4987
noisy38 0.303294 0.000834 2.081967 2 4987
noisy39 0.303505 0.000138 0.344294 2 4987
noisy40 0.303505 0.000138 0.344578 2 4987
Pr>F
V01 6.793741e-01
V02 2.224048e-01
V03 1.932951e-03
V04 1.169876e-07
V14 3.138302e-08
V15 1.281487e-09
V16 1.259973e-07
V18 1.514660e-13
V19 4.175469e-04
V20 3.899270e-02
V21 8.165549e-01
noisy1 1.777759e-01
noisy2 2.703182e-01
noisy3 7.073192e-01
noisy4 3.781646e-01
noisy5 5.104194e-01
noisy6 1.489933e-02
noisy7 3.919895e-01
noisy8 8.191814e-01
noisy9 8.586679e-01
noisy10 5.671970e-01
noisy11 8.957664e-01
noisy12 7.510561e-01
noisy13 6.881561e-01
noisy14 5.319751e-01
noisy15 5.425823e-01
noisy16 2.918056e-01
noisy17 8.612884e-01
noisy18 2.491968e-01
noisy19 7.168944e-01
noisy20 4.814080e-01
noisy21 9.362255e-01
noisy22 3.668230e-01
noisy23 8.848031e-01
noisy24 8.276473e-01
noisy25 6.344883e-01
noisy26 4.743781e-01
noisy27 5.930028e-02
noisy28 8.475520e-01
noisy29 5.720347e-01
noisy30 6.122186e-01
noisy31 1.394477e-01
noisy32 6.071889e-01
noisy33 7.768186e-01
noisy34 8.215495e-02
noisy35 7.756209e-01
noisy36 9.670224e-01
noisy37 7.082171e-01
noisy38 1.247930e-01
noisy39 7.087373e-01
noisy40 7.085365e-01
Variable V18 will enter
====================== Step 12 forward selection results =======================
Wilks' Lambda Partial R-Square F Value Num DF Den DF \
V01 0.299926 0.000164 0.408813 2 4986
V02 0.299792 0.000608 1.517541 2 4986
V03 0.299225 0.002500 6.248560 2 4986
V04 0.298128 0.006157 15.444077 2 4986
V14 0.298157 0.006060 15.198458 2 4986
V15 0.298206 0.005896 14.785448 2 4986
V16 0.298651 0.004414 11.051814 2 4986
V19 0.299202 0.002578 6.443538 2 4986
V20 0.299662 0.001042 2.601519 2 4986
V21 0.299944 0.000102 0.254389 2 4986
noisy1 0.299761 0.000713 1.778703 2 4986
noisy2 0.299815 0.000534 1.331422 2 4986
noisy3 0.299923 0.000172 0.430016 2 4986
noisy4 0.299865 0.000367 0.916209 2 4986
noisy5 0.299876 0.000328 0.818683 2 4986
noisy6 0.299476 0.001664 4.154771 2 4986
noisy7 0.299861 0.000380 0.946528 2 4986
noisy8 0.299950 0.000084 0.208630 2 4986
noisy9 0.299963 0.000041 0.101087 2 4986
noisy10 0.299906 0.000229 0.571182 2 4986
noisy11 0.299962 0.000044 0.110802 2 4986
noisy12 0.299925 0.000165 0.411947 2 4986
noisy13 0.299926 0.000161 0.402326 2 4986
noisy14 0.299895 0.000267 0.664958 2 4986
noisy15 0.299901 0.000248 0.617959 2 4986
noisy16 0.299857 0.000394 0.981923 2 4986
noisy17 0.299954 0.000069 0.172362 2 4986
noisy18 0.299818 0.000522 1.301481 2 4986
noisy19 0.299930 0.000150 0.373161 2 4986
noisy20 0.299894 0.000271 0.675452 2 4986
noisy21 0.299967 0.000026 0.064882 2 4986
noisy22 0.299844 0.000436 1.087290 2 4986
noisy23 0.299961 0.000047 0.116463 2 4986
noisy24 0.299952 0.000077 0.192589 2 4986
noisy25 0.299927 0.000159 0.397210 2 4986
noisy26 0.299875 0.000334 0.831945 2 4986
noisy27 0.299622 0.001176 2.934539 2 4986
noisy28 0.299956 0.000063 0.156720 2 4986
noisy29 0.299908 0.000224 0.557949 2 4986
noisy30 0.299921 0.000180 0.449655 2 4986
noisy31 0.299728 0.000821 2.049516 2 4986
noisy32 0.299913 0.000205 0.511329 2 4986
noisy33 0.299933 0.000139 0.346902 2 4986
noisy34 0.299693 0.000940 2.345250 2 4986
noisy35 0.299946 0.000097 0.242086 2 4986
noisy36 0.299970 0.000015 0.038139 2 4986
noisy37 0.299933 0.000139 0.347394 2 4986
noisy38 0.299722 0.000844 2.105963 2 4986
noisy39 0.299937 0.000126 0.315270 2 4986
noisy40 0.299937 0.000127 0.315781 2 4986
Pr>F
V01 6.644610e-01
V02 2.193516e-01
V03 1.948408e-03
V04 2.057845e-07
V14 2.626832e-07
V15 3.960299e-07
V16 1.625046e-05
V19 1.604048e-03
V20 7.426148e-02
V21 7.754004e-01
noisy1 1.689641e-01
noisy2 2.641953e-01
noisy3 6.505229e-01
noisy4 4.001001e-01
noisy5 4.410714e-01
noisy6 1.574374e-02
noisy7 3.881560e-01
noisy8 8.117028e-01
noisy9 9.038567e-01
noisy10 5.648944e-01
noisy11 8.951186e-01
noisy12 6.623821e-01
noisy13 6.687842e-01
noisy14 5.143408e-01
noisy15 5.390847e-01
noisy16 3.746626e-01
noisy17 8.416795e-01
noisy18 2.722209e-01
noisy19 6.885736e-01
noisy20 5.089726e-01
noisy21 9.371786e-01
noisy22 3.372088e-01
noisy23 8.900653e-01
noisy24 8.248271e-01
noisy25 6.722144e-01
noisy26 4.352624e-01
noisy27 5.324701e-02
noisy28 8.549477e-01
noisy29 5.724177e-01
noisy30 6.378740e-01
noisy31 1.289058e-01
noisy32 5.997296e-01
noisy33 7.068918e-01
noisy34 9.592892e-02
noisy35 7.849977e-01
noisy36 9.625796e-01
noisy37 7.065437e-01
noisy38 1.218366e-01
noisy39 7.296067e-01
noisy40 7.292338e-01
Variable V04 will enter
====================== Step 13 forward selection results =======================
Wilks' Lambda Partial R-Square F Value Num DF Den DF \
V01 0.298079 0.000163 0.407330 2 4985
V02 0.297958 0.000569 1.418846 2 4985
V03 0.297477 0.002184 5.455882 2 4985
V14 0.296556 0.005273 13.211486 2 4985
V15 0.296466 0.005576 13.974995 2 4985
V16 0.296854 0.004272 10.693027 2 4985
V19 0.297361 0.002573 6.429454 2 4985
V20 0.297819 0.001037 2.587419 2 4985
V21 0.298096 0.000108 0.268916 2 4985
noisy1 0.297938 0.000637 1.588878 2 4985
noisy2 0.297955 0.000579 1.443102 2 4985
noisy3 0.298078 0.000169 0.420522 2 4985
noisy4 0.298025 0.000345 0.861045 2 4985
noisy5 0.298027 0.000340 0.846593 2 4985
noisy6 0.297633 0.001660 4.144355 2 4985
noisy7 0.298019 0.000365 0.909901 2 4985
noisy8 0.298104 0.000081 0.202349 2 4985
noisy9 0.298116 0.000042 0.103952 2 4985
noisy10 0.298054 0.000247 0.615720 2 4985
noisy11 0.298117 0.000037 0.091932 2 4985
noisy12 0.298078 0.000169 0.421066 2 4985
noisy13 0.298077 0.000171 0.427210 2 4985
noisy14 0.298047 0.000272 0.677973 2 4985
noisy15 0.298044 0.000281 0.700859 2 4985
noisy16 0.298007 0.000405 1.008706 2 4985
noisy17 0.298106 0.000074 0.185587 2 4985
noisy18 0.297976 0.000509 1.270154 2 4985
noisy19 0.298085 0.000143 0.356026 2 4985
noisy20 0.298046 0.000276 0.688973 2 4985
noisy21 0.298120 0.000026 0.063968 2 4985
noisy22 0.297995 0.000447 1.115131 2 4985
noisy23 0.298116 0.000039 0.098255 2 4985
noisy24 0.298098 0.000102 0.254807 2 4985
noisy25 0.298075 0.000177 0.441998 2 4985
noisy26 0.298018 0.000370 0.923181 2 4985
noisy27 0.297773 0.001191 2.970976 2 4985
noisy28 0.298111 0.000056 0.139056 2 4985
noisy29 0.298060 0.000228 0.567708 2 4985
noisy30 0.298068 0.000203 0.505036 2 4985
noisy31 0.297878 0.000838 2.089566 2 4985
noisy32 0.298067 0.000204 0.509119 2 4985
noisy33 0.298087 0.000139 0.345609 2 4985
noisy34 0.297883 0.000821 2.047879 2 4985
noisy35 0.298100 0.000094 0.235222 2 4985
noisy36 0.298123 0.000015 0.038160 2 4985
noisy37 0.298088 0.000134 0.333963 2 4985
noisy38 0.297871 0.000863 2.153003 2 4985
noisy39 0.298092 0.000121 0.300577 2 4985
noisy40 0.298095 0.000110 0.275190 2 4985
Pr>F
V01 6.654468e-01
V02 2.420909e-01
V03 4.296650e-03
V14 1.894425e-06
V15 8.865187e-07
V16 2.322793e-05
V19 1.626743e-03
V20 7.531494e-02
V21 7.642184e-01
noisy1 2.042580e-01
noisy2 2.362926e-01
noisy3 6.567273e-01
noisy4 4.227828e-01
noisy5 4.289354e-01
noisy6 1.590832e-02
noisy7 4.026309e-01
noisy8 8.168162e-01
noisy9 9.012708e-01
noisy10 5.402926e-01
noisy11 9.121686e-01
noisy12 6.563702e-01
noisy13 6.523502e-01
noisy14 5.076916e-01
noisy15 4.962077e-01
noisy16 3.647650e-01
noisy17 8.306220e-01
noisy18 2.808793e-01
noisy19 7.004720e-01
noisy20 5.021392e-01
noisy21 9.380355e-01
noisy22 3.279542e-01
noisy23 9.064198e-01
noisy24 7.750758e-01
noisy25 6.427758e-01
noisy26 3.973212e-01
noisy27 5.134404e-02
noisy28 8.701830e-01
noisy29 5.668599e-01
noisy30 6.035148e-01
noisy31 1.238492e-01
noisy32 6.010558e-01
noisy33 7.078061e-01
noisy34 1.291168e-01
noisy35 7.904044e-01
noisy36 9.625588e-01
noisy37 7.160966e-01
noisy38 1.162428e-01
noisy39 7.404044e-01
noisy40 7.594393e-01
Variable V15 will enter
====================== Step 14 forward selection results =======================
Wilks' Lambda Partial R-Square F Value Num DF Den DF Pr>F
V01 0.296418 0.000160 0.399945 2 4984 0.670379
V02 0.296297 0.000569 1.417796 2 4984 0.242345
V03 0.295805 0.002229 5.567194 2 4984 0.003845
V14 0.295106 0.004586 11.479745 2 4984 0.000011
V16 0.295605 0.002905 7.259753 2 4984 0.000711
V19 0.295831 0.002140 5.344299 2 4984 0.004803
V20 0.296211 0.000860 2.144527 2 4984 0.117232
V21 0.296435 0.000103 0.256174 2 4984 0.774018
noisy1 0.296275 0.000643 1.603832 2 4984 0.201228
noisy2 0.296287 0.000603 1.503902 2 4984 0.222362
noisy3 0.296409 0.000191 0.475956 2 4984 0.621319
noisy4 0.296375 0.000305 0.759119 2 4984 0.468133
noisy5 0.296355 0.000374 0.932063 2 4984 0.393809
noisy6 0.295988 0.001612 4.024113 2 4984 0.017937
noisy7 0.296356 0.000370 0.922794 2 4984 0.397475
noisy8 0.296441 0.000084 0.209696 2 4984 0.810838
noisy9 0.296446 0.000066 0.164069 2 4984 0.848688
noisy10 0.296392 0.000250 0.624297 2 4984 0.535680
noisy11 0.296453 0.000042 0.105156 2 4984 0.900186
noisy12 0.296399 0.000226 0.564172 2 4984 0.568867
noisy13 0.296418 0.000160 0.397723 2 4984 0.671869
noisy14 0.296383 0.000280 0.697724 2 4984 0.497766
noisy15 0.296380 0.000291 0.725055 2 4984 0.484349
noisy16 0.296337 0.000435 1.085521 2 4984 0.337806
noisy17 0.296442 0.000080 0.199080 2 4984 0.819490
noisy18 0.296319 0.000496 1.236028 2 4984 0.290625
noisy19 0.296417 0.000166 0.412894 2 4984 0.661755
noisy20 0.296384 0.000277 0.691446 2 4984 0.500899
noisy21 0.296458 0.000026 0.065252 2 4984 0.936832
noisy22 0.296336 0.000439 1.094878 2 4984 0.334661
noisy23 0.296454 0.000041 0.101399 2 4984 0.903575
noisy24 0.296439 0.000092 0.228509 2 4984 0.795727
noisy25 0.296414 0.000175 0.436475 2 4984 0.646335
noisy26 0.296336 0.000439 1.094563 2 4984 0.334766
noisy27 0.296134 0.001117 2.787758 2 4984 0.061655
noisy28 0.296449 0.000058 0.143959 2 4984 0.865926
noisy29 0.296407 0.000198 0.492465 2 4984 0.611148
noisy30 0.296414 0.000174 0.433551 2 4984 0.648228
noisy31 0.296221 0.000827 2.061940 2 4984 0.127315
noisy32 0.296395 0.000240 0.597819 2 4984 0.550049
noisy33 0.296423 0.000145 0.360803 2 4984 0.697134
noisy34 0.296219 0.000833 2.078541 2 4984 0.125221
noisy35 0.296438 0.000095 0.237183 2 4984 0.788856
noisy36 0.296462 0.000014 0.035173 2 4984 0.965439
noisy37 0.296426 0.000134 0.333833 2 4984 0.716189
noisy38 0.296176 0.000979 2.441349 2 4984 0.087147
noisy39 0.296434 0.000107 0.265897 2 4984 0.766529
noisy40 0.296431 0.000117 0.291984 2 4984 0.746794
Variable V14 will enter
====================== Step 15 forward selection results =======================
Wilks' Lambda Partial R-Square F Value Num DF Den DF Pr>F
V01 0.295059 0.000162 0.402966 2 4983 0.668357
V02 0.294947 0.000539 1.344391 2 4983 0.260793
V03 0.294509 0.002025 5.055311 2 4983 0.006408
V16 0.294343 0.002585 6.456903 2 4983 0.001583
V19 0.294509 0.002023 5.050920 2 4983 0.006436
V20 0.294859 0.000838 2.089793 2 4983 0.123821
V21 0.295080 0.000088 0.220310 2 4983 0.802278
noisy1 0.294935 0.000580 1.446763 2 4983 0.235430
noisy2 0.294936 0.000578 1.440072 2 4983 0.237009
noisy3 0.295050 0.000191 0.476383 2 4983 0.621054
noisy4 0.295021 0.000290 0.723773 2 4983 0.484970
noisy5 0.294995 0.000377 0.940734 2 4983 0.390411
noisy6 0.294632 0.001608 4.013267 2 4983 0.018133
noisy7 0.294993 0.000384 0.957116 2 4983 0.384069
noisy8 0.295078 0.000097 0.240648 2 4983 0.786128
noisy9 0.295087 0.000065 0.161701 2 4983 0.850700
noisy10 0.295041 0.000223 0.554766 2 4983 0.574242
noisy11 0.295090 0.000056 0.138922 2 4983 0.870300
noisy12 0.295036 0.000237 0.590462 2 4983 0.554110
noisy13 0.295069 0.000127 0.316247 2 4983 0.728894
noisy14 0.295026 0.000272 0.678922 2 4983 0.507210
noisy15 0.295022 0.000285 0.710689 2 4983 0.491355
noisy16 0.294978 0.000435 1.085329 2 4983 0.337871
noisy17 0.295084 0.000074 0.184552 2 4983 0.831482
noisy18 0.294973 0.000451 1.124669 2 4983 0.324843
noisy19 0.295051 0.000188 0.469274 2 4983 0.625484
noisy20 0.295024 0.000279 0.694472 2 4983 0.499386
noisy21 0.295099 0.000025 0.061862 2 4983 0.940013
noisy22 0.294973 0.000451 1.123061 2 4983 0.325365
noisy23 0.295094 0.000042 0.104995 2 4983 0.900331
noisy24 0.295076 0.000101 0.252789 2 4983 0.776642
noisy25 0.295063 0.000148 0.367666 2 4983 0.692367
noisy26 0.294942 0.000557 1.389407 2 4983 0.249320
noisy27 0.294799 0.001042 2.598215 2 4983 0.074507
noisy28 0.295088 0.000063 0.157878 2 4983 0.853959
noisy29 0.295050 0.000191 0.475348 2 4983 0.621697
noisy30 0.295048 0.000199 0.496095 2 4983 0.608934
noisy31 0.294826 0.000951 2.372666 2 4983 0.093337
noisy32 0.295032 0.000252 0.628523 2 4983 0.533421
noisy33 0.295067 0.000132 0.330013 2 4983 0.718930
noisy34 0.294907 0.000675 1.682418 2 4983 0.186029
noisy35 0.295072 0.000115 0.287074 2 4983 0.750469
noisy36 0.295100 0.000023 0.056790 2 4983 0.944793
noisy37 0.295066 0.000137 0.340260 2 4983 0.711602
noisy38 0.294812 0.000998 2.488550 2 4983 0.083133
noisy39 0.295072 0.000116 0.288360 2 4983 0.749504
noisy40 0.295065 0.000138 0.344605 2 4983 0.708517
Variable V16 will enter
====================== Step 16 forward selection results =======================
Wilks' Lambda Partial R-Square F Value Num DF Den DF Pr>F
V01 0.294300 0.000149 0.371077 2 4982 0.690010
V02 0.294184 0.000543 1.353086 2 4982 0.258536
V03 0.293744 0.002035 5.079836 2 4982 0.006253
V19 0.293822 0.001770 4.417624 2 4982 0.012110
V20 0.294130 0.000724 1.804593 2 4982 0.164649
V21 0.294316 0.000093 0.231731 2 4982 0.793168
noisy1 0.294171 0.000585 1.459217 2 4982 0.232517
noisy2 0.294177 0.000564 1.405823 2 4982 0.245262
noisy3 0.294284 0.000202 0.503568 2 4982 0.604401
noisy4 0.294258 0.000292 0.727001 2 4982 0.483408
noisy5 0.294226 0.000399 0.994265 2 4982 0.370069
noisy6 0.293867 0.001618 4.037054 2 4982 0.017707
noisy7 0.294229 0.000388 0.966972 2 4982 0.380304
noisy8 0.294315 0.000096 0.238168 2 4982 0.788080
noisy9 0.294329 0.000050 0.124736 2 4982 0.882732
noisy10 0.294274 0.000236 0.587513 2 4982 0.555746
noisy11 0.294326 0.000060 0.149940 2 4982 0.860764
noisy12 0.294283 0.000207 0.515595 2 4982 0.597177
noisy13 0.294306 0.000129 0.320932 2 4982 0.725488
noisy14 0.294259 0.000287 0.714215 2 4982 0.489626
noisy15 0.294259 0.000289 0.719313 2 4982 0.487137
noisy16 0.294226 0.000398 0.991743 2 4982 0.371003
noisy17 0.294322 0.000074 0.184149 2 4982 0.831818
noisy18 0.294211 0.000451 1.124707 2 4982 0.324830
noisy19 0.294296 0.000161 0.400986 2 4982 0.669681
noisy20 0.294261 0.000279 0.695103 2 4982 0.499071
noisy21 0.294333 0.000035 0.086015 2 4982 0.917582
noisy22 0.294208 0.000462 1.150875 2 4982 0.316444
noisy23 0.294331 0.000041 0.102190 2 4982 0.902860
noisy24 0.294311 0.000109 0.272434 2 4982 0.761535
noisy25 0.294301 0.000145 0.361350 2 4982 0.696753
noisy26 0.294184 0.000542 1.351615 2 4982 0.258917
noisy27 0.294051 0.000994 2.479259 2 4982 0.083909
noisy28 0.294325 0.000061 0.152385 2 4982 0.858662
noisy29 0.294290 0.000183 0.455272 2 4982 0.634302
noisy30 0.294284 0.000204 0.507557 2 4982 0.601995
noisy31 0.294066 0.000944 2.352942 2 4982 0.095195
noisy32 0.294267 0.000259 0.644238 2 4982 0.525106
noisy33 0.294306 0.000126 0.315089 2 4982 0.729739
noisy34 0.294149 0.000661 1.647355 2 4982 0.192663
noisy35 0.294307 0.000126 0.312703 2 4982 0.731482
noisy36 0.294335 0.000027 0.067926 2 4982 0.934330
noisy37 0.294305 0.000131 0.327265 2 4982 0.720908
noisy38 0.294029 0.001070 2.668234 2 4982 0.069474
noisy39 0.294307 0.000126 0.313103 2 4982 0.731189
noisy40 0.294298 0.000155 0.386416 2 4982 0.679508
Variable V03 will enter
====================== Step 17 forward selection results =======================
Wilks' Lambda Partial R-Square F Value Num DF Den DF Pr>F
V01 0.293703 0.000142 0.353883 2 4981 0.701975
V02 0.293591 0.000523 1.304448 2 4981 0.271415
V19 0.293225 0.001768 4.410006 2 4981 0.012203
V20 0.293532 0.000722 1.799425 2 4981 0.165501
V21 0.293718 0.000091 0.226420 2 4981 0.797392
noisy1 0.293560 0.000627 1.561578 2 4981 0.209907
noisy2 0.293582 0.000552 1.375224 2 4981 0.252879
noisy3 0.293684 0.000206 0.512435 2 4981 0.599067
noisy4 0.293660 0.000289 0.719262 2 4981 0.487162
noisy5 0.293627 0.000400 0.996613 2 4981 0.369201
noisy6 0.293274 0.001603 3.998500 2 4981 0.018402
noisy7 0.293633 0.000380 0.947746 2 4981 0.387684
noisy8 0.293717 0.000093 0.232788 2 4981 0.792330
noisy9 0.293729 0.000054 0.133939 2 4981 0.874647
noisy10 0.293672 0.000247 0.615664 2 4981 0.540323
noisy11 0.293727 0.000061 0.152146 2 4981 0.858867
noisy12 0.293686 0.000201 0.499941 2 4981 0.606597
noisy13 0.293706 0.000133 0.330050 2 4981 0.718904
noisy14 0.293661 0.000284 0.707345 2 4981 0.493001
noisy15 0.293649 0.000325 0.810715 2 4981 0.444599
noisy16 0.293623 0.000413 1.029840 2 4981 0.357140
noisy17 0.293721 0.000079 0.197141 2 4981 0.821082
noisy18 0.293611 0.000456 1.135079 2 4981 0.321480
noisy19 0.293698 0.000158 0.393332 2 4981 0.674826
noisy20 0.293659 0.000291 0.725310 2 4981 0.484226
noisy21 0.293736 0.000030 0.074800 2 4981 0.927930
noisy22 0.293611 0.000455 1.132547 2 4981 0.322294
noisy23 0.293730 0.000049 0.121498 2 4981 0.885595
noisy24 0.293711 0.000114 0.284743 2 4981 0.752220
noisy25 0.293704 0.000139 0.346218 2 4981 0.707375
noisy26 0.293586 0.000539 1.343520 2 4981 0.261020
noisy27 0.293458 0.000974 2.428366 2 4981 0.088285
noisy28 0.293727 0.000060 0.149744 2 4981 0.860932
noisy29 0.293694 0.000172 0.427349 2 4981 0.652260
noisy30 0.293689 0.000187 0.466151 2 4981 0.627440
noisy31 0.293465 0.000952 2.373842 2 4981 0.093228
noisy32 0.293668 0.000261 0.650659 2 4981 0.521746
noisy33 0.293708 0.000124 0.309294 2 4981 0.733979
noisy34 0.293534 0.000718 1.788536 2 4981 0.167312
noisy35 0.293706 0.000130 0.324436 2 4981 0.722950
noisy36 0.293737 0.000024 0.060470 2 4981 0.941322
noisy37 0.293708 0.000123 0.306820 2 4981 0.735797
noisy38 0.293430 0.001070 2.667423 2 4981 0.069530
noisy39 0.293707 0.000127 0.317541 2 4981 0.727951
noisy40 0.293700 0.000151 0.376338 2 4981 0.686390
No variable can enter
[3]:
STEPDISC()In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook.
On GitHub, the HTML representation is unable to render, please try loading this page with nbviewer.org.
Parameters
| method | 'forward' | |
| alpha | 0.01 | |
| lambda_init | None | |
| verbose | True |
Selected variables#
[4]:
#selected variables
print(clf2.summary_.selected)
['V07', 'V11', 'V17', 'V06', 'V10', 'V12', 'V08', 'V13', 'V09', 'V05', 'V18', 'V04', 'V15', 'V14', 'V16', 'V03']
summary#
[5]:
from discrimintools import summarySTEPDISC
summarySTEPDISC(clf2)
Stepwise Discriminant Analysis - Results
====================== Before forward selection =======================
Discriminant Analysis - Results
Summary Information:
Infos Value DF DF value
0 Total Sample Size 5000 DF Total 4999
1 Variables 61 DF Within Classes 4997
2 Classes 3 DF Between Classes 2
Class Level Information:
Frequency Proportion Prior Probability
A 1657 0.3314 0.3314
B 1647 0.3294 0.3294
C 1696 0.3392 0.3392
Linear Discriminant Function for classe:
A B C
Constant -40.5465 -43.7591 -42.8812
V01 -0.1055 -0.0692 -0.0621
V02 0.3424 0.3123 0.2641
V03 1.0893 1.0046 0.9394
V04 1.7200 1.6800 1.5051
... ... ... ...
noisy36 -0.0600 -0.0569 -0.0638
noisy37 0.0332 0.0371 0.0470
noisy38 0.0279 -0.0042 0.0330
noisy39 0.0146 0.0016 0.0136
noisy40 0.0354 0.0333 0.0476
[62 rows x 3 columns]
====================== After forward selection =======================
Discriminant Analysis - Results
Summary Information:
Infos Value DF DF value
0 Total Sample Size 5000 DF Total 4999
1 Variables 16 DF Within Classes 4997
2 Classes 3 DF Between Classes 2
Class Level Information:
Frequency Proportion Prior Probability
A 1657 0.3314 0.3314
B 1647 0.3294 0.3294
C 1696 0.3392 0.3392
Linear Discriminant Function for classe:
A B C
Constant -39.2103 -42.6346 -41.6719
V07 2.8722 2.8429 2.5941
V11 1.5733 2.0246 1.9723
V17 1.9708 1.6452 1.7809
V06 2.5088 2.4344 2.1924
V10 1.9386 2.3487 2.2748
V12 2.1196 2.3906 2.4917
V08 2.4463 2.6514 2.3619
V13 2.0175 2.1804 2.3570
V09 1.8901 2.2207 2.0347
V05 2.2610 2.1779 1.9677
V18 1.5890 1.3263 1.5595
V04 1.7237 1.6831 1.5105
V15 3.1612 2.9791 3.1202
V14 2.4949 2.4335 2.6315
V16 2.4502 2.2995 2.4164
V03 1.0908 1.0070 0.9440
Evaluation on training data#
[6]:
#eval_predict function
eval_test = clf.eval_predict(X,y,verbose=True)
Observation Profile:
Read Used
Number of Observations 5000 5000
Number of Observations Classified into classe:
prediction A B C Total
classe
A 1321 155 181 1657
B 113 1443 91 1647
C 80 61 1555 1696
Total 1514 1659 1827 5000
Percent Classified into classe:
prediction A B C Total
classe
A 79.722390 9.354255 10.923355 100.0
B 6.860959 87.613843 5.525197 100.0
C 4.716981 3.596698 91.686321 100.0
Total 30.280000 33.180000 36.540000 100.0
Priors 0.331400 0.329400 0.339200 NaN
Error Count Estimates for classe:
A B C Total
Rate 0.202776 0.123862 0.083137 0.1362
Priors 0.331400 0.329400 0.339200 NaN
Classification Report for classe:
precision recall f1-score support
A 0.872523 0.797224 0.833176 1657.0000
B 0.869801 0.876138 0.872958 1647.0000
C 0.851122 0.916863 0.882770 1696.0000
accuracy 0.863800 0.863800 0.863800 0.8638
macro avg 0.864482 0.863409 0.862968 5000.0000
weighted avg 0.864367 0.863800 0.863103 5000.0000