Overview

tabularTools provides a structured and extensible machine learning framework for tabular data.

It supports:

  • Data standardization
  • Yaml config file for selecting predictors and ML models
  • Model-agnostic evaluation
  • Performance visualization

Workflow

The standard workflow consists of:

  1. Load configuration using read_config()
  2. Read data using read_data()
  3. Validate and preprocess the dataset preprocess_data()
  4. Fit models with fit_models()
  5. Evaluate results using evaluate_models()
  6. Generate plots using visualize_results()

Reading config and defined data

The package information from a yaml config file, including the location of the data set and user-defined models.

Validating and proprocesing data

The model will format the loaded dataset based on specifications in the config file

Running models

The user defined models will be ran with the preprocessed data

mod=fit_models(cfg,pdata)
#> [1] 1
#> Rows before NA removal: 676 
#> Rows after NA removal: 253 
#> [1] 2
#> Rows before NA removal: 520 
#> Rows after NA removal: 221 
#> [1] 3
#> Rows before NA removal: 518 
#> Rows after NA removal: 224 
#> [1] 4
#> Rows before NA removal: 439 
#> Rows after NA removal: 187
#> Warning: package 'purrr' was built under R version 4.4.3
#> Warning: glm.fit: fitted probabilities numerically 0 or 1 occurred
#> Warning: glm.fit: algorithm did not converge
#> Warning: glm.fit: fitted probabilities numerically 0 or 1 occurred
#> Rows before NA removal: 676 
#> Rows after NA removal: 253 
#> Rows before NA removal: 520 
#> Rows after NA removal: 221 
#> Rows before NA removal: 518 
#> Rows after NA removal: 224 
#> Rows before NA removal: 439 
#> Rows after NA removal: 187

Evaluation and visualization

Multiple evaluations and visualizations of these evaluations will be run on the model results

evals=evaluate_models(mod)
#> [1] "logistic"
#> [1] "svm"
#>              0          1
#> 1   0.82197229 0.17802771
#> 2   0.14332279 0.85667721
#> 3   0.82197799 0.17802201
#> 4   0.89068935 0.10931065
#> 5   0.93444274 0.06555726
#> 6   0.87231709 0.12768291
#> 7   0.35828471 0.64171529
#> 8   0.71890831 0.28109169
#> 9   0.82205786 0.17794214
#> 10  0.81304696 0.18695304
#> 11  0.80241631 0.19758369
#> 12  0.92698088 0.07301912
#> 13  0.78347811 0.21652189
#> 14  0.88667366 0.11332634
#> 15  0.91240590 0.08759410
#> 16  0.91345382 0.08654618
#> 17  0.79420410 0.20579590
#> 18  0.90787140 0.09212860
#> 19  0.83203533 0.16796467
#> 20  0.90077750 0.09922250
#> 21  0.94392238 0.05607762
#> 22  0.82198083 0.17801917
#> 23  0.84526333 0.15473667
#> 24  0.82207222 0.17792778
#> 25  0.91940027 0.08059973
#> 26  0.70953594 0.29046406
#> 27  0.91358994 0.08641006
#> 28  0.86061151 0.13938849
#> 29  0.16832615 0.83167385
#> 30  0.78551313 0.21448687
#> 31  0.73449516 0.26550484
#> 32  0.82199225 0.17800775
#> 33  0.93503986 0.06496014
#> 34  0.88393907 0.11606093
#> 35  0.83607587 0.16392413
#> 36  0.87575355 0.12424645
#> 37  0.89394849 0.10605151
#> 38  0.84311565 0.15688435
#> 39  0.79557346 0.20442654
#> 40  0.88091532 0.11908468
#> 41  0.38342182 0.61657818
#> 42  0.06556767 0.93443233
#> 43  0.58709941 0.41290059
#> 44  0.61512645 0.38487355
#> 45  0.81485742 0.18514258
#> 46  0.52004160 0.47995840
#> 47  0.82202947 0.17797053
#> 48  0.15401058 0.84598942
#> 49  0.94711082 0.05288918
#> 50  0.72884716 0.27115284
#> 51  0.77287360 0.22712640
#> 52  0.58212841 0.41787159
#> 53  0.91942056 0.08057944
#> 54  0.15410880 0.84589120
#> 55  0.54016320 0.45983680
#> 56  0.71134567 0.28865433
#> 57  0.85558300 0.14441700
#> 58  0.14089731 0.85910269
#> 59  0.82204688 0.17795312
#> 60  0.86815847 0.13184153
#> 61  0.56051986 0.43948014
#> 62  0.83075521 0.16924479
#> 63  0.84692882 0.15307118
#> 64  0.90563085 0.09436915
#> 65  0.89328297 0.10671703
#> 66  0.87529355 0.12470645
#> 67  0.86705190 0.13294810
#> 68  0.92401157 0.07598843
#> 69  0.87546737 0.12453263
#> 70  0.46110163 0.53889837
#> 71  0.87352418 0.12647582
#> 72  0.93118077 0.06881923
#> 73  0.51603274 0.48396726
#> 74  0.82209101 0.17790899
#> 75  0.87220439 0.12779561
#> 76  0.86157315 0.13842685
#> 77  0.82211419 0.17788581
#> 78  0.82197436 0.17802564
#> 79  0.91944868 0.08055132
#> 80  0.83760882 0.16239118
#> 81  0.53370182 0.46629818
#> 82  0.33835080 0.66164920
#> 83  0.47729252 0.52270748
#> 84  0.85466316 0.14533684
#> 85  0.60907885 0.39092115
#> 86  0.92717611 0.07282389
#> 87  0.86982033 0.13017967
#> 88  0.82205093 0.17794907
#> 89  0.77118159 0.22881841
#> 90  0.88161699 0.11838301
#> 91  0.90324010 0.09675990
#> 92  0.92565060 0.07434940
#> 93  0.73021004 0.26978996
#> 94  0.72009323 0.27990677
#> 95  0.82203382 0.17796618
#> 96  0.82212339 0.17787661
#> 97  0.90577049 0.09422951
#> 98  0.85507859 0.14492141
#> 99  0.15401409 0.84598591
#> 100 0.83328169 0.16671831
#> 101 0.88009550 0.11990450
#> 102 0.50256564 0.49743436
#> 103 0.93509407 0.06490593
#> 104 0.51055595 0.48944405
#> 105 0.74035948 0.25964052
#> 106 0.91379343 0.08620657
#> 107 0.91172813 0.08827187
#> 108 0.85050610 0.14949390
#> 109 0.92611016 0.07388984
#> 110 0.74353393 0.25646607
#> 111 0.77556755 0.22443245
#> 112 0.79329399 0.20670601
#> 113 0.33512008 0.66487992
#> 114 0.57955533 0.42044467
#> 115 0.45744174 0.54255826
#> 116 0.82201530 0.17798470
#> 117 0.82205151 0.17794849
#> 118 0.91516696 0.08483304
#> 119 0.85558237 0.14441763
#> 120 0.84383063 0.15616937
#> 121 0.75315940 0.24684060
#> 122 0.93005396 0.06994604
#> 123 0.82195079 0.17804921
#> 124 0.43597475 0.56402525
#> 125 0.82199863 0.17800137
#> 126 0.25186994 0.74813006
#> 127 0.48744918 0.51255082
#> 128 0.79955463 0.20044537
#> 129 0.08735540 0.91264460
#> 130 0.62143608 0.37856392
#> 131 0.10490036 0.89509964
#> 132 0.81447126 0.18552874
#> 133 0.75006970 0.24993030
#> 134 0.68836033 0.31163967
#> 135 0.68699729 0.31300271
#> 136 0.78366570 0.21633430
#> 137 0.82215800 0.17784200
#> 138 0.87126425 0.12873575
#> 139 0.41212929 0.58787071
#> 140 0.92419695 0.07580305
#> 141 0.33922712 0.66077288
#> 142 0.85658160 0.14341840
#> 143 0.70709340 0.29290660
#> 144 0.70147151 0.29852849
#> 145 0.93096091 0.06903909
#> 146 0.70554102 0.29445898
#> 147 0.90038938 0.09961062
#> 148 0.61825597 0.38174403
#> 149 0.82171988 0.17828012
#> 150 0.82212797 0.17787203
#> 151 0.73140609 0.26859391
#> 152 0.91201009 0.08798991
#> 153 0.69898009 0.30101991
#> 154 0.90573571 0.09426429
#> 155 0.82197575 0.17802425
#> 156 0.80147826 0.19852174
#> 157 0.67752810 0.32247190
#> 158 0.91950652 0.08049348
#> 159 0.71029378 0.28970622
#> 160 0.60448283 0.39551717
#> 161 0.86334363 0.13665637
#> 162 0.90124225 0.09875775
#> 163 0.94275598 0.05724402
#> 164 0.88752179 0.11247821
#> 165 0.55431444 0.44568556
#> 166 0.89558237 0.10441763
#> 167 0.83737704 0.16262296
#> 168 0.89636358 0.10363642
#> 169 0.89097049 0.10902951
#> 170 0.45694692 0.54305308
#> 171 0.82210910 0.17789090
#> 172 0.85225126 0.14774874
#> 173 0.53508315 0.46491685
#> 174 0.88581041 0.11418959
#> 175 0.87689848 0.12310152
#> 176 0.87091676 0.12908324
#> 177 0.88880306 0.11119694
#> 178 0.89890868 0.10109132
#> 179 0.83585655 0.16414345
#> 180 0.34971862 0.65028138
#> 181 0.89471839 0.10528161
#> 182 0.47757376 0.52242624
#> 183 0.15142142 0.84857858
#> 184 0.28892407 0.71107593
#> 185 0.93830340 0.06169660
#> 186 0.85492407 0.14507593
#> 187 0.90545291 0.09454709
#> 188 0.82030268 0.17969732
#> 189 0.82203249 0.17796751
#> 190 0.82203672 0.17796328
#> 191 0.79484518 0.20515482
#> 192 0.83853033 0.16146967
#> 193 0.92492997 0.07507003
#> 194 0.91907504 0.08092496
#> 195 0.69509377 0.30490623
#> 196 0.86330691 0.13669309
#> 197 0.24487331 0.75512669
#> 198 0.73510839 0.26489161
#> 199 0.82202718 0.17797282
#> 200 0.74234687 0.25765313
#> 201 0.57496831 0.42503169
#> 202 0.82211232 0.17788768
#> 203 0.83837116 0.16162884
#> 204 0.72700493 0.27299507
#> 205 0.80851146 0.19148854
#> 206 0.92956286 0.07043714
#> 207 0.86213171 0.13786829
#> 208 0.71975930 0.28024070
#> 209 0.79355133 0.20644867
#> 210 0.92313261 0.07686739
#> 211 0.67614055 0.32385945
#> 212 0.90436377 0.09563623
#> 213 0.78078598 0.21921402
#> 214 0.88295103 0.11704897
#> 215 0.29937587 0.70062413
#> 216 0.48877409 0.51122591
#> 217 0.80099611 0.19900389
#> 218 0.88129686 0.11870314
#> 219 0.87503804 0.12496196
#> 220 0.68065393 0.31934607
#> 221 0.75267475 0.24732525
#> 222 0.74616791 0.25383209
#> 223 0.06193675 0.93806325
#> 224 0.27545358 0.72454642
#> 225 0.11693989 0.88306011
#> 226 0.14745481 0.85254519
#> 227 0.19556956 0.80443044
#> 228 0.15392884 0.84607116
#> 229 0.42018808 0.57981192
#> 230 0.15398722 0.84601278
#> 231 0.07967328 0.92032672
#> 232 0.11804314 0.88195686
#> 233 0.21003691 0.78996309
#> 234 0.16039435 0.83960565
#> 235 0.09459044 0.90540956
#> 236 0.09272222 0.90727778
#> 237 0.15411261 0.84588739
#> 238 0.13360566 0.86639434
#> 239 0.31168822 0.68831178
#> 240 0.15402723 0.84597277
#> 241 0.35416069 0.64583931
#> 242 0.25110214 0.74889786
#> 243 0.15391546 0.84608454
#> 244 0.31553746 0.68446254
#> 245 0.15406431 0.84593569
#> 246 0.11603406 0.88396594
#> 247 0.41206025 0.58793975
#> 248 0.17138669 0.82861331
#> 249 0.58192511 0.41807489
#> 250 0.15468282 0.84531718
#> 251 0.85002468 0.14997532
#> 252 0.25886352 0.74113648
#> 253 0.22465129 0.77534871
#>              0           1
#> 1   0.92875451 0.071245491
#> 2   0.04868448 0.951315518
#> 3   0.92885428 0.071145722
#> 4   0.97732920 0.022670801
#> 5   0.99330613 0.006693868
#> 6   0.98923293 0.010767070
#> 7   0.25132585 0.748674151
#> 8   0.89799158 0.102008423
#> 9   0.96897340 0.031026602
#> 10  0.47899697 0.521003030
#> 11  0.97702086 0.022979143
#> 12  0.94983599 0.050164010
#> 13  0.98761489 0.012385113
#> 14  0.98693803 0.013061966
#> 15  0.99272276 0.007277242
#> 16  0.99261684 0.007383161
#> 17  0.93025757 0.069742427
#> 18  0.99404491 0.005955089
#> 19  0.98107341 0.018926590
#> 20  0.99735230 0.002647704
#> 21  0.92881260 0.071187398
#> 22  0.97426450 0.025735497
#> 23  0.92240218 0.077597819
#> 24  0.27000321 0.729996788
#> 25  0.92990686 0.070093136
#> 26  0.98989753 0.010102471
#> 27  0.98618053 0.013819472
#> 28  0.92875871 0.071241288
#> 29  0.92887242 0.071127579
#> 30  0.92881534 0.071184656
#> 31  0.98697301 0.013026995
#> 32  0.96580424 0.034195759
#> 33  0.97717906 0.022820939
#> 34  0.96424691 0.035753086
#> 35  0.97281090 0.027189104
#> 36  0.92878433 0.071215667
#> 37  0.95163959 0.048360407
#> 38  0.98597173 0.014028272
#> 39  0.95447932 0.045520682
#> 40  0.69467972 0.305320280
#> 41  0.64312939 0.356870611
#> 42  0.92883988 0.071160119
#> 43  0.99633120 0.003668799
#> 44  0.07309961 0.926900385
#> 45  0.00821889 0.991781110
#> 46  0.94702123 0.052978769
#> 47  0.28465538 0.715344622
#> 48  0.99588221 0.004117787
#> 49  0.99276946 0.007230537
#> 50  0.92874537 0.071254625
#> 51  0.98316803 0.016831973
#> 52  0.72857025 0.271429749
#> 53  0.97284220 0.027157804
#> 54  0.98882638 0.011173624
#> 55  0.99357402 0.006425979
#> 56  0.99112194 0.008878064
#> 57  0.99114216 0.008857843
#> 58  0.98951103 0.010488968
#> 59  0.99324003 0.006759973
#> 60  0.98371553 0.016284474
#> 61  0.07762041 0.922379590
#> 62  0.98049406 0.019505938
#> 63  0.99672091 0.003279087
#> 64  0.19099958 0.809000425
#> 65  0.94378921 0.056210791
#> 66  0.98656225 0.013437747
#> 67  0.98743483 0.012565169
#> 68  0.97972293 0.020277073
#> 69  0.98064162 0.019358380
#> 70  0.97490552 0.025094483
#> 71  0.97996227 0.020037731
#> 72  0.67061706 0.329382936
#> 73  0.03978688 0.960213118
#> 74  0.97007327 0.029926731
#> 75  0.06038295 0.939617050
#> 76  0.28673889 0.713261110
#> 77  0.87464418 0.125355816
#> 78  0.99075095 0.009249052
#> 79  0.96839555 0.031604447
#> 80  0.05320343 0.946796571
#> 81  0.96445747 0.035542527
#> 82  0.97993938 0.020060623
#> 83  0.98931357 0.010686434
#> 84  0.99418464 0.005815356
#> 85  0.94177601 0.058223994
#> 86  0.92881833 0.071181671
#> 87  0.96807743 0.031922575
#> 88  0.98073163 0.019268372
#> 89  0.98813988 0.011860117
#> 90  0.97221122 0.027788780
#> 91  0.92885932 0.071140684
#> 92  0.98425911 0.015740890
#> 93  0.98882808 0.011171923
#> 94  0.92882757 0.071172433
#> 95  0.99298797 0.007012031
#> 96  0.98928110 0.010718898
#> 97  0.99173955 0.008260449
#> 98  0.94688127 0.053118728
#> 99  0.92887576 0.071124240
#> 100 0.92880649 0.071193509
#> 101 0.15614748 0.843852521
#> 102 0.92887519 0.071124807
#> 103 0.95149361 0.048506392
#> 104 0.98612564 0.013874360
#> 105 0.94697808 0.053021921
#> 106 0.96505895 0.034941048
#> 107 0.94168810 0.058311897
#> 108 0.99491110 0.005088904
#> 109 0.95079619 0.049203814
#> 110 0.95550259 0.044497405
#> 111 0.60515291 0.394847090
#> 112 0.97554237 0.024457635
#> 113 0.64955226 0.350447738
#> 114 0.92965671 0.070343291
#> 115 0.90926475 0.090735249
#> 116 0.05739018 0.942609819
#> 117 0.92882288 0.071177120
#> 118 0.70723128 0.292768724
#> 119 0.94224517 0.057754826
#> 120 0.96891965 0.031080346
#> 121 0.08847949 0.911520508
#> 122 0.05733664 0.942663358
#> 123 0.99286075 0.007139252
#> 124 0.08461118 0.915388816
#> 125 0.94009034 0.059909657
#> 126 0.87596208 0.124037916
#> 127 0.92883329 0.071166712
#> 128 0.99188662 0.008113384
#> 129 0.99025200 0.009748002
#> 130 0.97227443 0.027725573
#> 131 0.86079445 0.139205553
#> 132 0.98732977 0.012670232
#> 133 0.95801113 0.041988873
#> 134 0.99320501 0.006794993
#> 135 0.98987210 0.010127903
#> 136 0.94608173 0.053918270
#> 137 0.86630206 0.133697944
#> 138 0.98952378 0.010476224
#> 139 0.94102060 0.058979399
#> 140 0.26292637 0.737073629
#> 141 0.99177037 0.008229632
#> 142 0.98785701 0.012142985
#> 143 0.99568380 0.004316196
#> 144 0.98675507 0.013244927
#> 145 0.98115366 0.018846339
#> 146 0.97722856 0.022771443
#> 147 0.99187570 0.008124296
#> 148 0.81326217 0.186737826
#> 149 0.98545954 0.014540455
#> 150 0.14341120 0.856588795
#> 151 0.92889925 0.071100751
#> 152 0.97712078 0.022879217
#> 153 0.16510569 0.834894313
#> 154 0.98866086 0.011339140
#> 155 0.98972196 0.010278040
#> 156 0.98519320 0.014806798
#> 157 0.98925756 0.010742439
#> 158 0.99318986 0.006810136
#> 159 0.25283614 0.747163859
#> 160 0.92882464 0.071175364
#> 161 0.50730849 0.492691507
#> 162 0.89600106 0.103998936
#> 163 0.97158558 0.028414417
#> 164 0.62535315 0.374646845
#> 165 0.23585797 0.764142034
#> 166 0.99496763 0.005032365
#> 167 0.97635898 0.023641019
#> 168 0.98858651 0.011413491
#> 169 0.92876713 0.071232874
#> 170 0.92878474 0.071215257
#> 171 0.98439131 0.015608686
#> 172 0.95622956 0.043770444
#> 173 0.99670964 0.003290362
#> 174 0.99366462 0.006335378
#> 175 0.26907534 0.730924659
#> 176 0.24794865 0.752051351
#> 177 0.98291604 0.017083957
#> 178 0.88936842 0.110631580
#> 179 0.01107842 0.988921579
#> 180 0.92878267 0.071217326
#> 181 0.92889024 0.071109755
#> 182 0.96874801 0.031251995
#> 183 0.97504796 0.024952045
#> 184 0.95225557 0.047744431
#> 185 0.06281964 0.937180365
#> 186 0.99534372 0.004656281
#> 187 0.98046548 0.019534524
#> 188 0.84148502 0.158514982
#> 189 0.05741799 0.942582015
#> 190 0.91516984 0.084830162
#> 191 0.96268951 0.037310488
#> 192 0.99145651 0.008543485
#> 193 0.99218395 0.007816055
#> 194 0.46838432 0.531615679
#> 195 0.05736103 0.942638970
#> 196 0.97934361 0.020656390
#> 197 0.03794896 0.962051042
#> 198 0.98440907 0.015590930
#> 199 0.97889505 0.021104950
#> 200 0.85206802 0.147931981
#> 201 0.93919586 0.060804143
#> 202 0.92888381 0.071116192
#> 203 0.08467643 0.915323572
#> 204 0.05733396 0.942666044
#> 205 0.05168332 0.948316679
#> 206 0.25703874 0.742961256
#> 207 0.04072257 0.959277429
#> 208 0.14256023 0.857439770
#> 209 0.05738845 0.942611552
#> 210 0.05731480 0.942685199
#> 211 0.05732778 0.942672223
#> 212 0.14246823 0.857531773
#> 213 0.04729505 0.952704953
#> 214 0.05733840 0.942661602
#> 215 0.14847526 0.851524745
#> 216 0.05740531 0.942594687
#> 217 0.29323201 0.706767986
#> 218 0.10251890 0.897481097
#> 219 0.28449914 0.715500860
#> 220 0.76917583 0.230824169
#> 221 0.97487101 0.025128994
#>               0           1
#> 1   0.942863682 0.057136318
#> 2   0.937610152 0.062389848
#> 3   0.977457108 0.022542892
#> 4   0.995718801 0.004281199
#> 5   0.217065527 0.782934473
#> 6   0.995452188 0.004547812
#> 7   0.950304795 0.049695205
#> 8   0.983016359 0.016983641
#> 9   0.977815172 0.022184828
#> 10  0.937659803 0.062340197
#> 11  0.988011621 0.011988379
#> 12  0.993369865 0.006630135
#> 13  0.996012432 0.003987568
#> 14  0.995375819 0.004624181
#> 15  0.937571115 0.062428885
#> 16  0.995534415 0.004465585
#> 17  0.163911997 0.836088003
#> 18  0.990345798 0.009654202
#> 19  0.998505573 0.001494427
#> 20  0.938407963 0.061592037
#> 21  0.985547204 0.014452796
#> 22  0.078375237 0.921624763
#> 23  0.937568517 0.062431483
#> 24  0.958553160 0.041446840
#> 25  0.993036018 0.006963982
#> 26  0.990561073 0.009438927
#> 27  0.063320016 0.936679984
#> 28  0.319331407 0.680668593
#> 29  0.937569019 0.062430981
#> 30  0.937598731 0.062401269
#> 31  0.937549927 0.062450073
#> 32  0.988450635 0.011549365
#> 33  0.967479259 0.032520741
#> 34  0.976789346 0.023210654
#> 35  0.974685645 0.025314355
#> 36  0.968032049 0.031967951
#> 37  0.956051960 0.043948040
#> 38  0.988015712 0.011984288
#> 39  0.974488551 0.025511449
#> 40  0.773189615 0.226810385
#> 41  0.937621186 0.062378814
#> 42  0.997556952 0.002443048
#> 43  0.947109284 0.052890716
#> 44  0.996078220 0.003921780
#> 45  0.577152516 0.422847484
#> 46  0.992687906 0.007312094
#> 47  0.958338325 0.041661675
#> 48  0.985901582 0.014098418
#> 49  0.582307439 0.417692561
#> 50  0.696264704 0.303735296
#> 51  0.986024096 0.013975904
#> 52  0.990972706 0.009027294
#> 53  0.508514887 0.491485113
#> 54  0.996234783 0.003765217
#> 55  0.993447565 0.006552435
#> 56  0.993820235 0.006179765
#> 57  0.993328060 0.006671940
#> 58  0.995697371 0.004302629
#> 59  0.990337992 0.009662008
#> 60  0.052835276 0.947164724
#> 61  0.104142752 0.895857248
#> 62  0.981023903 0.018976097
#> 63  0.997615053 0.002384947
#> 64  0.063318398 0.936681602
#> 65  0.969097061 0.030902939
#> 66  0.991720863 0.008279137
#> 67  0.991680679 0.008319321
#> 68  0.977033048 0.022966952
#> 69  0.987887650 0.012112350
#> 70  0.980537575 0.019462425
#> 71  0.063318987 0.936681013
#> 72  0.984808120 0.015191880
#> 73  0.674994917 0.325005083
#> 74  0.983519300 0.016480700
#> 75  0.841168725 0.158831275
#> 76  0.993869203 0.006130797
#> 77  0.970299103 0.029700897
#> 78  0.048507326 0.951492674
#> 79  0.314554045 0.685445955
#> 80  0.968639294 0.031360706
#> 81  0.063363134 0.936636866
#> 82  0.982826573 0.017173427
#> 83  0.063271108 0.936728892
#> 84  0.063370767 0.936629233
#> 85  0.990995260 0.009004740
#> 86  0.996729248 0.003270752
#> 87  0.954109273 0.045890727
#> 88  0.937662887 0.062337113
#> 89  0.953545844 0.046454156
#> 90  0.988140192 0.011859808
#> 91  0.991032024 0.008967976
#> 92  0.981886878 0.018113122
#> 93  0.150841449 0.849158551
#> 94  0.958112874 0.041887126
#> 95  0.989431502 0.010568498
#> 96  0.991860196 0.008139804
#> 97  0.936492350 0.063507650
#> 98  0.994715910 0.005284090
#> 99  0.991529618 0.008470382
#> 100 0.994805293 0.005194707
#> 101 0.964519155 0.035480845
#> 102 0.937644406 0.062355594
#> 103 0.937550863 0.062449137
#> 104 0.131546172 0.868453828
#> 105 0.956950023 0.043049977
#> 106 0.940573881 0.059426119
#> 107 0.992226990 0.007773010
#> 108 0.963516862 0.036483138
#> 109 0.965982677 0.034017323
#> 110 0.963048258 0.036951742
#> 111 0.997113872 0.002886128
#> 112 0.953361535 0.046638465
#> 113 0.940127850 0.059872150
#> 114 0.077126297 0.922873703
#> 115 0.567554813 0.432445187
#> 116 0.988174250 0.011825750
#> 117 0.460623690 0.539376310
#> 118 0.964574189 0.035425811
#> 119 0.841719818 0.158280182
#> 120 0.929887503 0.070112497
#> 121 0.935640249 0.064359751
#> 122 0.622939188 0.377060812
#> 123 0.947805888 0.052194112
#> 124 0.970527978 0.029472022
#> 125 0.995660646 0.004339354
#> 126 0.009355480 0.990644520
#> 127 0.955562924 0.044437076
#> 128 0.320255779 0.679744221
#> 129 0.936111660 0.063888340
#> 130 0.943017342 0.056982658
#> 131 0.994580451 0.005419549
#> 132 0.993781199 0.006218801
#> 133 0.963242436 0.036757564
#> 134 0.890982888 0.109017112
#> 135 0.991429340 0.008570660
#> 136 0.958785484 0.041214516
#> 137 0.063369849 0.936630151
#> 138 0.006246755 0.993753245
#> 139 0.207205949 0.792794051
#> 140 0.995882361 0.004117639
#> 141 0.990840663 0.009159337
#> 142 0.956729100 0.043270900
#> 143 0.113431499 0.886568501
#> 144 0.897251065 0.102748935
#> 145 0.990811092 0.009188908
#> 146 0.951687678 0.048312322
#> 147 0.545194817 0.454805183
#> 148 0.995664320 0.004335680
#> 149 0.990782701 0.009217299
#> 150 0.997289903 0.002710097
#> 151 0.987492512 0.012507488
#> 152 0.014030937 0.985969063
#> 153 0.978692188 0.021307812
#> 154 0.982400218 0.017599782
#> 155 0.993365690 0.006634310
#> 156 0.351372387 0.648627613
#> 157 0.989607033 0.010392967
#> 158 0.937575008 0.062424992
#> 159 0.980833255 0.019166745
#> 160 0.026527263 0.973472737
#> 161 0.992025994 0.007974006
#> 162 0.991801650 0.008198350
#> 163 0.983917721 0.016082279
#> 164 0.992174863 0.007825137
#> 165 0.996328922 0.003671078
#> 166 0.948743878 0.051256122
#> 167 0.613540377 0.386459623
#> 168 0.978156073 0.021843927
#> 169 0.710507711 0.289492289
#> 170 0.348404262 0.651595738
#> 171 0.997011863 0.002988137
#> 172 0.987481719 0.012518281
#> 173 0.990552027 0.009447973
#> 174 0.940320756 0.059679244
#> 175 0.937623615 0.062376385
#> 176 0.987268918 0.012731082
#> 177 0.971659088 0.028340912
#> 178 0.890098489 0.109901511
#> 179 0.997649743 0.002350257
#> 180 0.995510157 0.004489843
#> 181 0.984840061 0.015159939
#> 182 0.876596840 0.123403160
#> 183 0.937532676 0.062467324
#> 184 0.931450291 0.068549709
#> 185 0.980510737 0.019489263
#> 186 0.977692006 0.022307994
#> 187 0.975734747 0.024265253
#> 188 0.997182608 0.002817392
#> 189 0.063383877 0.936616123
#> 190 0.975266536 0.024733464
#> 191 0.932843563 0.067156437
#> 192 0.969672737 0.030327263
#> 193 0.994587496 0.005412504
#> 194 0.995811085 0.004188915
#> 195 0.978574557 0.021425443
#> 196 0.063349716 0.936650284
#> 197 0.041150089 0.958849911
#> 198 0.985350490 0.014649510
#> 199 0.985175674 0.014824326
#> 200 0.854218146 0.145781854
#> 201 0.967510680 0.032489320
#> 202 0.958444369 0.041555631
#> 203 0.063406623 0.936593377
#> 204 0.063406091 0.936593909
#> 205 0.213954346 0.786045654
#> 206 0.069552838 0.930447162
#> 207 0.068340934 0.931659066
#> 208 0.114313848 0.885686152
#> 209 0.020194397 0.979805603
#> 210 0.043318337 0.956681663
#> 211 0.012173054 0.987826946
#> 212 0.063370933 0.936629067
#> 213 0.063423792 0.936576208
#> 214 0.059080635 0.940919365
#> 215 0.067651989 0.932348011
#> 216 0.021059514 0.978940486
#> 217 0.072008981 0.927991019
#> 218 0.090679115 0.909320885
#> 219 0.146818755 0.853181245
#> 220 0.017586853 0.982413147
#> 221 0.205394353 0.794605647
#> 222 0.617863548 0.382136452
#> 223 0.974371475 0.025628525
#> 224 0.154074032 0.845925968
#>              0           1
#> 1   0.96025110 0.039748896
#> 2   0.94220547 0.057794526
#> 3   0.97893589 0.021064115
#> 4   0.99379960 0.006200401
#> 5   0.99391491 0.006085094
#> 6   0.97288262 0.027117381
#> 7   0.97755762 0.022442380
#> 8   0.98389470 0.016105297
#> 9   0.95986087 0.040139129
#> 10  0.98526887 0.014731126
#> 11  0.99374839 0.006251608
#> 12  0.99529697 0.004703033
#> 13  0.99393024 0.006069763
#> 14  0.96054507 0.039454926
#> 15  0.99437743 0.005622565
#> 16  0.02816754 0.971832456
#> 17  0.98365516 0.016344845
#> 18  0.99471787 0.005282127
#> 19  0.95929308 0.040706920
#> 20  0.98461956 0.015380439
#> 21  0.94220250 0.057797502
#> 22  0.97546764 0.024532360
#> 23  0.98911037 0.010889631
#> 24  0.98855715 0.011442853
#> 25  0.97416345 0.025836551
#> 26  0.05825140 0.941748602
#> 27  0.94327562 0.056724375
#> 28  0.94216967 0.057830333
#> 29  0.99031172 0.009688279
#> 30  0.56726148 0.432738517
#> 31  0.98937692 0.010623076
#> 32  0.48519278 0.514807222
#> 33  0.97567357 0.024326430
#> 34  0.98209899 0.017901007
#> 35  0.98670322 0.013296781
#> 36  0.98723841 0.012761585
#> 37  0.98443393 0.015566072
#> 38  0.98321107 0.016788933
#> 39  0.94215668 0.057843324
#> 40  0.94825893 0.051741067
#> 41  0.99507475 0.004925248
#> 42  0.95833578 0.041664217
#> 43  0.99485630 0.005143696
#> 44  0.98888425 0.011115747
#> 45  0.96841282 0.031587178
#> 46  0.97937961 0.020620393
#> 47  0.83403188 0.165968117
#> 48  0.98696568 0.013034322
#> 49  0.98208998 0.017910023
#> 50  0.99386256 0.006137444
#> 51  0.98751801 0.012481986
#> 52  0.99146689 0.008533115
#> 53  0.99240712 0.007592885
#> 54  0.99375652 0.006243480
#> 55  0.99042437 0.009575630
#> 56  0.23297275 0.767027248
#> 57  0.97235525 0.027644754
#> 58  0.99354756 0.006452444
#> 59  0.98570511 0.014294890
#> 60  0.98948847 0.010511534
#> 61  0.98937389 0.010626114
#> 62  0.98047390 0.019526102
#> 63  0.99044365 0.009556347
#> 64  0.98815070 0.011849300
#> 65  0.99082199 0.009178009
#> 66  0.97515421 0.024845788
#> 67  0.94916591 0.050834095
#> 68  0.99243443 0.007565565
#> 69  0.97256056 0.027439437
#> 70  0.02819364 0.971806364
#> 71  0.98308670 0.016913303
#> 72  0.97594626 0.024053738
#> 73  0.99151328 0.008486724
#> 74  0.99569572 0.004304281
#> 75  0.97352368 0.026476317
#> 76  0.98300131 0.016998688
#> 77  0.95534443 0.044655572
#> 78  0.98418645 0.015813550
#> 79  0.98651025 0.013489750
#> 80  0.97471684 0.025283165
#> 81  0.69402159 0.305978408
#> 82  0.95034192 0.049658083
#> 83  0.99113423 0.008865774
#> 84  0.99119229 0.008807707
#> 85  0.96519622 0.034803781
#> 86  0.03949629 0.960503713
#> 87  0.99108598 0.008914019
#> 88  0.98942949 0.010570508
#> 89  0.99357758 0.006422420
#> 90  0.96071861 0.039281392
#> 91  0.97881708 0.021182921
#> 92  0.94220096 0.057799039
#> 93  0.49183087 0.508169129
#> 94  0.97918369 0.020816308
#> 95  0.98244959 0.017550406
#> 96  0.64379196 0.356208040
#> 97  0.98536422 0.014635779
#> 98  0.98324846 0.016751543
#> 99  0.98884003 0.011159970
#> 100 0.98354998 0.016450022
#> 101 0.99445153 0.005548469
#> 102 0.98364424 0.016355764
#> 103 0.97598697 0.024013026
#> 104 0.94222033 0.057779666
#> 105 0.98139675 0.018603251
#> 106 0.07124527 0.928754729
#> 107 0.94211635 0.057883651
#> 108 0.97733787 0.022662130
#> 109 0.94220004 0.057799956
#> 110 0.94222506 0.057774940
#> 111 0.86379845 0.136201551
#> 112 0.97351842 0.026481576
#> 113 0.96884843 0.031151570
#> 114 0.99417468 0.005825318
#> 115 0.96005296 0.039947042
#> 116 0.94217248 0.057827517
#> 117 0.96466388 0.035336119
#> 118 0.99402055 0.005979450
#> 119 0.99338579 0.006614206
#> 120 0.97614863 0.023851366
#> 121 0.95607852 0.043921477
#> 122 0.99270513 0.007294871
#> 123 0.98436097 0.015639029
#> 124 0.99575692 0.004243083
#> 125 0.98784345 0.012156546
#> 126 0.59766534 0.402334662
#> 127 0.94223406 0.057765944
#> 128 0.90455353 0.095446474
#> 129 0.98925547 0.010744532
#> 130 0.96925242 0.030747583
#> 131 0.71549503 0.284504969
#> 132 0.99165020 0.008349805
#> 133 0.98594927 0.014050726
#> 134 0.99331856 0.006681441
#> 135 0.98059702 0.019402982
#> 136 0.97580004 0.024199959
#> 137 0.99364369 0.006356306
#> 138 0.98982577 0.010174233
#> 139 0.98086058 0.019139417
#> 140 0.97451963 0.025480373
#> 141 0.98268160 0.017318397
#> 142 0.98881893 0.011181070
#> 143 0.99223894 0.007761064
#> 144 0.99126791 0.008732085
#> 145 0.99064104 0.009358955
#> 146 0.99520871 0.004791290
#> 147 0.98359859 0.016401414
#> 148 0.99147309 0.008526911
#> 149 0.94219722 0.057802777
#> 150 0.93559201 0.064407991
#> 151 0.99450331 0.005496693
#> 152 0.98314158 0.016858421
#> 153 0.98443501 0.015564995
#> 154 0.98123037 0.018769632
#> 155 0.94210817 0.057891834
#> 156 0.98810646 0.011893541
#> 157 0.98624089 0.013759106
#> 158 0.99583597 0.004164033
#> 159 0.99351856 0.006481441
#> 160 0.08145522 0.918544782
#> 161 0.98907045 0.010929551
#> 162 0.94146782 0.058532178
#> 163 0.95650393 0.043496070
#> 164 0.94213023 0.057869767
#> 165 0.96909692 0.030903082
#> 166 0.97707702 0.022922983
#> 167 0.98619637 0.013803627
#> 168 0.99354581 0.006454189
#> 169 0.98104635 0.018953652
#> 170 0.02816400 0.971835996
#> 171 0.97675600 0.023243997
#> 172 0.98257767 0.017422327
#> 173 0.99349068 0.006509324
#> 174 0.99394553 0.006054466
#> 175 0.98111940 0.018880605
#> 176 0.98284513 0.017154867
#> 177 0.97655057 0.023449428
#> 178 0.95989652 0.040103477
#> 179 0.98913199 0.010868012
#> 180 0.98657316 0.013426843
#> 181 0.36079807 0.639201926
#> 182 0.39690463 0.603095369
#> 183 0.74100206 0.258997935
#> 184 0.18869590 0.811304102
#> 185 0.60433152 0.395668481
#> 186 0.94211591 0.057884086
#> 187 0.97373773 0.026262274
plots=visualize_results(evals)