Gap between Prediction and Truth: A Case Study of False-Positives in Leakage Detection

<table class="table-group" id="tab2"><tr><td><table class="table"><tr><td class="thead-hr" colspan="2"><hr/></td></tr><tr class="thead"><td class="align_left">Hypothesis test tool</td><td class="align_center">The null hypothesis in this study</td></tr><tr><td class="thead-hr" colspan="2"><hr/></td></tr><tr><td class="align_left">One-sample <span class="nowrap"><svg height="8.02022pt" id="M214" style="vertical-align:-0.2063999pt" version="1.1" viewbox="-0.0498162 -7.81382 4.54925 8.02022" width="4.54925pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M324 430H196L233 583L223 592L145 529L120 430H54L29 396L31 388H111L56 126C33 15 54 -12 77 -12C137 -12 214 57 250 95L233 119C208 92 155 59 138 59C126 59 120 70 131 125L186 390L298 394L324 430Z"></path></g></svg>-</span>test</td><td class="align_center">The mean <span class="nowrap"><svg height="11.7782pt" id="M215" style="vertical-align:-3.42938pt" version="1.1" viewbox="-0.0498162 -8.34882 28.5284 11.7782" width="28.5284pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M538 96L524 119C492 88 454 63 446 63C439 63 434 70 440 101C463 223 491 341 518 448H508L433 422L401 276C355 192 240 56 188 56C163 56 154 89 163 133C184 233 207 338 235 443L230 448L152 424L58 17C40 -60 23 -143 23 -185C23 -241 42 -261 63 -261C92 -261 117 -241 125 -227L124 -221C109 -209 89 -165 89 -103C89 -55 96 -13 105 26H107C121 -3 134 -12 151 -12C172 -12 194 -5 221 16C279 61 330 124 384 194H386C381 159 377 141 368 105C343 3 363 -12 383 -12C416 -12 486 35 538 96Z"></path></g><g transform="matrix(.013,0,0,-0.013,10.848,0)"><path d="M535 323V373H52V323H535ZM535 138V188H52V138H535Z"></path></g><g transform="matrix(.013,0,0,-0.013,22.111,0)"><path d="M241 635C89 635 35 457 35 312C35 153 89 -12 240 -12C390 -12 443 166 443 312C443 466 390 635 241 635ZM238 602C329 602 354 454 354 312C354 172 330 22 240 22C152 22 124 173 124 313S148 602 238 602Z"></path></g></svg>.</span></td></tr><tr><td class="align_left">Chi-squared test</td><td class="align_center">The variance <span class="nowrap"><svg height="11.7978pt" id="M216" style="vertical-align:-0.2063999pt" version="1.1" viewbox="-0.0498162 -11.5914 33.6053 11.7978" width="33.6053pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M548 455L523 469C505 448 490 439 461 439C416 439 374 447 316 447C144 447 23 310 23 161C23 47 89 -12 179 -12C312 -12 429 106 429 244C429 303 419 344 368 386L371 388C404 383 440 378 474 378C507 378 530 411 548 455ZM350 274C350 191 308 25 198 25C144 25 108 75 108 157C108 264 170 395 276 395C296 395 320 384 333 360C347 334 350 316 350 274Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,7.347,-5.741)"><path d="M414 144C384 79 371 75 317 75H135L276 221C367 316 408 376 408 465C408 570 327 635 237 635C179 635 131 609 100 575L42 494L67 471C94 510 138 565 205 565C277 565 321 517 321 435C321 348 258 270 195 195C146 137 88 81 33 26V0H411C423 44 433 88 446 135L414 144Z"></path></g><g transform="matrix(.013,0,0,-0.013,15.926,0)"><path d="M535 323V373H52V323H535ZM535 138V188H52V138H535Z"></path></g><g transform="matrix(.013,0,0,-0.013,27.188,0)"><path d="M384 0V27C293 34 287 42 287 114V635C232 613 172 594 109 583V559L157 557C201 555 205 550 205 499V114C205 42 199 34 109 27V0H384Z"></path></g></svg>.</span></td></tr><tr><td class="align_left">Kolmogorov–Smirnov test</td><td class="align_center">The samples come from a standard normal distribution <span class="nowrap"><svg height="11.5564pt" id="M217" style="vertical-align:-2.26807pt" version="1.1" viewbox="-0.0498162 -9.28833 39.4677 11.5564" width="39.4677pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M569 131C584 203 591 291 596 391C603 524 609 615 622 658L609 669C545 642 461 523 357 312C267 129 194 14 119 14C104 14 91 21 88 36H91C96 33 101 32 107 32C134 32 149 54 149 77C149 104 128 128 97 128C65 128 38 101 38 62C38 19 71 -15 118 -15C207 -15 274 84 391 315C446 423 501 518 534 563L535 562C518 501 511 401 508 297C504 160 495 63 476 -13H496C588 65 656 224 712 363C783 536 828 621 863 640H866C866 608 894 595 913 595C937 595 956 613 956 641C956 670 935 687 904 687C875 687 853 675 830 650C782 596 735 496 692 394C649 290 605 184 570 131H569Z"></path></g><g transform="matrix(.013,0,0,-0.013,12.61,0)"><path d="M300 -147C201 -63 143 98 143 270S200 602 300 686L282 710C136 610 70 450 70 271V270C70 89 136 -72 282 -170L300 -147Z"></path></g><g transform="matrix(.013,0,0,-0.013,17.108,0)"><path d="M241 635C89 635 35 457 35 312C35 153 89 -12 240 -12C390 -12 443 166 443 312C443 466 390 635 241 635ZM238 602C329 602 354 454 354 312C354 172 330 22 240 22C152 22 124 173 124 313S148 602 238 602Z"></path></g><g transform="matrix(.013,0,0,-0.013,23.348,0)"><path d="M95 130C70 130 46 113 46 88C46 72 54 64 59 64C93 55 121 33 121 -3C121 -41 93 -68 44 -88L55 -117C117 -98 186 -56 186 22C186 91 131 130 95 130Z"></path></g><g transform="matrix(.013,0,0,-0.013,28.491,0)"><path d="M384 0V27C293 34 287 42 287 114V635C232 613 172 594 109 583V559L157 557C201 555 205 550 205 499V114C205 42 199 34 109 27V0H384Z"></path></g><g transform="matrix(.013,0,0,-0.013,34.731,0)"><path d="M275 270C275 450 212 609 64 710L45 686C145 604 203 442 203 270S147 -63 45 -147L64 -170C213 -68 275 89 275 270Z"></path></g></svg>.</span></td></tr><tr><td class="align_left">Pearson’s correlation test</td><td class="align_center">The correlation coefficient <span class="nowrap"><svg height="11.7782pt" id="M218" style="vertical-align:-3.42938pt" version="1.1" viewbox="-0.0498162 -8.34882 28.3196 11.7782" width="28.3196pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M516 277C516 378 460 448 376 448C335 448 288 434 240 401C158 345 127 277 107 159C53 -161 38 -221 23 -247L28 -261C43 -260 95 -250 114 -226C122 -216 129 -199 146 -75C152 -29 157 0 164 31C182 9 206 -12 237 -12C267 -12 325 8 376 46C451 102 516 179 516 277ZM432 259C432 134 366 40 259 40C236 40 204 48 171 76L195 203C219 327 253 400 326 400C398 400 432 336 432 259Z"></path></g><g transform="matrix(.013,0,0,-0.013,10.642,0)"><path d="M535 323V373H52V323H535ZM535 138V188H52V138H535Z"></path></g><g transform="matrix(.013,0,0,-0.013,21.905,0)"><path d="M241 635C89 635 35 457 35 312C35 153 89 -12 240 -12C390 -12 443 166 443 312C443 466 390 635 241 635ZM238 602C329 602 354 454 354 312C354 172 330 22 240 22C152 22 124 173 124 313S148 602 238 602Z"></path></g></svg>.</span></td></tr><tr class="table-tr"><td colspan="2"><hr class="tbody-hr"/></td></tr></table></td></tr></table>

Security and Communication Networks

tab2

Table 2

Table 2: Gap between Prediction and Truth: A Case Study of False-Positives in Leakage Detection 