Multisemantic Level Patch Merger Vision Transformer for Diagnosis of Pneumonia

<div>(a) Overview of Patch Merger architecture and the input/output streams. It receives an input sequence of length n and produces an output sequence of length <svg height="8.68572pt" id="M90" style="vertical-align:-0.0498209pt" version="1.1" viewbox="-0.0498162 -8.6359 12.9526 8.68572" width="12.9526pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M962 650H795L470 145L347 650H176L170 622C268 613 275 606 244 503L190 322C150 188 132 126 118 91C102 50 80 33 18 28L12 0H245L251 28C175 35 170 48 174 93C177 128 191 180 220 284L292 542H294C331 392 383 150 409 4H432L774 555H776L714 137C700 40 694 34 612 28L606 0H868L874 28C793 34 784 37 797 137L849 533C859 612 863 616 956 622L962 650Z"></path></g></svg> (usually <span class="nowrap"><svg height="9.2729pt" id="M91" style="vertical-align:-0.6370001pt" version="1.1" viewbox="-0.0498162 -8.6359 34.4264 9.2729" width="34.4264pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M962 650H795L470 145L347 650H176L170 622C268 613 275 606 244 503L190 322C150 188 132 126 118 91C102 50 80 33 18 28L12 0H245L251 28C175 35 170 48 174 93C177 128 191 180 220 284L292 542H294C331 392 383 150 409 4H432L774 555H776L714 137C700 40 694 34 612 28L606 0H868L874 28C793 34 784 37 797 137L849 533C859 612 863 616 956 622L962 650Z"></path></g><g transform="matrix(.013,0,0,-0.013,16.439,0)"><path d="M512 -3V55L134 254V256L512 456V514L75 281V230L512 -3Z"></path></g><g transform="matrix(.013,0,0,-0.013,27.702,0)"><path d="M495 86L479 114C446 82 419 66 409 66C401 66 401 72 406 97C420 166 436 231 453 297C489 435 454 448 428 448C406 448 384 439 354 422C305 394 222 327 161 247H159L183 345C200 415 194 448 173 448C143 448 82 410 23 351L38 325C64 349 95 371 105 371C111 371 116 365 109 336L25 -4L31 -12C50 -4 77 3 107 9C119 69 132 122 145 168C197 254 321 381 370 381C387 381 393 374 378 305L329 95C309 17 320 -12 345 -12C372 -12 430 19 495 86Z"></path></g></svg>).</span> (b) The location of the application of Patch Merger.</div>

Computational and Mathematical Methods in Medicine

fig5

Figure 5

Figure 5: Multisemantic Level Patch Merger Vision Transformer for Diagnosis of Pneumonia 