SentMask: A Sentence-Aware Mask Attention-Guided Two-Stage Text Summarization Component

<div>The transformation of a sample input, <span class="nowrap"><svg height="6.1673pt" id="M12" style="vertical-align:-0.2063904pt" version="1.1" viewbox="-0.0498162 -5.96091 7.39387 6.1673" width="7.39387pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M536 404C536 423 520 448 491 448C445 448 398 404 308 283L286 338C255 416 242 448 217 448C182 448 138 402 92 341L111 321C149 368 169 378 178 378C188 378 198 363 214 320L254 212C185 117 138 65 107 65C98 65 85 69 82 75C79 82 73 86 65 86C44 86 23 60 23 39C23 7 44 -12 71 -12C119 -12 168 33 265 177L306 61C321 17 347 -12 373 -12C413 -12 465 33 507 96L491 119C459 84 432 60 413 60C395 60 378 92 358 148L321 250C341 279 369 310 389 332C417 363 439 382 456 382C466 382 475 376 481 368C486 361 492 358 496 358C513 358 536 381 536 404Z"></path></g></svg>,</span> is on the left representing the original article and <svg height="12.3641pt" id="M13" style="vertical-align:-0.2064009pt" version="1.1" viewbox="-0.0498162 -12.1577 27.7312 12.3641" width="27.7312pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M536 404C536 423 520 448 491 448C445 448 398 404 308 283L286 338C255 416 242 448 217 448C182 448 138 402 92 341L111 321C149 368 169 378 178 378C188 378 198 363 214 320L254 212C185 117 138 65 107 65C98 65 85 69 82 75C79 82 73 86 65 86C44 86 23 60 23 39C23 7 44 -12 71 -12C119 -12 168 33 265 177L306 61C321 17 347 -12 373 -12C413 -12 465 33 507 96L491 119C459 84 432 60 413 60C395 60 378 92 358 148L321 250C341 279 369 310 389 332C417 363 439 382 456 382C466 382 475 376 481 368C486 361 492 358 496 358C513 358 536 381 536 404Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,7.267,-5.741)"><path d="M810 0V30C751 35 744 40 744 106V296C744 396 694 451 614 451C583 451 558 438 537 425C512 409 485 391 454 368C434 420 390 451 342 451C309 451 285 439 260 424C228 405 206 387 185 372V453C141 434 90 421 43 413V386C102 378 105 373 105 309V106C105 41 96 35 29 30V0H243V30C194 35 185 41 185 106V335C216 360 256 389 297 389C357 389 384 348 384 275V106C384 41 374 35 312 30V0H530V30C475 35 465 41 465 104V294C465 313 464 324 463 336C502 367 539 389 576 389C637 389 663 346 663 274V109C663 41 653 35 593 30V0H810Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,14.829,-5.741)"><path d="M442 39L431 68C420 63 406 57 394 57C377 57 359 71 359 118V301C359 353 349 393 314 424C291 443 261 451 230 451C171 438 107 401 79 381C59 366 46 355 46 340C46 316 72 295 91 295C106 295 117 303 122 319C131 350 139 371 152 384C163 397 178 404 197 404C246 404 281 365 281 293V278C260 262 186 232 124 213C69 194 41 161 41 112C41 47 92 -12 163 -12C195 -12 243 25 283 51C288 35 293 22 308 7C319 -4 339 -12 354 -12L442 39ZM281 87C262 68 226 51 199 51C169 51 129 74 129 126C129 162 151 181 190 198C211 208 259 229 281 240V87Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,18.888,-5.741)"><path d="M327 325C324 350 312 408 304 433C283 442 256 451 213 451C120 451 59 391 59 320C59 243 125 210 188 181C237 158 266 136 266 93C266 52 231 24 195 24C134 24 93 81 74 148L42 143C42 106 51 37 59 23C78 8 125 -12 177 -12C257 -12 345 35 345 127C345 198 292 234 216 264C171 283 131 305 131 348C131 387 156 416 195 416C243 416 277 378 297 317L327 325Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,22.273,-5.741)"><path d="M523 0V30C483 33 455 48 422 83C390 115 285 234 266 263C309 314 327 333 351 357C388 392 414 404 483 415V444L273 435V405C320 400 321 392 302 364C285 339 256 300 233 277C218 262 201 250 170 243V710C130 697 73 680 22 675V647C85 642 89 637 89 570V107C89 44 83 35 14 30V0H244V30C179 35 170 41 170 107V214C176 216 181 217 186 217C194 217 203 212 216 196C273 129 333 54 384 -1L523 0Z"></path></g></svg> is on the right representing the corresponding sentence-aware mask matrix. The sentences marked in red (<span class="nowrap"><svg height="11.9805pt" id="M14" style="vertical-align:-0.2063999pt" version="1.1" viewbox="-0.0498162 -11.7741 13.5825 11.9805" width="13.5825pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M536 404C536 423 520 448 491 448C445 448 398 404 308 283L286 338C255 416 242 448 217 448C182 448 138 402 92 341L111 321C149 368 169 378 178 378C188 378 198 363 214 320L254 212C185 117 138 65 107 65C98 65 85 69 82 75C79 82 73 86 65 86C44 86 23 60 23 39C23 7 44 -12 71 -12C119 -12 168 33 265 177L306 61C321 17 347 -12 373 -12C413 -12 465 33 507 96L491 119C459 84 432 60 413 60C395 60 378 92 358 148L321 250C341 279 369 310 389 332C417 363 439 382 456 382C466 382 475 376 481 368C486 361 492 358 496 358C513 358 536 381 536 404Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,7.267,-5.741)"><path d="M615 650H141L132 618C223 612 227 607 212 526L136 123C122 42 112 38 27 32L18 0H522C539 33 580 135 592 166L558 179C536 139 512 100 486 75C454 48 420 41 345 41C287 41 252 42 237 55C221 68 220 100 231 158L261 316H357C455 316 455 309 455 235H489L529 437H494C468 366 460 360 369 360H269L305 565C315 609 316 611 357 611H450C525 611 535 599 548 578C559 556 561 526 560 482L595 486L615 650Z"></path></g></svg>)</span> are the sentences extracted by the extractor.</div>

International Journal of Intelligent Systems

fig3

Figure 3

Figure 3: SentMask: A Sentence-Aware Mask Attention-Guided Two-Stage Text Summarization Component 