MISD-SLAM: Multimodal Semantic SLAM for Dynamic Environments

<table class="figure-group"><tr class="fig-image" id="a"><td><object data="https://static-preview.hindawi.com/articles/wcmc/volume-2022/7600669/figures/7600669.fig.003a.svgz" name="7600669.fig.003a" type="image/svg+xml"></object></td></tr><tr class="fig-caption"><td><b>(a) </b>The situation of static point</td></tr><tr class="fig-image" id="b"><td><object data="https://static-preview.hindawi.com/articles/wcmc/volume-2022/7600669/figures/7600669.fig.003b.svgz" name="7600669.fig.003b" type="image/svg+xml"></object></td></tr><tr class="fig-caption"><td><b>(b) </b>The situation of dynamic point</td></tr></table>

<div>Multiview geometry constraint. <svg height="11.927pt" id="M14" style="vertical-align:-3.291101pt" version="1.1" viewbox="-0.0498162 -8.6359 11.8066 11.927" width="11.8066pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M645 631C614 643 545 666 457 666C215 666 23 519 23 283C23 90 158 -16 337 -16C412 -16 489 2 522 10C543 39 590 127 606 167L580 181C519 89 459 18 348 18C201 18 122 136 122 287C122 464 244 632 435 632C544 632 602 595 608 472L639 475C643 526 645 581 645 631Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,8.619,3.132)"><path d="M250 606C250 634 233 656 203 656C168 656 146 618 146 593C146 564 169 545 192 545C227 545 250 573 250 606ZM227 95L212 119C187 98 152 71 135 71C129 71 128 78 134 102L207 373C219 418 217 451 194 451C165 451 92 411 30 351L44 326C77 353 106 371 114 371C124 371 121 357 117 341L55 97C32 5 46 -12 70 -12C108 -12 191 51 227 95Z"></path></g></svg> and <svg height="14.1649pt" id="M15" style="vertical-align:-5.529pt" version="1.1" viewbox="-0.0498162 -8.6359 13.1767 14.1649" width="13.1767pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M645 631C614 643 545 666 457 666C215 666 23 519 23 283C23 90 158 -16 337 -16C412 -16 489 2 522 10C543 39 590 127 606 167L580 181C519 89 459 18 348 18C201 18 122 136 122 287C122 464 244 632 435 632C544 632 602 595 608 472L639 475C643 526 645 581 645 631Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,8.619,3.132)"><path d="M400 606C400 634 383 656 353 656C316 656 294 620 294 593C294 564 317 545 343 545C375 545 400 573 400 606ZM366 351C379 413 381 451 356 451C323 451 251 408 183 341L199 313C223 335 267 365 277 365C285 365 284 354 277 312C245 132 222 27 193 -100C182 -148 160 -188 131 -188C113 -188 90 -178 75 -170C64 -164 55 -168 48 -175C38 -185 24 -203 24 -222S48 -257 71 -257C89 -257 131 -241 186 -192C243 -141 286 -46 310 74L366 351Z"></path></g></svg> are two consecutive frames, <svg height="6.1673pt" id="M16" style="vertical-align:-0.2063904pt" version="1.1" viewbox="-0.0498162 -5.96091 7.11985 6.1673" width="7.11985pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M515 96L502 119C471 88 431 62 423 62C416 62 411 70 417 101C440 223 469 341 497 448H486L412 422L380 277C330 188 210 57 152 57C137 57 126 69 139 124L195 366C210 431 205 448 182 448C155 448 89 413 23 350L36 326C73 354 103 376 112 376C118 376 118 365 113 340L61 118C54 90 52 68 52 51C52 0 75 -12 98 -12S151 -3 181 17C242 58 305 119 362 193H364L345 104C323 3 339 -12 359 -12C390 -12 464 35 515 96Z"></path></g></svg> and <svg height="11.6425pt" id="M17" style="vertical-align:-0.2063999pt" version="1.1" viewbox="-0.0498162 -11.4361 10.9154 11.6425" width="10.9154pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M515 96L502 119C471 88 431 62 423 62C416 62 411 70 417 101C440 223 469 341 497 448H486L412 422L380 277C330 188 210 57 152 57C137 57 126 69 139 124L195 366C210 431 205 448 182 448C155 448 89 413 23 350L36 326C73 354 103 376 112 376C118 376 118 365 113 340L61 118C54 90 52 68 52 51C52 0 75 -12 98 -12S151 -3 181 17C242 58 305 119 362 193H364L345 104C323 3 339 -12 359 -12C390 -12 464 35 515 96Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,6.994,-5.741)"><path d="M310 541L304 571C290 586 211 619 185 610L80 76L131 52L310 541Z"></path></g></svg> are corresponding image pixels, and <svg height="13.7903pt" id="M18" style="vertical-align:-3.83391pt" version="1.1" viewbox="-0.0498162 -9.95639 14.9305 13.7903" width="14.9305pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.0091,0,0,-0.0091,0,-5.741)"><path d="M698 334C698 397 680 451 655 451C627 451 602 424 602 397C602 389 605 383 614 371C622 360 624 340 624 317C624 161 546 47 458 47C419 47 389 69 389 125C389 142 391 162 397 185L457 430L451 435L380 421L315 164C301 107 266 47 222 47C182 47 153 69 153 126C153 137 157 162 161 185C166 214 179 265 197 334C203 358 208 385 208 407C208 433 201 451 176 451C124 451 64 404 24 348L44 320C86 366 113 382 121 382C126 382 128 381 128 374C128 368 126 356 122 341C102 266 88 204 81 164C77 143 73 121 73 107C73 23 131 -12 187 -12C234 -12 281 10 322 45C343 5 383 -12 422 -12C559 -12 698 174 698 334Z"></path></g><g transform="matrix(.013,0,0,-0.013,7.093,-1.651)"><path d="M570 304C570 398 525 448 414 448C385 448 343 445 312 434L329 511L321 518C297 504 262 482 244 460L233 411C195 397 159 381 128 358L135 332C160 347 189 360 224 373L111 -147C97 -210 84 -218 17 -231L13 -257L254 -247L259 -218L233 -216C183 -212 177 -202 189 -142L218 -1C238 -10 266 -12 283 -12C351 3 429 48 483 105C543 168 570 242 570 304ZM482 289C482 161 380 33 304 33C278 33 248 51 233 69L303 396C326 400 352 403 369 403C428 403 482 380 482 289Z"></path></g></svg> and <svg height="16.1926pt" id="M19" style="vertical-align:-3.8339pt" version="1.1" viewbox="-0.0498162 -12.3587 18.726 16.1926" width="18.726pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.0091,0,0,-0.0091,0,-5.741)"><path d="M698 334C698 397 680 451 655 451C627 451 602 424 602 397C602 389 605 383 614 371C622 360 624 340 624 317C624 161 546 47 458 47C419 47 389 69 389 125C389 142 391 162 397 185L457 430L451 435L380 421L315 164C301 107 266 47 222 47C182 47 153 69 153 126C153 137 157 162 161 185C166 214 179 265 197 334C203 358 208 385 208 407C208 433 201 451 176 451C124 451 64 404 24 348L44 320C86 366 113 382 121 382C126 382 128 381 128 374C128 368 126 356 122 341C102 266 88 204 81 164C77 143 73 121 73 107C73 23 131 -12 187 -12C234 -12 281 10 322 45C343 5 383 -12 422 -12C559 -12 698 174 698 334Z"></path></g><g transform="matrix(.013,0,0,-0.013,7.093,-1.651)"><path d="M570 304C570 398 525 448 414 448C385 448 343 445 312 434L329 511L321 518C297 504 262 482 244 460L233 411C195 397 159 381 128 358L135 332C160 347 189 360 224 373L111 -147C97 -210 84 -218 17 -231L13 -257L254 -247L259 -218L233 -216C183 -212 177 -202 189 -142L218 -1C238 -10 266 -12 283 -12C351 3 429 48 483 105C543 168 570 242 570 304ZM482 289C482 161 380 33 304 33C278 33 248 51 233 69L303 396C326 400 352 403 369 403C428 403 482 380 482 289Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,14.831,-6.664)"><path d="M310 541L304 571C290 586 211 619 185 610L80 76L131 52L310 541Z"></path></g></svg> are their back-projection points.</div>

Wireless Communications and Mobile Computing

MISD-SLAM: Multimodal Semantic SLAM for Dynamic Environments

Figure 3