Face Swapping: Realistic Image Synthesis Based on Facial Landmarks Alignment

<div>Warping of the reference face image: (a) triangulation pattern, (b) reference image <svg height="11.9316pt" id="M49" style="vertical-align:-3.2957pt" version="1.1" viewbox="-0.0498162 -8.6359 16.2405 11.9316" width="16.2405pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M405 650H141L135 622C222 616 230 610 215 535L133 116C118 41 113 33 29 28L23 0H289L295 28C209 33 205 40 219 116L298 535C312 609 317 616 399 622L405 650Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,4.719,3.132)"><path d="M185 344V453C137 433 92 421 41 413V386C100 378 104 375 104 310V106C104 41 97 35 33 30V0H268V30C190 35 185 41 185 107V283C206 340 240 371 267 371C282 371 296 364 310 351C316 344 325 343 336 348C357 357 369 378 369 399C369 424 345 451 310 451C262 451 219 397 187 344H185Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,8.067,3.132)"><path d="M384 109C349 76 310 59 268 59C197 59 123 113 120 245C240 248 367 259 384 262C403 266 407 275 407 296C407 376 338 451 254 451H253C201 451 148 425 105 378C65 334 39 272 39 203C39 88 112 -12 235 -12C266 -12 339 5 402 84L384 109ZM230 411C285 411 319 365 319 313C319 298 313 293 294 293C236 291 180 290 125 290C141 370 185 411 230 411Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,12.017,3.132)"><path d="M56 439L27 407L32 396H103V106C103 41 96 35 31 30V0H271V29C191 37 184 40 184 110V396H293C304 404 309 428 303 439H184V473C183 558 195 604 207 623S234 653 261 653C293 653 322 635 341 616C350 607 360 606 370 614C381 622 386 631 389 638C394 652 393 664 384 675C366 696 339 708 303 710C263 705 225 686 190 655C137 608 121 561 114 538S103 487 103 456V439H56Z"></path></g></svg> with facial landmarks and their new locations, (c) warped reference image <span class="nowrap"><svg height="13.836pt" id="M50" style="vertical-align:-3.948111pt" version="1.1" viewbox="-0.0498162 -9.88789 16.2405 13.836" width="16.2405pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M405 650H141L135 622C222 616 230 610 215 535L133 116C118 41 113 33 29 28L23 0H289L295 28C209 33 205 40 219 116L298 535C312 609 317 616 399 622L405 650Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,5.567,-5.741)"><path d="M708 439H523V409C587 401 594 395 581 344C562 272 534 184 513 118H511C468 225 428 330 391 434H361C318 317 283 217 244 121H242C218 196 193 273 170 349C157 394 160 401 220 409V439H10V409C60 403 67 394 86 343C127 224 165 109 201 -10H233C273 101 314 199 353 299C393 195 432 99 475 -10H507C554 126 596 251 627 334C648 390 657 401 708 409V439Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,4.719,3.784)"><path d="M185 344V453C137 433 92 421 41 413V386C100 378 104 375 104 310V106C104 41 97 35 33 30V0H268V30C190 35 185 41 185 107V283C206 340 240 371 267 371C282 371 296 364 310 351C316 344 325 343 336 348C357 357 369 378 369 399C369 424 345 451 310 451C262 451 219 397 187 344H185Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,8.067,3.784)"><path d="M384 109C349 76 310 59 268 59C197 59 123 113 120 245C240 248 367 259 384 262C403 266 407 275 407 296C407 376 338 451 254 451H253C201 451 148 425 105 378C65 334 39 272 39 203C39 88 112 -12 235 -12C266 -12 339 5 402 84L384 109ZM230 411C285 411 319 365 319 313C319 298 313 293 294 293C236 291 180 290 125 290C141 370 185 411 230 411Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,12.017,3.784)"><path d="M56 439L27 407L32 396H103V106C103 41 96 35 31 30V0H271V29C191 37 184 40 184 110V396H293C304 404 309 428 303 439H184V473C183 558 195 604 207 623S234 653 261 653C293 653 322 635 341 616C350 607 360 606 370 614C381 622 386 631 389 638C394 652 393 664 384 675C366 696 339 708 303 710C263 705 225 686 190 655C137 608 121 561 114 538S103 487 103 456V439H56Z"></path></g></svg>,</span> and (d) the aligned input image <span class="nowrap"><svg height="11.8174pt" id="M51" style="vertical-align:-3.1815pt" version="1.1" viewbox="-0.0498162 -8.6359 12.934 11.8174" width="12.934pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M405 650H141L135 622C222 616 230 610 215 535L133 116C118 41 113 33 29 28L23 0H289L295 28C209 33 205 40 219 116L298 535C312 609 317 616 399 622L405 650Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,4.719,3.132)"><path d="M138 535C169 535 191 560 191 589C191 620 168 644 139 644S85 620 85 589C85 560 110 535 138 535ZM257 0V30C192 35 185 43 185 109V453C142 435 94 422 40 414V386C101 378 104 372 104 311V109C104 41 97 35 33 30V0H257Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,7.221,3.132)"><path d="M532 0V30C473 38 467 38 467 107V298C467 395 416 451 336 451C307 451 279 439 251 420C226 404 205 389 185 374V453C142 434 94 422 43 413V386C98 378 104 373 104 309V107C104 41 100 38 31 30V0H251V30C191 35 185 40 185 107V337C216 364 255 389 295 389C360 389 386 347 386 276V110C386 44 380 35 321 30V0H532Z"></path></g></svg>.</span></div>

Mathematical Problems in Engineering

fig3

Figure 3

Figure 3: Face Swapping: Realistic Image Synthesis Based on Facial Landmarks Alignment 