Revisit Retinex Theory: Towards a Lightness-Aware Restorer for Underexposed Images

<div><svg height="11.927pt" id="M37" style="vertical-align:-3.291101pt" version="1.1" viewbox="-0.0498162 -8.6359 34.3892 11.927" width="34.3892pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M405 650H141L135 622C222 616 230 610 215 535L133 116C118 41 113 33 29 28L23 0H289L295 28C209 33 205 40 219 116L298 535C312 609 317 616 399 622L405 650Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,4.719,3.132)"><path d="M389 0V32C297 38 291 46 291 118V635C234 613 175 595 109 583V556L161 554C203 552 207 547 207 497V118C207 46 201 38 110 32V0H389Z"></path></g><g transform="matrix(.013,0,0,-0.013,13.297,0)"><path d="M548 311L516 323C497 274 452 240 400 240C372 240 342 260 316 278C277 305 235 330 188 330C116 330 66 268 40 199L72 187C91 236 136 270 188 270C216 270 246 250 272 232C311 205 353 180 400 180C472 180 522 242 548 311Z"></path></g><g transform="matrix(.013,0,0,-0.013,24.56,0)"><path d="M405 650H141L135 622C222 616 230 610 215 535L133 116C118 41 113 33 29 28L23 0H289L295 28C209 33 205 40 219 116L298 535C312 609 317 616 399 622L405 650Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,29.279,3.132)"><path d="M290 377C321 398 342 415 358 430C378 450 389 473 389 502C389 578 329 635 238 635H237C184 635 137 610 109 578L64 515L88 493C112 529 154 573 208 573S303 542 303 482C303 409 233 370 141 341L149 308C165 313 190 319 215 319C272 319 341 283 341 193C342 98 292 43 222 43C163 43 122 72 96 94C88 101 79 100 70 94C61 87 47 73 46 60C44 47 48 37 62 23C76 10 118 -12 165 -12C238 -12 430 62 430 223C430 297 379 359 290 375V377Z"></path></g></svg> are three input images with different exposure levels. <svg height="11.927pt" id="M38" style="vertical-align:-3.291101pt" version="1.1" viewbox="-0.0498162 -8.6359 37.1034 11.927" width="37.1034pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M449 634C442 637 425 643 405 650C376 660 341 666 307 666C181 666 98 590 98 485C98 400 170 343 215 310L246 288C307 243 343 204 343 147C343 67 291 18 219 18C104 18 61 124 51 202L23 199C28 124 27 71 27 47C47 22 122 -16 204 -16C324 -16 428 60 428 174C428 256 379 309 307 360L276 382C223 419 179 455 179 516C179 576 221 632 293 632C379 632 410 564 418 487L448 490C446 536 446 592 449 634Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,6.071,3.132)"><path d="M389 0V32C297 38 291 46 291 118V635C234 613 175 595 109 583V556L161 554C203 552 207 547 207 497V118C207 46 201 38 110 32V0H389Z"></path></g><g transform="matrix(.013,0,0,-0.013,14.649,0)"><path d="M548 311L516 323C497 274 452 240 400 240C372 240 342 260 316 278C277 305 235 330 188 330C116 330 66 268 40 199L72 187C91 236 136 270 188 270C216 270 246 250 272 232C311 205 353 180 400 180C472 180 522 242 548 311Z"></path></g><g transform="matrix(.013,0,0,-0.013,25.912,0)"><path d="M449 634C442 637 425 643 405 650C376 660 341 666 307 666C181 666 98 590 98 485C98 400 170 343 215 310L246 288C307 243 343 204 343 147C343 67 291 18 219 18C104 18 61 124 51 202L23 199C28 124 27 71 27 47C47 22 122 -16 204 -16C324 -16 428 60 428 174C428 256 379 309 307 360L276 382C223 419 179 455 179 516C179 576 221 632 293 632C379 632 410 564 418 487L448 490C446 536 446 592 449 634Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,31.983,3.132)"><path d="M290 377C321 398 342 415 358 430C378 450 389 473 389 502C389 578 329 635 238 635H237C184 635 137 610 109 578L64 515L88 493C112 529 154 573 208 573S303 542 303 482C303 409 233 370 141 341L149 308C165 313 190 319 215 319C272 319 341 283 341 193C342 98 292 43 222 43C163 43 122 72 96 94C88 101 79 100 70 94C61 87 47 73 46 60C44 47 48 37 62 23C76 10 118 -12 165 -12C238 -12 430 62 430 223C430 297 379 359 290 375V377Z"></path></g></svg> are the estimated illumination maps of <span class="nowrap"><svg height="11.927pt" id="M39" style="vertical-align:-3.291101pt" version="1.1" viewbox="-0.0498162 -8.6359 34.3892 11.927" width="34.3892pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M405 650H141L135 622C222 616 230 610 215 535L133 116C118 41 113 33 29 28L23 0H289L295 28C209 33 205 40 219 116L298 535C312 609 317 616 399 622L405 650Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,4.719,3.132)"><path d="M389 0V32C297 38 291 46 291 118V635C234 613 175 595 109 583V556L161 554C203 552 207 547 207 497V118C207 46 201 38 110 32V0H389Z"></path></g><g transform="matrix(.013,0,0,-0.013,13.297,0)"><path d="M548 311L516 323C497 274 452 240 400 240C372 240 342 260 316 278C277 305 235 330 188 330C116 330 66 268 40 199L72 187C91 236 136 270 188 270C216 270 246 250 272 232C311 205 353 180 400 180C472 180 522 242 548 311Z"></path></g><g transform="matrix(.013,0,0,-0.013,24.56,0)"><path d="M405 650H141L135 622C222 616 230 610 215 535L133 116C118 41 113 33 29 28L23 0H289L295 28C209 33 205 40 219 116L298 535C312 609 317 616 399 622L405 650Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,29.279,3.132)"><path d="M290 377C321 398 342 415 358 430C378 450 389 473 389 502C389 578 329 635 238 635H237C184 635 137 610 109 578L64 515L88 493C112 529 154 573 208 573S303 542 303 482C303 409 233 370 141 341L149 308C165 313 190 319 215 319C272 319 341 283 341 193C342 98 292 43 222 43C163 43 122 72 96 94C88 101 79 100 70 94C61 87 47 73 46 60C44 47 48 37 62 23C76 10 118 -12 165 -12C238 -12 430 62 430 223C430 297 379 359 290 375V377Z"></path></g></svg>,</span> respectively, and <svg height="15.2153pt" id="M40" style="vertical-align:-3.2911pt" version="1.1" viewbox="-0.0498162 -11.9242 37.1034 15.2153" width="37.1034pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,-2.897)"><path d="M846 558C704 595 559 633 434 679H412C288 633 141 595 0 558L8 532L423 607L838 532L846 558Z"></path></g><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M449 634C442 637 425 643 405 650C376 660 341 666 307 666C181 666 98 590 98 485C98 400 170 343 215 310L246 288C307 243 343 204 343 147C343 67 291 18 219 18C104 18 61 124 51 202L23 199C28 124 27 71 27 47C47 22 122 -16 204 -16C324 -16 428 60 428 174C428 256 379 309 307 360L276 382C223 419 179 455 179 516C179 576 221 632 293 632C379 632 410 564 418 487L448 490C446 536 446 592 449 634Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,6.071,3.132)"><path d="M389 0V32C297 38 291 46 291 118V635C234 613 175 595 109 583V556L161 554C203 552 207 547 207 497V118C207 46 201 38 110 32V0H389Z"></path></g><g transform="matrix(.013,0,0,-0.013,14.672,0)"><path d="M548 311L516 323C497 274 452 240 400 240C372 240 342 260 316 278C277 305 235 330 188 330C116 330 66 268 40 199L72 187C91 236 136 270 188 270C216 270 246 250 272 232C311 205 353 180 400 180C472 180 522 242 548 311Z"></path></g><g transform="matrix(.013,0,0,-0.013,25.935,-2.897)"><path d="M846 558C704 595 559 633 434 679H412C288 633 141 595 0 558L8 532L423 607L838 532L846 558Z"></path></g><g transform="matrix(.013,0,0,-0.013,25.935,0)"><path d="M449 634C442 637 425 643 405 650C376 660 341 666 307 666C181 666 98 590 98 485C98 400 170 343 215 310L246 288C307 243 343 204 343 147C343 67 291 18 219 18C104 18 61 124 51 202L23 199C28 124 27 71 27 47C47 22 122 -16 204 -16C324 -16 428 60 428 174C428 256 379 309 307 360L276 382C223 419 179 455 179 516C179 576 221 632 293 632C379 632 410 564 418 487L448 490C446 536 446 592 449 634Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,32.006,3.132)"><path d="M290 377C321 398 342 415 358 430C378 450 389 473 389 502C389 578 329 635 238 635H237C184 635 137 610 109 578L64 515L88 493C112 529 154 573 208 573S303 542 303 482C303 409 233 370 141 341L149 308C165 313 190 319 215 319C272 319 341 283 341 193C342 98 292 43 222 43C163 43 122 72 96 94C88 101 79 100 70 94C61 87 47 73 46 60C44 47 48 37 62 23C76 10 118 -12 165 -12C238 -12 430 62 430 223C430 297 379 359 290 375V377Z"></path></g></svg> are the corresponding corrected illumination maps. <svg height="15.2153pt" id="M41" style="vertical-align:-3.2911pt" version="1.1" viewbox="-0.0498162 -11.9242 34.3892 15.2153" width="34.3892pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,.705,-2.897)"><path d="M470 557C393 591 314 624 246 666H224C156 624 76 591 0 557L12 532C86 550 163 573 235 596C309 572 384 550 458 532L470 557Z"></path></g><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M405 650H141L135 622C222 616 230 610 215 535L133 116C118 41 113 33 29 28L23 0H289L295 28C209 33 205 40 219 116L298 535C312 609 317 616 399 622L405 650Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,4.719,3.132)"><path d="M389 0V32C297 38 291 46 291 118V635C234 613 175 595 109 583V556L161 554C203 552 207 547 207 497V118C207 46 201 38 110 32V0H389Z"></path></g><g transform="matrix(.013,0,0,-0.013,13.315,0)"><path d="M548 311L516 323C497 274 452 240 400 240C372 240 342 260 316 278C277 305 235 330 188 330C116 330 66 268 40 199L72 187C91 236 136 270 188 270C216 270 246 250 272 232C311 205 353 180 400 180C472 180 522 242 548 311Z"></path></g><g transform="matrix(.013,0,0,-0.013,25.282,-2.897)"><path d="M470 557C393 591 314 624 246 666H224C156 624 76 591 0 557L12 532C86 550 163 573 235 596C309 572 384 550 458 532L470 557Z"></path></g><g transform="matrix(.013,0,0,-0.013,24.578,0)"><path d="M405 650H141L135 622C222 616 230 610 215 535L133 116C118 41 113 33 29 28L23 0H289L295 28C209 33 205 40 219 116L298 535C312 609 317 616 399 622L405 650Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,29.297,3.132)"><path d="M290 377C321 398 342 415 358 430C378 450 389 473 389 502C389 578 329 635 238 635H237C184 635 137 610 109 578L64 515L88 493C112 529 154 573 208 573S303 542 303 482C303 409 233 370 141 341L149 308C165 313 190 319 215 319C272 319 341 283 341 193C342 98 292 43 222 43C163 43 122 72 96 94C88 101 79 100 70 94C61 87 47 73 46 60C44 47 48 37 62 23C76 10 118 -12 165 -12C238 -12 430 62 430 223C430 297 379 359 290 375V377Z"></path></g></svg> are the outputs of LiAR by taking <svg height="11.927pt" id="M42" style="vertical-align:-3.291101pt" version="1.1" viewbox="-0.0498162 -8.6359 34.3892 11.927" width="34.3892pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M405 650H141L135 622C222 616 230 610 215 535L133 116C118 41 113 33 29 28L23 0H289L295 28C209 33 205 40 219 116L298 535C312 609 317 616 399 622L405 650Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,4.719,3.132)"><path d="M389 0V32C297 38 291 46 291 118V635C234 613 175 595 109 583V556L161 554C203 552 207 547 207 497V118C207 46 201 38 110 32V0H389Z"></path></g><g transform="matrix(.013,0,0,-0.013,13.297,0)"><path d="M548 311L516 323C497 274 452 240 400 240C372 240 342 260 316 278C277 305 235 330 188 330C116 330 66 268 40 199L72 187C91 236 136 270 188 270C216 270 246 250 272 232C311 205 353 180 400 180C472 180 522 242 548 311Z"></path></g><g transform="matrix(.013,0,0,-0.013,24.56,0)"><path d="M405 650H141L135 622C222 616 230 610 215 535L133 116C118 41 113 33 29 28L23 0H289L295 28C209 33 205 40 219 116L298 535C312 609 317 616 399 622L405 650Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,29.279,3.132)"><path d="M290 377C321 398 342 415 358 430C378 450 389 473 389 502C389 578 329 635 238 635H237C184 635 137 610 109 578L64 515L88 493C112 529 154 573 208 573S303 542 303 482C303 409 233 370 141 341L149 308C165 313 190 319 215 319C272 319 341 283 341 193C342 98 292 43 222 43C163 43 122 72 96 94C88 101 79 100 70 94C61 87 47 73 46 60C44 47 48 37 62 23C76 10 118 -12 165 -12C238 -12 430 62 430 223C430 297 379 359 290 375V377Z"></path></g></svg> as inputs.</div>

Mathematical Problems in Engineering

fig2

Figure 2

Figure 2: Revisit Retinex Theory: Towards a Lightness-Aware Restorer for Underexposed Images 