US7901093B2  Modeling light transport in complex display systems  Google Patents
Modeling light transport in complex display systems Download PDFInfo
 Publication number
 US7901093B2 US7901093B2 US11/623,016 US62301607A US7901093B2 US 7901093 B2 US7901093 B2 US 7901093B2 US 62301607 A US62301607 A US 62301607A US 7901093 B2 US7901093 B2 US 7901093B2
 Authority
 US
 United States
 Prior art keywords
 projector
 image
 camera
 projection
 matrix
 Prior art date
 Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
 Active, expires
Links
 239000011159 matrix material Substances 0.000 claims abstract description 133
 230000000875 corresponding Effects 0.000 claims abstract description 63
 238000010276 construction Methods 0.000 claims abstract description 5
 238000000034 method Methods 0.000 claims description 33
 238000003384 imaging method Methods 0.000 description 29
 230000001131 transforming Effects 0.000 description 8
 230000000694 effects Effects 0.000 description 7
 230000003287 optical Effects 0.000 description 7
 230000003213 activating Effects 0.000 description 6
 239000002131 composite materials Substances 0.000 description 6
 230000004913 activation Effects 0.000 description 5
 238000005094 computer simulation Methods 0.000 description 5
 230000000717 retained Effects 0.000 description 5
 210000004080 Milk Anatomy 0.000 description 4
 239000008267 milk Substances 0.000 description 4
 235000013336 milk Nutrition 0.000 description 4
 230000001419 dependent Effects 0.000 description 3
 238000004364 calculation methods Methods 0.000 description 2
 239000011521 glasses Substances 0.000 description 2
 238000007654 immersion Methods 0.000 description 2
 239000004973 liquid crystal related substances Substances 0.000 description 2
 239000000203 mixtures Substances 0.000 description 2
 230000004048 modification Effects 0.000 description 2
 238000006011 modification reactions Methods 0.000 description 2
 XUIMIQQOPSSXEZUHFFFAOYSAN silicon Chemical compound data:image/svg+xml;base64,PD94bWwgdmVyc2lvbj0nMS4wJyBlbmNvZGluZz0naXNvLTg4NTktMSc/Pgo8c3ZnIHZlcnNpb249JzEuMScgYmFzZVByb2ZpbGU9J2Z1bGwnCiAgICAgICAgICAgICAgeG1sbnM9J2h0dHA6Ly93d3cudzMub3JnLzIwMDAvc3ZnJwogICAgICAgICAgICAgICAgICAgICAgeG1sbnM6cmRraXQ9J2h0dHA6Ly93d3cucmRraXQub3JnL3htbCcKICAgICAgICAgICAgICAgICAgICAgIHhtbG5zOnhsaW5rPSdodHRwOi8vd3d3LnczLm9yZy8xOTk5L3hsaW5rJwogICAgICAgICAgICAgICAgICB4bWw6c3BhY2U9J3ByZXNlcnZlJwp3aWR0aD0nMzAwcHgnIGhlaWdodD0nMzAwcHgnIHZpZXdCb3g9JzAgMCAzMDAgMzAwJz4KPCEtLSBFTkQgT0YgSEVBREVSIC0tPgo8cmVjdCBzdHlsZT0nb3BhY2l0eToxLjA7ZmlsbDojRkZGRkZGO3N0cm9rZTpub25lJyB3aWR0aD0nMzAwJyBoZWlnaHQ9JzMwMCcgeD0nMCcgeT0nMCc+IDwvcmVjdD4KPHRleHQgeD0nMTM4JyB5PScxNzAnIGNsYXNzPSdhdG9tLTAnIHN0eWxlPSdmb250LXNpemU6NDBweDtmb250LXN0eWxlOm5vcm1hbDtmb250LXdlaWdodDpub3JtYWw7ZmlsbC1vcGFjaXR5OjE7c3Ryb2tlOm5vbmU7Zm9udC1mYW1pbHk6c2Fucy1zZXJpZjt0ZXh0LWFuY2hvcjpzdGFydDtmaWxsOiMzQjQxNDMnID5TPC90ZXh0Pgo8dGV4dCB4PScxNjUuNicgeT0nMTcwJyBjbGFzcz0nYXRvbS0wJyBzdHlsZT0nZm9udC1zaXplOjQwcHg7Zm9udC1zdHlsZTpub3JtYWw7Zm9udC13ZWlnaHQ6bm9ybWFsO2ZpbGwtb3BhY2l0eToxO3N0cm9rZTpub25lO2ZvbnQtZmFtaWx5OnNhbnMtc2VyaWY7dGV4dC1hbmNob3I6c3RhcnQ7ZmlsbDojM0I0MTQzJyA+aTwvdGV4dD4KPHBhdGggZD0nTSAxNzguODk4LDEzOCBMIDE3OC44OTEsMTM3LjgyOCBMIDE3OC44NjksMTM3LjY1NyBMIDE3OC44MzIsMTM3LjQ4OSBMIDE3OC43ODEsMTM3LjMyNSBMIDE3OC43MTYsMTM3LjE2NiBMIDE3OC42MzcsMTM3LjAxMiBMIDE3OC41NDYsMTM2Ljg2NyBMIDE3OC40NDMsMTM2LjcyOSBMIDE3OC4zMjgsMTM2LjYwMSBMIDE3OC4yMDIsMTM2LjQ4MyBMIDE3OC4wNjcsMTM2LjM3NyBMIDE3Ny45MjMsMTM2LjI4MiBMIDE3Ny43NzEsMTM2LjIwMSBMIDE3Ny42MTQsMTM2LjEzMiBMIDE3Ny40NSwxMzYuMDc4IEwgMTc3LjI4MywxMzYuMDM3IEwgMTc3LjExMywxMzYuMDEyIEwgMTc2Ljk0MSwxMzYgTCAxNzYuNzY5LDEzNi4wMDQgTCAxNzYuNTk4LDEzNi4wMjMgTCAxNzYuNDI5LDEzNi4wNTYgTCAxNzYuMjY0LDEzNi4xMDMgTCAxNzYuMTAzLDEzNi4xNjUgTCAxNzUuOTQ4LDEzNi4yNCBMIDE3NS44MDEsMTM2LjMyOCBMIDE3NS42NjEsMTM2LjQyOSBMIDE3NS41MywxMzYuNTQxIEwgMTc1LjQxLDEzNi42NjQgTCAxNzUuMzAxLDEzNi43OTcgTCAxNzUuMjAzLDEzNi45MzkgTCAxNzUuMTE4LDEzNy4wODggTCAxNzUuMDQ2LDEzNy4yNDUgTCAxNzQuOTg4LDEzNy40MDcgTCAxNzQuOTQ0LDEzNy41NzMgTCAxNzQuOTE1LDEzNy43NDMgTCAxNzQuOSwxMzcuOTE0IEwgMTc0LjksMTM4LjA4NiBMIDE3NC45MTUsMTM4LjI1NyBMIDE3NC45NDQsMTM4LjQyNyBMIDE3NC45ODgsMTM4LjU5MyBMIDE3NS4wNDYsMTM4Ljc1NSBMIDE3NS4xMTgsMTM4LjkxMiBMIDE3NS4yMDMsMTM5LjA2MSBMIDE3NS4zMDEsMTM5LjIwMyBMIDE3NS40MSwxMzkuMzM2IEwgMTc1LjUzLDEzOS40NTkgTCAxNzUuNjYxLDEzOS41NzEgTCAxNzUuODAxLDEzOS42NzIgTCAxNzUuOTQ4LDEzOS43NiBMIDE3Ni4xMDMsMTM5LjgzNSBMIDE3Ni4yNjQsMTM5Ljg5NyBMIDE3Ni40MjksMTM5Ljk0NCBMIDE3Ni41OTgsMTM5Ljk3NyBMIDE3Ni43NjksMTM5Ljk5NiBMIDE3Ni45NDEsMTQwIEwgMTc3LjExMywxMzkuOTg4IEwgMTc3LjI4MywxMzkuOTYzIEwgMTc3LjQ1LDEzOS45MjIgTCAxNzcuNjE0LDEzOS44NjggTCAxNzcuNzcxLDEzOS43OTkgTCAxNzcuOTIzLDEzOS43MTggTCAxNzguMDY3LDEzOS42MjMgTCAxNzguMjAyLDEzOS41MTcgTCAxNzguMzI4LDEzOS4zOTkgTCAxNzguNDQzLDEzOS4yNzEgTCAxNzguNTQ2LDEzOS4xMzMgTCAxNzguNjM3LDEzOC45ODggTCAxNzguNzE2LDEzOC44MzQgTCAxNzguNzgxLDEzOC42NzUgTCAxNzguODMyLDEzOC41MTEgTCAxNzguODY5LDEzOC4zNDMgTCAxNzguODkxLDEzOC4xNzIgTCAxNzguODk4LDEzOCBMIDE3Ni44OTgsMTM4IFonIHN0eWxlPSdmaWxsOiMwMDAwMDA7ZmlsbC1ydWxlOmV2ZW5vZGQ7ZmlsbC1vcGFjaXR5OjE7c3Ryb2tlOiMwMDAwMDA7c3Ryb2tlLXdpZHRoOjBweDtzdHJva2UtbGluZWNhcDpidXR0O3N0cm9rZS1saW5lam9pbjptaXRlcjtzdHJva2Utb3BhY2l0eToxOycgLz4KPHBhdGggZD0nTSAxNzguODk4LDE2MiBMIDE3OC44OTEsMTYxLjgyOCBMIDE3OC44NjksMTYxLjY1NyBMIDE3OC44MzIsMTYxLjQ4OSBMIDE3OC43ODEsMTYxLjMyNSBMIDE3OC43MTYsMTYxLjE2NiBMIDE3OC42MzcsMTYxLjAxMiBMIDE3OC41NDYsMTYwLjg2NyBMIDE3OC40NDMsMTYwLjcyOSBMIDE3OC4zMjgsMTYwLjYwMSBMIDE3OC4yMDIsMTYwLjQ4MyBMIDE3OC4wNjcsMTYwLjM3NyBMIDE3Ny45MjMsMTYwLjI4MiBMIDE3Ny43NzEsMTYwLjIwMSBMIDE3Ny42MTQsMTYwLjEzMiBMIDE3Ny40NSwxNjAuMDc4IEwgMTc3LjI4MywxNjAuMDM3IEwgMTc3LjExMywxNjAuMDEyIEwgMTc2Ljk0MSwxNjAgTCAxNzYuNzY5LDE2MC4wMDQgTCAxNzYuNTk4LDE2MC4wMjMgTCAxNzYuNDI5LDE2MC4wNTYgTCAxNzYuMjY0LDE2MC4xMDMgTCAxNzYuMTAzLDE2MC4xNjUgTCAxNzUuOTQ4LDE2MC4yNCBMIDE3NS44MDEsMTYwLjMyOCBMIDE3NS42NjEsMTYwLjQyOSBMIDE3NS41MywxNjAuNTQxIEwgMTc1LjQxLDE2MC42NjQgTCAxNzUuMzAxLDE2MC43OTcgTCAxNzUuMjAzLDE2MC45MzkgTCAxNzUuMTE4LDE2MS4wODggTCAxNzUuMDQ2LDE2MS4yNDUgTCAxNzQuOTg4LDE2MS40MDcgTCAxNzQuOTQ0LDE2MS41NzMgTCAxNzQuOTE1LDE2MS43NDMgTCAxNzQuOSwxNjEuOTE0IEwgMTc0LjksMTYyLjA4NiBMIDE3NC45MTUsMTYyLjI1NyBMIDE3NC45NDQsMTYyLjQyNyBMIDE3NC45ODgsMTYyLjU5MyBMIDE3NS4wNDYsMTYyLjc1NSBMIDE3NS4xMTgsMTYyLjkxMiBMIDE3NS4yMDMsMTYzLjA2MSBMIDE3NS4zMDEsMTYzLjIwMyBMIDE3NS40MSwxNjMuMzM2IEwgMTc1LjUzLDE2My40NTkgTCAxNzUuNjYxLDE2My41NzEgTCAxNzUuODAxLDE2My42NzIgTCAxNzUuOTQ4LDE2My43NiBMIDE3Ni4xMDMsMTYzLjgzNSBMIDE3Ni4yNjQsMTYzLjg5NyBMIDE3Ni40MjksMTYzLjk0NCBMIDE3Ni41OTgsMTYzLjk3NyBMIDE3Ni43NjksMTYzLjk5NiBMIDE3Ni45NDEsMTY0IEwgMTc3LjExMywxNjMuOTg4IEwgMTc3LjI4MywxNjMuOTYzIEwgMTc3LjQ1LDE2My45MjIgTCAxNzcuNjE0LDE2My44NjggTCAxNzcuNzcxLDE2My43OTkgTCAxNzcuOTIzLDE2My43MTggTCAxNzguMDY3LDE2My42MjMgTCAxNzguMjAyLDE2My41MTcgTCAxNzguMzI4LDE2My4zOTkgTCAxNzguNDQzLDE2My4yNzEgTCAxNzguNTQ2LDE2My4xMzMgTCAxNzguNjM3LDE2Mi45ODggTCAxNzguNzE2LDE2Mi44MzQgTCAxNzguNzgxLDE2Mi42NzUgTCAxNzguODMyLDE2Mi41MTEgTCAxNzguODY5LDE2Mi4zNDMgTCAxNzguODkxLDE2Mi4xNzIgTCAxNzguODk4LDE2MiBMIDE3Ni44OTgsMTYyIFonIHN0eWxlPSdmaWxsOiMwMDAwMDA7ZmlsbC1ydWxlOmV2ZW5vZGQ7ZmlsbC1vcGFjaXR5OjE7c3Ryb2tlOiMwMDAwMDA7c3Ryb2tlLXdpZHRoOjBweDtzdHJva2UtbGluZWNhcDpidXR0O3N0cm9rZS1saW5lam9pbjptaXRlcjtzdHJva2Utb3BhY2l0eToxOycgLz4KPHBhdGggZD0nTSAxNzguODk4LDE0NiBMIDE3OC44OTEsMTQ1LjgyOCBMIDE3OC44NjksMTQ1LjY1NyBMIDE3OC44MzIsMTQ1LjQ4OSBMIDE3OC43ODEsMTQ1LjMyNSBMIDE3OC43MTYsMTQ1LjE2NiBMIDE3OC42MzcsMTQ1LjAxMiBMIDE3OC41NDYsMTQ0Ljg2NyBMIDE3OC40NDMsMTQ0LjcyOSBMIDE3OC4zMjgsMTQ0LjYwMSBMIDE3OC4yMDIsMTQ0LjQ4MyBMIDE3OC4wNjcsMTQ0LjM3NyBMIDE3Ny45MjMsMTQ0LjI4MiBMIDE3Ny43NzEsMTQ0LjIwMSBMIDE3Ny42MTQsMTQ0LjEzMiBMIDE3Ny40NSwxNDQuMDc4IEwgMTc3LjI4MywxNDQuMDM3IEwgMTc3LjExMywxNDQuMDEyIEwgMTc2Ljk0MSwxNDQgTCAxNzYuNzY5LDE0NC4wMDQgTCAxNzYuNTk4LDE0NC4wMjMgTCAxNzYuNDI5LDE0NC4wNTYgTCAxNzYuMjY0LDE0NC4xMDMgTCAxNzYuMTAzLDE0NC4xNjUgTCAxNzUuOTQ4LDE0NC4yNCBMIDE3NS44MDEsMTQ0LjMyOCBMIDE3NS42NjEsMTQ0LjQyOSBMIDE3NS41MywxNDQuNTQxIEwgMTc1LjQxLDE0NC42NjQgTCAxNzUuMzAxLDE0NC43OTcgTCAxNzUuMjAzLDE0NC45MzkgTCAxNzUuMTE4LDE0NS4wODggTCAxNzUuMDQ2LDE0NS4yNDUgTCAxNzQuOTg4LDE0NS40MDcgTCAxNzQuOTQ0LDE0NS41NzMgTCAxNzQuOTE1LDE0NS43NDMgTCAxNzQuOSwxNDUuOTE0IEwgMTc0LjksMTQ2LjA4NiBMIDE3NC45MTUsMTQ2LjI1NyBMIDE3NC45NDQsMTQ2LjQyNyBMIDE3NC45ODgsMTQ2LjU5MyBMIDE3NS4wNDYsMTQ2Ljc1NSBMIDE3NS4xMTgsMTQ2LjkxMiBMIDE3NS4yMDMsMTQ3LjA2MSBMIDE3NS4zMDEsMTQ3LjIwMyBMIDE3NS40MSwxNDcuMzM2IEwgMTc1LjUzLDE0Ny40NTkgTCAxNzUuNjYxLDE0Ny41NzEgTCAxNzUuODAxLDE0Ny42NzIgTCAxNzUuOTQ4LDE0Ny43NiBMIDE3Ni4xMDMsMTQ3LjgzNSBMIDE3Ni4yNjQsMTQ3Ljg5NyBMIDE3Ni40MjksMTQ3Ljk0NCBMIDE3Ni41OTgsMTQ3Ljk3NyBMIDE3Ni43NjksMTQ3Ljk5NiBMIDE3Ni45NDEsMTQ4IEwgMTc3LjExMywxNDcuOTg4IEwgMTc3LjI4MywxNDcuOTYzIEwgMTc3LjQ1LDE0Ny45MjIgTCAxNzcuNjE0LDE0Ny44NjggTCAxNzcuNzcxLDE0Ny43OTkgTCAxNzcuOTIzLDE0Ny43MTggTCAxNzguMDY3LDE0Ny42MjMgTCAxNzguMjAyLDE0Ny41MTcgTCAxNzguMzI4LDE0Ny4zOTkgTCAxNzguNDQzLDE0Ny4yNzEgTCAxNzguNTQ2LDE0Ny4xMzMgTCAxNzguNjM3LDE0Ni45ODggTCAxNzguNzE2LDE0Ni44MzQgTCAxNzguNzgxLDE0Ni42NzUgTCAxNzguODMyLDE0Ni41MTEgTCAxNzguODY5LDE0Ni4zNDMgTCAxNzguODkxLDE0Ni4xNzIgTCAxNzguODk4LDE0NiBMIDE3Ni44OTgsMTQ2IFonIHN0eWxlPSdmaWxsOiMwMDAwMDA7ZmlsbC1ydWxlOmV2ZW5vZGQ7ZmlsbC1vcGFjaXR5OjE7c3Ryb2tlOiMwMDAwMDA7c3Ryb2tlLXdpZHRoOjBweDtzdHJva2UtbGluZWNhcDpidXR0O3N0cm9rZS1saW5lam9pbjptaXRlcjtzdHJva2Utb3BhY2l0eToxOycgLz4KPHBhdGggZD0nTSAxNzguODk4LDE1NCBMIDE3OC44OTEsMTUzLjgyOCBMIDE3OC44NjksMTUzLjY1NyBMIDE3OC44MzIsMTUzLjQ4OSBMIDE3OC43ODEsMTUzLjMyNSBMIDE3OC43MTYsMTUzLjE2NiBMIDE3OC42MzcsMTUzLjAxMiBMIDE3OC41NDYsMTUyLjg2NyBMIDE3OC40NDMsMTUyLjcyOSBMIDE3OC4zMjgsMTUyLjYwMSBMIDE3OC4yMDIsMTUyLjQ4MyBMIDE3OC4wNjcsMTUyLjM3NyBMIDE3Ny45MjMsMTUyLjI4MiBMIDE3Ny43NzEsMTUyLjIwMSBMIDE3Ny42MTQsMTUyLjEzMiBMIDE3Ny40NSwxNTIuMDc4IEwgMTc3LjI4MywxNTIuMDM3IEwgMTc3LjExMywxNTIuMDEyIEwgMTc2Ljk0MSwxNTIgTCAxNzYuNzY5LDE1Mi4wMDQgTCAxNzYuNTk4LDE1Mi4wMjMgTCAxNzYuNDI5LDE1Mi4wNTYgTCAxNzYuMjY0LDE1Mi4xMDMgTCAxNzYuMTAzLDE1Mi4xNjUgTCAxNzUuOTQ4LDE1Mi4yNCBMIDE3NS44MDEsMTUyLjMyOCBMIDE3NS42NjEsMTUyLjQyOSBMIDE3NS41MywxNTIuNTQxIEwgMTc1LjQxLDE1Mi42NjQgTCAxNzUuMzAxLDE1Mi43OTcgTCAxNzUuMjAzLDE1Mi45MzkgTCAxNzUuMTE4LDE1My4wODggTCAxNzUuMDQ2LDE1My4yNDUgTCAxNzQuOTg4LDE1My40MDcgTCAxNzQuOTQ0LDE1My41NzMgTCAxNzQuOTE1LDE1My43NDMgTCAxNzQuOSwxNTMuOTE0IEwgMTc0LjksMTU0LjA4NiBMIDE3NC45MTUsMTU0LjI1NyBMIDE3NC45NDQsMTU0LjQyNyBMIDE3NC45ODgsMTU0LjU5MyBMIDE3NS4wNDYsMTU0Ljc1NSBMIDE3NS4xMTgsMTU0LjkxMiBMIDE3NS4yMDMsMTU1LjA2MSBMIDE3NS4zMDEsMTU1LjIwMyBMIDE3NS40MSwxNTUuMzM2IEwgMTc1LjUzLDE1NS40NTkgTCAxNzUuNjYxLDE1NS41NzEgTCAxNzUuODAxLDE1NS42NzIgTCAxNzUuOTQ4LDE1NS43NiBMIDE3Ni4xMDMsMTU1LjgzNSBMIDE3Ni4yNjQsMTU1Ljg5NyBMIDE3Ni40MjksMTU1Ljk0NCBMIDE3Ni41OTgsMTU1Ljk3NyBMIDE3Ni43NjksMTU1Ljk5NiBMIDE3Ni45NDEsMTU2IEwgMTc3LjExMywxNTUuOTg4IEwgMTc3LjI4MywxNTUuOTYzIEwgMTc3LjQ1LDE1NS45MjIgTCAxNzcuNjE0LDE1NS44NjggTCAxNzcuNzcxLDE1NS43OTkgTCAxNzcuOTIzLDE1NS43MTggTCAxNzguMDY3LDE1NS42MjMgTCAxNzguMjAyLDE1NS41MTcgTCAxNzguMzI4LDE1NS4zOTkgTCAxNzguNDQzLDE1NS4yNzEgTCAxNzguNTQ2LDE1NS4xMzMgTCAxNzguNjM3LDE1NC45ODggTCAxNzguNzE2LDE1NC44MzQgTCAxNzguNzgxLDE1NC42NzUgTCAxNzguODMyLDE1NC41MTEgTCAxNzguODY5LDE1NC4zNDMgTCAxNzguODkxLDE1NC4xNzIgTCAxNzguODk4LDE1NCBMIDE3Ni44OTgsMTU0IFonIHN0eWxlPSdmaWxsOiMwMDAwMDA7ZmlsbC1ydWxlOmV2ZW5vZGQ7ZmlsbC1vcGFjaXR5OjE7c3Ryb2tlOiMwMDAwMDA7c3Ryb2tlLXdpZHRoOjBweDtzdHJva2UtbGluZWNhcDpidXR0O3N0cm9rZS1saW5lam9pbjptaXRlcjtzdHJva2Utb3BhY2l0eToxOycgLz4KPC9zdmc+Cg== data:image/svg+xml;base64,PD94bWwgdmVyc2lvbj0nMS4wJyBlbmNvZGluZz0naXNvLTg4NTktMSc/Pgo8c3ZnIHZlcnNpb249JzEuMScgYmFzZVByb2ZpbGU9J2Z1bGwnCiAgICAgICAgICAgICAgeG1sbnM9J2h0dHA6Ly93d3cudzMub3JnLzIwMDAvc3ZnJwogICAgICAgICAgICAgICAgICAgICAgeG1sbnM6cmRraXQ9J2h0dHA6Ly93d3cucmRraXQub3JnL3htbCcKICAgICAgICAgICAgICAgICAgICAgIHhtbG5zOnhsaW5rPSdodHRwOi8vd3d3LnczLm9yZy8xOTk5L3hsaW5rJwogICAgICAgICAgICAgICAgICB4bWw6c3BhY2U9J3ByZXNlcnZlJwp3aWR0aD0nODVweCcgaGVpZ2h0PSc4NXB4JyB2aWV3Qm94PScwIDAgODUgODUnPgo8IS0tIEVORCBPRiBIRUFERVIgLS0+CjxyZWN0IHN0eWxlPSdvcGFjaXR5OjEuMDtmaWxsOiNGRkZGRkY7c3Ryb2tlOm5vbmUnIHdpZHRoPSc4NScgaGVpZ2h0PSc4NScgeD0nMCcgeT0nMCc+IDwvcmVjdD4KPHRleHQgeD0nMzUuMDQ1NScgeT0nNTMuNTkwOScgY2xhc3M9J2F0b20tMCcgc3R5bGU9J2ZvbnQtc2l6ZToyM3B4O2ZvbnQtc3R5bGU6bm9ybWFsO2ZvbnQtd2VpZ2h0Om5vcm1hbDtmaWxsLW9wYWNpdHk6MTtzdHJva2U6bm9uZTtmb250LWZhbWlseTpzYW5zLXNlcmlmO3RleHQtYW5jaG9yOnN0YXJ0O2ZpbGw6IzNCNDE0MycgPlM8L3RleHQ+Cjx0ZXh0IHg9JzUxLjA0MDknIHk9JzUzLjU5MDknIGNsYXNzPSdhdG9tLTAnIHN0eWxlPSdmb250LXNpemU6MjNweDtmb250LXN0eWxlOm5vcm1hbDtmb250LXdlaWdodDpub3JtYWw7ZmlsbC1vcGFjaXR5OjE7c3Ryb2tlOm5vbmU7Zm9udC1mYW1pbHk6c2Fucy1zZXJpZjt0ZXh0LWFuY2hvcjpzdGFydDtmaWxsOiMzQjQxNDMnID5pPC90ZXh0Pgo8cGF0aCBkPSdNIDYwLjMwNjcsMzUuMDQ1NSBMIDYwLjMwMjQsMzQuOTQ1OCBMIDYwLjI4OTYsMzQuODQ2OSBMIDYwLjI2ODMsMzQuNzQ5NSBMIDYwLjIzODcsMzQuNjU0MiBMIDYwLjIwMSwzNC41NjE5IEwgNjAuMTU1NSwzNC40NzMxIEwgNjAuMTAyNiwzNC4zODg2IEwgNjAuMDQyNiwzNC4zMDg5IEwgNTkuOTc2LDM0LjIzNDcgTCA1OS45MDMyLDM0LjE2NjUgTCA1OS44MjQ4LDM0LjEwNDggTCA1OS43NDE1LDM0LjA1MDEgTCA1OS42NTM3LDM0LjAwMjcgTCA1OS41NjIyLDMzLjk2MzEgTCA1OS40Njc2LDMzLjkzMTQgTCA1OS4zNzA3LDMzLjkwOCBMIDU5LjI3MjEsMzMuODkzMSBMIDU5LjE3MjUsMzMuODg2NiBMIDU5LjA3MjgsMzMuODg4OCBMIDU4Ljk3MzcsMzMuODk5NSBMIDU4Ljg3NTgsMzMuOTE4NyBMIDU4Ljc3OTksMzMuOTQ2MiBMIDU4LjY4NjgsMzMuOTgxOSBMIDU4LjU5NzEsMzQuMDI1NCBMIDU4LjUxMTQsMzQuMDc2NSBMIDU4LjQzMDUsMzQuMTM0OCBMIDU4LjM1NDksMzQuMTk5OCBMIDU4LjI4NTEsMzQuMjcxMSBMIDU4LjIyMTcsMzQuMzQ4MSBMIDU4LjE2NTIsMzQuNDMwMyBMIDU4LjExNiwzNC41MTcgTCA1OC4wNzQ0LDM0LjYwNzcgTCA1OC4wNDA3LDM0LjcwMTUgTCA1OC4wMTUyLDM0Ljc5OCBMIDU3Ljk5ODIsMzQuODk2MiBMIDU3Ljk4OTYsMzQuOTk1NiBMIDU3Ljk4OTYsMzUuMDk1MyBMIDU3Ljk5ODIsMzUuMTk0NyBMIDU4LjAxNTIsMzUuMjkyOSBMIDU4LjA0MDcsMzUuMzg5NCBMIDU4LjA3NDQsMzUuNDgzMyBMIDU4LjExNiwzNS41NzM5IEwgNTguMTY1MiwzNS42NjA2IEwgNTguMjIxNywzNS43NDI4IEwgNTguMjg1MSwzNS44MTk4IEwgNTguMzU0OSwzNS44OTExIEwgNTguNDMwNSwzNS45NTYxIEwgNTguNTExNCwzNi4wMTQ0IEwgNTguNTk3MSwzNi4wNjU1IEwgNTguNjg2OCwzNi4xMDkgTCA1OC43Nzk5LDM2LjE0NDcgTCA1OC44NzU4LDM2LjE3MjIgTCA1OC45NzM3LDM2LjE5MTQgTCA1OS4wNzI4LDM2LjIwMjEgTCA1OS4xNzI1LDM2LjIwNDMgTCA1OS4yNzIxLDM2LjE5NzggTCA1OS4zNzA3LDM2LjE4MjkgTCA1OS40Njc2LDM2LjE1OTUgTCA1OS41NjIyLDM2LjEyNzkgTCA1OS42NTM3LDM2LjA4ODIgTCA1OS43NDE1LDM2LjA0MDggTCA1OS44MjQ4LDM1Ljk4NjEgTCA1OS45MDMyLDM1LjkyNDQgTCA1OS45NzYsMzUuODU2MiBMIDYwLjA0MjYsMzUuNzgyIEwgNjAuMTAyNiwzNS43MDIzIEwgNjAuMTU1NSwzNS42MTc4IEwgNjAuMjAxLDM1LjUyOSBMIDYwLjIzODcsMzUuNDM2NyBMIDYwLjI2ODMsMzUuMzQxNCBMIDYwLjI4OTYsMzUuMjQ0IEwgNjAuMzAyNCwzNS4xNDUxIEwgNjAuMzA2NywzNS4wNDU1IEwgNTkuMTQ3NiwzNS4wNDU1IFonIHN0eWxlPSdmaWxsOiMwMDAwMDA7ZmlsbC1ydWxlOmV2ZW5vZGQ7ZmlsbC1vcGFjaXR5OjE7c3Ryb2tlOiMwMDAwMDA7c3Ryb2tlLXdpZHRoOjBweDtzdHJva2UtbGluZWNhcDpidXR0O3N0cm9rZS1saW5lam9pbjptaXRlcjtzdHJva2Utb3BhY2l0eToxOycgLz4KPHBhdGggZD0nTSA2MC4zMDY3LDQ4Ljk1NDUgTCA2MC4zMDI0LDQ4Ljg1NDkgTCA2MC4yODk2LDQ4Ljc1NiBMIDYwLjI2ODMsNDguNjU4NiBMIDYwLjIzODcsNDguNTYzMyBMIDYwLjIwMSw0OC40NzEgTCA2MC4xNTU1LDQ4LjM4MjIgTCA2MC4xMDI2LDQ4LjI5NzcgTCA2MC4wNDI2LDQ4LjIxOCBMIDU5Ljk3Niw0OC4xNDM4IEwgNTkuOTAzMiw0OC4wNzU2IEwgNTkuODI0OCw0OC4wMTM5IEwgNTkuNzQxNSw0Ny45NTkyIEwgNTkuNjUzNyw0Ny45MTE4IEwgNTkuNTYyMiw0Ny44NzIxIEwgNTkuNDY3Niw0Ny44NDA1IEwgNTkuMzcwNyw0Ny44MTcxIEwgNTkuMjcyMSw0Ny44MDIyIEwgNTkuMTcyNSw0Ny43OTU3IEwgNTkuMDcyOCw0Ny43OTc5IEwgNTguOTczNyw0Ny44MDg2IEwgNTguODc1OCw0Ny44Mjc4IEwgNTguNzc5OSw0Ny44NTUzIEwgNTguNjg2OCw0Ny44OTEgTCA1OC41OTcxLDQ3LjkzNDUgTCA1OC41MTE0LDQ3Ljk4NTYgTCA1OC40MzA1LDQ4LjA0MzkgTCA1OC4zNTQ5LDQ4LjEwODkgTCA1OC4yODUxLDQ4LjE4MDIgTCA1OC4yMjE3LDQ4LjI1NzIgTCA1OC4xNjUyLDQ4LjMzOTQgTCA1OC4xMTYsNDguNDI2MSBMIDU4LjA3NDQsNDguNTE2NyBMIDU4LjA0MDcsNDguNjEwNiBMIDU4LjAxNTIsNDguNzA3MSBMIDU3Ljk5ODIsNDguODA1MyBMIDU3Ljk4OTYsNDguOTA0NyBMIDU3Ljk4OTYsNDkuMDA0NCBMIDU3Ljk5ODIsNDkuMTAzOCBMIDU4LjAxNTIsNDkuMjAyIEwgNTguMDQwNyw0OS4yOTg1IEwgNTguMDc0NCw0OS4zOTIzIEwgNTguMTE2LDQ5LjQ4MyBMIDU4LjE2NTIsNDkuNTY5NyBMIDU4LjIyMTcsNDkuNjUxOSBMIDU4LjI4NTEsNDkuNzI4OSBMIDU4LjM1NDksNDkuODAwMiBMIDU4LjQzMDUsNDkuODY1MiBMIDU4LjUxMTQsNDkuOTIzNSBMIDU4LjU5NzEsNDkuOTc0NiBMIDU4LjY4NjgsNTAuMDE4MSBMIDU4Ljc3OTksNTAuMDUzOCBMIDU4Ljg3NTgsNTAuMDgxMyBMIDU4Ljk3MzcsNTAuMTAwNSBMIDU5LjA3MjgsNTAuMTExMiBMIDU5LjE3MjUsNTAuMTEzNCBMIDU5LjI3MjEsNTAuMTA2OSBMIDU5LjM3MDcsNTAuMDkyIEwgNTkuNDY3Niw1MC4wNjg2IEwgNTkuNTYyMiw1MC4wMzY5IEwgNTkuNjUzNyw0OS45OTczIEwgNTkuNzQxNSw0OS45NDk5IEwgNTkuODI0OCw0OS44OTUyIEwgNTkuOTAzMiw0OS44MzM1IEwgNTkuOTc2LDQ5Ljc2NTMgTCA2MC4wNDI2LDQ5LjY5MTEgTCA2MC4xMDI2LDQ5LjYxMTQgTCA2MC4xNTU1LDQ5LjUyNjkgTCA2MC4yMDEsNDkuNDM4MSBMIDYwLjIzODcsNDkuMzQ1OCBMIDYwLjI2ODMsNDkuMjUwNSBMIDYwLjI4OTYsNDkuMTUzMSBMIDYwLjMwMjQsNDkuMDU0MiBMIDYwLjMwNjcsNDguOTU0NSBMIDU5LjE0NzYsNDguOTU0NSBaJyBzdHlsZT0nZmlsbDojMDAwMDAwO2ZpbGwtcnVsZTpldmVub2RkO2ZpbGwtb3BhY2l0eToxO3N0cm9rZTojMDAwMDAwO3N0cm9rZS13aWR0aDowcHg7c3Ryb2tlLWxpbmVjYXA6YnV0dDtzdHJva2UtbGluZWpvaW46bWl0ZXI7c3Ryb2tlLW9wYWNpdHk6MTsnIC8+CjxwYXRoIGQ9J00gNjAuMzA2NywzOS42ODE4IEwgNjAuMzAyNCwzOS41ODIyIEwgNjAuMjg5NiwzOS40ODMzIEwgNjAuMjY4MywzOS4zODU4IEwgNjAuMjM4NywzOS4yOTA2IEwgNjAuMjAxLDM5LjE5ODMgTCA2MC4xNTU1LDM5LjEwOTUgTCA2MC4xMDI2LDM5LjAyNSBMIDYwLjA0MjYsMzguOTQ1MyBMIDU5Ljk3NiwzOC44NzExIEwgNTkuOTAzMiwzOC44MDI5IEwgNTkuODI0OCwzOC43NDEyIEwgNTkuNzQxNSwzOC42ODY0IEwgNTkuNjUzNywzOC42MzkxIEwgNTkuNTYyMiwzOC41OTk0IEwgNTkuNDY3NiwzOC41Njc4IEwgNTkuMzcwNywzOC41NDQ0IEwgNTkuMjcyMSwzOC41Mjk0IEwgNTkuMTcyNSwzOC41MjMgTCA1OS4wNzI4LDM4LjUyNTEgTCA1OC45NzM3LDM4LjUzNTkgTCA1OC44NzU4LDM4LjU1NSBMIDU4Ljc3OTksMzguNTgyNiBMIDU4LjY4NjgsMzguNjE4MyBMIDU4LjU5NzEsMzguNjYxOCBMIDU4LjUxMTQsMzguNzEyOSBMIDU4LjQzMDUsMzguNzcxMiBMIDU4LjM1NDksMzguODM2MiBMIDU4LjI4NTEsMzguOTA3NSBMIDU4LjIyMTcsMzguOTg0NSBMIDU4LjE2NTIsMzkuMDY2NyBMIDU4LjExNiwzOS4xNTM0IEwgNTguMDc0NCwzOS4yNDQgTCA1OC4wNDA3LDM5LjMzNzkgTCA1OC4wMTUyLDM5LjQzNDMgTCA1Ny45OTgyLDM5LjUzMjYgTCA1Ny45ODk2LDM5LjYzMiBMIDU3Ljk4OTYsMzkuNzMxNyBMIDU3Ljk5ODIsMzkuODMxIEwgNTguMDE1MiwzOS45MjkzIEwgNTguMDQwNyw0MC4wMjU3IEwgNTguMDc0NCw0MC4xMTk2IEwgNTguMTE2LDQwLjIxMDMgTCA1OC4xNjUyLDQwLjI5NyBMIDU4LjIyMTcsNDAuMzc5MiBMIDU4LjI4NTEsNDAuNDU2MiBMIDU4LjM1NDksNDAuNTI3NCBMIDU4LjQzMDUsNDAuNTkyNSBMIDU4LjUxMTQsNDAuNjUwNyBMIDU4LjU5NzEsNDAuNzAxOCBMIDU4LjY4NjgsNDAuNzQ1NCBMIDU4Ljc3OTksNDAuNzgxMSBMIDU4Ljg3NTgsNDAuODA4NiBMIDU4Ljk3MzcsNDAuODI3OCBMIDU5LjA3MjgsNDAuODM4NSBMIDU5LjE3MjUsNDAuODQwNiBMIDU5LjI3MjEsNDAuODM0MiBMIDU5LjM3MDcsNDAuODE5MiBMIDU5LjQ2NzYsNDAuNzk1OSBMIDU5LjU2MjIsNDAuNzY0MiBMIDU5LjY1MzcsNDAuNzI0NiBMIDU5Ljc0MTUsNDAuNjc3MiBMIDU5LjgyNDgsNDAuNjIyNSBMIDU5LjkwMzIsNDAuNTYwOCBMIDU5Ljk3Niw0MC40OTI2IEwgNjAuMDQyNiw0MC40MTgzIEwgNjAuMTAyNiw0MC4zMzg3IEwgNjAuMTU1NSw0MC4yNTQxIEwgNjAuMjAxLDQwLjE2NTQgTCA2MC4yMzg3LDQwLjA3MyBMIDYwLjI2ODMsMzkuOTc3OCBMIDYwLjI4OTYsMzkuODgwNCBMIDYwLjMwMjQsMzkuNzgxNSBMIDYwLjMwNjcsMzkuNjgxOCBMIDU5LjE0NzYsMzkuNjgxOCBaJyBzdHlsZT0nZmlsbDojMDAwMDAwO2ZpbGwtcnVsZTpldmVub2RkO2ZpbGwtb3BhY2l0eToxO3N0cm9rZTojMDAwMDAwO3N0cm9rZS13aWR0aDowcHg7c3Ryb2tlLWxpbmVjYXA6YnV0dDtzdHJva2UtbGluZWpvaW46bWl0ZXI7c3Ryb2tlLW9wYWNpdHk6MTsnIC8+CjxwYXRoIGQ9J00gNjAuMzA2Nyw0NC4zMTgyIEwgNjAuMzAyNCw0NC4yMTg1IEwgNjAuMjg5Niw0NC4xMTk2IEwgNjAuMjY4Myw0NC4wMjIyIEwgNjAuMjM4Nyw0My45MjcgTCA2MC4yMDEsNDMuODM0NiBMIDYwLjE1NTUsNDMuNzQ1OSBMIDYwLjEwMjYsNDMuNjYxMyBMIDYwLjA0MjYsNDMuNTgxNyBMIDU5Ljk3Niw0My41MDc0IEwgNTkuOTAzMiw0My40MzkyIEwgNTkuODI0OCw0My4zNzc1IEwgNTkuNzQxNSw0My4zMjI4IEwgNTkuNjUzNyw0My4yNzU0IEwgNTkuNTYyMiw0My4yMzU4IEwgNTkuNDY3Niw0My4yMDQxIEwgNTkuMzcwNyw0My4xODA4IEwgNTkuMjcyMSw0My4xNjU4IEwgNTkuMTcyNSw0My4xNTk0IEwgNTkuMDcyOCw0My4xNjE1IEwgNTguOTczNyw0My4xNzIyIEwgNTguODc1OCw0My4xOTE0IEwgNTguNzc5OSw0My4yMTg5IEwgNTguNjg2OCw0My4yNTQ2IEwgNTguNTk3MSw0My4yOTgyIEwgNTguNTExNCw0My4zNDkzIEwgNTguNDMwNSw0My40MDc1IEwgNTguMzU0OSw0My40NzI2IEwgNTguMjg1MSw0My41NDM4IEwgNTguMjIxNyw0My42MjA4IEwgNTguMTY1Miw0My43MDMgTCA1OC4xMTYsNDMuNzg5NyBMIDU4LjA3NDQsNDMuODgwNCBMIDU4LjA0MDcsNDMuOTc0MyBMIDU4LjAxNTIsNDQuMDcwNyBMIDU3Ljk5ODIsNDQuMTY5IEwgNTcuOTg5Niw0NC4yNjgzIEwgNTcuOTg5Niw0NC4zNjggTCA1Ny45OTgyLDQ0LjQ2NzQgTCA1OC4wMTUyLDQ0LjU2NTcgTCA1OC4wNDA3LDQ0LjY2MjEgTCA1OC4wNzQ0LDQ0Ljc1NiBMIDU4LjExNiw0NC44NDY2IEwgNTguMTY1Miw0NC45MzMzIEwgNTguMjIxNyw0NS4wMTU1IEwgNTguMjg1MSw0NS4wOTI1IEwgNTguMzU0OSw0NS4xNjM4IEwgNTguNDMwNSw0NS4yMjg4IEwgNTguNTExNCw0NS4yODcxIEwgNTguNTk3MSw0NS4zMzgyIEwgNTguNjg2OCw0NS4zODE3IEwgNTguNzc5OSw0NS40MTc0IEwgNTguODc1OCw0NS40NDUgTCA1OC45NzM3LDQ1LjQ2NDEgTCA1OS4wNzI4LDQ1LjQ3NDkgTCA1OS4xNzI1LDQ1LjQ3NyBMIDU5LjI3MjEsNDUuNDcwNiBMIDU5LjM3MDcsNDUuNDU1NiBMIDU5LjQ2NzYsNDUuNDMyMiBMIDU5LjU2MjIsNDUuNDAwNiBMIDU5LjY1MzcsNDUuMzYwOSBMIDU5Ljc0MTUsNDUuMzEzNiBMIDU5LjgyNDgsNDUuMjU4OCBMIDU5LjkwMzIsNDUuMTk3MSBMIDU5Ljk3Niw0NS4xMjg5IEwgNjAuMDQyNiw0NS4wNTQ3IEwgNjAuMTAyNiw0NC45NzUgTCA2MC4xNTU1LDQ0Ljg5MDUgTCA2MC4yMDEsNDQuODAxNyBMIDYwLjIzODcsNDQuNzA5NCBMIDYwLjI2ODMsNDQuNjE0MiBMIDYwLjI4OTYsNDQuNTE2NyBMIDYwLjMwMjQsNDQuNDE3OCBMIDYwLjMwNjcsNDQuMzE4MiBMIDU5LjE0NzYsNDQuMzE4MiBaJyBzdHlsZT0nZmlsbDojMDAwMDAwO2ZpbGwtcnVsZTpldmVub2RkO2ZpbGwtb3BhY2l0eToxO3N0cm9rZTojMDAwMDAwO3N0cm9rZS13aWR0aDowcHg7c3Ryb2tlLWxpbmVjYXA6YnV0dDtzdHJva2UtbGluZWpvaW46bWl0ZXI7c3Ryb2tlLW9wYWNpdHk6MTsnIC8+Cjwvc3ZnPgo= [Si] XUIMIQQOPSSXEZUHFFFAOYSAN 0.000 description 2
 229910052710 silicon Inorganic materials 0.000 description 2
 239000010703 silicon Substances 0.000 description 2
 210000002370 ICC Anatomy 0.000 description 1
 241001123622 Pseudoeurycea rex Species 0.000 description 1
 241000495825 Rallus elegans Species 0.000 description 1
 241001246288 Succineidae Species 0.000 description 1
 238000004458 analytical methods Methods 0.000 description 1
 230000002457 bidirectional Effects 0.000 description 1
 230000000903 blocking Effects 0.000 description 1
 238000006073 displacement reactions Methods 0.000 description 1
 238000005315 distribution function Methods 0.000 description 1
 238000005516 engineering processes Methods 0.000 description 1
 235000020280 flat white Nutrition 0.000 description 1
 230000003116 impacting Effects 0.000 description 1
 238000007689 inspection Methods 0.000 description 1
 230000003993 interaction Effects 0.000 description 1
 230000001788 irregular Effects 0.000 description 1
 239000000463 materials Substances 0.000 description 1
 238000002360 preparation methods Methods 0.000 description 1
 108010083077 roundabout protein Proteins 0.000 description 1
 238000004088 simulation Methods 0.000 description 1
 238000000844 transformation Methods 0.000 description 1
Images
Classifications

 G—PHYSICS
 G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
 G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
 G03B21/00—Projectors or projectiontype viewers; Accessories therefor
 G03B21/14—Details
 G03B21/26—Projecting separately subsidiary matter simultaneously with main image

 H—ELECTRICITY
 H04—ELECTRIC COMMUNICATION TECHNIQUE
 H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
 H04N17/00—Diagnosis, testing or measuring for television systems or their details
 H04N17/002—Diagnosis, testing or measuring for television systems or their details for television cameras

 H—ELECTRICITY
 H04—ELECTRIC COMMUNICATION TECHNIQUE
 H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
 H04N9/00—Details of colour television systems
 H04N9/12—Picture reproducers
 H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
 H04N9/3179—Video signal processing therefor
 H04N9/3185—Geometric adjustment, e.g. keystone or convergence

 H—ELECTRICITY
 H04—ELECTRIC COMMUNICATION TECHNIQUE
 H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
 H04N9/00—Details of colour television systems
 H04N9/12—Picture reproducers
 H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
 H04N9/3191—Testing thereof
 H04N9/3194—Testing thereof including sensor feedback
Abstract
Description
Rcptr′=T Rprjct′
where T is called the light transport matrix. It is to be understood that since each projection pixel j results in a light ray that is scattered across the entire image sensor array 29 of real camera 25, each sensor pixel i within the image sensor array 29 will have a differently valued light transport coefficient for each projection pixel j. Therefore, each projection pixel j will result in a column of (m×n) individual light transport coefficients, one for each sensor pixel i of the camera's image sensor array 29. Since there are (p×q) projection pixels j in real projector 21, light transport matrix T will have (p×q) columns [one for each projection pixel j] and (m×n) rows [one for each sensor pixel i] of individual light transport coefficients. Thus, light transport matrix T will necessarily be huge, consisting of (p×q×m×n) individual light transport coefficient values.
Vcptr″=T^{T }Vprjct″
Remarkably, the duality transformation between the real light transport matrix, T, and its dual light transport matrix, T^{T}, is the transpose matrix operation known in the art of matrix computation.
Rcptr′=T Rprjct′
is exactly the j^{th }column of matrix T. It is to be understood that since the resolution of real projector 21 is likely to be lower than the resolution of real camera 25, the single light beam emitted from the j^{th }projection pixel under test may fall across several sensor pixels i of image sensor array 29.
[i.e. S1⊂{1, . . . , (p×q)}]
maps to a corresponding set of columns (one per projection pixel) in light transport matrix T. Furthermore, it is assumed that the first set of projection pixels S1 includes target projection pixel j, i.e. the target pixel under test.
[i.e. S1∩S2={j}]
Let Rcptr_S2 be a second image captured by real camera 25 of a projected image created by the simultaneous activation of the second set of projection pixels S2. The light transport coefficients of the j^{th }column of light transport matrix T (which corresponds to the target projection pixel under test, i.e. correspondents to j) may be directly obtain from real captured images Rcptr_S1 and Rcptr_S2 by identifying the one light ray footprint (i.e. similar to light ray footprint 50 in
Tj≈MIN(Rcptr_S1, Rcptr_S2)
where Tj is the j^{th }column of matrix T, and “MIN” indicates that the lower valued sensor pixel (i.e. the darker pixel having a lower captured light intensity value) in Rcptr_S1 and Rcptr_S2 is retained, and the higher valued (i.e. brighter) sensor pixel is discarded. In this way, the only high intensity values that are retained correspond to a lit footprint common to both S1 and S2.
[i.e. L⊂{1, . . . , (m×n)}]
common to captured image Rcptr_S1 and Rcptr_S2 that corresponds to the target projector pixel, j. It should again be noted that the target projection pixel, j, is the intersection of projection pixel sets S1 and S2, (i.e. j is the only projection pixel common to both sets S1 and S2), such that
S1∩S2={j}
Therefore, among the captured image pixels (in both Rcptr_S1 and Rcptur_S2) that do not correspond to the target projection pixel, j, [i.e. those sensor pixels not in set L, i.e. ∉L], at least one of the compared, captured sensor pixels in either Rcptr_S1 or Rcptr_S2 will not have received light. Since sensor pixels receiving light will be brighter than sensor pixels not receiving light, the operation MIN(Rcptr_S1, Rcptr_S2), provides an image where only pixels in set L [i.e. ∈L] are lit, which is a good approximation of Tj, i.e. the j^{th }column in matrix T.
Rprjct_Sy_{—}1, . . . , Rprjct_Sy_q and Rprjct_Sx_{—}1, . . . , Rprjct_Sx_p
where each image Rprjct_Sy_1, . . . , Rprjct_Sy_q is paired with any of images Rprjct_Sx_1, . . . , Rprjct_Sx_p such that each set of paired images shares only one projection pixel in common, such that
∀j ∈{1, . . . , (p×q)}∃Rprjct_{—} Sy _{—} a, Rprjct_{—} Sx _{—} b Rprjct_{—} Sy _{—} a∩Rprjct_{—} Sx _{—} b={j}
The above formula being interpreted to mean that for all projection pixels j in {1 . . . (p×q)} there exist a pair of projection images, each having a differently constructed pattern such that the intersection of the constructed patterns intersect at a single point corresponding to a common projection pixel. A basic example of such pairs of constructed patterns would be projected pairs of vertical light beams and horizontal light beams. In this case, the intersection of a captured image of a vertical line and a captured image of a horizontal line would include all the sensor pixels i that correspond to a target projection pixel, j, (i.e. pixels i that lie within a light ray footprint created by a light ray emitted from projection pixel j).
Vcptr″=T^{T }Vprjct″
Since the virtual image sensor array 27″ in the virtual camera 21″ corresponds in actuality to real imaging projection array 27 of real projector 21, it is convenient to use the same index j to denote any virtual sensor pixel within Vcptr″ obtained by virtual camera 21″. Therefore, a relationship between each virtual projection pixel j in a virtual captured image versus a corresponding row of elements in T^{T }may be denoted as
Vcptr″(j)=T ^{T} _{j }Vprjct″
where T^{T} _{j }refers to the j^{th }row in T^{T}.
SVcptr″(G)={a∀z ∈{1, . . . , (p×q)}T _{COL} _{ — } G(a)≧T T _{COL} _{ — } z (a)}
Since in general ∥SVcptr″(G)∥<<(p×q), it takes significantly less time to compute:
than to compute:
Vcptr″(j)=T ^{T} _{j }Vprjct″
Up=λHUc
where λ is a scalar and H is the 3×3 homography transformation matrix (as known in the art) of which the bottom right entry is set to 1. The pair of corresponding coordinates provide 3 linear equations, where one of them determines the scalar and the other two are used to determine H, the homography transformation matrix. Since there are 8 unknown entries in 3×3 matrix H, given the correspondence of between N coordinate points (where N≧4) on the checker board, the homography between the projectorview image and the camera image can be recovered by solving the 2N linear equations. The greater the number of N, the lower the error relating coordinate points between the projectorview and the camera image.
AI=IA=IA
If matrix A were a matrix of order m by n, then the premultiplicative identify matrix I would be of order m by m, while the postmultiplicative identify matrix I would be of order n by n.
{hacek over (T)}r=Tr/(∥Tr∥)^{2} , r=1, 2, 3, . . . , pq
where {hacek over (T)}r is the r^{th }column of {hacek over (T)}. Since the operation ∥Tr∥ defines the square root of the sum of the squares of all values in column r of matrix T, the square of ∥Tr∥ is simply the sum of the squares of all the values in column r. That is,
By dividing each value entry in column r by the sum of the squares of all the values entries in column r, operation {Tr/(∥Tr∥)^{2}} has the effect of normalizing the value entries in column r of matrix T. If one now takes the transpose of {hacek over (T)}r, i.e. flips it on its side such that the first column becomes the top row and the last column becomes the bottom row, the result will be rows of elements that are the normalized values of corresponding columns of elements in T. Therefore, for every column in T, one has the following result:
({hacek over (T)}r ^{T})×(Tr)=1
and
({hacek over (T)}r ^{T})×(Tg)=0, for r≠g
In other words, multiplying a column of T with a corresponding row in {hacek over (T)}r^{T }always results in numeral 1, and as one multiplies all the columns in T with the corresponding row in {hacek over (T)}r^{T}, one produces a matrix with numeral 1's along its diagonal, and one may place zeroes everywhere else.
c_{1}=T_{1}p_{1 }
and
c_{2}=T_{2}p_{2 }
In order to simulate projected image p_{1 }from front projector P1 using immersive projector P2, one needs c_{1 }(i.e. the captured, projected image from front projector P1) to be the same as c_{2 }(i.e. the captured, projected image from immersive projector P2), i.e. one needs
c_{2}=c_{1 }
which lead to the relation:
T_{2}p_{2}=T_{1}p_{1 }
solving for p_{2}, one obtains the following relation:
p_{2}=(T_{2} ^{−1})(T_{1}p_{1})
c_{3}=T_{3}p_{3 }
which results in
p _{3}=(T _{3} ^{−1})×(c _{3})
Consequently, one can build a virtual model of display surfaces of room 111. The virtually modeled room 111″, shown in
Claims (13)
Priority Applications (3)
Application Number  Priority Date  Filing Date  Title 

US76217806P true  20060124  20060124  
US11/613,129 US7794090B2 (en)  20060124  20061219  Efficient dual photography 
US11/623,016 US7901093B2 (en)  20060124  20070112  Modeling light transport in complex display systems 
Applications Claiming Priority (3)
Application Number  Priority Date  Filing Date  Title 

US11/623,016 US7901093B2 (en)  20060124  20070112  Modeling light transport in complex display systems 
JP2008002919A JP2008171431A (en)  20070112  20080110  Method of generating estimated inverse matrix of reference matrix, method of simulating first projected image from first projector using second projected image from second projector, method of generating projected image and projection system 
US12/329,099 US8197070B2 (en)  20060124  20081205  Colorbased feature identification 
Related Parent Applications (1)
Application Number  Title  Priority Date  Filing Date  

US11/613,129 ContinuationInPart US7794090B2 (en)  20060124  20061219  Efficient dual photography 
Related Child Applications (1)
Application Number  Title  Priority Date  Filing Date 

US12/329,099 ContinuationInPart US8197070B2 (en)  20060124  20081205  Colorbased feature identification 
Publications (2)
Publication Number  Publication Date 

US20070171382A1 US20070171382A1 (en)  20070726 
US7901093B2 true US7901093B2 (en)  20110308 
Family
ID=39709244
Family Applications (1)
Application Number  Title  Priority Date  Filing Date 

US11/623,016 Active 20291214 US7901093B2 (en)  20060124  20070112  Modeling light transport in complex display systems 
Country Status (1)
Country  Link 

US (1)  US7901093B2 (en) 
Cited By (9)
Publication number  Priority date  Publication date  Assignee  Title 

US20080285843A1 (en) *  20070516  20081120  Honda Motor Co., Ltd.  CameraProjector Duality: MultiProjector 3D Reconstruction 
US20090219381A1 (en) *  20080303  20090903  Disney Enterprises, Inc., A Delaware Corporation  System and/or method for processing three dimensional images 
US20100123784A1 (en) *  20081119  20100520  Yuanyuan Ding  Catadioptric Projectors 
US8432435B2 (en) *  20110810  20130430  Seiko Epson Corporation  Ray image modeling for fast catadioptric light field rendering 
US20160042553A1 (en) *  20140807  20160211  Pixar  Generating a Volumetric Projection for an Object 
US9354452B2 (en)  20140814  20160531  Delta Electronics, Inc.  Lightfield immersive display and operation method thereof 
US9438813B2 (en)  20120313  20160906  Dolby Laboratories Licensing Corporation  Lighting system and method for image and object enhancement 
US10276075B1 (en) *  20180327  20190430  Christie Digital System USA, Inc.  Device, system and method for automatic calibration of image devices 
US10846917B2 (en)  20190103  20201124  Microsoft Technology Licensing, Llc  Iterating different camera representations in threedimensional model 
Families Citing this family (13)
Publication number  Priority date  Publication date  Assignee  Title 

US8197070B2 (en) *  20060124  20120612  Seiko Epson Corporation  Colorbased feature identification 
US7901093B2 (en) *  20060124  20110308  Seiko Epson Corporation  Modeling light transport in complex display systems 
US8095745B1 (en) *  20060807  20120110  Marvell International Ltd.  Nonsequential transfer of data from a memory 
EP2133797B1 (en) *  20070228  20120411  NEC Corporation  Dma transfer device and method 
US7857461B2 (en) *  20071106  20101228  Panasonic Corporation  Projector and projection method 
US8310525B2 (en) *  20081007  20121113  Seiko Epson Corporation  Onetouch projector alignment for 3D stereo display 
US8106949B2 (en) *  20090326  20120131  Seiko Epson Corporation  Small memory footprint light transport matrix capture 
US7901095B2 (en) *  20090327  20110308  Seiko Epson Corporation  Resolution scalable view projection 
US9600855B2 (en) *  20090711  20170321  HewlettPackard Development Company, L.P.  View projection 
US8243144B2 (en) *  20090731  20120814  Seiko Epson Corporation  Light transport matrix from homography 
US8355601B2 (en) *  20100115  20130115  Seiko Epson Corporation  Realtime geometry aware projection and fast recalibration 
US8976256B2 (en) *  20110321  20150310  The United States Of America As Represented By The Secretary Of The Air Force  Remote sensing of hidden objects 
CN105403230B (en) *  20151127  20181120  财团法人车辆研究测试中心  Object coordinates merge bearing calibration and its correction panel assembly 
Citations (15)
Publication number  Priority date  Publication date  Assignee  Title 

US6527395B1 (en) *  20011210  20030304  Mitsubishi Electric Research Laboratories, Inc.  Method for calibrating a projector with a camera 
US6549203B2 (en)  19990312  20030415  Terminal Reality, Inc.  Lighting and shadowing methods and arrangements for use in computer graphic simulations 
US6618076B1 (en) *  19991223  20030909  Justsystem Corporation  Method and apparatus for calibrating projectorcamera system 
US6628892B2 (en)  19990512  20030930  Kabushiki Kaisha Toshiba  Digital video recording/playback system with entry point processing function 
US20040119729A1 (en)  20021219  20040624  Eastman Kodak Company  Immersive image viewing system and method 
US20050285860A1 (en) *  20040618  20051229  Hanspeter Pfister  Scene reflectance functions under natural illumination 
US20070171381A1 (en) *  20060124  20070726  KarHan Tan  Efficient Dual Photography 
US20070171382A1 (en) *  20060124  20070726  KarHan Tan  Modeling Light Transport In Complex Display Systems 
US20080174704A1 (en) *  20070124  20080724  KarHan Tan  View Projection: OneTouch Setup of Light Displays on Arbitrary Surfaces 
US20090073324A1 (en) *  20070918  20090319  KarHan Tan  View Projection for Dynamic Configurations 
US20090086081A1 (en) *  20060124  20090402  KarHan Tan  ColorBased Feature Identification 
US20090091615A1 (en) *  20071005  20090409  KarHan Tan  Optimization Strategies for GPU View Projection Matrix Implementation 
US20100085425A1 (en) *  20081007  20100408  KarHan Tan  OneTouch Projector Alignment for 3D Stereo Display 
US20100123784A1 (en) *  20081119  20100520  Yuanyuan Ding  Catadioptric Projectors 
US20100141780A1 (en) *  20081209  20100610  KarHan Tan  View Projection Matrix Based High Performance Low Latency Display Pipeline 

2007
 20070112 US US11/623,016 patent/US7901093B2/en active Active
Patent Citations (17)
Publication number  Priority date  Publication date  Assignee  Title 

US6549203B2 (en)  19990312  20030415  Terminal Reality, Inc.  Lighting and shadowing methods and arrangements for use in computer graphic simulations 
US6628892B2 (en)  19990512  20030930  Kabushiki Kaisha Toshiba  Digital video recording/playback system with entry point processing function 
US6618076B1 (en) *  19991223  20030909  Justsystem Corporation  Method and apparatus for calibrating projectorcamera system 
US6527395B1 (en) *  20011210  20030304  Mitsubishi Electric Research Laboratories, Inc.  Method for calibrating a projector with a camera 
US20040119729A1 (en)  20021219  20040624  Eastman Kodak Company  Immersive image viewing system and method 
US7218324B2 (en) *  20040618  20070515  Mitsubishi Electric Research Laboratories, Inc.  Scene reflectance functions under natural illumination 
US20050285860A1 (en) *  20040618  20051229  Hanspeter Pfister  Scene reflectance functions under natural illumination 
US20090086081A1 (en) *  20060124  20090402  KarHan Tan  ColorBased Feature Identification 
US20070171381A1 (en) *  20060124  20070726  KarHan Tan  Efficient Dual Photography 
US20070171382A1 (en) *  20060124  20070726  KarHan Tan  Modeling Light Transport In Complex Display Systems 
US20080174516A1 (en) *  20070124  20080724  Jing Xiao  Mosaicing of View Projections 
US20080174704A1 (en) *  20070124  20080724  KarHan Tan  View Projection: OneTouch Setup of Light Displays on Arbitrary Surfaces 
US20090073324A1 (en) *  20070918  20090319  KarHan Tan  View Projection for Dynamic Configurations 
US20090091615A1 (en) *  20071005  20090409  KarHan Tan  Optimization Strategies for GPU View Projection Matrix Implementation 
US20100085425A1 (en) *  20081007  20100408  KarHan Tan  OneTouch Projector Alignment for 3D Stereo Display 
US20100123784A1 (en) *  20081119  20100520  Yuanyuan Ding  Catadioptric Projectors 
US20100141780A1 (en) *  20081209  20100610  KarHan Tan  View Projection Matrix Based High Performance Low Latency Display Pipeline 
NonPatent Citations (4)
Title 

KarHan Tan and Anoop K. Bhattacharjya, "Adaptive Light Projection System for Immersive Surround Video", May 24, 2005, Version 0.1, Palo Alto Laboratory, Epson R&D, Inc., Palo Alto, CA, USA, pp. 18. 
KarHan Tan, Jing Xiao, and Anoop K. Bhattacharjya, "Efficient Dual Photography", Dec. 14, 2005, Version 0.1, Palo Alto Laboratory, Epson R&D, Inc. Palo Alto, CA, USA, pp. 17. 
Pradeep Sen et al., "Dual Photography", ACM SIGGRAPH 2005 conference proceedings, pp. 111. 
Steven M. Seitz, et al. "A Theory of Inverse Light Transport", pp. 18. 
Cited By (12)
Publication number  Priority date  Publication date  Assignee  Title 

US20080285843A1 (en) *  20070516  20081120  Honda Motor Co., Ltd.  CameraProjector Duality: MultiProjector 3D Reconstruction 
US8172407B2 (en) *  20070516  20120508  Honda Motor Co., Ltd.  Cameraprojector duality: multiprojector 3D reconstruction 
US20090219381A1 (en) *  20080303  20090903  Disney Enterprises, Inc., A Delaware Corporation  System and/or method for processing three dimensional images 
US20100123784A1 (en) *  20081119  20100520  Yuanyuan Ding  Catadioptric Projectors 
US8201951B2 (en) *  20081119  20120619  Seiko Epson Corporation  Catadioptric projectors 
US8432435B2 (en) *  20110810  20130430  Seiko Epson Corporation  Ray image modeling for fast catadioptric light field rendering 
US9438813B2 (en)  20120313  20160906  Dolby Laboratories Licensing Corporation  Lighting system and method for image and object enhancement 
US20160042553A1 (en) *  20140807  20160211  Pixar  Generating a Volumetric Projection for an Object 
US10169909B2 (en) *  20140807  20190101  Pixar  Generating a volumetric projection for an object 
US9354452B2 (en)  20140814  20160531  Delta Electronics, Inc.  Lightfield immersive display and operation method thereof 
US10276075B1 (en) *  20180327  20190430  Christie Digital System USA, Inc.  Device, system and method for automatic calibration of image devices 
US10846917B2 (en)  20190103  20201124  Microsoft Technology Licensing, Llc  Iterating different camera representations in threedimensional model 
Also Published As
Publication number  Publication date 

US20070171382A1 (en)  20070726 
Similar Documents
Publication  Publication Date  Title 

US7901093B2 (en)  Modeling light transport in complex display systems  
US8197070B2 (en)  Colorbased feature identification  
US7901094B2 (en)  View projection: onetouch setup of light displays on arbitrary surfaces  
US8310525B2 (en)  Onetouch projector alignment for 3D stereo display  
US8106949B2 (en)  Small memory footprint light transport matrix capture  
US7794090B2 (en)  Efficient dual photography  
US8013904B2 (en)  View projection matrix based high performance low latency display pipeline  
US7901095B2 (en)  Resolution scalable view projection  
US8189957B2 (en)  View projection for dynamic configurations  
US8218003B2 (en)  Optimization strategies for GPU view projection matrix implementation  
US8201951B2 (en)  Catadioptric projectors  
US6715888B1 (en)  Method and system for displaying images on curved surfaces  
CN100382592C (en)  Method and system for determining correspondence between locations on display surface having arbitrary shape and pixels in output image of projector  
US6811264B2 (en)  Geometrically aware projector  
US6834965B2 (en)  Selfconfigurable adhoc projector cluster  
US6729733B1 (en)  Method for determining a largest inscribed rectangular image within a union of projected quadrilateral images  
Raskar et al.  A lowcost projector mosaic with fast registration  
JP2004288181A (en)  Method for adapting output image to shape of display surface  
JP2008171431A (en)  Method of generating estimated inverse matrix of reference matrix, method of simulating first projected image from first projector using second projected image from second projector, method of generating projected image and projection system  
Quéau et al.  A full photometric and geometric model for attached webcam/matte screen devices  
Xie et al.  A calibration method for largescale projection based floor display system  
Lee et al.  LowCost Smart Projector for Home Entertainment.  
Lee et al.  Automated calibration Method for MultiProjector Curved Displays  
Yun et al.  TEXTURE NEUTRALIZATION OF OBJECT USING A PROJECTORCAMERA SYSTEM  
Parnami  Building Visionbased applications of ProCams 3D Shooting Range Simulation & Photometric Compensation 
Legal Events
Date  Code  Title  Description 

AS  Assignment 
Owner name: EPSON RESEARCH AND DEVELOPMENT, INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:TAN, KARHAN;XIAO, JING;BHATTACHARJYA, ANOOP K;REEL/FRAME:018754/0993 Effective date: 20070112 

AS  Assignment 
Owner name: SEIKO EPSON CORPORATION, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:EPSON RESEARCH & DEVELOPMENT, INC.;REEL/FRAME:018768/0774 Effective date: 20070116 

STCF  Information on status: patent grant 
Free format text: PATENTED CASE 

FPAY  Fee payment 
Year of fee payment: 4 

MAFP  Maintenance fee payment 
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 8 