Image Registration for a Multispectral Imaging System Using Interference Filters and Application to Digital Archiving of Art Paintings

Authors

  • Shogo Nishi Faculty of Information and Communication Engineering, Osaka Electro-Communication University
  • Akira Kimachi Faculty of Information and Communication Engineering, Osaka Electro-Communication University
  • Motonori Doi Faculty of Information and Communication Engineering, Osaka Electro-Communication University
  • Shoji Tominaga Graduate School of Advanced Integration Science, Chiba University

DOI:

https://doi.org/10.23738/ccsj.i72017.05

Keywords:

Interference filter, Spectral imaging, Misregistration, Calibration, Phase-only correlation, Digital archiving

Abstract

The present paper proposes a calibration method of a multispectral imaging system using interference filters. A multispectral imaging with interference filter is effective to acquire the inherent information of an object surface. However, in the imaging system using interference filters, the problem of misregistration is caused by longitudinal aberration or transverse aberration, where image position is slightly different between each captured image with the interference filters. We present a calibration method for correcting the observed images. The captured images are transformed into frequency domain, where the phase correlation between the Fourier-transformed images for different channels is maximized so as to compensate the misregistration. As a practical use, we describe the application to digital archive of paintings based the present imaging system. The surface properties such as surface-spectral reflectance and surface normal are estimated using the multichannel images.

Author Biographies

  • Shogo Nishi, Faculty of Information and Communication Engineering, Osaka Electro-Communication University

    Shogo Nishi, is an associate professor in the department of engineering informatics at Osaka Electro-Communication University, Osaka, Japan. He received his B.E. (1998) and Ph.D. (2003) in information engineering from Kagoshima University. His current research interests include spectral imaging, color image analysis, reflection modeling, and color reproduction. He is a member of IS&T and OSA.

  • Akira Kimachi, Faculty of Information and Communication Engineering, Osaka Electro-Communication University

    Akira Kimachi is a professor in the department of engineering informatics at Osaka Electro-Communication University, Osaka, Japan. He received his B.S. (1993) and Ph.D. (1999) in mathematical engineering and information physics from the University of Tokyo. His current research interests include optical measurement, image sensing and computer vision. He is a member of OSA, SPIE and IEEE.

  • Motonori Doi, Faculty of Information and Communication Engineering, Osaka Electro-Communication University

    Motonori Doi is an associate professor in the department of telecommunication and computer networks at Osaka Electro-Communication University, Osaka, Japan. He received his B.S. in control engineering from Osaka University (1993) and his Ph.D. in information engineering from Nara Advanced Institute of Science and Technology (NAIST) (1998). His current research interests include color/spectral image analysis. He is a member of IS&T and IEEE.

  • Shoji Tominaga, Graduate School of Advanced Integration Science, Chiba University

    Shoji Tominaga received the Ph.D. degree in electrical engineering from Osaka University, Japan in 1975. He was a Professor at Graduate School of Advanced Integration Science, Chiba University, and is now a Specially Appointed Researcher. His research interests include digital color imaging, multispectral imaging, and material appearance. He is a Fellow of IEEE, IS&T, SPIE, OSA, and IEICE.

References

Y. Miyake, Y. Yokoyama, N. Tsumura, H. Haneishi, K. Miyata and J.Hayashi, “Development of multiband color imaging systems for recording of art paintings,” Proc. SPIE 3648, pp. 218–225, 1999.

S. Tominaga and N. Tanaka, “Spectral Image Acquisition, Analysis, and Rendering for Art Paintings,” J. Electron. Imaging, Vol. 17, No. 4 , pp.043022-1–043022-13, 2008.

S. Tominaga, S. Nakamoto, H. Keita and T. Horiuchi, “Estimation of Surface Properties for Art Paintings Using a Six-band Scanner”, Journal of the International Colour Association, vol.12, pp.9–21, 2014.

F. H. Imai and R. S. Berns, “Spectral estimation using trichromatic digital camera,” Proc. of International Symp. Multispectral Imaging and Color Reproduction for Digital Archives, pp. 42–49, 1999.

S. Tominaga, “Multichannel vision system for estimating surface and illuminant functions,” J. Opt. Soc. Am. A, Vol. 13, pp. 2163–2173, 1996.

N. Shimano, K. Terai and M. Hironaga, “Recovery

Nishi S., Kimachi A., Doi M., Tominaga S.

of spectral reflectances of objects being imaged by multispectral cameras,” J. Opt. Soc. Am. A, Vol. 24, pp. 3211–3219, 2007.

J. Y. Hardeberg, F. Schmitt, and H. Brettel, “Multispectral color image capture using liquid crystal tunable filter,” Opt. Eng., Vol. 41, No. 10, pp. 2532–2548, 2002.

S. Nishi and S. Tominaga, “Calibration of a Multispectral Camera System Using Interference Filters”, Proc. of SPIE, Vol. 8011, pp.80119E-1–80119E-7, 2011.

A. Mansouri, F. S. Marzani, J. Y. Hardeberg, and P. Gouton, “Optical calibration of a multispectral imaging system based on interference filters,” Opt. Eng., Vol. 44, No. 2, pp.027004-1–027004-12, 2005.

J. Brauers, N. Schulte, and T. Aach, “Multispectral Filter-Wheel Cameras: Geometric Distortion Model and Compensation Algorithms,” IEEE Trans. Image Process., Vol. 17, No. 12, pp.2368–2380, 2008.

C. D. Kuglin and D. C. Hines, “The phase correlation image alignment method,” Proc. IEEE Int. Conf. Cybernetics and Society, pp.163–165, 1975.

S. Nishi, N. Tanaka and S. Tominaga, “Estimation of Reflection Properties of Paintings and its Application to Image Rendering”, Proc. Inter. Congress of Imaging Science, pp. 292–293, 2006.

S. Nishi and S. Tominaga “Measurement and Analysis of Spectral Reflection Properties of Oil Paints”, Journal of the Color Science Association of Japan, Vol. 32, No. 4, pp. 260–270, 2008. [in Japanese]

S. Tominaga and S. Nishi, “Surface Reflection Properties of Oil Paints under Various Conditions”, Proc. SPIE, Vol.6807, pp.0M1–0M8, 2008.

R. Cook and K. Torrance, “A reflection model for computer graphics,” Proc. SIGGRAPH ’81, Vol. 15, No. 3, pp. 307–316, 1981.

Downloads

Published

2017-05-31

Issue

Vol. 7 (2017)

Section

Papers

License

The "Cultura e Scienza del Colore - Color Culture and Science" journal is registered at the Court of Milan at n.233 of 24.06.2014.

The journal is an open access journal, free for readers and authors and has joined ROAD, the Directory of Open Access scholarly Resources, since 2014. Articles published in the “Cultura e Scienza del Colore - Color Culture and Science" journal are open access articles, distributed under the terms and conditions of the Creative Commons Attribution License (CC BY). The copyright is retained by the author(s).

How to Cite

“Image Registration for a Multispectral Imaging System Using Interference Filters and Application to Digital Archiving of Art Paintings” (2017) Cultura e Scienza del Colore - Color Culture and Science, 7, pp. 59–68. doi:10.23738/ccsj.i72017.05.