Image Semantics in the Description and Categorization of Journalistic Photographs

Laine-Hernandez, Mari and Westman, Stina Image Semantics in the Description and Categorization of Journalistic Photographs., 2006 . In 69th Annual Meeting of the American Society for Information Science and Technology (ASIST), Austin (US), 3-8 November 2006. [Conference paper]

[thumbnail of laine-hernandez_westman_2006.pdf]
Preview
 PDF
laine-hernandez_westman_2006.pdf
Download (423kB) | Preview

English abstract

This paper reports a study on the description and categorization of images. The aim of the study was to evaluate existing indexing frameworks in the context of reportage photographs and to find out how the use of this particular image genre influences the results. The effect of different tasks on image description and categorization was also studied. Subjects performed keywording and free description tasks and the elicited terms were classified using the most extensive one of the reviewed frameworks. Differences were found in the terms used in constrained and unconstrained descriptions. Summarizing terms such as abstract concepts, themes, settings and emotions were used more frequently in keywording than in free description. Free descriptions included more terms referring to locations within the images, people and descriptive terms due to the narrative form the subjects used without prompting. The evaluated framework was found to lack some syntactic and semantic classes present in the data and modifications were suggested. According to the results of this study image categorization is based on high-level interpretive concepts, including affective and abstract themes. The results indicate that image genre influences categorization and keywording modifies and truncates natural image description.

Item type: Conference paper
Keywords: image content ; free description ; keywording ; categorization ; image categories ; multidimensional scaling ; hierarchical cluster analysis
Subjects: B. Information use and sociology of information > BH. Information needs and information requirements analysis.
I. Information treatment for information services > IC. Index languages, processes and schemes.
H. Information sources, supports, channels. > HG. Non-print materials.
I. Information treatment for information services > IH. Image systems.
I. Information treatment for information services > IA. Cataloging, bibliographic control.
Depositing user: Norm Medeiros
Date deposited: 14 Dec 2006
Last modified: 02 Oct 2014 12:05
URI: http://hdl.handle.net/10760/8606

References

Eakins, J.P., Briggs, P. & Burford, B. (2004). Image Retrieval Interfaces: A User Perspective. Lecture Notes in Computer Science, 3115, 628-637.

Fidel, R. (1997). The image retrieval task: implications for the design and evaluation of image databases. The New Review of Hypermedia and Multimedia, 3, 181-199.

Greisdorf, H. & O’Connor, B. (2002). Modelling what users see when they look at images: a cognitive viewpoint. Journal of Documentation, 58(1), 6-29.

Hasler, D. & Süsstrunk, S.E. (2003). Measuring colourfulness in natural images. In B. Rogowitz & T. Pappas (EDS) IS&T/SPIE Human Vision and Electronic Imaging VIII, SPIE vol. 5007, 87-95. Santa Clara, CA.

Hollink, L., Schreiber, G., Wielinga, B. & Worring, M. (2004). Classification of User Image Descriptions. International Journal of Human-Computer Studies, 61(5), 601-626.

Jaimes, A. & Chang, S-F. (2000). A Conceptual Framework for Indexing Visual Information at Multiple Levels. In G. Beretta & R. Schettini (EDS) IS&T/SPIE Internet Imaging I, SPIE vol. 3964, 2-15. San Jose, CA.

Jörgensen, C. (1998). Attributes of Images in Describing Tasks. Information Processing & Management, 34(2), 161-174.

Jörgensen, C. (1999). Retrieving the Unretrievable: Art, Aesthetics, and Emotion in Image Retrieval Systems. In B. Rogowitz & T. Pappas (ED) IS&T/SPIE Human Vision and Electronic Imaging IV, SPIE vol. 3644, 348-355. San Jose, CA.

Kobré, K. (2000). Photojournalism: The Professionals' Approach, 4th ed. Boston, Focal Press. 384 p.

Lohse, G.L., Biolsi, K., Walker, N. & Rueter, H.H. (1994). A classification of visual representations. Communications of the ACM, 37(12), 36-49.

Lohse, J., Rueter, H., Biolsi, K. & Walker, N. (1990). Classifying visual knowledge representations: a foundation for visualization research. In A. Kaufman (ED) IEEE Visualization '90, 131-138. San Francisco, CA.

Markkula, M. & Sormunen, E. (2000). End-user searching challenges indexing practices in the digital newspaper photo archive. Information Retrieval, 1(4), 259-285.

Markkula, M. & Sormunen, E. (1998). Searching for Photos - Journalists' Practices in Pictorial IR. In J. Eakins, D. Harper & J. Jose (EDS) The Challenge of Image Retrieval. Newcastle upon Tyne, UK.

Mojsilovic, A. & Rogowitz, B. (2001a). A Psychophysical approach to modeling image semantics. In B. Rogowitz & T. Pappas (EDS) IST&T/SPIE Human Vision and Electronic Imaging VI, SPIE vol. 4299, 470-477. San Jose, CA.

Mojsilovic, A. & Rogowitz, B. (2001b). Capturing Image Semantics with Low-level Descriptors. In (EDS) IEEE International Conference on Image Processing, ICIP 2001, vol. 1, 18-21. Thessaloniki, Greece.

Ornager, S. (1997). Image retrieval: Theoretical analysis and empirical user studies on accessing information in images. In C. Schwartz & M. Rorvig (EDS) Proceedings of the 60th Annual Meeting of the American Society for Information Science, 34, 202-211.

Rogowitz, B.E., Frese, T., Smith, J.R., Bouman, C.A. & Kalin, E. (1998). Perceptual image similarity experiments. In B. Rogowitz & T. Pappas (EDS) IS&T/SPIE Human Vision and Electronic Imaging III, SPIE vol. 3299, 576-590. San Jose, CA.

Rorissa, A. & Hastings, S.K. (2004). Free sorting of images: Attributes used for categorization. In L. Schamber & C. Barry (EDS) Annual Meeting of the American Society for Information Science and Technology, Providence, RI.

Sormunen, E., Markkula, M. & Järvelin, K. (1999). The Perceived Similarity of Photos - A Test-Collection Based Evaluation Framework for the Content-Based Photo Retrieval Algorithms. In: Draper S.W., Dunlop M.D., Ruthven I., van Rijsbergen C.J. (Eds.) Mira 99: Evaluating interactive information retrieval.

Teeselink, I.K., Blommaert, F. & de Ridder, H. (2000). Image Categorization. Journal of Imaging Science and Technology, 44(6), 552-559.

Vailaya, A., Jain, A. & Zhang, H.J. (1998). On Image Classification: City Images vs. Landscapes. Pattern Recognition, 31(12), 1921-1935.


Downloads

Downloads per month over past year

Actions (login required)

View Item View Item
Contact us
Send email Sponsors
Sponsor: AIMS Sponsor: D&P Sponsor: UniNa CAB Get connected
Facebook Facebook Twitter Twitter Linkedin LinkedIn RSS RSS