Semantic Visual Features in Content-based Video Retrieval

Mu, Xiangming Semantic Visual Features in Content-based Video Retrieval., 2006 . In 69th Annual Meeting of the American Society for Information Science and Technology (ASIST), Austin (US), 3-8 November 2006. [Conference paper]

[img]
Preview
 PDF
Mu_Semantic.pdf
Download (171kB) | Preview

English abstract

A new semantic visual features (e.g., car, mountain, and fire) navigation technology is proposed to improve the effectiveness of video retrieval. Traditional temporal neighbor browsing technology allows users to navigate temporal neighbors of a selected sample frame to find additional matches, while semantic visual feature browsing enables users to navigate keyframes that have similar features to the selected sample frame. A pilot evaluation was conducted to compare the effectiveness of three video retrieval designs that support 1) temporal neighbor browsing; 2) semantic visual feature browsing; and 3) fused browsing which is a combination of both temporal neighbor and semantic visual feature browsing. Two types of searching tasks: visual centric and non-visual centric tasks were applied. Initial results indicated that the semantic visual feature browsing system was more efficient for non-visual centric tasks.

Item type: Conference paper
Keywords: digital videos ; digital multimedia ; resource discovery ; information access ; search effectiveness
Subjects: I. Information treatment for information services > IB. Content analysis (A and I, class.)
B. Information use and sociology of information > BH. Information needs and information requirements analysis.
H. Information sources, supports, channels. > HH. Audio-visual, Multimedia.
I. Information treatment for information services > IA. Cataloging, bibliographic control.
Depositing user: Norm Medeiros
Date deposited: 15 Jan 2007
Last modified: 02 Oct 2014 12:06
URI: http://hdl.handle.net/10760/8829

References

Amir,A., Argillander,O.J., Berg, M., Chang,S.F., Franz, M., Hsu,W., Iyengar, G., et al. (2004) IBM Research TRECVID-2004 video retrieval system TRECVID2004

Carmel, E., Crawford, S., & Chen, H. (1992) Browsing in hypertext: a cognitive study IEEE Transactions on Systems , Man, and Cybernetics 22, 865-884

Chen, H-L., & Choi, G. (2005) Construction of a digital video library: a socio-technical pilot study on college students' attitudes Journal of Academic Librarianship 31(5), 469-476

Christel G. M., Smith, A. M., Taylor, R. C., & Winkler, B. D. (1998) Evolving video skims into useful multimedia abstractions

Cooke, E., Ferguson,P., Gaughan, G., Gurrin, C., Jones, J.F. G., Borgne, L.H., Lee,H., et al. (2004) TRECVID2004 experiments in Dublin City University TRECVID2004

Evans, J. (2003) The future of video indexing in the BBC TRECVID workshop

Gauch, S., Aust, R., Evans, J., Gauch, J., Miden, G., Niehaus, D., & Roberts, J. (1994) The Digital Video Library System: Vision and Design Proceedings of The First Annual Conference on the Theory and Practice of Digital Libraries Retrieved January 18, 2006 from http://www.csdl.tamu.edu/DL94/paper/gauch.html

Heesch, D., Howarth, P., Magalhaes, J., May, A., Pickering, M., Yavlinsky, A., and ruger, S. (2004) Video retrieval using search and browsing TRECVID2004

Helander, M. (Ed.). (1988) Handbook of human-computer interaction Amsterdam, Netherlands: North-Holland

Houten, V., Setten, V., and Enschede, E. O. (2000) Video browsing & summarization: user interaction techniques for video browsing & summarization TI/RS/2000/163 Retreived 11/15/2005 from https://doc.telin.nl/dscgi/ds.py/Get/File-12409/user_interaction.pdf

Li, F.C., Gupta, A., Sanocki, E., He, L., and Rui, Y. (2000) Browsing digital video Proceedings of CHI 2000 p. 169-176

Marchionini, G., Geisler, G. (2002) The Open Video Digital Library D-Lib Magazine 8(12). Retrieved January 18, 2006 from http://www.dlib.org/dlib/december02/marchionini/12marchionini.html

Mezaris, Y., Doulaverakis, H., Herrmann, S., Lehane, B., O’Connor, N., Kompatsiaris, I., and Strintzis, G. M. (2004) Combining textual and visual information processing for interactive video retrieval: SCHEMA’s participation to TRECVID2004 TRECVID2004 program

Murdock, V. and Croft, W. B. (2002) Task-orientation in question answering Proceedings of the 25th International ACM SIGIR Conference, Tampere, Finland, August

Naphade, R. M., Kennedy, L., Kender, R. J. , chang, S., Smith, R. J. , Over, P., and Hauptmann, A. (2005) A light scale concept ontology for multimedia understanding for TRECVID 2005 Retrieved 11/15/2005 from http://www-nlpir.nist.gov/projects/tv2005/LSCOMlite_NKKCSOH.pdf

Rose, B., and Rosin, L. (2001) The Internet & Streaming: What consumers want next Arbitron/Edison Media Research Internet VIIRetrieved Nov. 20, 2005 from http://www. edisonresearch.com

Salampasis, M., tait, J., & Bloor, C. (1998) Evaluation of information-seeking performance in hypermedia digital libraries Interacting with computers 10, 269-284

Shatford, S., (1986) Analyzing the subject of a picture: a theoretical approach Cataloguing & Classification Quarterly 5(3), 39-61

Shneiderman, B. (1996) The eyes have it: a task by data type taxonomy for information visualizations Proceedings of the IEEE conference on visual languages pp. 336-343

Tse, T., Vegh, S., Marchionini, G., & Shneiderman, B. (1999) An exploratory study of video browsing user interface designs and research methodologies: Effectiveness in information seeking tasks Proceedings of the 62nd Annual Meeting of the American Society for Information Science p. 681-692

Wildemuth, M. B., Yang, M., Hughes, A., Gruss, R., Geisler, G., & Marchionini, G. (2003) Access via features versus access via transcripts: user performance and satisfaction TRECVID2004

Yang, M. Wildemuth, M. B., Marchionini, G., (2004) The relative effectiveness of concept-based versus content -based video retrieval Proceedings of the 12th annual ACM international conference on Multimedia pp.368-271

Zhang, H., J., Low, C.Y., Smoliar, S., W., & Wu, J.H. (1995) Video parsing, retrieval and browsing: an integrated and content-based solution Proceedings of the third ACM international conference on Multimedia 15-24


Downloads

Downloads per month over past year

Actions (login required)

View Item View Item
Contact us
Send email Sponsors
Sponsor: AIMS Sponsor: D&P Sponsor: UniNa CAB Get connected
Facebook Facebook Twitter Twitter Linkedin LinkedIn RSS RSS