Customised content and impact in Website evaluation models: the case of international film festivals

Antolí-Calleja, Mónica and Orduña-Malea, Enrique and Ontalba-Ruipérez, José-Antonio Customised content and impact in Website evaluation models: the case of international film festivals. Information Research, 2016, vol. 21, n. 1. [Journal article (Unpaginated)]

[img] Text (English text)
_paper_film-festivals.pdf - Published version
Available under License Creative Commons Attribution.

Download (9MB)

English abstract

Introduction: The main objective of this study is to design a methodology to evaluate international film festival Websites considering personalised content and content outcomes. Method: This model consists of formal indicators (personalised content and Web functionalities) and impact indicators (outcomes of the content on search engines). Analysis The sample chosen to validate the model is composed of all fourteen film festivals from the category of competitive film festivals, according to the 2011 international federation of film producers associations criteria. For each festival URL, all the indicators from the proposed model were calculated manually. Results: Only 28.57% of the festivals analysed have adequate content quality (i.e., they obtained at least 50 out of a possible 100 points). This means that the quality of Website content does not correspond to that of the associated event. Conclusion: The proposed model is considered a valid and complementary tool for evaluating the quality of the content of international film festival Websites and suitable for inclusion in general Website evaluation models; it could also contribute to the improvement of design and construction guidelines for similar Websites.

Item type: Journal article (Unpaginated)
Keywords: International film festival, Content evaluation model, Website evaluation, Web indicators, Webometrics, Ranking.
Subjects: B. Information use and sociology of information > BA. Use and impact of information.
H. Information sources, supports, channels. > HQ. Web pages.
L. Information technology and library technology
L. Information technology and library technology > LC. Internet, including WWW.
L. Information technology and library technology > LS. Search engines.
Depositing user: Enrique Orduna-Malea
Date deposited: 05 Apr 2016 08:22
Last modified: 05 Apr 2016 08:22


"SEEK" links will first look for possible matches inside E-LIS and query Google Scholar if no results are found.

Aguillo, I.F., Granadino, B., Ortega, J.L. & Prieto, J.A. (2006). Scientific research activity and communication measured with cybermetrics indicators. Journal of the American Society for Information Science and Technology, 57(10), 1296-1302.

Aladwani, A.M. & Palvia, P.C. (2002). Developing and validating an instrument for measuring user-perceived eb quality. Information and Management, 30(3), 467-476.

Alpar, P. (1999). Satisfaction with a Web site: its measurement factors and correlates.Marburg, Germany: Philipps-Universität Marburg, Institut für Wirtschaftsinformatik. (Working Paper No. 99/01)

Baeza-Yates, R., Castillo, C. & Efthimiadis, E.N. (2007). Characterization of national Web domains. ACM Transactions on Internet Technology, 7(2), article 9.

Barjak, F., Li, X. & Thelwall, M. (2007). Which factors explain the Web impact of scientists' personal homepages? Journal of the American Society for Information Science and Technology, 58(2), 200-211.

Barnes, S.J. & Vidgen, R.T. (2002). An integrative approach to the assessment of E-commerce quality. Journal of Electronic Commerce Research, 3(3), 114–127.

Bauer, C. & Scharl, A. (2000). Quantitative evaluation of Web site content and structure. Internet Research, 10(1), 31-44.

Bauer, H.H., Falk, T. & Hammerschmidt, M. (2006). ETransQual: a transaction process-based approach for capturing service quality in online shopping. Journal of Business Research, 59(7), 866–875.

Bosma, P. (2010). Introduction: a few basics about film festivals, [Web log post]. Retrieved from (Archived by WebCite® at

Cai, S. & Jun, M. (2003). Internet users’ perceptions of online service quality: a comparison of online buyers and information searchers. Managing Service Quality, 13(6), 504–519.

Carlson, J. & O'Cass, A. (2010). Exploring the relationships between e-service quality, satisfaction, attitudes and behaviours in content-driven e-service Web sites. Journal of Services Marketing, 24(2), 112-127.

Chiou, J-S., Chi-Fen Hsu, A. & Hsieh, C-H (2013). How negative online information affects consumers' brand evaluation: The moderating effects of brand attachment and source credibility. Online Information Review, 37(6), 910-926.

Chu, H., He, S. & Thelwall, M. (2002). Library and information science schools in Canada and USA: a Webometric perspective. Journal of Education for Library and Information Science, 43(2), 110-125.

Codina, L. (2006). Metodología de análisis y evaluación de recursos digitales en línea [Methodology of analysis and evaluation of online digital resources]. Retrieved from (Archived by WebCite® at

Collier, J.E. & Bienstock, C.C. (2006). Measuring service quality in e-retailing. Journal of Service Research, 8(3), 260-275.

Cristobal, E., Flavián, C. & Guinalíu, M. (2007). Perceived e-service quality (PeSQ): measurement validation and effects on consumer satisfaction and Web site loyalty. Managing Service Quality, 17(3), 317–340.

Espadas, J., Calero, C. & Piattini, M. (2008). Web site visibility evaluation. Journal of the American Society for Information Science and Technology, 59(11), 1727-1742.

Fassnacht, M. & Koese, I. (2006). Quality of electronic services: conceptualizing and testing a hierarchical model. Journal of Service Research, 9(1), 19–37.

Follows, S. (2013, August 19). Film festivals Part I: the truths behind film festivals [Web log post]. Retrieved from (Archived by WebCite® at

Gounaris, S. & Dimitriadis, S. (2003). Assessing service quality on the Web: evidence from business-to-consumer portals. Journal of Services Marketing, 17(4/5), 529–548.

Ho, C-I. & Lee, Y-L. (2007). The development of an e-travel service quality scale. Tourism Management, 28(6), 1434–1449.

Huizingh, E.K.R.E. (2000). The content and design of Web sites: an empirical study. Information and Management. 37(3), 123-134.

Ibrahim, E.E., Joseph, M. & Ibeh, K.I.N. (2006). Customers’ perception of electronic service delivery in the UK retail banking sector. International Journal of Bank Marketing, 24(7), 475–493.

International Federation of Film Producers Associations. (2011). FIAPF accredited festivals directory. Retrieved from: (Archived by WebCite® at

International Organization for Standardization. (2001). ISO/IEC 9126-1:2001 Software engineering — Product quality — Part 1: Quality model. Genevea, Switzerland: International Organization for Standardization

Janda, S., Trocchia, P.J. & Gwinner, K. P. (2002). Consumer perceptions of Internet retail service quality. International Journal of Service Industry Management, 13(5), 412–431.

Jiménez Piano, M. & Ortiz-Repiso, V. (2007). Evaluación y calidad de sedes Web. Gijón, Spain: Trea.

Jurado Martín, M. (2003). Los festivales de cine en España: incidencia en los nuevos realizadores y análisis del tratamiento que reciben en los medios de comunicación. [Film festivals in Spain impact on new filmmakers and analysis of their treatment in the media] Unpublished doctoral dissertation, Universidad Complutense de Madrid, Spain.

Kim, S. & Stoel, L. (2004). Apparel retailers: Website quality dimensions and satisfaction. Journal of Retailing and Consumer Services, 11(2), 109–117.

Ladhari, R (2008). Alternative measures of service quality: a review. Managing Service Quality, 18(1), 65–86.

Ladhari, R. (2010). Developing e-service quality scales: a literature review. Journal of Retailing and Consumer Services, 17(6), 464-477.

Lewin, C.G. (1970). An Early Book on Compound Interest - Richard Witt's Arithmeticall Questions. Journal of the Institute of Actuaries, 96(1), 121–132.

Li, X., Thelwall, M., Musgrove, P., & Wilkinson, D. (2003). The relationship between the WIFs or inlinks of computer science departments in UK and their RAE ratings or research productivities in 2001. Scientometrics, 57(2), 239-255.

Li, Y.N., Tan, K.C. & Xie, M. (2002). Measuring Web-based service quality. Total Quality Management, 13(5), 685–700.

Lin, J.C-C.. & Lu, H. (2000). Towards an understanding of the behavioural intention to use a Web site. International Journal of Information Management, 20(3), 197-208.

Liu, C. & Arnett, K.P. (2000). Exploring the factors associated with Web site success in the context of electronic commerce. Information and Management, 38(1), 23–33.

Llinás, G., Rodríguez-Iñesta, D., Mira, J.J., Lorenzo, S. & Aibar, C. (2008). A comparison of Websites from Spanish, American and British hospitals. Methods of Information in Medicine, 47(2), 124-130.

Loiacono, E.T., Watson, R.T. & Goodhue, D.L. (2002). WEBQUAL: a measure of Website quality. In K. Evans & L. Scheer (Eds.) Marketing educators’ conference: marketing theory and applications (13), (pp. 432–437). Chicago, IL: American Marketing Association.

Más-Bleda, A. & Aguillo, I.F. (2013). Can a personal Website be useful as an information source to assess individual scientists? The case of European highly cited researchers. Scientometrics, 96(1), 51-67.

Mich, L., Franch & M., Gaio, L. (2003). Evaluating and designing Website quality. IEEE Multimedia, 10(1), 34–43.

Moraga, C., Moraga, M.A., Calero, C., & Caro, A. (2009). SQuaRE-aligned data quality model for Web portals. In Proceedings of the 9th international conference on quality software, (pp. 117-122). Los Alamitos, CA: IEEE.

Olsina, L.A. (1999). Metodología cuantitativa para la evaluación y comparación de la calidad de sitios Web. [Quantitative methodology for the evaluation and comparison of the quality of Web sites.] Unpublished doctoral dissertation, Universidad Nacional de La Plata, Buenos Aires, Argentina.

O’Neill, M., Wright, C. & Fitz, F. (2001). Quality evaluation in on-line service environments: an application of the importance–performance measurement technique. Managing Service Quality, 11(6), 402–417.

Orduna-Malea, E. (2013). Aggregation of the Web performance of internal university units as a method of quantitative analysis of a university system: the case of Spain. Journal of the American Society for Information Science and Technology, 64(10), 2100-2114.

Orduna-Malea, E. & Aguillo, I.F. (2014). Cibermetría: midiendo el espacio red. [Cybermetrics: measuring the network space]. Barcelona, Spain: UOC Publishing.

Parasuraman, A., Zeithaml, V.A. & Malhotra, A. (2005). E-S-Qual: a multiple-item scale for assessing electronic service quality. Journal of Service Research, 7(3), 213–233.

Park, Y.A. & Gretzel, U. (2007). Success factors for destination marketing Web sites: a qualitative meta-analysis. Journal of Travel Research, 46(1), 46-63.

Perdue, R.R. (2002). Internet site evaluations: the influence of behavioral experience, existing images, and selected Website characteristics. Journal of Travel & Tourism Marketing, 11(2-3), 21-38.

Ramírez, A.M.U., Fernández, M., Ortega, J.L. & Aguillo, I.F. (2009). Clasificación Web de hospitales del mundo: situación de los hospitales en la Red. [Web classification of the world's hospitals: status of hospitals on the World Wide Web]. Medicina Clínica, 132(4), 144-153.

Ranganathan, C. & Ganapathy, S. (2002). Key dimensions of business-to-consumer Web sites. Information and Management, 39(6), 457–465.

Rekik, R. & Kallel, I. (2011). Fuzzy reduced method for evaluating the quality of institutional Websites. In 7th International Conference on Next Generation Web Services Practices (NWeSP), (pp.296–301). Los Alamitos, CA: IEEE.

Robbins, S.S. & Stylianou, A.C. (2003). Global corporate Websites: an empirical investigation of content and design. Information and Management, 40(3), 205-212.

Romero-Frías, E., & Vaughan, L. (2010). European political trends viewed through patterns of Web linking. Journal of the American Society for Information Science and Technology, 61(10), 2109-2121.

Rüling, C-C. & Strandgaard Pedersen, J. (2010). Film festival research from an organizational studies perspective. Scandinavian Journal of Management, 26(3), 318–323.

Santos, J. (2003). E-service quality: a model of virtual service quality dimensions. Managing Service Quality, 13(3), 233–246.

Signore, O. (2005). A comprehensive model for Web sites quality. In D. Distante (Ed.) Seventh IEEE international symposium on Website Evolution (WSE 2005). (pp. 30–36). Los Alamitos, CA: IEEE.

Smith, A.G. (1999). A tale of two Web spaces: comparing sites using Web impact factors. Journal of Documentation, 55(5), 577-592.

Sohn, C. & Tadisina, S.K. (2008). Development of e-service quality measure for internet-based financial institutions. Total Quality Management and Business Excellence, 19(9), 903–918.

Szymanski, D.M. & Hise, R.T. (2000). E-satisfaction: an initial examination. Journal of Retailing, 76(3), 309–322.

Thelwall, M. (2004). Link analysis: an information science approach. Amsterdam, The Netherlands: Elsevier.

Thelwall, M., Klitkou, A., Verbeek, A., Stuart, D., & Vincent, C. (2010). Policy-relevant Webometrics for individual scientific fields. Journal of the American Society for Information Science and Technology, 61(7), 1464-1475

Vaughan, L. (2004). Exploring Website features for business information. Scientometrics, 61(3), 467-477.

Vaughan, L. & Thelwall, M. (2003). Scholarly use of the Web: what are the key inducers of links to journal Web sites? Journal of the American Society for Information Science and Technology, 54(1), 29-38.

Vaughan, L. & Wu, G. (2004). Links to commercial Websites as a source of business information. Scientometrics, 60(3), 487-496.

Wilkinson, D. & Thelwall, M. (2013). Search markets and search results: the case of Bing. Library and Information Science Research, 35(4), 318-325.

Wolfinbarger, M. & Gilly, M.C. (2003). ETailQ: dimensionalizing, measuring and predicting retail quality. Journal of Retailing, 79(3), 183–198.

Xu, J. D., Benbasat, I. & Cenfetelli, R.T. (2013). Integrating service quality with system and information quality: an empirical test in the e-service context [Appendices]. MIS Quarterly, 37(3), A1-A9.

Yang, Z., Cai, S., Zhou, Z. & Zhou, N. (2005). Development and validation of an instrument to measure user perceived service quality of information presenting Web portals. Information and Management, 42(4), 575–589.

Yoo, B. & Donthu, N. (2001). Developing a scale to measure the perceived quality of Internet shopping sites (SITEQUAL). Quarterly Journal of Electronic Commerce, 2(1), 31–46.

Zeithaml, V.A., Parasuraman, A. & Malhotra, A. (2000). E-service quality: definitions, dimensions and conceptual model. Cambridge, MA: Marketing Science Institute. (Working paper).

Zhang, P. & von Dran, G. M. von (2000). Satisfiers and dissatisfiers: a two-factor model for Website design and evaluation. Journal of the American Society for Information Science and Technology, 51(14), 1253-1268.


Downloads per month over past year

Actions (login required)

View Item View Item