Svein Ølnes
However, we emphasize that the indicator sets should include more criteria than those that the existing evaluations are based on. We furthermore claim that these evaluations should be supplemented with other types of testing in order to get a more comprehensive picture of a web site. The experiences from such testing can then be used to further develop these indicator sets. Usability tests of a few of the evaluated websites would give valuable feedback to the development of indicators. User surveys and surveys to those responsible for the work with the websites are also valuable methods that can give a richer picture and complement the overall quality issue. Finally there is need for more research where several methods are combined. This paper has suggested some of the reasons for the observed differences in quality of municipality websites. But the paper has also shown that this difference is not perceived by the real users of the websites. There is a need to combine heuristic methods( expert evaluations), usability tests, and user surveys to try to find a link between these.
References
Barnes, Stuart J., and Richard Vidgen. 2000.“ WebQual: An Exploration of Web Site Quality.” In Proceedings of the EighthEuropean Conference on Information Systems, 1:298 – 305. http:// homepage. ufp. pt / lmbg / formacao / web _ quality. pdf. Boulter, Louise, and Anthony Bendell. 2010.“ Service Quality: Mind the Gap!” http:// eprints. mdx. ac. uk / 6929 /. Cap Gemini, Rand Europe, Sogeti, and DTi. 2010. Digitizing Public Services in Europe: Putting Ambition into Action. European Commission, Directorate General Information Society and Media. http:// storage. vuzit. com / public / 2c2bh / Digitizing _ Public _ Services _ in _ Europe __ Putting _ Ambition _ into _ Action. pdf. Dahlbom, B., and L. Mathiassen. 1993. Computers in Context. Basil Blackwell. Delone, William H., and Ephraim R. McLean. 2002.“ Information Systems Success Revisited.” In System Sciences, 2002. HICSS. Proceedings of the 35th Annual Hawaii International Conference On, 2966 – 2976. http:// ieeexplore. ieee. org / xpls / abs _ all. jsp? arnumber = 994345.
Difi. 2010. Innbygggerundersøkelsen Del 22010:14. Oslo: Agency for Public Management and eGovernment( Difi). http:// www. difi. no / filearchive / difi‐rapport‐2010‐14‐innbyggerundersokelsen‐del‐2. pdf.
Digitaliseringsstyrelsen. 2012. Bedst på Nettet ‐ Vurderingsgrundlag 2012. Copenhagen: Digitaliseringsstyrelsen. http:// www. bedstpaanettet. dk / vurderingsgrundlag‐2012 / Vurderingsgrundlag % 20for % 20BPN % 202012. pdf. Donker‐Kuijer, M. W., de Jong M., and L. Lentz. 2010.“ Usable Guidelines for Usable Websites? ‐ An Analysis of Five E‐ government Heuristics.” Government Information Quarterly 27( 3): 254 – 263.
Grönlund, Åke. 2010.“ Ten Years of E‐Government: The‘ End of History’ and New Beginning.” In Electronic Government ‐ 9th IFIP WG 8.5 International Conference, EGOV 2010, Lausanne, Switzerland, August 29 ‐ September 2, 2010, Proceedings, 11 – 24. Lecture Notes in Computer Science. Springer Berlin / Heidelberg.
Jansen, A., and S. Ølnes. 2004.“ Quality Assessment and Benchmarking of Norwegian Public Web Sites.” In 4 Th European Conference on E‐Government, Dublin, 17 – 18. http:// www. jus. uio. no / ifp / om / organisasjon / afin / forskning / notatserien / 2004 / qualityassessment. pdf.
De Jong, M., and T. van der Geest. 2000.“ Characterizing Web Heuristics.” Technical Communication 47( 3)( August): 311 – 326.
K. Braa, and L. Øgrim. 1995.“ Critical View of the Application of the ISO Standard for Quality Assurance.” Information Systems Journal 5( 4): 253 – 269. Kahneman, D. 2011. Thinking, Fast and Slow. Farrar, Straus and Giroux. Ladhari, Riadh. 2009.“ A Review of Twenty Years of SERVQUAL Research.” International Journal of Quality and Service Sciences 1( 2): 172 – 198. Langørgen, A., and R. Aaberge. 2011. Gruppering av kommuner etter folkemengde og økonomiske rammebetingelser 20088 / 2011. Oslo: Statistics Norway. http:// www. ssb. no / emner / 12 / 90 / rapp _ 201108 / rapp _ 201108. pdf.
Ministry of Government Administration, Reform and Church Affairs. 2012. På nett med innbyggerne ‐ Regjeringens digitaliseringsprogram. Oslo: Ministry of Government Administration, Reform and Church Affairs. http:// www. regjeringen. no / upload / FAD / Kampanje / DAN / Regjeringensdigitaliseringsprogram / digit _ prg. pdf. Nielsen, J. 1993. Usability Engineering. San Diego, CA: Academic Press. Nielsen, Jakob. 1994.“ Heuristic Evaluation.” In Usability Inspection Methods. New York, N. Y.: John Wiley. Parasuraman, A., Valarie A. Zeithaml, and Leonard L. Berry. 1988.“ Servqual.” Journal of Retailing 64( 1): 12 – 40. Preece, J., Y. Rogers, and H. Sharp. 2002.“ Interaction Design: Beyond Human‐computer Interaction. 2002.” NY: John Wiley
& Son. Sørum, Hanne, Rony Medaglia, and Kim Andersen. 2009.“ Assessment of Website Quality: Scandinavian Web Awards Right on Track?” Electronic Government: 198 – 209. Videnskapsministeriet. e‐Service på borgernes premisser? Statusrapport for Bedst på Nettet 2002. http:// www. bedstpaanettet. dk / status2002. W3C. 2008.“ Web Content Accessibility Guidelines( WCAG) ‐ W3C Recommendation”. W3C. http:// www. w3. org / TR / WCAG20 /.
397