Egovernment Benchmark Usability Pilots
Research type: Project report
Related capability: Digital government consultancy
Egovernment Benchmark Usability Pilots
Authors: Nathan da Silva Carvalho, David Osimo, Cristina Moise, Angeles Kenny, Gavin Freeguard

Share:

About the publication

Publication date: 30 December, 2021
ISBN/ISSN: 978-92-76-44449-7
DOI: 10.2759/301547
Place of publication: Luxembourg
Publisher: Publications office of the European Union
Year: 2021

Abstract

The eGovernment Benchmarking has become, over the years, not just a measurement framework but one of the main policy tools in digital government. As such, it needs continuous updating to stay relevant in a fast-changing context while keeping year-by-year comparability. In particular, indicators to measure usability were added over the last years but are now in need of updating and refinement. To define and pilot such indicators is the goal that the Lisbon Council and Public.Digital set out to deliver in the present study. To do so, the study started off by collecting the widest range of indicators, creating a long list of 97 indicators. This longlist was developed based on desk research, one to one interviews with 13 stakeholders and open discussion with 21 experts. This longlist was then assessed based on the criteria of compliance with usability theory, alignment with policy priority, technical feasibility. Based on such assessment, the feedback of the Member States, and early mini-pilots, the list was drawn down to 20 indicators grouped in four areas: clear language, consistency and ease of use, speed and performance, help and support. Additionally, the decision was taken (based on expert interviews) to implement the methodology not on portals, as in the existing usability indicators, but on individual services. Such methodology was then deployed in three Member States (Czech Republic, Denmark, and Italy) by selected mystery shoppers (two per country) on 16 services (two per each of the eight life events). The Member States were selected based on the geographical balance and performance in terms of supply and demand of eGovernment services.

How to cite

Nathan da Silva Carvalho et al., "eGovernment Benchmark Usability Pilots" (Luxembourg: Publications Office of the European Union, 2021), http://doi.org/10.2759/71461).

Keywords

Digital government, digital public services, UX for public serices

Participating author(s)

nathan
Nathan Carvalho
Founder and chief executive officer (CEO)

Join our community

Stay up to date on our latest research

Enrol in theDigital Transformation Bulletin

Ensure that you remain updated on current opportunities for EU project funding and the latest digital government initiatives.  Access exclusive insights and uncover valuable partnership opportunities.

Our website uses cookies. Some of these cookies are essential to the operation of the website itself and are used by default. Other cookies (‘statistical cookies’) are used to compile statistics on how you and others use our website. Statistical cookies are only placed and collected with your consent. For more information on how we use cookies, please refer to our cookie policy. Do you agree with our use of statistical cookies?