Skip to main content
Open Research Europe logoLink to Open Research Europe
. 2025 Nov 28;5:329. Originally published 2025 Oct 28. [Version 2] doi: 10.12688/openreseurope.21096.2

Mapping immersive digital tools in the ICT4Water Cluster: innovation, interoperability and impact.

Ilias Karachalios 1,a, Nikolaos Tantaroudas 2, Christos Makropoulos 1
PMCID: PMC12699209  PMID: 41394321

Version Changes

Revised. Amendments from Version 1

In this revised version, we have carefully addressed all comments from both reviewers. We added a dedicated “Limitations and scope of the evidence” subsection to clarify the small sample size, the self-selected nature of the data and the reliance on self-reported perceptions of impact. In the Introduction, we rewrote the passages referring to NESSIE, PathoVIEW and FIWARE so that the cited references are more precisely aligned with what they actually report, while still situating them within the broader XR and digital-twin landscape. We also elaborated the explanation of the TRL scale, provided a clearer breakdown of immersion levels across the seven tools, and expanded the discussion of technical causes behind interoperability gaps, linking them more explicitly to concrete frameworks such as NGSI-LD/Smart Data Models. Finally, we clarified in the Results and in the Data availability statement that impact findings are based on self-reported survey data, and that the tool-level dataset and questionnaire are openly available via Zenodo for replication. All co-authors have read and approved the revised manuscript, and we have no competing interests to declare.

Abstract

Background

Immersive technologies—virtual, augmented, and mixed reality (XR)—are being piloted in the water sector for public engagement, training, and decision support. Within the European Commission’s ICT4Water Cluster, multiple projects report XR tools, but comparable evidence on functionality, interoperability, and scalability is limited.

Methods

We conducted a two-stage survey across ICT4Water projects (preliminary project-level screening: September–December 2023; tool-level assessment: April–May 2024). Responses were triangulated with public project materials. Seven distinct immersive solutions were analysed using a four-dimension rubric covering functionality, interoperability, scalability, and perceived impact.

Results

The portfolio spans VR, AR, MR, decision-support dashboards, and public-facing installations. Reported deployment options include PCs (4/7; 57%) and smartphones (4/7; 57%), with online-only operation in 3/7 (43%) tools and offline capability in 2/7 (29%). Interoperability is uneven: 3/7 (43%) expose data integration or APIs, while 4/7 (57%) lack external interfaces. Evidence of scalability beyond single-site pilots is reported for 4/7 (57%) tools; 3/7 (43%) remain at pilot/proof-of-concept stage.

Conclusions

XR can enhance awareness, learning, and operational insight, yet broader uptake depends on open interfaces, shared semantics, and post-project maintainability. We recommend designing against open standards and Smart Data Models, adopting modular packaging and open repositories to support post-project sustainment, and embedding XR within utility workflows and digital-twin initiatives to enable responsible scale-up.

Keywords: immersive technologies; virtual reality; augmented reality; mixed reality; extended reality (XR); digital water; interoperability; ICT4Water Cluster

Plain Language Summary

Water systems are complex and mostly hidden - from the pipes under our streets to the treatment plants on the edge of town. This article looks at how immersive digital tools - like virtual reality (VR), augmented reality (AR), and mixed reality (MR) - can make this invisible world easier to see and understand. The research reviewed projects in the European ICT4Water cluster and mapped the tools they created. We found seven distinct tools, ranging from AR apps that help visitors understand water-reuse technologies, to VR training rooms for planners, and MR guides that support first responders during emergencies. These tools turn data and engineering into clear pictures and step-by-step experiences that anyone can follow, not just specialists.

What do they change in practice? People learn faster, discussions between citizens and authorities become more concrete, and operators can spot problems sooner - especially when these tools are connected to live data (so what you see reflects what is happening right now). At the same time, we noticed common hurdles: many apps don’t “talk” to other systems, some need expensive hardware, and several stop being updated after a project ends.

Based on this mapping, we recommend four simple steps: build on open standards so tools connect easily; design for accessibility and multiple languages; plan maintenance from day one so tools outlive short projects; and link immersive visuals to real measurements and digital twins so they are useful in daily decisions.

If we do this, immersive tools can help communities save water, prevent pollution, and run critical services more safely and efficiently.

Introduction

The digital transformation of the water sector has become a practical driver of smarter, more sustainable resource management. Climate change, rapid urbanisation and rising demand pile fresh pressure onto already stretched water infrastructure, pushing utilities toward data-driven solutions that shorten reaction times and cut losses 1 . Recent outreach pilots even show citizens using phone-based augmented reality to explore circular-economy options in real-time.

Among the digital advances, immersive tools—virtual, augmented and mixed-reality—are attracting notice for their potential to re-shape water governance, education and day-to-day operations 2 . Virtual reality (VR) places users inside fully synthetic environments where they can rehearse tasks such as flood-gate sequencing or membrane-cleaning cycles 3 . Augmented reality (AR) overlays digital information on real-world objects, enhancing field training, public awareness campaigns, and infrastructure maintenance 4 . An early example of digital engagement at household scale is the NESSIE platform, which provided web-based feedback on water use derived from smart-meter data and analytics 5 . Similar concepts have since been explored in immersive and AR-enhanced formats building on such data infrastructures, although these developments extend beyond the original NESSIE publications. Mixed reality (MR) more broadly blends digital and physical layers, offering real-time, hands-on decision spaces that can improve collaboration among stakeholders 6 . In the safety and security domain, the PathoCERT project has demonstrated how multi-modal guidance on smartphones can support first responders during contamination incidents 7 , and related prototypes within the Cluster are now experimenting with XR-enabled interfaces on top of such platforms. When these visual layers are connected to digital twins - data infrastructures that combine live telemetry, physics-based models and AI surrogates 8, 9 - they can unlock predictive analytics and optimisation of complex water networks, even if the underlying publications focus primarily on the data and systems layer rather than on immersive front-ends.

The role of the ICT4Water cluster

The ICT4Water Cluster, an initiative of the European Commission, brings together more than 60 projects to advance interoperable smart-water solutions 1 . A core focus is to strengthen stakeholder participation through digital tools that enable actor engagement, scenario-based decision-making and interactive learning 10– 12 .

Within this framework, the Actor Engagement and Co-Creation Group has undertaken an in-depth assessment of immersive tools created or adopted by Cluster members. In this paper we compile that inventory, and evaluate each tool against four pragmatic criteria, functionality, interoperability, impact and scalability 2 . Early feedback from developers and end-users highlights key challenges: proprietary data formats, limited accessibility after project close, and the need for structured onboarding and training 13, 14 . These findings echo cross-sector XR-user studies and point to concrete next steps.

Objectives of the study

This study aims to:

  • 1.

    Identify and catalogue the immersive digital tools used within the ICT4Water Cluster.

  • 2.

    Evaluate their functionality and interoperability within water management frameworks.

  • 3.

    Assess their impact and scalability across different use cases, including decision support, education, and infrastructure monitoring.

  • 4.

    Provide recommendations to enhance adoption, usability, and effectiveness in addressing water-related challenges.

By achieving these objectives, the study contributes to digital innovation in water governance, supporting the EU’s broader policy goals for a sustainable and digitally advanced water sector. The insights gathered will inform future developments, guide industry stakeholders, and contribute to ongoing research in immersive digital technologies for water management.

Literature review

The digital turn in water management

Digitalisation is steadily reshaping European water services, marrying high-frequency sensing, data analytics and customer apps with decades-old pipes and pumps. The European Commission’s ICT4Water Action Plan sketched a “Digital Single Market for Water Services” built on open interfaces, shared vocabularies and cross-utility pilots 15 . That ambition is echoed in the 2024 Rolling Plan for ICT Standardisation, which puts water-management digitalisation on the Green-Deal priority list 16 .

Yet progress remains uneven, an ethnographic deep dive into Ghana Water Company shows smart meters and mobile billing being bolted on as stand-alone add-ons, limiting value capture and reinforcing organisational silos 17 . Similar stories surface elsewhere, reminding us that hardware and code do not, by themselves, dismantle institutional inertia.

Immersive technologies: definitions and capabilities

Immersive media are now on trial across the entire water value chain—from catchment planning to customer engagement. A consolidated summary of definitions, core capabilities, and example use cases is provided in Table 1.

Table 1. Immersive modalities, their core affordances, and illustrative use-cases in the water sector.

Modality Core affordance Illustrative water sector usecase
Virtual-reality (VR) Full synthetic environment for risk
free exploration
Serious game prototype allowing citizens to test
flood-mitigation portfolios in a 3-D catchment 26
Augmented-reality
(AR)
Data overlays anchored to the
physical asset
HoloLens based visualisation of underground
sewers to s assist condition assessment 27
Mixed-reality (MR) Real time coupling of digital objects
and physical space
Field level inspection tool that fuses BIM, IoT
and simulation data for water supply pipes 28

Beyond operations, these media are valued for communicating complex, dynamic risks to non technical audiences and for shortening training cycles in hazardous settings.

Digital twins and interoperability in water systems

Digital twins (DTs) augment conventional SCADA setups with live telemetry, physics based simulators and AI surrogates. Recent work demonstrates how a DT of a municipal network can be queried in VR/MR to rehearse incident response or schedule predictive maintenance 18 . Similar VR walk-throughs are now being trialed on FIWARE-enabled raw-water twins, showing that the concept is not limited to distribution networks 9 . Early operational evidence is emerging; Gothenburg’s sewer utility, for example, reports pump-energy savings and overflow reductions after wiring its real-time control system to a DT platform 19 . Whether these gains scale hinges on common semantics. WaterML 2.0 already standardises time-series exchange, yet immersive front ends still struggle to ‘speak’ to heterogeneous back-ends. Wider uptake of linked-data vocabularies such as SAREF4WATR and RESTful NGSI-LD APIs would close that gap 20 .

Actor engagement, serious gaming, and capacity building

Gameful environments are a hallmark of the EU SIM4NEXUS project, where stakeholders co designed a policy sandbox to explore long term trade offs across the water energy food land climate nexus 21 . A meta analysis of 41 urban water games confirms their pedagogical value but notes that only one third were assessed with real end users, limiting generalisability 22 . Beyond the water domain, a recent review of 230 sustainability focused gamification studies highlights the design levers, narrative framing, social competition, real world rewards, that consistently deliver behavioural change 23 . Importing these insights could strengthen the next generation of digital water engagement tools.

Gaps in knowledge and need for structured assessment

While pilot studies are everywhere, yet we still lack a panoramic view of how immersive tools perform across regions, governance set-ups and sometimes creaky IT stacks. Comparative metrics for technical readiness, interoperability and socio economic impact are still rare. To fill that gap, we compile a Cluster-wide inventory of immersive applications and, borrowing from the interoperability principles above, we propose a lean rubric others can lift or refine.

Methodology

This study employed a mixed-methods approach combining structured data collection, stakeholder engagement, and comparative analysis to assess immersive digital tools developed or used by members of the ICT4Water Cluster. The methodology was developed under the framework of the Actor Engagement and Co-Creation Group and aligns with the ICT4Water Cluster's broader goals of promoting digital transformation through participatory innovation.

Research design

The assessment was carried out in two consecutive phases, involving separate but complementary rounds of data collection:

  • 1.

    A Preliminary Questionnaire 24 distributed across the ICT4Water community to gather an initial inventory of immersive digital tools, and

  • 2.

    A Main Survey 25 , designed to explore specific technical and functional characteristics of each tool, including interoperability, user experience, scalability, and perceived impact.

These instruments were supported by qualitative feedback from respondents, including open-text responses, workshop discussions, and follow-up communications with project representatives. This multi-layered approach provided both breadth and depth in the evaluation.

Sample and participants

The sampling frame comprised all ICT4Water Cluster projects active or completed at the time of the survey period. Invitations were distributed via ICT4Water Cluster channels (mailing list), with one reminder at a 2-week interval.

  • Preliminary (project-level) questionnaire. Fielded September–December 2023, it targeted all 77 projects (36 ongoing; 41 past) and yielded 28 valid project responses, a 36% response rate (28/77).

  • Main (tool-level) questionnaire. Fielded April–May 2024, it was addressed to projects that had indicated the use of immersive (XR) tools. It collected 7 valid tool-level responses, each corresponding to a distinct immersive solution.

At the time of data collection, these seven responses represented all immersive tools self-reported by ICT4Water projects that met the inclusion criteria, providing a workable snapshot of the ecosystem.

Survey instruments and indicators

The Preliminary Survey captured high-level information, including: (i) existence and name of immersive tool(s); (ii) XR environment type (VR, AR, MR); (iii) application domain (e.g., training, decision-support, education).

The Main Questionnaire evaluated each identified tool along four dimensions:

  • Functionality: degree of immersion, online/offline operation, device compatibility, accessibility features;

  • Interoperability: interfaces with other software, APIs and data systems, conformance to open standards;

  • Scalability: readiness beyond pilots, modularity, adaptability to new contexts;

  • Perceived impact: stakeholder engagement, training effectiveness, decision-making support, end-user feedback.

Items combined Likert-type ratings, multiple-choice selections, and open-ended comments. Metadata captured user categories (e.g., researchers, utilities, citizens), usage frequency, and training requirements. Full instruments and a codebook are provided as Extended data 24, 25 .

Ethics and consent

In line with institutional guidance at National Technical University of Athens, this minimal-risk professional survey did not require prior ethics committee approval, as no special-category personal data were collected, and all responses were anonymized. Electronic informed consent was obtained before participants accessed each questionnaire. No IP addresses or geolocation data were stored; free-text responses were screened/redacted prior to data deposit. Preliminary survey contact details are not publicly shared; only aggregated indicators are reported.

Data analysis

The survey data were analysed through a combination of:

  • Quantitative analysis (e.g., frequency distributions, cross-tabulations) to identify general trends and tool typologies.

  • Qualitative thematic coding of open-ended responses to extract emerging themes, user concerns, and best practices.

  • Comparative assessment of tools across projects to identify patterns in usage, strengths, and limitations.

• Key findings were visualised using summary tables and figures to support cross-case comparison. Tool functionalities and attributes were mapped to a comparative matrix that captures, for each of the seven tools, connectivity and use mode, device compatibility, intended user groups, interoperability, scalability status, perceived impact and reported challenges. This matrix is provided as an extended data file in the associated Zenodo record 29 , enabling readers to inspect the tool-by-tool overview in full detail.

Validation and presentation

Findings from the study were presented and validated during the ICT4Water Annual Cluster Meeting on June 19, 2024, as part of the Water Innovation Europe event in Brussels. This provided an opportunity for live feedback, clarification of tool details, and stakeholder input on future priorities. These discussions were incorporated into the final synthesis.

Results & findings

This section presents the key findings from the two-stage survey process and stakeholder engagement activities conducted across ICT4Water Cluster projects. The results are organized around four main analytical dimensions: (1) inventory and typology of tools, (2) functionality and user experience, (3) interoperability and scalability, and (4) perceived impact and challenges. Insights were drawn from 28 responses to the preliminary questionnaire and 7 detailed tool-level responses from the main questionnaire.

Inventory and typology of immersive tools

The survey pinpointed seven immersive solutions that are either being built or actively used inside ICT4Water projects. For clarity, each entry below pairs the tool with the EU project that created—or now deploys—it, drawing directly on the questionnaire responses presented to the Cluster in June 2024:

  • ARSINOE VR ( ARSINOE project) – a virtual reality environment in which regional planners explore multi hazard climate resilience scenarios and negotiate adaptation pathways.

  • NextGen AR application & authoring tool ( NextGen project) – mobile augmented reality overlays that let Living Lab visitors “see” circular water technologies on top of existing assets; an integrated authoring module allows non coders to publish new AR scenes.

  • iWAYS immersive Decision Support Suite ( iWAYS project) – a web based analytics cockpit whose 3 D dashboards support factory managers in optimising heat and water recovery lines before installation.

  • PathoVIEW AR instruction app ( PathoCERT project) – a phone based AR guide that walks first responders through sampling and disinfection steps during pathogen contamination incidents.

  • NESSIE mixed reality toolset – delivered in two successive builds:

    • ⚬

      NESSIE Platform ( iWIDGET project): a studio based MR prototype for collaborative design of new water infrastructure layouts.

    • ⚬

      NESSIE System ( B-WaterSmart project): a field ready evolution that couples a headset with live IoT feeds so on site engineers can inspect hidden assets. Both builds represent iterations of the same tool family rather than separate products.

  • Immersive Media eXpriences (IMX) exhibitions ( ULTIMATE project) – a travelling installation that blends VR headsets, large screen projection and live sensor feeds to bring digital water stories to general audiences.

Mapped to their dominant immersive modes, the portfolio distributes evenly across VR, AR, MR, decision support dashboards and public engagement exhibitions, underscoring the Cluster’s strategy of applying extended reality wherever it offers the greatest value—from high level policy planning through factory optimisation to citizen outreach.

Functionality and user experience

Tool categories were evenly split: VR 2/7 (29%), Digital platform 2/7 (29%), AR 1/7 (14%), MR 1/7 (14%), simulation/DSS 1/7 (14%). The tools vary considerably in terms of immersion levels, user interface design, and technological requirements. In terms of immersion, the two VR environments offer fully synthetic 3D spaces accessed via dedicated headsets or projection rooms, whereas the remaining five tools combine 2D dashboards, AR overlays or mixed-reality views with conventional screens and handheld devices. In practice, this means that ‘immersive’ spans a continuum from high-end room-scale VR to lighter, semi-immersive experiences that run on standard PCs, tablets or smartphones: 1

  • Connectivity & Use Mode:

    • ⚬

      3/7 (43%) of tools require internet access.

    • ⚬

      2/7 (29%) function offline; 1/7 (14%) support both modes; 1/7 (14%) require on-site installation.

  • Device Compatibility:

    • ⚬

      4/7 (57%) run on PCs;

    • ⚬

      3/7 (43%) on tablets;

    • ⚬

      4/7 (57%) on smartphones;

    • ⚬

      1/7 (14%) require a dedicated VR headset or on-site artefact.

  • Intended User Groups:

    • ⚬

      Tools target a wide spectrum of users, including water professionals, researchers, educators, public authorities, and general citizens.

Several respondents highlighted that while immersion enhances engagement, user-friendliness and onboarding remain key barriers. Training resources, language accessibility, and hardware availability were mentioned as critical areas for improvement.

Interoperability and scalability

A key metric in any digital-water roadmap is the ability of tools to interoperate with external platforms and scale beyond pilot contexts:

  • Interoperability:

    • ⚬

      3/7 (43%) of tools offer data integration or API-level communication with other systems.

    • ⚬

      4/7 (57%) do not currently support interoperability, representing a limitation for wider adoption.

  • Scalability:

    • ⚬

      4/7 (57%) of tools have been tested for scalability, either via multi-site deployment or stress testing.

    • ⚬

      3/7 (43%) remain in pilot or proof-of-concept stages, requiring further investment and infrastructure.

These figures suggest that while technical innovation is advancing, system-level integration remains an obstacle, particularly for smaller projects or research prototypes.

Perceived impact and user feedback

Respondents reported several positive outcomes from the use of immersive tools:

  • Enhanced Learning: Users indicated higher retention and comprehension when using immersive training modules, particularly in VR environments simulating complex systems like wastewater plants or flood risk zones, a finding aligned with an urban-water game meta-analysis 22 .

  • Increased Engagement: Tools like serious games and AR storytelling were praised for boosting citizen awareness, particularly in educational campaigns and public consultations.

  • Decision-Making Support: Several tools enabled multi-scenario visualization and stakeholder co-creation, enhancing the transparency of planning processes.

While these patterns are consistent across multiple respondents, it is important to note that they reflect self-reported perceptions rather than behavioural measurements. The survey did not collect pre/post learning scores, long-term usage statistics or independent usability evaluations, so the impact signals reported here should be interpreted as indicative rather than causal evidence of XR effectiveness.

Despite these strengths, common challenges include:

  • Limited funding and time to support full deployment,

  • Lack of standard training materials and guidance,

  • Hardware limitations in field applications (especially for AR).

Cluster-wide trends and maturity levels

An aggregated view of all responses suggests that immersive technologies in the ICT4Water cluster are in a transitional phase. In this analysis we follow the standard nine-level Technology Readiness Level (TRL) scale, where TRL 1–4 correspond to early concepts and proof-of-principle under controlled conditions, TRL 5–7 to prototype development and testing in relevant but still partially controlled environments, and TRL 8–9 to full system demonstration and routine operation in real-world settings.

  • Most tools are between Technology Readiness Levels (TRL) 5–7, indicating a shift from research to applied development.

  • There is a growing interest in Digital Twins, often coupled with immersive dashboards or visual simulations (e.g., VR-linked hydraulic models).

  • Use cases are moving beyond demonstration toward multi-stakeholder engagement platforms, integrating real-time data and AI-assisted analytics.

This comprehensive analysis provides a basis for identifying strategic needs, aligning technological development with stakeholder demand, and advancing immersive tools from innovation to mainstream adoption within digital water governance.

Limitations and scope of the evidence

Our findings should be interpreted considering several limitations. First, the evidence base is necessarily small: the preliminary project-level survey achieved a 36% response rate (28/77 projects), and only seven tools met the inclusion criteria for the main tool-level questionnaire. As a result, the mapped portfolio should be read as a purposive sample of self-reporting ICT4Water initiatives rather than a statistically representative picture of the entire Cluster or the wider European water sector. Second, all characterisations of functionality, interoperability and maturity are based on self-reported information from project representatives, occasionally triangulated with public deliverables; we did not conduct independent code audits or usability evaluations. Third, the “perceived impact” dimension synthesises qualitative feedback and subjective ratings rather than behavioural or learning outcomes, so claims about the benefits of XR adoption must be understood as indicative, not causal. Finally, several of the authors are affiliated with institutions that developed or deployed some of the tools inventoried through the NESSIE Platform and NESSIE System; while this insider perspective helped interpret technical details, it may also introduce optimism bias. Future work should therefore seek external validation and complementary quantitative studies (e.g. pre/post training assessments, longitudinal uptake metrics) to corroborate and extend these findings.

Discussion

Immersive tools added value in the water sector

The findings of this study are showing that immersive tools (VR/AR/MR) help showcase buried assets, subsurface flows, hydraulic behaviour, or the trade-offs behind flood protection. When engineers and operators use AR overlays on site, they can visualise pipe alignments, defects and condition states while standing above the network, which speeds up diagnosis and supports safer decisions. Recent work shows how GIS, AR and machine learning can be combined to render sewer condition dynamically, exactly the kind of “seeing is understanding” we aim for 27.

Immersive tools also make participation easier. In serious-game and VR settings, people can explore scenarios together (e.g., upstream retention vs. downstream channel works), see consequences, and then discuss trade-offs without needing expert knowledge. A widely cited study reports that a flood-risk serious game improved stakeholder understanding of options in mixed urban–rural catchments, evidence that play, when well-designed, can support informed dialogue 26 .

At the citizen level, AR can be used as a lightweight public-engagement path on phones people already carry. Controlled trials of an AR “eco-game” found gains in sustainability knowledge and pro-environmental attitudes, suggesting that simple, well-tested AR interactions can raise awareness at scale. For water utilities and projects, this matters: AR can be the front door to more complex back-end systems (dashboards, simulations, digital twins) without imposing heavy hardware 4 .

Finally, immersive front ends are most useful when connected to live data. Experience from wastewater utilities shows that when operational digital twins feed a visual interface (not always XR, but compatible with XR), operators get better foresight for storms and can reduce overflows or energy use. That is the direction we recommend for water XR: keep the interface simple, but wire it to real measurements and simulations 19 .

Technical barriers: interoperability and integration challenges

Most of the tools we inventoried were built as project pilots. They work, but many are effectively ‘islands’. From the survey responses, three recurring design patterns emerged behind this lack of interoperability. First, several XR tools were conceived as stand-alone demonstrators, with hard-coded data and no persistent back end or context broker, which makes it difficult to connect them to live telemetry or simulators once the pilot ends. Second, a subset of applications relies on proprietary vendor platforms where external API access is either restricted or out of scope for the project budget, locking immersive front ends into closed ecosystems. Third, time and funding constraints often prevent project teams from refactoring one-off prototypes into modular services with stable, documented APIs. Together, these factors limit reuse and hinder the integration of XR interfaces into digital twins, decision-support systems and wider utility IT stacks. In practice, we see three concrete fixes:

(a) Use shared context APIs. The EU’s NGSI-LD standard gives a common way to publish and subscribe to dynamic “entities” (assets, sensors, events). ETSI guidance shows how to link external vocabularies to NGSI-LD so different systems can speak the same language. For XR, this means the headset or phone can query a single context endpoint and receive the right attributes (location, status, forecast) without custom adapters for each pilot 30 .

(b) Reuse domain vocabularies. Rather than citing the SAREF portal, we rely on peer-reviewed SAREF literature. The SAREF ontology is well documented in a recent Wiley chapter; for the water domain, multiple scholarly works apply SAREF4WATR to model water assets and observations (e.g., industrial-water knowledge graphs; water-quality and monitoring ontologies; large open knowledge graphs). Using these vocabularies reduces custom mappings and lets XR clients consume consistent semantics across projects 20, 31– 33 .

(c) Standardise data models for payloads. Instead of the FIWARE programme page, we cite peer-reviewed studies that operationalise Smart Data Models (and FIWARE/NGSI-LD) at scale: city platforms aligned with Smart Data Models, end-to-end FIWARE reference implementations for context-aware analytics, and new Smart Data Models for flood-risk and satellite imagery. These works show how shared payload schemas shorten integration and help XR interfaces stay plug-compatible 34– 36 .

Finally, our own lineage in web platforms points to a feasible path: earlier iWIDGET work already exposed water-use analytics via the web; newer raw-water supply papers define NGSI/NGSI-LD data models for key hydraulic entities—exactly the substrate that immersive front-ends can render, provided those endpoints are kept stable beyond project end 5, 9, 37 .

Human-centric design and equity of access

Beyond technical integration, user-friendliness, training support, and accessibility were frequently cited as gaps by ICT4Water respondents. Immersive tools, while engaging, often assume a level of digital literacy and access to hardware that is not universally available—particularly among smaller utilities or citizen end-users. Previous studies have shown that without deliberate design for inclusivity, digital tools risk reinforcing existing inequalities in environmental governance 10, 21 .

Moreover, language support, offline modes, and platform neutrality (e.g., web-based vs headset-dependent) are crucial for making immersive experiences broadly usable. These limitations must be addressed through co-design practices, involving end users throughout the development cycle 38 .

Strategic policy alignment with EU goals

The European Commission has emphasized digital water transformation through key policies including the Green Deal, the Digital Europe Programme, and the Digital Water Action Plan. The ICT4Water Cluster is positioned to play a vital role in operationalizing these goals through scalable, interoperable, and participatory digital tools 1 .

Immersive technologies can directly contribute to:

  • Meeting Water Framework Directive goals by facilitating stakeholder participation.

  • Supporting workforce development through digital training environments.

  • Enhancing adaptive planning by enabling multi-scenario visualizations in urban water systems.

These benefits underscore the need for funding frameworks that support maintenance, scaling, and institutional embedding of immersive tools.

Recommendations for future development

To fully realize the potential of immersive technologies in water governance, this study proposes the following targeted actions:

  • 1.

    Standardise Interoperability: Support open architectures and shared data formats through alignment with initiatives like the Common European Data Space for Water.

  • 2.

    Promote Scalable Architectures: Encourage modular design, ensuring tools can evolve beyond demonstration environments.

  • 3.

    Invest in Inclusive Design: Prioritize user onboarding, multilingual content, and low-tech accessibility to reduce adoption barriers.

  • 4.

    Integrate Tools with Digital Twin Initiatives: Leverage real-time data environments to deepen the decision-support capacity of immersive tools.

  • 5.

    Support Ecosystem Development: Fund networks of developers, utilities, and researchers to co-create next-generation immersive solutions for water resilience.

Recommendations

The assessment of immersive digital tools across ICT4Water Cluster projects reveals both substantial opportunities and key barriers. To ensure that these tools evolve from prototypes to impactful digital solutions within water governance, the following targeted recommendations are proposed:

Foster interoperability through open standards

A significant number of tools assessed lack the ability to integrate with existing digital systems. To address this:

  • Adopt open APIs and standardized protocols, such as those developed by the Open Geospatial Consortium (OGC), to ensure compatibility with other water platforms and legacy systems.

  • Promote compliance with the Common European Data Space for Water, encouraging tools to contribute and draw from shared, interoperable datasets 16 .

Prioritize scalability and modularity in tool design

Many immersive solutions remain confined to the pilot stage due to architectural limitations. To enable broader deployment:

  • Encourage modular architectures that allow tools to be adapted and expanded across geographies and stakeholder contexts.

  • Provide funding mechanisms for long-term maintenance and scaling, including through Horizon Europe and Digital Europe Programmes.

Improve user experience and accessibility

Barriers to usability—especially for non-experts—can severely limit the adoption of immersive tools. To enhance access:

  • Co-design tools with diverse user groups, incorporating feedback from utilities, educators, and citizens at early stages 38 .

  • Ensure accessibility features, including multilingual support, offline operation, mobile compatibility, and usability for individuals with varying levels of digital literacy.

Embed immersive tools in digital twin and smart city strategies

To maximize impact and visibility:

  • Integrate immersive solutions with digital twin environments, enabling real-time monitoring, predictive planning, and collaborative engagement 8 .

  • Align tool development with smart city initiatives and EU climate adaptation policies, such as the EU Mission on Climate-Neutral and Smart Cities.

Support capacity building and institutional uptake

The successful deployment of immersive tools depends on the ecosystem surrounding them:

  • Fund training programs and onboarding materials for professionals, municipalities, and community organizations.

  • Develop a repository of best practices, case studies, and reusable components, hosted within the ICT4Water Cluster and disseminated through EU platforms.

Enable policy integration and long-term planning

To institutionalize immersive technologies:

  • Recognize immersive tools as valid methods of stakeholder engagement under the Water Framework Directive.

  • Encourage national and regional water authorities to include digital engagement strategies in their planning processes and procurement guidelines.

By implementing these recommendations, the ICT4Water Cluster and the broader European water community can unlock the full potential of immersive technologies, supporting innovation, inclusivity, and resilience in the face of growing water management challenges.

Conclusions

This study provides the first cross-cluster assessment of immersive digital tools used within the ICT4Water community, offering new insights into how technologies such as Virtual Reality (VR), Augmented Reality (AR), and Mixed-reality (MR) are being applied to support water resilience, stakeholder engagement, and digital transformation.

The findings highlight a growing ecosystem of immersive solutions that span diverse functions, from simulation-based training and scenario planning to interactive public education and participatory co-creation. While the tools demonstrate strong potential for enhancing transparency, inclusivity, and operational awareness, their deployment is often hindered by limited interoperability, low scalability readiness, and uneven user accessibility.

Key barriers such as fragmented architectures, incomplete API integration, and a lack of standardised onboarding point to the need for more coordinated design strategies and alignment with EU-level data and digital policy initiatives. Furthermore, many tools remain in mid-stage development (TRL 5–7), indicating a critical need for funding and technical support to move toward mainstream adoption.

The integration of immersive tools with broader digital water infrastructures, such as digital twins, IoT networks, and decision support systems, presents a compelling pathway forward. Equally, embedding these tools in regulatory frameworks and national strategies will be crucial for institutional uptake and long-term sustainability.

Ultimately, this research contributes to the ongoing vision of the ICT4Water Cluster: promoting a digitally empowered, interoperable, and collaborative European water sector. The recommendations provided offer a roadmap for transforming immersive prototypes into impactful, scalable innovations aligned with European Green Deal objectives and the Digital Europe Programme.

Ethics and consent

In line with institutional guidance at National Technical University of Athens, this minimal-risk professional survey did not require prior ethics committee approval, as no special-category personal data were collected, and all responses were anonymized. Electronic informed consent was obtained before participants accessed each questionnaire. No IP addresses or geolocation data were stored; free-text responses were screened/redacted prior to data deposit. Preliminary survey contact details are not publicly shared; only aggregated indicators are reported.

Acknowledgements

We thank colleagues from the ICT4Water Actor Engagement & Co-Creation group and all survey respondents for sharing information about immersive tools and use cases. We are also grateful to peers who provided informal feedback on the screening rubric and early drafts.

AI-use disclosure (F1000 policy): During manuscript preparation we used OpenAI ChatGPT (GPT-5 Thinking; model snapshot August 2025) to assist with language editing for clarity and concision, structuring of the Discussion subsections, and drafting the plain-language summary. All outputs were verified and edited by the authors, who take full responsibility for the content; no data analysis, coding, or generation of scientific results was performed by the tool.

Funding Statement

This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 883484 (PathoCERT), grant agreement No 776541 (NextGen), and grant agreement No 869171 (B-WaterSmart).

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

[version 2; peer review: 2 approved]

Footnotes

1Percentages refer to seven detailed responses; multiple selections were possible.

Data and software availability

Project-level responses from the preliminary screening survey (28 projects) are only reported in aggregate form to preserve confidentiality and avoid re-identification. All tool-level variables that underpin the analyses in this article are, however, shared at respondent level in the anonymised main survey dataset, enabling full replication of the results reported here.

Source data

No previously published third-party datasets were analysed.

Underlying data

Zenodo. Dataset: Responses to the Main Survey on Immersive (XR) Tools in ICT4Water Cluster Projects (Anonymised). DOI: https://doi.org/10.5281/zenodo.17073494 29

  • Respondent-level answers (CSV/XLSX), codebook, README (collection window, anonymisation steps, reuse notes).

Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC BY 4.0).

Extended data (survey instruments)

Zenodo: Preliminary Survey on Tools Used by ICT4Water Cluster Projects (English). DOI: https://doi.org/10.5281/zenodo.17341824 24

Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC BY 4.0).

Privacy note

De-identified data are shared; no IP addresses or geolocation were stored. Free-text fields were screened/redacted to prevent re-identification. (See Ethics & consent.)

Software availability

No new software was developed.

References

  • 1. European Commission: Executive agency for small and medium-sized enterprises, Vamvakeridou-Lyroudia LS: ICT4WATER cluster – vision and showcases. Publications Office,2021. Reference Source
  • 2. Beisheim N, Kayapinar H, Amann S, et al. : Using immersive technologies and Digital Twins in a real world with non-orthogonal coordinate systems.In: Cooper A, Trigos F, Stjepandić J, Curran R, Lazar I, editors. Advances in Transdisciplinary Engineering. IOS Press,2024; [cited 2025 Sept 25]. 10.3233/ATDE240855 [DOI] [Google Scholar]
  • 3. Li Q, Zhang C, Jiang R: A BIBLIOMETRIC REVIEW OF RESEARCH ON GAMIFICATION USED IN ENVIRONMENTAL PROTECTION, 2014–2024.In: DS 136: Proceedings of the Asia Design and Innovation Conference (ADIC) 2024. 2024;305–14. Reference Source [Google Scholar]
  • 4. Wang K, Tekler ZD, Cheah L, et al. : Evaluating the effectiveness of an augmented reality game promoting environmental action. Sustainability. 2021;13(24): 13912. 10.3390/su132413912 [DOI] [Google Scholar]
  • 5. Makropoulos C, Kossieris P, Kozanis S, et al. : From smart meters to smart decisions: web-based support for the water efficient household.In: Proceedings of 11th International Conference on Hydroinformatics. New York, NY,2014. Reference Source [Google Scholar]
  • 6. Trout T, Russell SM, Harrison AV, et al. : Collaborative Mixed Reality (MxR) and networked decision making. In: Llinas J, Hanratty TP, editors, Next-Generation Analyst VI. Orlando, United States: SPIE,2018;21. 10.1117/12.2309959 [DOI] [Google Scholar]
  • 7. Knecht C, Kanth Kosuru R: Protecting the First Responders: improving FR situational awareness through multi-modal interfaces leveraging the ubiquitous personal smartphone.In:2024; [cited 2025 Oct 1]. 10.54941/ahfe1005304 [DOI]
  • 8. Hossain R, Ahmed F, Kobayashi K, et al. : Virtual sensing-enabled Digital Twin framework for real-time monitoring of nuclear systems leveraging deep neural operators. Npj Mater Degrad. 2025;9(1): 21. 10.1038/s41529-025-00557-y [DOI] [Google Scholar]
  • 9. Kossieris P, Pantazis C, Makropoulos C: Data-models for fiware-enabled smart applications for raw-water supply system modelling, management and operation. In:2021. 10.5281/ZENODO.7354551 [DOI] [Google Scholar]
  • 10. Karachalios I: Utilizing educational gaming to foster sustainability awareness in corporate settings. Int J Sci Res. 2024;13(3):740–4. 10.21275/SR24308032254 [DOI] [Google Scholar]
  • 11. Karachalios I, Manesis N: Fostering environmental awareness in primary school students: evaluating the impact of a waste management education program. Eur J Educ Stud. 2025;12(4):77–94. 10.46827/ejes.v12i4.5886 [DOI] [Google Scholar]
  • 12. Karachalios I, Tantaroudas N: Future greek pre-service teachers’ knowledge, attitudes and self-efficacy in waste management. Br J Educ. 2025;13(8):25–42. 10.37745/bje.2013/vol13n82542 [DOI] [Google Scholar]
  • 13. Killough D, Ji TF, Zhang K, et al. : XR for all: understanding developers’ perspectives on accessibility integration in extended reality. arXiv.2024; [cited 2025 Sept 25]. Reference Source
  • 14. Lund GK, Ortova M, Syversen AG: Using VR technology in the pre-onboarding of temporary employees in a Norwegian SME. Procedia CIRP. 2023;120:320–325. 10.1016/j.procir.2023.08.057 [DOI] [Google Scholar]
  • 15. European Commission: Directorate general for communications networks, content and technology. ICT4Water.eu: Digital single market for water services action plan: final report. LU: Publications Office,2018; [cited 2025 July 28]. Reference Source
  • 16. European Commission: Interoperable Europe: Water Management Digitalisation (RP2024).2024; [cited 2025 Aug 11]. Reference Source
  • 17. Amankwaa G, Heeks R, Browne AL: Powershifts, organisational value, and water management: digital transformation of Ghana’s public water utility. Util Policy. 2024;87: 101724. 10.1016/j.jup.2024.101724 [DOI] [Google Scholar]
  • 18. Ciliberti FG, Berardi L, Laucelli DB, et al. : Digital water services using Digital Twin paradigm. IOP Conf Ser Earth Environ Sci.2023;1136(1): 012002. 10.1088/1755-1315/1136/1/012002 [DOI] [Google Scholar]
  • 19. Lumley D, Jursic Wanninger D, Magnusson Å, et al. : Implementing a Digital Twin for optimized real-time control of Gothenburg’s regional sewage system. Water Pract Technol. 2024;19(3):657–70. 10.2166/wpt.2024.060 [DOI] [Google Scholar]
  • 20. García-Castro R, Lefrançois M, Poveda-Villalón M, et al. : The ETSI SAREF ontology for smart applications: a long path of development and evolution. In: Moreno-Munoz A, Giacomini N, editors. Energy smart appliances. 1st ed. Wiley,2023;183–215. 10.1002/9781119899457.ch7 [DOI] [Google Scholar]
  • 21. Sušnik J, Masia S, Indriksone D, et al. : System dynamics modelling to explore the impacts of policies on the water-energy-food-land-climate nexus in Latvia. Sci Total Environ. 2021;775: 145827. 10.1016/j.scitotenv.2021.145827 [DOI] [PubMed] [Google Scholar]
  • 22. Mittal A, Scholten L, Kapelan Z: A review of serious games for urban water management decisions: current gaps and future research directions. Water Res. 2022;215: 118217. 10.1016/j.watres.2022.118217 [DOI] [PubMed] [Google Scholar]
  • 23. Mabalay AA: Gamification for sustainability: a systematic review of applications, trends, and opportunities. Comput Hum Behav. 2025;165: 108529. 10.1016/j.chb.2024.108529 [DOI] [Google Scholar]
  • 24. Karachalios I: Preliminary Survey on Tools Used by ICT4Water Cluster Projects. Zenodo. 2025; [cited 2025 Sept 1]. https://zenodo.org/records/17341824 [Google Scholar]
  • 25. Karachalios I: Main Survey on Immersive Tools in ICT4Water Cluster Projects. Zenodo. 2025; [cited 2025 Sept 1]. 10.5281/zenodo.16903913 [DOI] [Google Scholar]
  • 26. Khoury M, Gibson MJ, Savic D, et al. : A serious game designed to explore and understand the complexities of flood mitigation options in urban–rural catchments. Water. 2018;10(12): 1885. 10.3390/w10121885 [DOI] [Google Scholar]
  • 27. Nguyen LV, Bui DT, Seidu R: Utilization of augmented reality technique for sewer condition visualization. Water. 2023;15(24): 4232. 10.3390/w15244232 [DOI] [Google Scholar]
  • 28. Zhao X, Tao Y, Bao Y, et al. : Mixed reality-based inspection method for underground water supply network with multi-source information integration. Electronics. 2024;13(22): 4479. 10.3390/electronics13224479 [DOI] [Google Scholar]
  • 29. Karachalios I: Responses to the main survey on immersive (XR) tools in ICT4Water cluster projects (anonymised). Zenodo. 2025; [cited 2025 Sept 7]. 10.5281/zenodo.17073494 [DOI] [Google Scholar]
  • 30. ETSI ISG CIM: GR CIM 021 V1.1.1: usage of external data models with NGSI-LD API. 2022. Reference Source
  • 31. Koufakis AM, Tzanakis S, Moumtzidou A, et al. : OntoAqua: ontology-based modelling of context in water safety and security.In: Proceedings of the 13th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management.Online Streaming, --- Select a Country ---: SCITEPRESS - Science and Technology Publications,2021;194–201. 10.5220/0010676900003064 [DOI] [Google Scholar]
  • 32. Lippolis AS, Lodi G, Nuzzolese AG: The water health open knowledge graph. Sci Data. 2025;12(1): 274. 10.1038/s41597-025-04537-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33. Papageorgiou N, Pournara D, Apostolou D, et al. : Managing industrial water treatment processes knowledge with knowledge graphs. Intell Decis Technol. 2025;19(2):687–717. 10.1177/18724981251321368 [DOI] [Google Scholar]
  • 34. Bellini P, Ipsaro Palesi LA, Giovannoni A, et al. : Managing complexity of data models and performance in broker-based Internet/Web of Things architectures. Internet Things. 2023;23: 100834. 10.1016/j.iot.2023.100834 [DOI] [Google Scholar]
  • 35. Kouloglou IO, Antzoulatos G, Vosinakis G, et al. : FIWARE-compatible smart data models for satellite imagery and flood risk assessment to enhance data management. Information. 2024;15(5):257. 10.3390/info15050257 [DOI] [Google Scholar]
  • 36. Munoz-Arcentales A, López-Pernas S, Conde J, et al. : Enabling context-aware data analytics in smart environments: an open source reference implementation. Sensors (Basel). 2021;21(21): 7095. 10.3390/s21217095 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37. Kossieris P, Kozanis S, Hashmi A, et al. : A web-based platform for water efficient households. Procedia Eng. 2014;89:1128–1135. 10.1016/j.proeng.2014.11.234 [DOI] [Google Scholar]
  • 38. Brouwer F, Vamvakeridou-Lyroudia L, Alexandri E, et al. : The nexus concept integrating energy and resource efficiency for policy assessments: a comparative approach from three cases. Sustainability. 2018;10(12): 4860. 10.3390/su10124860 [DOI] [Google Scholar]
Open Res Eur. 2025 Dec 11. doi: 10.21956/openreseurope.23865.r65002

Reviewer response for version 2

Yutaro Onuki 1

I have carefully read the revised manuscript and the authors’ responses. All of my previous major and minor concerns have been adequately addressed.

Is the study design appropriate and does the work have academic merit?

Yes

Is the work clearly and accurately presented and does it cite the current literature?

Partly

If applicable, is the statistical analysis and its interpretation appropriate?

Not applicable

Are all the source data underlying the results available to ensure full reproducibility?

Yes

Are the conclusions drawn adequately supported by the results?

Partly

Are sufficient details of methods and analysis provided to allow replication by others?

Yes

Reviewer Expertise:

Cognitive Science, Judgement and Decision-making, and Human-Computer Interaction.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Open Res Eur. 2025 Nov 25. doi: 10.21956/openreseurope.22819.r63690

Reviewer response for version 1

Yutaro Onuki 1

This manuscript provides a valuable contribution by systematically mapping immersive tools (VR/AR/MR) developed and used within the ICT4Water Cluster, and by organising their functionality, interoperability, scalability, and impact along four analytical dimensions. The two-stage survey design, combined with feedback gathered at the annual Cluster meeting, allows the authors to show that immersive tools bring clear benefits, but also to surface important challenges such as “not connecting to other systems,” “remaining at pilot/prototype stage,” and “not being accessible to all user groups.” The recommendations proposed in the manuscript have the potential to serve as practical guidance for future work within the Cluster, especially for addressing these issues.

At the same time, I believe that the manuscript’s academic rigour and persuasive power could be further strengthened by addressing the points below. I group my comments into Major Points and Minor Points.

Major Points

1.

As described in the Methodology section:

The Preliminary Survey achieved a 36% response rate (28 out of 77 projects), and the Main Survey collected detailed tool-level responses for 7 tools.

The authors themselves characterise the results as “a workable snapshot.” At the same time, this sample size is necessarily limited for drawing conclusions that might be interpreted as representative of the ICT4Water Cluster as a whole, let alone the wider European water sector.

To help readers correctly interpret the scope of the findings, I recommend that the Discussion section explicitly states at least the limitations and potential biases arising from the small sample size. This kind of explicit limitation statement would, in my view, strengthen rather than weaken the credibility of the manuscript.

2.

In the Introduction, several concrete examples (NESSIE, PathoVIEW, FIWARE) are presented, but their descriptions do not fully align with the content of the cited references. I recommend checking and, if necessary, adjusting the following:

  • NESSIE

    The manuscript cites NESSIE as an AR example:

    “An early example is the NESSIE household-efficiency platform, which coupled AR overlays with smart-meter feedback [5].”

    However, in the cited paper [5] (Makropoulos et al., 2014), I could not find any explicit discussion of AR overlays.

  • PathoVIEW

    The manuscript presents PathoVIEW as an MR example:

    “The forthcoming PathoVIEW suite for first responders illustrates how MR can also support crisis management [7].”

    Yet the cited work [7] (Knecht & Kosuru, 2024) does not read as a study centred on mixed-reality headsets or spatial MR environments.

  • FIWARE

    In the “Digital twins and interoperability in water systems” section, FIWARE is used as a VR example:

    “Similar VR walk-throughs are now being trialed on FIWARE-enabled raw-water twins, showing that the concept is not limited to distribution networks [9].”

    However, the cited paper [9] (Kossieris et al., 2021) does not provide details on VR walk-through implementations or evaluations.

My interpretation is that these references are mainly intended to demonstrate the existence of platforms or data models, while the AR/MR/VR elements may be based on subsequent developments or related work. In their current form, however, the sentences can easily be read as if the cited papers themselves directly report AR/MR/VR implementations.

I therefore recommend either:

  • providing more appropriate references that explicitly describe the AR/MR/VR implementations in question, or

  • splitting the sentences so that one part clearly cites the platform or data model (NESSIE, PathoVIEW, FIWARE), and a separate part discusses AR/MR/VR usage or potential, without implying that the same reference directly covers both.

This would make the relationship between examples and references more transparent and prevent misunderstandings for readers who follow up the citations.

Minor Points

1.

In the Results section, the characteristics of the seven tools are carefully described in text. However, this information is currently dispersed across multiple paragraphs, which makes side-by-side comparison somewhat demanding for the reader.

I recommend adding a summary table in which:

  • Rows: the seven tools (e.g. ARSINOE VR, NextGen AR application, iWAYS suite, PathoVIEW, NESSIE toolset, IMX exhibitions)

  • Columns, for example:

• Connectivity & use mode

• Device compatibility

• Intended user groups

• Interoperability

• Scalability status

• Perceived impact and user feedback

• Technology Readiness Level

• Challenges

Such a table, complementing the qualitative text, would make similarities and differences among tools more immediately visible and would reinforce one of the core contributions of the paper: the cross-cluster overview.

If space or layout constraints make it difficult to include such a table in the main text, an alternative would be to refer explicitly in the Results section to the comparative matrix already provided in the Zenodo dataset (e.g. the Excel sheet of “Immersive tools of ICT4Water Cluster (Answers).xlsx”). A brief pointer there would help readers quickly locate the tool-by-tool overview, even if it remains in the extended data rather than in the article body.

2.

In the “Cluster-wide trends and maturity levels” subsection, the statement that:

“Most tools are between Technology Readiness Levels (TRL) 5–7 …”

is one of the important findings of the paper. However, some readers may not know what TRL 5–7 implies in practice.

I suggest including a brief explanation of the TRL scale at one point in the manuscript, for example:

  • TRL 1–4: from early concept to proof-of-principle under controlled conditions.

  • TRL 5–7: prototype development and testing under relevant but still controlled conditions.

  • TRL 8–9: system demonstration and operation in real or operational environments.

Then you can state that most tools in this study fall into TRL 5–7, meaning that prototypes exist and are being tested in relevant or near-operational contexts. This would help non-expert readers appreciate the significance of the maturity assessment.

3.

In the “Functionality and user experience” section, the manuscript notes that:

“The tools vary considerably in terms of immersion levels …”

but immediately afterwards there is no direct quantitative or categorical breakdown of immersion levels. Since immersion is one of the key dimensions distinguishing VR, AR, and MR, a small amount of additional detail here would improve clarity. Even one or two sentences summarising this breakdown would make it easier for readers to understand in what sense “immersion levels” differ across the portfolio.]

Thank you very much for your assistance.

Is the study design appropriate and does the work have academic merit?

Yes

Is the work clearly and accurately presented and does it cite the current literature?

Partly

If applicable, is the statistical analysis and its interpretation appropriate?

Not applicable

Are all the source data underlying the results available to ensure full reproducibility?

Yes

Are the conclusions drawn adequately supported by the results?

Partly

Are sufficient details of methods and analysis provided to allow replication by others?

Yes

Reviewer Expertise:

Cognitive Science, Judgement and Decision-making, and Human-Computer Interaction.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

Open Res Eur. 2025 Nov 25.
ilias karachalios

Major Point 1 – Scope and limitations of the sample

As noted in our response to Reviewer 1, we have added a dedicated subsection in the Discussion titled “Limitations and scope of the evidence” where we: highlight the response rate of the preliminary survey and the small number of tools in the main survey; clarify that the paper presents a workable snapshot of self-reporting projects rather than a representative sample of the entire ICT4Water Cluster; explain that self-selection and the self-reported nature of the data may bias the picture towards projects with stronger communication resources. We believe this addition makes the boundaries of our evidence base more transparent.

Major Point 2 – Alignment between examples (NESSIE, PathoVIEW, FIWARE) and cited references

Our intention was to use these citations to anchor the underlying platforms and data infrastructures, while mentioning immersive or mixed-reality developments that build on them. To avoid any confusion: We have rewritten the relevant paragraph in the Introduction. NESSIE is now presented primarily as a platform providing web-based feedback on water use derived from smart-meter data, with a brief remark that immersive and AR-enhanced formats have later been explored as extensions of such infrastructures, without implying that these are part of the original publication. PathoCERT / PathoVIEW are described as providing multi-modal guidance for first responders via smartphones, with XR interfaces mentioned as ongoing or related experimentation rather than as the core contribution of the cited work. FIWARE and NGSI-LD are explicitly framed as data and context-broker infrastructures which can support VR or 3D dashboards, again without suggesting that the referenced papers themselves include VR evaluations. We have kept all the original references, but we have now separated more clearly which part of the sentence is covered by the citation and which part refers to subsequent or potential XR usage. We hope this resolves the ambiguity identified by the reviewer.

Minor Point 1 – Summary table / comparative matrix

In the revised “Data analysis” subsection we now: explicitly describe the comparative matrix used to aggregate tool-level attributes (connectivity and use mode, device compatibility, intended user groups, interoperability, scalability status, perceived impact and challenges); refer directly to the inputs at the associated Zenodo record, noting that this matrix enables readers to inspect the tool-by-tool overview in full detail. If the editorial team considers it useful, we would also be happy to format a condensed version of this matrix as an additional table in the main text in a further iteration, but we believe the strengthened link to the extended data already addresses the reviewer’s request.

Minor Point 2 – Explanation of the TRL scale

In the revised Results subsection “Cluster-wide trends and maturity levels”, we now include a concise explanation of the nine-level TRL scale immediately before discussing our findings. Specifically, we note that: TRL 1–4 correspond to early concepts and proof-of-principle under controlled conditions; TRL 5–7 correspond to prototype development and testing in relevant but still partially controlled environments; TRL 8–9 correspond to full system demonstration and routine operation. We then reiterate that most tools in our sample are at TRL 5–7, meaning that they have functioning prototypes being tested in relevant or near-operational contexts rather than being fully embedded in routine utility workflows. We hope this makes the maturity assessment clearer, especially for non-specialist readers.

Minor Point 3 – Clarifying “immersion levels”

In the “Functionality and user experience” section we have expanded the text to clarify the distribution of immersion levels: we specify that two tools in our sample provide fully immersive VR environments accessed through dedicated headsets or projection rooms; the remaining five tools combine 2D dashboards, AR overlays or mixed-reality views with standard screens and handheld devices; we also state that the portfolio spans a continuum from high-end room-scale VR to lighter, semi-immersive experiences that run on standard PCs, tablets or smartphones. This additional detail should make the variation in immersion more tangible. Additional clarifications introduced in response to both reviewers Although not directly requested in single comments, we introduced two small clarifications that we believe improve transparency: In “Perceived impact and user feedback” we explicitly state that impact findings are based on self-reported perceptions, and that no pre/post tests or behavioural metrics were collected. In “Data and software availability” we clarify that preliminary project-level survey responses are only reported in aggregate form to protect confidentiality, while all tool-level variables used in the analyses are shared at respondent level in the anonymised main survey dataset, allowing full replication. We hope that these revisions address all the issues raised by both the reviewers and that the manuscript is now suitable for approval.

Open Res Eur. 2025 Nov 20. doi: 10.21956/openreseurope.22819.r63185

Reviewer response for version 1

Francesco De Paola 1

Although the seven tools analyzed are representative of current ICT4Water projects, the sample remains small relative to the cluster’s 60+ initiatives. The authors acknowledge that the dataset reflects only self-reported tools, potentially excluding under-documented or non-respondent projects. This limits generalizability and may skew toward projects with greater communication capacity or resources.

While qualitative feedback indicates improved learning, engagement, and decision-making, no empirical performance metrics (e.g., pre/post-training scores, behavioural data) are reported. The “perceived impact” dimension relies on self-assessment rather than objective evaluation. This weakens claims about the measurable benefits of XR adoption.

The study identifies interoperability gaps—only 43% of tools expose APIs—but does not deeply analyze technical causes or architectural designs behind these limitations. A comparative case analysis or technical deep-dive (e.g., data model architectures, protocol mapping) would enhance understanding of integration barriers.

The recommendations—such as promoting open standards or inclusive design—are valid but somewhat generic. The paper would benefit from specific implementation pathways, such as referencing concrete interoperability frameworks (e.g., NGSI-LD data models, OGC APIs) in use by particular tools.

The authors—who are also involved in ICT4Water projects—acknowledge this but do not reflect deeply on possible bias in tool assessment. Independent validation or external peer benchmarking would strengthen credibility.

Is the study design appropriate and does the work have academic merit?

Yes

Is the work clearly and accurately presented and does it cite the current literature?

Partly

If applicable, is the statistical analysis and its interpretation appropriate?

Yes

Are all the source data underlying the results available to ensure full reproducibility?

Partly

Are the conclusions drawn adequately supported by the results?

Partly

Are sufficient details of methods and analysis provided to allow replication by others?

Partly

Reviewer Expertise:

Hydraulic Engineering

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Open Res Eur. 2025 Nov 25.
ilias karachalios

1.  Sample size, representativeness and self-selection

We have now made these limitations explicit in the manuscript. In the revised version, we have added a dedicated subsection in the Discussion titled “Limitations and scope of the evidence”. There we clarify: that the preliminary survey achieved a 36% response rate (28/77 projects) and that only seven tools met the inclusion criteria for the main tool-level survey; that the resulting portfolio should be read as a purposive sample of self-reporting ICT4Water initiatives, not as a statistically representative picture of the entire Cluster or the wider European water sector; that all characterisations of functionality, interoperability and maturity are based on self-reported information from project representatives, occasionally triangulated with public deliverables. We believe this addition helps readers interpret the findings with the appropriate level of caution.  

2. Lack of empirical performance metrics and reliance on perceived impact

Our aim was to surface how project teams and users perceive the contribution of immersive tools rather than to provide causal evidence of impact. To make this clear:

  1. In the Results subsection “Perceived impact and user feedback ” we have inserted a short paragraph explicitly stating that:
    • the impact patterns reported are self-reported perceptions;
    • no pre/post learning scores, longitudinal usage statistics, or independent usability evaluations were collected;
    • the impact signals should therefore be interpreted as indicative rather than causal evidence.
  2. In the new “Limitations and scope of the evidence” subsection we reiterate this point at manuscript level, noting that future work should include quantitative assessments (e.g. pre/post training assessments, longitudinal uptake metrics) to corroborate our findings.

3. Limited analysis of the technical causes of interoperability gaps

We have now expanded the subsection “Technical barriers: interoperability and integration challenges” in the Discussion. In the revised text we describe three recurring design patterns that emerged from the survey responses:

  1. Stand-alone demonstrators: several XR tools were built as stand-alone visual demonstrators, with hard-coded data and no persistent backend or context broker, which limits connection to live telemetry or simulators after the project ends.

  2. Dependence on proprietary platforms: a subset of tools relies on vendor platforms where external API access is restricted or out of scope for the project budget, effectively locking immersive front-ends into closed ecosystems.

  3. Resource constraints for refactoring: time and funding constraints often prevent refactoring project prototypes into modular services with stable, documented APIs.

We then connect these observed patterns with the remedies that were already discussed (use of shared context brokers, NGSI-LD / SAREF / Smart Data Models, and open APIs). This should provide a clearer explanation of why interoperability is challenging, not only how it could be improved.  

4. Specificity of recommendations and reference to concrete interoperability frameworks

In the original version we already referred to NGSI-LD, FIWARE context brokers and Smart Data Models, but we agree that the link between these frameworks and our recommendations could be made more explicit. In the revised Discussion:

  • we make clearer that the tools which reported higher interoperability typically build on web-based dashboards or decision-support suites connected to IoT platforms and digital twins;

  • we explicitly mention NGSI-LD-compliant context brokers, OGC-inspired APIs and domain-specific data models (such as SAREF and Smart Data Models for Water) as concrete examples of infrastructures that can support reusable XR front-ends.

This provides a more tangible implementation pathway, in line with the reviewer’s suggestion.  

5. Potential bias arising from the authors’ involvement in ICT4Water projects

In the new “Limitations and scope of the evidence” subsection we add that:

  • several of the authors are affiliated with institutions that developed or deployed some of the tools inventoried through the NESSIE Platform and NESSIE System;

  • this insider perspective helped us interpret technical details but may introduce optimism bias;

  • future work should therefore seek external validation and peer benchmarking to strengthen credibility.

We hope this addresses your concern.

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Availability Statement

    Project-level responses from the preliminary screening survey (28 projects) are only reported in aggregate form to preserve confidentiality and avoid re-identification. All tool-level variables that underpin the analyses in this article are, however, shared at respondent level in the anonymised main survey dataset, enabling full replication of the results reported here.

    Source data

    No previously published third-party datasets were analysed.

    Underlying data

    Zenodo. Dataset: Responses to the Main Survey on Immersive (XR) Tools in ICT4Water Cluster Projects (Anonymised). DOI: https://doi.org/10.5281/zenodo.17073494 29

    • Respondent-level answers (CSV/XLSX), codebook, README (collection window, anonymisation steps, reuse notes).

    Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC BY 4.0).

    Extended data (survey instruments)

    Zenodo: Preliminary Survey on Tools Used by ICT4Water Cluster Projects (English). DOI: https://doi.org/10.5281/zenodo.17341824 24

    Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC BY 4.0).

    Privacy note

    De-identified data are shared; no IP addresses or geolocation were stored. Free-text fields were screened/redacted to prevent re-identification. (See Ethics & consent.)

    Software availability

    No new software was developed.


    Articles from Open Research Europe are provided here courtesy of European Commission, Directorate General for Research and Innovation

    RESOURCES