ACM CHIWORK 2024 Poster, demo & extended abstract Demo

Exploring AI-Enhanced Multi-Screen Interaction in Extended Reality Workspaces

Ravindu Tharanga Perera, Carlos Toxtli-Hernández

CHIWORK '24: 3rd Annual Meeting of the Symposium on Human-Computer Interaction for Work, Demo Track, 2024

DOI Website Code

Abstract

This demo paper explores AI-enhanced multi-screen interaction within extended reality (XR) workspaces using called VirtuaScreens. The system facilitates the user-centric addition of customized virtual monitors and employs machine learning to understand user preferences for monitor arrangements and application arrangements. We employed Large language and multimedia models to offer context-sensitive feedback and enhance the user experience. We created this research framework called VirtuaScreens for researchers and practitioners to use to understand the interaction of the multiple screens in the XR environment.

Cite this work

Ravindu Tharanga Perera and Carlos Toxtli-Hernández. 2024. Exploring AI-Enhanced Multi-Screen Interaction in Extended Reality Workspaces. CHIWORK '24: 3rd Annual Meeting of the Symposium on Human-Computer Interaction for Work, Demo Track. https://doi.org/10.13140/RG.2.2.31604.36481

@misc{Perera2024Exploring,
  doi = {10.13140/RG.2.2.31604.36481},
  url = {https://www.researchgate.net/doi/10.13140/RG.2.2.31604.36481},
  author = {{Ravindu Perera} and Toxtli, Carlos},
  language = {en},
  title = {Exploring AI-Enhanced Multi-Screen Interaction in Extended Reality Workspaces},
  publisher = {Unpublished},
  year = {2024},
  howpublished = {Preprint, ResearchGate},
  note = {Preprint}
}

Related

Related publications