Inclusive gaming
We frame the act of playing games with others as a way to reinforce social bonds, reduce stigma, enhance social support and inclusion.
Alt desc.
Publications
A diagram built around an horizontal line that represents the spectrum of definitions for social gaming identified in the work. The definitions are: Social as non-solitary, Social in the game's intent, Social in the interactions, Social in the outcomes, and Social inherent to gaming.

Social gaming: A systematic review

This work contributes with a systematized view of social aspects that permeate gaming experiences, while outlining directions and implications for future work. It presents a systematic review, covering 263 publications, with a particular focus on previous definitions and approaches, determinants that shape the experience, methodologies, and measurable outcomes.

David Gonçalves, Pedro Pais, Kathrin Gerling, Tiago Guerreiro, André Rodrigues

CHB 2023 ‑ Computers in Human Behavior, July, 2023

{publication.award}
screenshot taken from the video game 'The Legend of Zelda: Majora's Mask'. The image shows the playable character, Link, swinging his sword besides a big pot in a swamp-like scenario. The player’s webcam is seen in the corner of the image, but their face is pixelated (anonymized).

“My Zelda Cane”: Strategies Used by Blind Players to Play Visual-Centric Digital Games

In this work, we analyze over 70 hours of YouTube videos, where blind content-creators play visual-centric games. We point out the various strategies employed by players to overcome barriers that permeate mainstream games. We reflect on ways to enable and improve blind players’ experience with these games, shedding light on the positive and negative consequences of apparently benign design choices. Our observations underline how game elements are appropriated for accessibility, the incidental consequences of audio design, and the trade-offs between accessibility, agency, and engagement.

David Gonçalves, Manuel Piçarra, Pedro Pais, João Guerreiro, André Rodrigues

CHI 2023 ‑ ACM Conference on Human Factors in Computing Systems, April, 2023

Best Paper Award

Three of the different accessibility features available during the user study of the Virtual Environment. The first navigational task demonstrates that the avatar has to reach an objective, a cube. On the fourth task, players have to overcome the fence that is blocking their path, with two torches identifying the objective's directions and the length of the door to the next room. And on the sixth task, they can request directions to the objective, which can be done visually by following an orange line.

Evaluating Accessible Navigation for Blind People in Virtual Environments

We explore a set of techniques that augment or are even embedded in the game design to facilitate navigation and spatial awareness of virtual environments. We conducted a user study where seven blind participants faced a number of navigational tasks in a virtual environment with these techniques and shared their perspectives on the experience. We contribute with an exploration of a catalog of techniques used to facilitate the navigation of virtual spaces and a reflection of their impact on players' experience, highlighting avenues for future work in the field.

Manuel Piçarra, André Rodrigues, João Guerreiro

CHI EA 2023 ‑ Extended Abstracts of the ACM Conference on Human Factors in Computing Systems, April, 2023

Montage of 5 screenshots, in a 3 by 2 grid, that illustrate our 2D virtual environment. The image on the upper left corner depicts a group of 4 avatars having a conversation, followed by an image that shows an interaction between 2 avatars, where the user's avatar is receiving audio notifcations with the name of the passerby. The third image from the top depicts the environment of the 'Teleport' and 'Auto-Walk' scenarios, where the user has access to 4 buttons disposed vertically on the top left, which indicates that there are 4 groups in the environment - Group 1, Group 2, Group 3 and Group 4. Here, the user is accessing group 1, which is shown in a popup screen next to the buttons, having 'Group 1' as a title, followed by the names of the 5 participants of that group, a button to hear a conversation preview, and another button to be automatically transported to that group. In the lower-left corner, there is an image with the total view of the room. It is a large rectangular space, with a small adjacent rectangle on the upper left corner of the room. The room is bordered by walls and trees, and it is composed by 2 groups of 3 avatars, 2 groups of 5 avatars, 2 individual avatars, and the main avatar - controlled by the user. The last image illustrates the user's avatar being guided by another avatar toward a group of 3 participants.

Inclusive Social Virtual Environments: Exploring the Acceptability of Different Navigation and Awareness Techniques

Social virtual environments are becoming more prevalent, replicating and sometimes replacing real-world interactions. Nowadays, such environments are not accessible and end up excluding blind people, due to their strong visual components. In this study, we designed and explored multiple navigation and feedback techniques assessing social acceptability, ease of use, and efficiency. We developed a virtual environment composed of six scenarios to analyze different navigation methods (Free Exploration, Teleport, Auto-Walk, and Co-Pilot) and awareness cues in group conversations (Audio Cues While In-Group Footsteps and In-Group Teleport), and conducted a user study with 8 blind and 8 sighted participants. Our results indicate that participants tend to privilege autonomy and room awareness over efficiency and navigation ease and disapprove of intrusive actions that may jeopardize privacy.

Inês Gonçalves, André Rodrigues, Tiago Guerreiro, João Guerreiro

CHI EA 2023 ‑ Extended Abstracts of the ACM Conference on Human Factors in Computing Systems, April, 2023

Preview of the three games developed in this project.

Using Games to Practice Screen Reader Gestures

We explore the use of games to inconspicuously train gestures. We designed and developed a set of accessible games, enabling users to practice smartphone gestures. We evaluated the games with 8 blind users and conducted remote interviews. Our results show how purposeful accessible games could be important in the process of training and discovering smartphone gestures, as they offer a playful method of learning. This, in turn, increases autonomy and inclusion, as this process becomes easier and more engaging.

Gonçalo Lobo, David Gonçalves, Pedro Pais, Tiago Guerreiro, André Rodrigues

ASSETS 2021 ‑ ACM Conference on Computers and Accessibility

a screenshot of the rescue:under pressure game showing a submarine in a dark sea

Exploring Asymmetric Roles in Mixed-Ability Gaming

We explore ability-based asymmetric roles as a design approach to create engaging and challenging mixed-ability play. Our team designed and developed two collaborative testbed games exploring asymmetric interdependent roles. In a remote study with 13 mixed-visual-ability pairs we assessed how roles affected perceptions of engagement, competence, and autonomy, using a mixed-methods approach. The games provided an engaging and challenging experience, in which differences in visual ability were not limiting. Our results underline how experiences unequal by design can give rise to an equitable joint experience.

David Gonçalves, André Rodrigues, Mike Richardson, Alexandra de Sousa, Michael Proulx, Tiago Guerreiro

CHI 2021 ‑ ACM Conference on Human Factors in Computing Systems, May, 2021

{publication.award}
It shows four colorful bar charts.

Playing With Others: Depicting Multiplayer Gaming Experiences of People With Visual Impairments

We share multiplayer gaming experiences of people with visual impairments collected from interviews with 10 adults and 10 minors, and 140 responses to an online survey. We include the perspectives of 17 sighted people who play with someone who has a visual impairment, collected in a second online survey. Our focus is on group play, particularly on the problems and opportunities that arise from mixed-visual-ability scenarios. These show that people with visual impairments are playing diverse games, but face limitations in playing with others who have different visual abilities.

David Gonçalves, André Rodrigues, Tiago Guerreiro

ASSETS 2020 ‑ ACM Conference on Computers and Accessibility

Best Paper Nominee

We propose a paradigm shift where interactions and contributions by knowledgeable users can assist others beyond what mobile applications and operating systems provide Interaction data collection methods are fragmented and are gathered by each app and operating system individually, with the purpose of self-improvement with limited control and awareness by the user.

Data Donors: Sharing Knowledge for Mobile Accessibility

Inspired by charitable donations, Data Donors, is a conceptual framework proposing the enablement of users with the capacity to help others to do so by donating their mobile interaction data and knowledge.

André Rodrigues, Kyle Montague, Tiago Guerreiro

CHI 2018 ‑ Late Breaking Work - Extended Abstracts of the ACM Conference on Human Factors in Computing Systems, Montreal, Canada, May, 2018

Two digital puzzles side by side; one is a visual version of the Android logo, the other is a audio puzzle with several pieces already in the right order and some in the incorrect ones

Audio-Based Puzzle Gaming for Blind People

We present audio puzzle games, an interactive way of playing with music by rebuilding a song, just like the original image jigsaw puzzle, broken into pieces which are by turn randomly shuffled. The audio mode design followed a participatory approach starting from a version similar to the visual one, but around music instead of images. We report on an evaluation with 13 blind people using the proposed game application with three different songs randomly distributed.

Jaime Carvalho, Luís Duarte, Tiago Guerreiro, Luís Carriço

MOBACC 2012 ‑ Mobile Accessibility Workshop at MobileHCI 2012

Games
An animated gif capturing the gameplay. Its overall look consists of pixel art and vibrant colors. At first, it shows the inside of a shop with a cartoony adult koala at the counter. Then, the player enters a dungeon and starts controlling a little koala with a bow. It enters a door to a new room and an enemy approaches.

Koala Boutique

Your shop in the Koala Kingdom is at the brink of bankruptcy, cooperate with your partner to save its future! As the Adventurer, you will explore the dungeons, collecting items and materials. As the Trader, you will manage the loot the Adventurer brings, selling and processing it to unlock more and more content! You will need to work as a team in order to maximize your profit and unlock new powers and abilities.

Date: 2020
Platform: Windows (Adventurer role), Android (Trader role)
Devices: Keyboard, Mouse (no key remapping options), Touchscreen
Language: English, Portuguese
Players: Online two-player only
Accessibility: The Adventurer role implies a challenge depending on dexterity and reflex, where various enemies have to be dodged and defeated to progress. The Trader role implies a challenge with no time restrictions, where the player have to manage various menus (playing on the smartphone) to utilize and craft resources. The game does not include accessibility options.

A screenshot showing goalkeeper gloves in front of a soccer field. The user interface shows buttons to start and learn the game.

Goalkeeper

In this game you are your team's goalkeeper and they are counting on you! They will shoot for you and you have to defend as many shots as possible. Can you do it? To defend, you'll have to do it with Talkback's more advanced gestures.

Date: 2021
Platform: Android
Devices: Touchscreen
Language: Portuguese
Players: Single-player
Accessibility: The gameplay presents an auditory challenge where the player has to perform a gesture to respond to audio feedback.

A screenshot showing a couple of spaceships and meteor viewed from above. The user interface shows time left, points, and lives.

Space Shooter

In this game you are in command of your spaceship and the enemies come against you at any time. You have to listen carefully and sweep to the side in time. Let's see how long you can take it.

Date: 2021
Platform: Android
Devices: Touchscreen
Language: Portuguese
Players: Single-player
Accessibility: The gameplay presents an auditory challenge where the player has to perform a gesture to respond to audio feedback.

A screenshot showing an illustration of a landscape with mountains, trees, and clouds. There is message saying Game Over.

Jumping Rope

Jump the rope using the double tap. The double tap is the gesture used by Talkback to select options. In this game you will be able to practice the gesture while having fun trying to 'beat' your high score.

Date: 2021
Platform: Android
Devices: Touchscreen
Language: Portuguese
Players: Single-player
Accessibility: The gameplay presents an auditory challenge where the player has to perform a gesture to respond to audio feedback.

An animated gif capturing the gameplay. Its overall look consists of pixel art and vibrant ambience. It shows an airplane viewed from above, on the sky. Particles are emitted from the tail of the plane, indicating it is moving. A strip at the bottom represents the available and selected radio frequency. The airplane suddenly morphs into an helicopter.

Rescue: Mayday

Bring a friend and venture through the skies together! Will you be the hero of the day? Be the brave Pilot and lead the aircraft through the menacing stormy skies. Play as the crafty Engineer and pay close attention to the surroundings.

Date: 2020
Platform: Windows, Mac
Devices: Keyboard, Mouse (no key remapping options)
Language: English
Players: Online two-player only
Accessibility: One role (the Pilot) implies an entirely auditory challenge (blind accessible) and the other (the Engineer) implies a visual challenge. The game was designed as an inclusive game experience for players with mixed visual abilities.

An animated gif capturing the gameplay. Its overall look consists of pixel art and dark ambience. It shows a submarine, seen from the side, which approaches a wall of rocks. A mechanical claw protruding from the submarine's hatch aims towards a colored rock which is actually a mineral. The central area is lit by a spotlight around the submarine and the mineral, and everything outside of that is black.

Rescue: Under Pressure

Bring a friend and explore the bottom of the ocean together! Can you find the lost treasure? Be the brave Pilot and drive the submarine through the frightening underwater caves. Play as the crafty Engineer and man the sonar with care.

Date: 2020
Platform: Windows, Mac
Devices: Keyboard, Mouse (no key remapping options)
Language: English, Portuguese
Players: Online two-player only
Accessibility: One role (the Engineer) implies an entirely auditory challenge (blind accessible) and the other (the Pilot) implies a visual challenge. The game was designed as an inclusive game experience for players with mixed visual abilities.

Contact
Get in touch! Reach out to us at inclusivegamingtech@googlegroups.com.