Inclusive gaming
We frame the act of playing games with others as a way to reinforce social bonds, reduce stigma, enhance social support and inclusion.
Alt desc.
Publications
An overview of the Living Framework for Cooperative Games. Play Structures, with its subcategories: Progression Structure, Goal Structure, Group Formation; Player Context, with its subcategories: Representation Type, Representation Selection, Representation Progress, Representation Relations, Game World, and Player Viewpoint; Forms of Cooperation, with its subcategories: Arrangement, Synchronicity, Communication By Design, and Means of Communication; And Cooperative Design Patterns, with its subcategories: Play Structures and Player Context (part of the first two categories), Dependencies, Action Relations, Asymmetries, Affecting Others and Resource Sharing.

A Living Framework for Understanding Cooperative Games

In this work, we introduce the Living Framework for Cooperative Games (LFCG), a framework derived from a multi-step systematic analysis of 129 cooperative games with contributions of eleven researchers. We describe how LFCG can be used as a tool for analyses and ideation, and as a shared language for describing a game’s design. LFCG is published as a web application to facilitate use and appropriation. It supports the creation, dissemination and aggregation of game reports and specifications; and enables stakeholders to extend and publish custom versions. Lastly, we discuss using a research-driven approach for formalising game structures and the advantages of community contributions for consolidation and reach.

Pedro Pais, David Gonçalves, Daniel Reis, João Godinho, João Morais, Manuel Piçarra, Pedro Trindade, Dmitry Alexandrovsky, Kathrin Gerling, João Guerreiro, André Rodrigues

CHI 2024 ‑ ACM Conference on Human Factors in Computing Systems, May, 2024

The image shows two panels - each of them consists of a screenshot taken from the game, demonstranting one of the mechanics. In both of them, there is a blue penguin on a red floater centered on a white snowy track, facing forward. The trail behind the floater indicates it is moving forward. The left panel shows the timed gate - a gate appears blocking the entire track, with a cobbled floor in that area and a traffic light. The right panel shows the activation of the forced handbrake - red particles appear behind the floater.

The Trick is to Stay Behind?: Defining and Exploring the Design Space of Player Balancing Mechanics

Disparate skill levels or expertise may result in unbalanced multiplayer experiences, where players feel frustrated, unchallenged, or left out. Some games employ player balancing mechanisms, such as matchmaking to group players according to their rank or, in racing games, players who lag behind receiving powerful boosts to catch up. We add to the understanding of player balancing in multiplayer gaming. First with a theoretical model that captures seven high-level design categories. Second, with a study where participant pairs experienced and gave their perspectives on seven different balancing mechanics in a racing game. Our results outline the importance of preserving a sense of merit and agency, while avoiding an obtrusive effect on the gameplay.

David Gonçalves, Daniel Barros, Pedro Pais, João Guerreiro, Tiago Guerreiro, André Rodrigues

CHI 2024 ‑ ACM Conference on Human Factors in Computing Systems, May, 2024

A montage of two screenshots, one from the desktop version and the other from the mobile version. In the desktop version, you can see the player character in a room with 2D top-down visuals and the controls imprinted on the room's floor. In the mobile version, you can see the unlocks tab of the shop, with multiple unlocks appearing and a visualization of the shop on the bottom part of the screen.

Promoting Family Play through Asymmetric Game Design

For families, where abilities, motivations, and availability vary widely, opportunities for intergenerational play are limited. Designing games that cater to these differences remains an open challenge. In this paper, we first identify barriers related with time and expertise. Next, we propose asymmetric game design and asynchronous play to reconcile children's and adults' requirements; and interdependent gameplay mechanics to foster real-world interactions. Following this approach, we designed a testbed game and conducted a mixed-methods remote study with six pairs of adult-child family members. Our results showcase how asymmetric, asynchronous experiences can be leveraged to create novel gaming experiences that meet the requirements of family play. We discuss how interdependent progress can be designed to promote real-world interactions, creating pervasive conversational topics that permeate the family routine.

Pedro Pais, David Gonçalves, Kathrin Gerling, Teresa Romão, Tiago Guerreiro, André Rodrigues

CSCW 2024 ‑ ACM Conference on Computer-Supported Cooperative Work and Social Computing, October, 2024

A diagram built around an horizontal line that represents the spectrum of definitions for social gaming identified in the work. The definitions are: Social as non-solitary, Social in the game's intent, Social in the interactions, Social in the outcomes, and Social inherent to gaming.

Social gaming: A systematic review

This work contributes with a systematized view of social aspects that permeate gaming experiences, while outlining directions and implications for future work. It presents a systematic review, covering 263 publications, with a particular focus on previous definitions and approaches, determinants that shape the experience, methodologies, and measurable outcomes.

David Gonçalves, Pedro Pais, Kathrin Gerling, Tiago Guerreiro, André Rodrigues

CHB 2023 ‑ Computers in Human Behavior, July, 2023

{publication.award}
screenshot taken from the video game 'The Legend of Zelda: Majora's Mask'. The image shows the playable character, Link, swinging his sword besides a big pot in a swamp-like scenario. The player’s webcam is seen in the corner of the image, but their face is pixelated (anonymized).

“My Zelda Cane”: Strategies Used by Blind Players to Play Visual-Centric Digital Games

In this work, we analyze over 70 hours of YouTube videos, where blind content-creators play visual-centric games. We point out the various strategies employed by players to overcome barriers that permeate mainstream games. We reflect on ways to enable and improve blind players’ experience with these games, shedding light on the positive and negative consequences of apparently benign design choices. Our observations underline how game elements are appropriated for accessibility, the incidental consequences of audio design, and the trade-offs between accessibility, agency, and engagement.

David Gonçalves, Manuel Piçarra, Pedro Pais, João Guerreiro, André Rodrigues

CHI 2023 ‑ ACM Conference on Human Factors in Computing Systems, April, 2023

Best Paper Award

Three of the different accessibility features available during the user study of the Virtual Environment. The first navigational task demonstrates that the avatar has to reach an objective, a cube. On the fourth task, players have to overcome the fence that is blocking their path, with two torches identifying the objective's directions and the length of the door to the next room. And on the sixth task, they can request directions to the objective, which can be done visually by following an orange line.

Evaluating Accessible Navigation for Blind People in Virtual Environments

We explore a set of techniques that augment or are even embedded in the game design to facilitate navigation and spatial awareness of virtual environments. We conducted a user study where seven blind participants faced a number of navigational tasks in a virtual environment with these techniques and shared their perspectives on the experience. We contribute with an exploration of a catalog of techniques used to facilitate the navigation of virtual spaces and a reflection of their impact on players' experience, highlighting avenues for future work in the field.

Manuel Piçarra, André Rodrigues, João Guerreiro

CHI EA 2023 ‑ Extended Abstracts of the ACM Conference on Human Factors in Computing Systems, April, 2023

Montage of 5 screenshots, in a 3 by 2 grid, that illustrate our 2D virtual environment. The image on the upper left corner depicts a group of 4 avatars having a conversation, followed by an image that shows an interaction between 2 avatars, where the user's avatar is receiving audio notifcations with the name of the passerby. The third image from the top depicts the environment of the 'Teleport' and 'Auto-Walk' scenarios, where the user has access to 4 buttons disposed vertically on the top left, which indicates that there are 4 groups in the environment - Group 1, Group 2, Group 3 and Group 4. Here, the user is accessing group 1, which is shown in a popup screen next to the buttons, having 'Group 1' as a title, followed by the names of the 5 participants of that group, a button to hear a conversation preview, and another button to be automatically transported to that group. In the lower-left corner, there is an image with the total view of the room. It is a large rectangular space, with a small adjacent rectangle on the upper left corner of the room. The room is bordered by walls and trees, and it is composed by 2 groups of 3 avatars, 2 groups of 5 avatars, 2 individual avatars, and the main avatar - controlled by the user. The last image illustrates the user's avatar being guided by another avatar toward a group of 3 participants.

Inclusive Social Virtual Environments: Exploring the Acceptability of Different Navigation and Awareness Techniques

Social virtual environments are becoming more prevalent, replicating and sometimes replacing real-world interactions. Nowadays, such environments are not accessible and end up excluding blind people, due to their strong visual components. In this study, we designed and explored multiple navigation and feedback techniques assessing social acceptability, ease of use, and efficiency. We developed a virtual environment composed of six scenarios to analyze different navigation methods (Free Exploration, Teleport, Auto-Walk, and Co-Pilot) and awareness cues in group conversations (Audio Cues While In-Group Footsteps and In-Group Teleport), and conducted a user study with 8 blind and 8 sighted participants. Our results indicate that participants tend to privilege autonomy and room awareness over efficiency and navigation ease and disapprove of intrusive actions that may jeopardize privacy.

Inês Gonçalves, André Rodrigues, Tiago Guerreiro, João Guerreiro

CHI EA 2023 ‑ Extended Abstracts of the ACM Conference on Human Factors in Computing Systems, April, 2023

Preview of the three games developed in this project.

Using Games to Practice Screen Reader Gestures

We explore the use of games to inconspicuously train gestures. We designed and developed a set of accessible games, enabling users to practice smartphone gestures. We evaluated the games with 8 blind users and conducted remote interviews. Our results show how purposeful accessible games could be important in the process of training and discovering smartphone gestures, as they offer a playful method of learning. This, in turn, increases autonomy and inclusion, as this process becomes easier and more engaging.

Gonçalo Lobo, David Gonçalves, Pedro Pais, Tiago Guerreiro, André Rodrigues

ASSETS 2021 ‑ ACM Conference on Computers and Accessibility

a screenshot of the rescue:under pressure game showing a submarine in a dark sea

Exploring Asymmetric Roles in Mixed-Ability Gaming

We explore ability-based asymmetric roles as a design approach to create engaging and challenging mixed-ability play. Our team designed and developed two collaborative testbed games exploring asymmetric interdependent roles. In a remote study with 13 mixed-visual-ability pairs we assessed how roles affected perceptions of engagement, competence, and autonomy, using a mixed-methods approach. The games provided an engaging and challenging experience, in which differences in visual ability were not limiting. Our results underline how experiences unequal by design can give rise to an equitable joint experience.

David Gonçalves, André Rodrigues, Mike Richardson, Alexandra de Sousa, Michael Proulx, Tiago Guerreiro

CHI 2021 ‑ ACM Conference on Human Factors in Computing Systems, May, 2021

{publication.award}
It shows four colorful bar charts.

Playing With Others: Depicting Multiplayer Gaming Experiences of People With Visual Impairments

We share multiplayer gaming experiences of people with visual impairments collected from interviews with 10 adults and 10 minors, and 140 responses to an online survey. We include the perspectives of 17 sighted people who play with someone who has a visual impairment, collected in a second online survey. Our focus is on group play, particularly on the problems and opportunities that arise from mixed-visual-ability scenarios. These show that people with visual impairments are playing diverse games, but face limitations in playing with others who have different visual abilities.

David Gonçalves, André Rodrigues, Tiago Guerreiro

ASSETS 2020 ‑ ACM Conference on Computers and Accessibility

Best Paper Nominee

We propose a paradigm shift where interactions and contributions by knowledgeable users can assist others beyond what mobile applications and operating systems provide Interaction data collection methods are fragmented and are gathered by each app and operating system individually, with the purpose of self-improvement with limited control and awareness by the user.

Data Donors: Sharing Knowledge for Mobile Accessibility

Inspired by charitable donations, Data Donors, is a conceptual framework proposing the enablement of users with the capacity to help others to do so by donating their mobile interaction data and knowledge.

André Rodrigues, Kyle Montague, Tiago Guerreiro

CHI 2018 ‑ Late Breaking Work - Extended Abstracts of the ACM Conference on Human Factors in Computing Systems, Montreal, Canada, May, 2018

Two digital puzzles side by side; one is a visual version of the Android logo, the other is a audio puzzle with several pieces already in the right order and some in the incorrect ones

Audio-Based Puzzle Gaming for Blind People

We present audio puzzle games, an interactive way of playing with music by rebuilding a song, just like the original image jigsaw puzzle, broken into pieces which are by turn randomly shuffled. The audio mode design followed a participatory approach starting from a version similar to the visual one, but around music instead of images. We report on an evaluation with 13 blind people using the proposed game application with three different songs randomly distributed.

Jaime Carvalho, Luís Duarte, Tiago Guerreiro, Luís Carriço

MOBACC 2012 ‑ Mobile Accessibility Workshop at MobileHCI 2012

Games
An animated gif capturing the gameplay. Two penguins (split-screen) are moving forward and avoiding (for the most part) the obstacles, which include trees, rocks, trunks, and the timed gate. The User Interface shows the health points each player has and their positions along the track.

Sled Racing

Sled Racing is a simple racing game, where each player controls a penguin sitting on a floater going down an ice track. Based on an existing open-source game, this prototype adds options to enable player balancing mechanics (also known as catch-up mechanics) which seek to bring players closer in performance. These mechanics include speed boosts, new obstacles, and other changes to the gameplay.

Date: 2023
Platform: Windows
Devices: Keyboard (no key remapping options)
Language: English
Players: Local two-player only (split-screen)
Accessibility: The gameplay demands quick reflexes and dexterity skills from players, in order to avoid the obstacles at high speed. The game does not include accessibility options.

An animated gif capturing the gameplay. A magical cook travels around the kitchen and several minigames are played: one where players have to find a specific visual element among many, one where they have to align three knobs, and one where they have to follow a visual element horizontally.

Cryptic Kitchen

Compete with a friend in a cooking race! Brew potions, craft staves, master minigames, and complete orders in this high-speed culinary showdown. Who will earn the title of the ultimate culinary speedster?

Date: 2023
Platform: Windows
Devices: Keyboard, Mouse (no key remapping options)
Language: English, Portuguese
Players: Online two-player only
Accessibility: One version implies an entirely auditory challenge (blind accessible) and the other implies a visual challenge. The game was designed as an inclusive game experience for players with mixed visual abilities.

An animated gif capturing the gameplay. Its overall look consists of pixel art and vibrant colors. At first, it shows the inside of a shop with a cartoony adult koala at the counter. Then, the player enters a dungeon and starts controlling a little koala with a bow. It enters a door to a new room and an enemy approaches.

Koala Boutique

Your shop in the Koala Kingdom is at the brink of bankruptcy. Cooperate with your partner to save its future! As the Adventurer, you will explore the dungeons, collecting items and materials. As the Trader, you will manage the loot the Adventurer brings, selling and processing it to unlock more and more content! You will need to work as a team in order to maximize your profit and unlock new powers and abilities.

Date: 2020
Platform: Windows (Adventurer role), Android (Trader role)
Devices: Keyboard, Mouse (no key remapping options), Touchscreen
Language: English, Portuguese
Players: Online two-player only
Accessibility: The Adventurer role implies a challenge depending on dexterity and reflex, where various enemies have to be dodged and defeated to progress. The Trader role implies a challenge with no time restrictions, where the player have to manage various menus (playing on the smartphone) to utilize and craft resources. The game does not include accessibility options.

A screenshot showing goalkeeper gloves in front of a soccer field. The user interface shows buttons to start and learn the game.

Goalkeeper

In this game you are your team's goalkeeper and they are counting on you! They will shoot for you and you have to defend as many shots as possible. Can you do it? To defend, you'll have to do it with Talkback's more advanced gestures.

Date: 2021
Platform: Android
Devices: Touchscreen
Language: Portuguese
Players: Single-player
Accessibility: The gameplay presents an auditory challenge where the player has to perform a gesture to respond to audio feedback.

A screenshot showing a couple of spaceships and meteor viewed from above. The user interface shows time left, points, and lives.

Space Shooter

In this game you are in command of your spaceship and the enemies come against you at any time. You have to listen carefully and sweep to the side in time. Let's see how long you can take it.

Date: 2021
Platform: Android
Devices: Touchscreen
Language: Portuguese
Players: Single-player
Accessibility: The gameplay presents an auditory challenge where the player has to perform a gesture to respond to audio feedback.

A screenshot showing an illustration of a landscape with mountains, trees, and clouds. There is message saying Game Over.

Jumping Rope

Jump the rope using the double tap. The double tap is the gesture used by Talkback to select options. In this game you will be able to practice the gesture while having fun trying to 'beat' your high score.

Date: 2021
Platform: Android
Devices: Touchscreen
Language: Portuguese
Players: Single-player
Accessibility: The gameplay presents an auditory challenge where the player has to perform a gesture to respond to audio feedback.

An animated gif capturing the gameplay. Its overall look consists of pixel art and vibrant ambience. It shows an airplane viewed from above, on the sky. Particles are emitted from the tail of the plane, indicating it is moving. A strip at the bottom represents the available and selected radio frequency. The airplane suddenly morphs into an helicopter.

Rescue: Mayday

Bring a friend and venture through the skies together! Will you be the hero of the day? Be the brave Pilot and lead the aircraft through the menacing stormy skies. Play as the crafty Engineer and pay close attention to the surroundings.

Date: 2020
Platform: Windows, Mac
Devices: Keyboard, Mouse (no key remapping options)
Language: English
Players: Online two-player only
Accessibility: One role (the Pilot) implies an entirely auditory challenge (blind accessible) and the other (the Engineer) implies a visual challenge. The game was designed as an inclusive game experience for players with mixed visual abilities.

An animated gif capturing the gameplay. Its overall look consists of pixel art and dark ambience. It shows a submarine, seen from the side, which approaches a wall of rocks. A mechanical claw protruding from the submarine's hatch aims towards a colored rock which is actually a mineral. The central area is lit by a spotlight around the submarine and the mineral, and everything outside of that is black.

Rescue: Under Pressure

Bring a friend and explore the bottom of the ocean together! Can you find the lost treasure? Be the brave Pilot and drive the submarine through the frightening underwater caves. Play as the crafty Engineer and man the sonar with care.

Date: 2020
Platform: Windows, Mac
Devices: Keyboard, Mouse (no key remapping options)
Language: English, Portuguese
Players: Online two-player only
Accessibility: One role (the Engineer) implies an entirely auditory challenge (blind accessible) and the other (the Pilot) implies a visual challenge. The game was designed as an inclusive game experience for players with mixed visual abilities.

Frameworks
A graphic with icons representing the various dimensions covered by the framework.

A Living Framework for Cooperative Games (LFCG)

The Living Framework for Cooperative Games (LFCG) is a framework derived from a multi-step systematic analysis of 129 cooperative games with contributions of eleven researchers. It serves as a tool for analysis and ideation, and as a shared language for describing a game’s design. LFCG is published as a web application to facilitate use and appropriation. It supports the creation, dissemination and aggregation of game reports and specifications; and enables stakeholders to extend and publish custom versions.

Date: 2024
Platform: Published at CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Contact
Get in touch! Reach out to us at inclusivegamingtech@googlegroups.com.