AUTOMATED TESTING ROUNDTABLES

GDC 2022

The Automated Testing Roundtables are virtually back again at GDC 2022!

Each session focuses on a different discipline, but cut across team sizes, budgets, genres, and platforms. We don't care if you're a iOS-only one-person indie or a console juggernaut, we just want to hear your voice!

In 2022, the roundtables are virtual. That means you can join from anywhere in the world!


Join the Community

Check out some of the talks around GDC 2022 that we recommend, and some of the vault talks we've enjoyed in the past.

If you'd like to keep in touch all year round, why not join our Discord?

Join the Discord!

Process Roundtable

Wednesday, 23rd March, 10.30am PDT

Beyond the software that we use to test our games are the people that write the tests and the workflows they use to reinforce them. How does the process work in your studio? Are the engineers responsible for automated tests, or QA? Are QA silo'd or integrated? What could be better?

Legacy Roundtable

Thursday, 24th March, 4pm PDT

As much as we would like otherwise, automated testing is still a rarity in our industry. Do you have a culture or a codebase that doesn't currently embrace automated testing? Are you having trouble getting people onboard, or maybe it was very easy and you want to share why? Grand failures are just as interesting as successes!

Implementation Roundtable

Friday, 25th March, 10am PDT

Software automation has many faces, from locally-run functional and unit tests, to server-driven continuous integration, and even external device farms. How do you do automated testing in your team? What works well for you? More interestingly, what didn't work and why?


More automated testing talks at GDC 2022

Here's a selection of talks that we think might be interesting to Automated Testing Roundtable attendees. Add them to your schedule now!

If you've spotted any that you think would be interesting to roundtable attendees, let us know in the discord or email andrew@autotestingroundtable.com.

Tools Roundtables Day 1: Workflow

Geoff Evans

All Access Pass, Core Pass

Wednesday, 10:30am PDT, Room 216, South

The Tools Roundtables are always worth attending, with lots of overlap between attendees

Wednesday is "Workflow", focuses on GUI tools programming languages, design patterns, frameworks, usability, user interfaces, and telemetry.

Tools Roundtables Day 2: Assets

Geoff Evans

All Access Pass, Core Pass

Thursday, 2pm PDT, Room 215, South

The Tools Roundtables are always worth attending, with lots of overlap between attendees

Thursday: "Assets" focuses on export, persistence, collaboration, searching and organization, development models (branch vs. trunk), revision control, and handling outsourcing.

Tools Roundtables Day 3: Pipeline

Geoff Evans

All Access Pass, Core Pass

Friday, 11.30am PDT, Room 215, South

The Tools Roundtables are always worth attending, with lots of overlap between attendees

Friday: "Pipeline" focuses on processing assets through to the game in all its forms: build systems, caching, distribution, scalability, optimization, disc mastering and patching.


Interesting talks to watch right now

Here are some that we've enjoyed in previous years. If you know one that we haven't got listed here, from any year, let us know by dropping by the discord, or email andrew@autotestingroundtable.com.

AI Summit: Where The $@*&% Are Your Tests?!

Kevin Dill, GDC 2021

Play on the Vault

Pracical lessons on unit testing AI from frequent AI Summit speaker Kevin Dill. This will be sure to have useful concrete takeaways.

AI Summit: Automated Game Testing Using a Numeric Domain Independent AI Planner

Bram Ridder, GDC 2021

Play on the Vault

This approach to testing with AI looks to be using more classical AI techniques than the usual machine learning approach. It'll be interesting to see how this compares to ML.

Lessons Learned in Adapting the 'Sea of Thieves' Automated Testing Methodology to 'Minecraft'

Henry Golding, GDC 2021

Play on the Vault

Sea of Thieves has been making waves(!) the last few years with its focus on automation and deployment. This talk on how similar approaches were tried at sister studio Mojang is sure to be insightful.

'Final Fantasy VII' Remake: Automating Quality Assurance and the Tools for the Future

Fabien Gravot, GDC 2021

Play on the Vault

Gravot will present a testing AI being used to explore FFIV Remake with greatly reduced setup costs compared to regular exploratory QA tests.

From 0-1000: A Test Driven Approach to Tools Development

David Paris, GDC 2020

Play on the Vault FREE!

How did Playground Games introduce a testing culture to an already-shipped game, and why? What did they learn, and how do they plan to improve?

Building An Intelligent Game Testing System in Netease MMORPG Game

Yingfeng Chen, Xiao Li, GDC 2020

Play on the Vault FREE!

This session will introduce new ML and AI techniques that have been used in the testing of the Netease MMORPG game - "Justice", which helps to build an intelligent testing system for three typical game testing scenarios: quests regression testing, class balancing testing and dungeons testing.

AI for Testing: The Development of Bots that Play 'Battlefield V'

Jonas Gillberg, GDC 2019

Play on the Vault

Bots designed specifically to help testing can be incredibly valuable. This talk provides some useful insight on how to develop and manage the workflow of such a system in a large team.

Automated Testing: Using AI Controlled Players to Test 'The Division'

Jose Paredes, Pete Jones, GDC 2019

Play on the Vault

Bots seem to be a theme of GDC 2019! This is an hour session, compared to the 30min for the Battlefield session listed above, so looks to go into more detail. We'd recommend seeing both if you can!

Automated Testing of Gameplay Features in 'Sea of Thieves'

Robert Masella (@ZipLockBagMan), GDC 2019

Play on the Vault

See Robert describe how Rare used multiple tiers of tests in unreal engine to have the confidence to ship Sea of Thieves updates every week. Also features the most astounding bug count graph in GDC history.

Level Up Your Jenkins Reporting

Adrian Yu, GDC 2019

Play on the Vault

A talk by veteran roundtabler Adrian Yu on how EA uses Jenkins for continuous integration and deployment - vital tools in the belt of any serious automated tester. His talk is more than just a dive into Jenkins, as he promises to explain how they manage spam and notifications to make them truely useful, rather than noisy.

A QA Perspective on Live Game Production

Michael Vork Larsen, GDC 2019

Play on the Vault

How RETO MOTO maintain stability in their live service game by involving QA early in an aglie process, including using automated testing. Heros & Generals is a game that's been running for a while, so this promises to have some great insights.

Tools to Reduce Open Bug Count at Media Molecule

Amy Phillips (@amy_phillips), GDC 2018

Play on the Vault FREE!

How to improve the stability of your game by linking tools together and optimizing the path that bugs take between being introduced and being closed.

Automated Testing and Profiling for Call of Duty

Jan van Valburg, GDC 2018

Play on the Vault FREE!

You will learn about the inner workings of Call of Duty's automated building and testing tooling, it's various unique features, and how its ideas might be applied to your own projects.

Assassin's Creed Origins: Monitoring and Validation of World Design Data

Nicholas Routhier, GDC 2018

Play on the Vault FREE!

Daily automated testing of world design data is a game changer. Attendees will learn how it helps world builders in their daily tasks, allows for more iteration time, provides data for evidence based decision making and makes for a much smoother debug phase.

Adopting Continuous Delivery At Rare

Jafar Soltani, GDC 2018

Play on the Vault FREE!

You will learn about the benefits of adopting "continuous delivery" in AAA video games, what challenges you'd face and what practices you can use.

Practical Unit Tests

Andrew Fray, GDC 2014

Play on the Vault FREE!

A failure study of Fray's first attempt at unit testing gameplay code, what went wrong, and how you can do better.

Notes from previous years

Notes from Process, 2018

Notes from Legacy, 2018

2021: Process, Legacy, Implementation (Thanks to Sean Sweeny)


If you have any questions or just want to say hi: andrew@autotestingroundtable.com, @tenpn