The Automated Testing Roundtables are physically back again at GDC 2023!
Each session focuses on a different discipline, but cut across team sizes, budgets, genres, and platforms. We don't care if you're a iOS-only one-person indie or a console juggernaut, we just want to hear your voice!
In 2023, the roundtables are back in-person for the first time in a few years. Looking forward to seeing you all again!
Resources
Check out some of the talks around GDC 2023 that we recommend, and some of the vault talks we've enjoyed in the past. Henry Golding and friends also maintain a Trello of useful resources:
Automated Testing ResourcesCommunity
If you'd like to keep in touch all year round, why not join our Discord?
Join the Discord!Wednesday 9am, Room 312, South Hall
Beyond the software that we use to test our games are the people that write the tests and the workflows they use to reinforce them. How does the process work in your studio? Are the engineers responsible for automated tests, or QA? Are QA silo'd or integrated? What could be better?
Thursday 5.30pm, Room 312, South Hall
As much as we would like otherwise, automated testing is still a rarity in our industry. Do you have a culture or a codebase that doesn't currently embrace automated testing? Are you having trouble getting people onboard, or maybe it was very easy and you want to share why? Grand failures are just as interesting as successes!
Friday 10am, Room 312, South Hall
Software automation has many faces, from locally-run functional and unit tests, to server-driven continuous integration, and even external device farms. How do you do automated testing in your team? What works well for you? More interestingly, what didn't work and why?
More automated testing talks at GDC 2022
Here's a selection of talks that we think might be interesting to Automated Testing Roundtable attendees. Add them to your schedule now!
If you've spotted any that you think would be interesting to roundtable attendees, let us know in the discord.
Matthew Blair
All Access Pass, Summits Pass, Independent Games Summit Pass
Monday 3pm, Room 2005, West Hall
Automated input replay can be a valuable tool in building some types of tests. This talk explains some practical steps to implement this in Unity.
Ben Hines
All Access Pass, Summits Pass
Monday 4.40pm, Room 3004, West Hall
A deep dive into Sony Santa Monica's testing framework, that can handle Visual Tests, Smoke Tests, SAN / ASAN Tests, Determinism, Gameplay, and Code Integration tests.
Jonas Gillberg
All Access Pass, Summits Pass
Tuesday 4.10pm, Room 2002, West Hall
Follow a simple testing AI for Battlefield V as it evolves into a useful tool for research and testing across EA
Vladimir Katchadourian, Vincent Leclercq
All Access Pass, Core Pass
Wednesday 2pm, Room 215, South Hall
If performance is a pillar of your game, why not track it with the same automated tools you use for testing? In this talk, Ubisoft explains their approach to aggregating and analysing performance data.
Interesting talks to watch right now
Here are some that we've enjoyed in previous years. If you know one that we haven't got listed here, from any year, let us know by dropping by the discord.
Kevin Dill, GDC 2021
Pracical lessons on unit testing AI from frequent AI Summit speaker Kevin Dill. This will be sure to have useful concrete takeaways.
Bram Ridder, GDC 2021
This approach to testing with AI looks to be using more classical AI techniques than the usual machine learning approach. It'll be interesting to see how this compares to ML.
Henry Golding, GDC 2021
Sea of Thieves has been making waves(!) the last few years with its focus on automation and deployment. This talk on how similar approaches were tried at sister studio Mojang is sure to be insightful.
Fabien Gravot, GDC 2021
Gravot will present a testing AI being used to explore FFIV Remake with greatly reduced setup costs compared to regular exploratory QA tests.
David Paris, GDC 2020
Play on the Vault FREE!
How did Playground Games introduce a testing culture to an already-shipped game, and why? What did they learn, and how do they plan to improve?
Yingfeng Chen, Xiao Li, GDC 2020
Play on the Vault FREE!
This session will introduce new ML and AI techniques that have been used in the testing of the Netease MMORPG game - "Justice", which helps to build an intelligent testing system for three typical game testing scenarios: quests regression testing, class balancing testing and dungeons testing.
Jonas Gillberg, GDC 2019
Bots designed specifically to help testing can be incredibly valuable. This talk provides some useful insight on how to develop and manage the workflow of such a system in a large team.
Jose Paredes, Pete Jones, GDC 2019
Bots seem to be a theme of GDC 2019! This is an hour session, compared to the 30min for the Battlefield session listed above, so looks to go into more detail. We'd recommend seeing both if you can!
Robert Masella (@ZipLockBagMan), GDC 2019
See Robert describe how Rare used multiple tiers of tests in unreal engine to have the confidence to ship Sea of Thieves updates every week. Also features the most astounding bug count graph in GDC history.
Adrian Yu, GDC 2019
A talk by veteran roundtabler Adrian Yu on how EA uses Jenkins for continuous integration and deployment - vital tools in the belt of any serious automated tester. His talk is more than just a dive into Jenkins, as he promises to explain how they manage spam and notifications to make them truely useful, rather than noisy.
Michael Vork Larsen, GDC 2019
How RETO MOTO maintain stability in their live service game by involving QA early in an aglie process, including using automated testing. Heros & Generals is a game that's been running for a while, so this promises to have some great insights.
Amy Phillips (@amy_phillips), GDC 2018
Play on the Vault FREE!
How to improve the stability of your game by linking tools together and optimizing the path that bugs take between being introduced and being closed.
Jan van Valburg, GDC 2018
Play on the Vault FREE!
You will learn about the inner workings of Call of Duty's automated building and testing tooling, it's various unique features, and how its ideas might be applied to your own projects.
Nicholas Routhier, GDC 2018
Play on the Vault FREE!
Daily automated testing of world design data is a game changer. Attendees will learn how it helps world builders in their daily tasks, allows for more iteration time, provides data for evidence based decision making and makes for a much smoother debug phase.
Jafar Soltani, GDC 2018
Play on the Vault FREE!
You will learn about the benefits of adopting "continuous delivery" in AAA video games, what challenges you'd face and what practices you can use.
Andrew Fray, GDC 2014
Play on the Vault FREE!
A failure study of Fray's first attempt at unit testing gameplay code, what went wrong, and how you can do better.
Notes from previous years
2021: Process, Legacy, Implementation (Thanks to Sean Sweeny)
If you have any questions or just want to say hi: @tenpn