Pass the Controller? Communities, Data, and AI in Game Development | GameDev Day 2026
Read full transcript 38 segments
-
Let's start our day on a Let's start our day on a light note before light note before light note before moving on to moving on to moving on to serious discussions serious discussions . We want . We want . We want to talk about to talk about to talk about communities, data, and AI communities, data, and AI communities, data, and AI in game development. Our in game development. Our in game development. Our panel today panel today panel today is called "Pass is called "Pass is called "Pass the Gamepad." For this the Gamepad." For this the Gamepad." For this panel, I've assembled a panel, I've assembled a panel, I've assembled a great team of people great team of people great team of people from all over the world with from all over the world with from all over the world with diverse diverse diverse backgrounds in backgrounds in backgrounds in game development, tools, and game development, tools, and community management. So, community management. So, today we'll today we'll today we'll discuss what players discuss what players discuss what players can tell can tell can tell us about games and what us about games and what us about games and what they want. How data they want. How data they want. How data shows us their shows us their shows us their desires and how AI desires and how AI desires and how AI is used to is used to is used to create content. create content. But sometimes these But sometimes these inputs can inputs can inputs can contradict each contradict each contradict each other. So we'll other. So we'll other. So we'll talk about how talk about how talk about how developers decide developers decide who to listen to and when to who to listen to and when to who to listen to and when to give up. give up. We also want We also want to discuss how we to discuss how we to discuss how we collectively learn collectively learn collectively learn from these decisions.
-
from these decisions. Finally, we Finally, we will discuss how AI will discuss how AI will discuss how AI can support can support can support people, especially people, especially people, especially those new to the industry, those new to the industry, those new to the industry, in learning the basics without in learning the basics without in learning the basics without doing all the hard doing all the hard doing all the hard work for them. So I would like to work for them. So I would like to work for them. So I would like to introduce introduce introduce today's today's today's panelists. panelists. Anton from Anton from Berlin was the first to join us. Anton, Berlin was the first to join us. Anton, Berlin was the first to join us. Anton, hello. Hi, Anton hello. Hi, Anton hello. Hi, Anton from a company from a company from a company called The Southern Forest. called The Southern Forest. He is the founder of He is the founder of this company. This is an this company. This is an this company. This is an indie studio in Berlin indie studio in Berlin that is creating The Tide Line, a that is creating The Tide Line, a that is creating The Tide Line, a narrative narrative narrative adventure game. adventure game. adventure game. Previously, Anton Previously, Anton Previously, Anton worked in worked in worked in mobile game development mobile game development mobile game development at King and Wooga. He also at King and Wooga. He also at King and Wooga. He also supports studios and supports studios and supports studios and projects as a projects as a projects as a game designer and game designer and game designer and development expert. development expert. Gennady is also with us today. Hello, Gennady Gennady is also with us today. Hello, Gennady . . . Greetings. Greetings. Greetings. He is the He is the He is the CEO and CEO and CEO and co-founder of General co-founder of General co-founder of General Arcade, as well as the Arcade, as well as the Arcade, as well as the co-founder of Beware of co-founder of Beware of co-founder of Beware of Bytes. His studio Bytes. His studio Bytes. His studio specializes in specializes in specializes in game ports, game ports, game ports, remasters, and remasters, and remasters, and collaborative development collaborative development collaborative development for PC, consoles, and for PC, consoles, and for PC, consoles, and mobile devices.
-
mobile devices. Jason is also with us today. Greetings. Greetings. Thank you. Thank you for Thank you. Thank you for Thank you. Thank you for joining. We joining. We joining. We appreciate you appreciate you appreciate you joining us at joining us at joining us at this hour. He is a this hour. He is a this hour. He is a game developer and game developer and game developer and teacher who teacher who teacher who shares his shares his shares his experiences on YouTube. His experiences on YouTube. His experiences on YouTube. His experience spans MMO experience spans MMO games, mobile games, games, mobile games, games, mobile games, and VR. And last but and VR. And last but and VR. And last but not least— not least— Anthony from Discord. Anthony is a Anthony from Discord. Anthony is a senior developer advocate at senior developer advocate at senior developer advocate at Discord and the creator of over 40 Discord and the creator of over 40 Discord and the creator of over 40 indie games indie games indie games focused on focused on focused on local local local multiplayer and multiplayer and multiplayer and exploration. His exploration. His exploration. His work also encompasses work also encompasses work also encompasses installation games, installation games, installation games, art, and art, and live visual performances. live visual performances. Thank you for joining Thank you for joining , friends. Well, let's , friends. Well, let's , friends. Well, let's get started. Because get started. Because get started. Because each of you, I each of you, I each of you, I think, has practical think, has practical think, has practical experience in experience in experience in game development and, I assume, you've game development and, I assume, you've game development and, I assume, you've worked with worked with worked with communities. My communities. My communities. My first question is first question is first question is just to get just to get just to get the conversation started. Can you the conversation started. Can you the conversation started. Can you think of a time when think of a time when think of a time when your community your community your community understood something about understood something about understood something about your game or product your game or product your game or product better than you did?
-
better than you did? Maybe I'll give the Maybe I'll give the floor to Anton to floor to Anton to floor to Anton to start first. start first. Yes, thank you for this Yes, thank you for this question. In fact, question. In fact, question. In fact, with the game we're with the game we're with the game we're working on right now, Tailwind, working on right now, Tailwind, working on right now, Tailwind, we're not at the stage of we're not at the stage of creating a Discord creating a Discord community yet, but it will be community yet, but it will be community yet, but it will be very soon. But I've very soon. But I've very soon. But I've worked on other worked on other worked on other projects before where projects before where projects before where we were we were we were supporting "live" supporting "live" supporting "live" services, had Discord services, had Discord communities, and could communities, and could communities, and could communicate with communicate with communicate with people directly. people directly. people directly. I also had situations I also had situations I also had situations with certain clients, with certain clients, with certain clients, for example, a for example, a mobile game creation platform that mobile game creation platform that we were developing, and there we were developing, and there we were developing, and there we encountered this we encountered this we encountered this constantly. constantly. constantly. Honestly, answering Honestly, answering Honestly, answering your question, your question, your question, about a situation where the about a situation where the about a situation where the community understood community understood community understood something better than us. I something better than us. I something better than us. I mean, we mean, we mean, we learned from the players. We learned from the players. We learned from the players. We always look at what always look at what always look at what they do, how they they do, how they they do, how they behave, what kind of behave, what kind of behave, what kind of feedback they have, etc. It's feedback they have, etc. It's feedback they have, etc. It's simply invaluable simply invaluable simply invaluable when you get this kind of when you get this kind of when you get this kind of feedback, and as a designer feedback, and as a designer feedback, and as a designer you have assumptions that you have assumptions that you have assumptions that you want to test and you want to test and you want to test and make into reality.
-
make into reality. But then you show But then you show it to the community, it to the community, it to the community, get feedback, and get feedback, and get feedback, and always learn always learn always learn something new. You can be something new. You can be something new. You can be the best designer the best designer , but without , but without , but without player feedback it just doesn't player feedback it just doesn't player feedback it just doesn't work. work. And, uh, thank you. Yes, I think having Yes, I think having player feedback is player feedback is player feedback is incredibly important, incredibly important, incredibly important, so finding a way so finding a way so finding a way to get it is always to get it is always to get it is always very valuable. So very valuable. So very valuable. So building a community building a community building a community early on, early on, early on, getting players to getting players to getting players to test and test and test and play your game—that's play your game—that's play your game—that's crucial to the crucial to the crucial to the entire entire entire development experience. So yes, development experience. So yes, development experience. So yes, finding a way finding a way finding a way to get that feedback to get that feedback is very, very important. is very, very important. It's interesting to hear from It's interesting to hear from you specifically about you specifically about you specifically about working with Discord. Do working with Discord. Do working with Discord. Do you think this you think this you think this community server is community server is community server is an extension of the an extension of the an extension of the gaming experience? And gaming experience? And gaming experience? And what does it give to players?
-
what does it give to players? Maybe there are more Maybe there are more reasons to spend time reasons to spend time reasons to spend time besides announcements and besides announcements and besides announcements and getting feedback? getting feedback? Yes, in my opinion, Yes, in my opinion, the community is becoming an the community is becoming an the community is becoming an important part of not important part of not important part of not only the gaming only the gaming only the gaming experience, but also a experience, but also a experience, but also a tool for tool for tool for developers. Not developers. Not developers. Not only for only for only for feedback, feedback, feedback, but also as a direct but also as a direct but also as a direct communication channel to communication channel to communication channel to talk about talk about talk about the future and engage the future and engage the future and engage the audience with the the audience with the the audience with the prospect. You know, prospect. You know, prospect. You know, a lot of games can, a lot of games can, a lot of games can, let's say, be let's say, be let's say, be released and their released and their released and their communities will communities will communities will exist elsewhere, on exist elsewhere, on exist elsewhere, on Reddit or somewhere else; but Reddit or somewhere else; but Reddit or somewhere else; but if you're building your if you're building your if you're building your own community, own community, own community, for example, I mean for example, I mean for example, I mean , I'll say Discord, , I'll say Discord, , I'll say Discord, but actually, if but actually, if but actually, if you're building that kind of you're building that kind of you're building that kind of community somewhere else, it's a community somewhere else, it's a community somewhere else, it's a very important very important very important tool for you as a tool for you as a tool for you as a developer to, well, developer to, well, developer to, well, engage your engage your engage your community. And that, community. And that, community. And that, of course, is great for the of course, is great for the of course, is great for the gaming experience. I've gaming experience. I've gaming experience. I've seen developers seen developers seen developers do really do really do really cool things, cool things, like porting ARGs or like porting ARGs or just game add-ons just game add-ons just game add-ons to their to their to their Discord server. They design Discord server. They design Discord server. They design their server in the style of their server in the style of their server in the style of their game. So it their game. So it their game. So it turns out a really turns out a really turns out a really cool two-way cool two-way cool two-way interaction of the community interaction of the community interaction of the community with your game.
-
with your game. So, let's get back to So, let's get back to Anton. Yes, Jason, Anton. Yes, Jason, Anton. Yes, Jason, I also have a I also have a I also have a question for you on question for you on question for you on this topic. I'll just this topic. I'll just this topic. I'll just quickly go back to quickly go back to quickly go back to Anton: you have Anton: you have Anton: you have experience working in a experience working in a data-driven environment like King and Wooga. Yes. What data-driven development habits might you have retained while might you have retained while working with the working with the working with the community? community? Yes. I think the Yes. I think the most interesting thing was to most interesting thing was to most interesting thing was to really create a really create a really create a mix of quantitative mix of quantitative mix of quantitative and qualitative data. When the and qualitative data. When the and qualitative data. When the quantitative part quantitative part is, of course, is, of course, is, of course, tracking events in tracking events in tracking events in your games so you your games so you your games so you can really can really can really understand what's understand what's understand what's going on in the game, and going on in the game, and going on in the game, and then you combine that then you combine that then you combine that with communicating with with communicating with with communicating with players; or, I players; or, I players; or, I mean, back then, Wooga had mean, back then, Wooga had mean, back then, Wooga had a lot a lot a lot going on on Facebook, going on on Facebook, going on on Facebook, where you could write where you could write where you could write in Facebook communities and in Facebook communities and in Facebook communities and ask questions, or ask questions, or ask questions, or even even even join some join some join some communities yourself as a player.
-
communities yourself as a player. We did it too. We We did it too. We had direct phone had direct phone had direct phone conversations with the players. conversations with the players. They were asked, "Hey, would They were asked, "Hey, would you be comfortable you be comfortable you be comfortable if we asked you if we asked you if we asked you a few questions during the a few questions during the a few questions during the call?" And then call?" And then call?" And then they talked about their they talked about their they talked about their cats, their children, the pies cats, their children, the pies cats, their children, the pies they bake, and so on. they bake, and so on. Understanding the wider Understanding the wider ecosystem around the ecosystem around the ecosystem around the player we are player we are player we are developing the game for developing the game for developing the game for really really really helped a lot, and I helped a lot, and I helped a lot, and I took that very close to took that very close to took that very close to heart and learned from that heart and learned from that heart and learned from that experience. Now, experience. Now, experience. Now, working in the indie working in the indie space on a 3D action space on a 3D action adventure, you might adventure, you might adventure, you might think, “Oh, we don’t think, “Oh, we don’t think, “Oh, we don’t need all this need all this need all this analytics.” That's all analytics.” That's all analytics.” That's all for the mobile world, for the mobile world, for the mobile world, but it's not really but it's not really but it's not really . I would still be . I would still be . I would still be very interested in very interested in very interested in seeing how people seeing how people seeing how people progress through the progress through the progress through the game. For example, what game. For example, what game. For example, what actions in the game do players actions in the game do players actions in the game do players perform most often, perform most often, perform most often, etc. To back up etc. To back up etc. To back up our observations our observations our observations and communication with and communication with and communication with communities with communities with communities with real data.
-
real data. It's a good thing you It's a good thing you mentioned cats, because it mentioned cats, because it mentioned cats, because it seems like every seems like every seems like every Discord server Discord server Discord server I've joined has a I've joined has a I've joined has a "share "share "share your pets" channel your pets" channel your pets" channel or something like that where or something like that where or something like that where everyone shares photos of everyone shares photos of everyone shares photos of dogs and cats. Thank you. dogs and cats. Thank you. dogs and cats. Thank you. Jason, it seems like Jason, it seems like Jason, it seems like you've had a very interesting you've had a very interesting you've had a very interesting experience with games and experience with games and experience with games and animals, maybe animals, maybe animals, maybe you can share something? you can share something? Um, yeah, I think, Um, yeah, I think, based on what based on what based on what Anton said, I... Anton said, I... sorry, I'm losing my train of sorry, I'm losing my train of sorry, I'm losing my train of thought. Hmm, it's thought. Hmm, it's thought. Hmm, it's too early. But I too early. But I too early. But I was thinking that in was thinking that in was thinking that in my experience, my experience, my experience, player feedback is player feedback is player feedback is extremely extremely extremely helpful depending helpful depending helpful depending on how on how on how involved the developers are involved the developers are involved the developers are in the game. In projects that in the game. In projects that in the game. In projects that are a great passion are a great passion are a great passion for developers, they for developers, they for developers, they know exactly what they know exactly what they know exactly what they want and what the want and what the want and what the game should be like. Um, external game should be like. Um, external game should be like. Um, external feedback is often just feedback is often just feedback is often just noise, and it's hard noise, and it's hard noise, and it's hard to filter out what is to filter out what is to filter out what is truly valuable, truly valuable, truly valuable, useful, and true, useful, and true, useful, and true, and this is where and this is where and this is where Anton's arguments about data Anton's arguments about data Anton's arguments about data make sense and are very make sense and are very make sense and are very helpful. Studying helpful. Studying helpful. Studying the data instead of the data instead of the data instead of listening only to listening only to listening only to the most active the most active the most active players, whose opinions are players, whose opinions are players, whose opinions are usually usually usually promoted by the promoted by the promoted by the loudest loudest loudest users on Discord users on Discord users on Discord or in the forums, often or in the forums, often or in the forums, often leads to the leads to the leads to the implementation of bad implementation of bad implementation of bad ideas. So working with the
-
ideas. So working with the ideas. So working with the data was very data was very data was very useful; However, there are useful; However, there are useful; However, there are interesting scenarios where interesting scenarios where interesting scenarios where developers don't developers don't developers don't necessarily necessarily necessarily play their own game much, and play their own game much, and play their own game much, and in such cases, in such cases, in such cases, user feedback user feedback user feedback and direct communication and direct communication and direct communication with them to understand with them to understand with them to understand what they like and do what they like and do what they like and do n't like is very n't like is very n't like is very important. I had a important. I had a important. I had a case where I case where I case where I was working on a children's was working on a children's was working on a children's game, and you know, a children's game, and you know, a children's game, and you know, a children's game is a children's game. game is a children's game. If a game is made for an If a game is made for an 8-year-old, that's 8-year-old, that's 8-year-old, that's cool, but I'm not going to cool, but I'm not going to cool, but I'm not going to get hooked on it or get hooked on it or get hooked on it or sit and sit and sit and play it all the time. play it all the time. So during my work, I So during my work, I talked a lot with talked a lot with talked a lot with younger schoolchildren younger schoolchildren younger schoolchildren who played this game every day who played this game every day who played this game every day , finding out what , finding out what , finding out what they liked, what they liked, what they liked, what they found they found they found fun, and fun, and fun, and focusing on focusing on focusing on those things. This those things. This those things. This worked really worked really worked really well, but again well, but again well, but again , you should be , you should be , you should be careful just careful just careful just listening to random listening to random listening to random people on forums or people on forums or people on forums or Discord. So, listen to Discord. So, listen to Discord. So, listen to Anton and look at the Anton and look at the Anton and look at the data. data. I absolutely agree I absolutely agree that knowing your that knowing your that knowing your audience through audience through audience through direct communication is direct communication is direct communication is very important, much more very important, much more very important, much more important than important than important than studying general studying general studying general community feedback community feedback community feedback or forums. And I think, or forums. And I think, or forums. And I think, as an as an as an indie game developer in the past, indie game developer in the past, indie game developer in the past, I also learned from those I also learned from those I also learned from those mistakes. I also learned mistakes. I also learned mistakes. I also learned these lessons by making these lessons by making these lessons by making mistakes, but really mistakes, but really mistakes, but really good observations. Uh, good observations. Uh, I was a little bit sneaky I was a little bit sneaky when I did it because my when I did it because my when I did it because my kids are always around, kids are always around, kids are always around, so I just
-
so I just so I just keep asking them, keep asking them, keep asking them, and then I have them and then I have them and then I have them keep asking their keep asking their keep asking their friends. This friends. This friends. This works great if you have a works great if you have a works great if you have a good test group. good test group. So, where do you find that kind of So, where do you find that kind of audience for audience for audience for good questions, right good questions, right ? To get ? To get ? To get feedback and to feedback and to feedback and to create the create the create the right product right product . So, you are lucky to have . So, you are lucky to have . So, you are lucky to have this this this access. So the rest of us access. So the rest of us access. So the rest of us have to look for have to look for have to look for people of the right people of the right people of the right age group and range of age group and range of age group and range of interests. So yeah, interests. So yeah, interests. So yeah, good points. good points. good points. We need to have more We need to have more We need to have more children in all groups, children in all groups, children in all groups, right? And then everything right? And then everything right? And then everything will be fine. will be fine. Oh, thank you. Gennady, Oh, thank you. Gennady, I'm curious I'm curious I'm curious to know if there's to know if there's to know if there's ever been any ever been any ever been any community feedback on community feedback on community feedback on projects when you projects when you projects when you work as a co-development partner work as a co-development partner ? Does this in ? Does this in any way change the work any way change the work any way change the work you prioritize you prioritize you prioritize as a studio as a studio as a studio for the project? Do for the project? Do for the project? Do you look at you look at you look at community feedback and community feedback and community feedback and work with it as a work with it as a work with it as a partner or as a partner or as a partner or as a port developer, or is port developer, or is port developer, or is that not really relevant to you that not really relevant to you that not really relevant to you ?
-
? Oh, of course, we always Oh, of course, we always keep an eye on the keep an eye on the keep an eye on the community of the games community of the games community of the games we work on. This is we work on. This is we work on. This is interesting and, of course, can interesting and, of course, can interesting and, of course, can affect our affect our affect our work. This may work. This may work. This may change the scope of work change the scope of work change the scope of work or priorities, or priorities, or priorities, as we as we as we have to discuss it with have to discuss it with have to discuss it with the client first, but I the client first, but I the client first, but I remember a case with remember a case with remember a case with Project Zomboid where we Project Zomboid where we Project Zomboid where we provided technical provided technical provided technical support. I was support. I was support. I was browsing Discord and the browsing Discord and the browsing Discord and the forums and discovered that forums and discovered that forums and discovered that one of the players one of the players one of the players decided to create his decided to create his decided to create his own map for the game. own map for the game. The question was The question was why, because he played the why, because he played the why, because he played the game so much that he game so much that he game so much that he lost the excitement of lost the excitement of lost the excitement of exploring new exploring new exploring new places, you know? And it places, you know? And it places, you know? And it was simply because was simply because was simply because you know the game well, you know the game well, you know the game well, but you don't always but you don't always but you don't always understand what exactly is understand what exactly is understand what exactly is valuable to the player. valuable to the player. So it changed the So it changed the approach a little bit, like, approach a little bit, like, approach a little bit, like, let's not add let's not add let's not add more activities more activities more activities to the current map.
-
to the current map. to the current map. Maybe we should Maybe we should Maybe we should expand the map and expand the map and expand the map and create more zones create more zones create more zones so players so players so players can experience that thrill can experience that thrill can experience that thrill of discovery again. of discovery again. That's actually a valid That's actually a valid point, and I think point, and I think point, and I think it's a good follow-up it's a good follow-up it's a good follow-up question for everyone: question for everyone: question for everyone: "Do you have some kind of "Do you have some kind of "Do you have some kind of process for process for process for distinguishing between feedback distinguishing between feedback distinguishing between feedback that actually that actually that actually improves the game and feedback improves the game and feedback improves the game and feedback that turns it into a that turns it into a that turns it into a completely different game?" completely different game?" Maybe I'll start. Maybe I'll start. Yes. Yes. Um, often feedback Um, often feedback comes with a comes with a comes with a suggestion on how suggestion on how suggestion on how to fix the problem, to fix the problem, to fix the problem, if there is one. And it's very if there is one. And it's very if there is one. And it's very important to distinguish between important to distinguish between important to distinguish between these two things, isn't it? these two things, isn't it? these two things, isn't it? For example, a player For example, a player For example, a player might say, "Oh, might say, "Oh, might say, "Oh, you know, this boss is you know, this boss is you know, this boss is too difficult. too difficult. too difficult. Let's Let's Let's remove him." But you remove him." But you remove him." But you really need to really need to really need to look deeper: look deeper: look deeper: maybe the game just has maybe the game just has maybe the game just has bad controls. Or bad controls. Or maybe there aren't enough save points before the boss maybe there aren't enough save points before the boss . Or when the . Or when the boss beats you, you don't boss beats you, you don't boss beats you, you don't get enough get enough get enough feedback, feedback, feedback, well, visual well, visual well, visual feedback. So this is feedback. So this is feedback. So this is really important. Um, really important. Um, really important. Um, so when you so when you so when you get feedback like that get feedback like that get feedback like that , you have to , you have to , you have to explain the purpose of a explain the purpose of a explain the purpose of a specific part, specific part, specific part, right? And not its right? And not its right? And not its implementation, right?
-
implementation, right? implementation, right? Just explain: Just explain: Just explain: you know, this is why we did it you know, this is why we did it you know, this is why we did it . Um, but we . Um, but we . Um, but we can change how can change how can change how it leads to this it leads to this it leads to this thing. thing. Thank you. Um, and perhaps Thank you. Um, and perhaps a question that is also a question that is also a question that is also very relevant to very relevant to very relevant to everyone in this room: when everyone in this room: when everyone in this room: when enthusiastic players enthusiastic players enthusiastic players become moderators, become moderators, become moderators, bug reporters, and the bug reporters, and the bug reporters, and the community of your game, do community of your game, do community of your game, do you, as a you, as a you, as a studio, feel like you studio, feel like you studio, feel like you owe them something in owe them something in owe them something in return? And if so, return? And if so, return? And if so, what could it be what could it be what could it be and how best and how best and how best to implement it? to implement it? This is a difficult question. This is a difficult question. I think everywhere I've I think everywhere I've I think everywhere I've worked, we've generally worked, we've generally worked, we've generally felt that way. felt that way. felt that way. We have to give them something, We have to give them something, We have to give them something, but we tried but we tried but we tried to give something that had no to give something that had no to give something that had no monetary value monetary value monetary value so that it wouldn't become a so that it wouldn't become a so that it wouldn't become a weird legal weird legal weird legal issue. Usually issue. Usually issue. Usually it was something it was something it was something like a special like a special like a special badge next to their badge next to their badge next to their name, even if it was name, even if it was name, even if it was just on the forums, just on the forums, just on the forums, or early access to or early access to or early access to content, sometimes content, sometimes special items special items special items or free or free or free access to things in access to things in access to things in very rare very rare very rare cases. I worked cases. I worked cases. I worked on a lot of them, on a lot of them, on a lot of them, so sometimes we would so sometimes we would so sometimes we would create a create a create a special item for someone special item for someone special item for someone because they were because they were because they were really useful or really useful or really useful or something. This didn't something. This didn't something. This didn't require much require much require much effort, but it sometimes effort, but it sometimes effort, but it sometimes caused conflicts caused conflicts . So it's always . So it's always . So it's always nice and interesting nice and interesting nice and interesting to do, but sometimes you have to to do, but sometimes you have to deal with legal deal with legal issues. But I would
-
issues. But I would issues. But I would definitely recommend doing it definitely recommend doing it . Be kind and . Be kind and . Be kind and reward them for their reward them for their reward them for their help. help. What was, you know, What was, you know, the most interesting the most interesting the most interesting reward you reward you reward you gave to players? And for gave to players? And for gave to players? And for what project, what project, what project, perhaps for the perhaps for the perhaps for the context? context? context? I think it was at Vanguard, I think it was at Vanguard, I think it was at Vanguard, where we had a lot of where we had a lot of where we had a lot of freedom to do pretty much anything freedom to do pretty much anything freedom to do pretty much anything we wanted. So we wanted. So we wanted. So we created some we created some we created some special items special items special items for people and all that. for people and all that. for people and all that. I think they're probably the I think they're probably the I think they're probably the coolest; Having a coolest; Having a coolest; Having a unique item unique item unique item with your name on it in an MMO is with your name on it in an MMO is with your name on it in an MMO is pretty cool. pretty cool. Yes. I think I saw Yes. I think I saw something similar while something similar while something similar while working on June's Journey. working on June's Journey. There were, let's say, VIP players, like a VIP players, like a VIP club, and really club, and really club, and really rewarding them rewarding them rewarding them by highlighting them as by highlighting them as by highlighting them as special members of special members of special members of our community is very our community is very our community is very useful. And on the useful. And on the game creation platform, we actually game creation platform, we actually made sure that made sure that made sure that a lot of the features that a lot of the features that a lot of the features that were suggested by active were suggested by active were suggested by active players who were giving players who were giving players who were giving a lot of feedback a lot of feedback a lot of feedback actually made it into the actually made it into the actually made it into the product, so product, so product, so the reward itself was that the reward itself was that the reward itself was that they they they got the things they got the things they got the things they asked for, and we asked for, and we asked for, and we made sure that it made sure that it made sure that it worked with the rest of it and worked with the rest of it and worked with the rest of it and helped them helped them helped them make the games that make the games that make the games that they wanted to make.
-
they wanted to make. I've noticed that players I've noticed that players really like both the really like both the really like both the visuals and everything visuals and everything visuals and everything you both are talking about. you both are talking about. One way One way to show gratitude, and to show gratitude, and to show gratitude, and some things that I've some things that I've some things that I've seen work really seen work really seen work really well, is when well, is when well, is when players provide players provide players provide feedback or feedback or feedback or report report report bugs. Mention them bugs. Mention them bugs. Mention them in your changelogs in your changelogs . Maybe even . Maybe even . Maybe even give them special give them special give them special roles, especially if roles, especially if roles, especially if they they they show up often and you show up often and you show up often and you implement a lot of implement a lot of implement a lot of their feedback, or their feedback, or their feedback, or they're very helpful, they're very helpful, they're very helpful, or are generally or are generally or are generally good members of good members of good members of your community; your community; your community; giving them a special giving them a special giving them a special role or some role or some role or some visual element visual element , or, if they were , or, if they were , or, if they were early early early testers testers testers for a long for a long for a long time, they can time, they can time, they can keep that role keep that role keep that role for the entire for the entire for the entire existence of your existence of your existence of your community, and people community, and people community, and people will see that they will see that they will see that they helped steer the helped steer the helped steer the game in the direction game in the direction game in the direction it is it is it is developing. So, I developing. So, I developing. So, I think anything you think anything you think anything you can really can really can really do to do to do to recognize players is recognize players is recognize players is extremely helpful extremely helpful , and yes, people just , and yes, people just , and yes, people just like to be like to be like to be recognized.
-
recognized. Thank you. Gennady, do Thank you. Gennady, do you have anything to add? you have anything to add? Ahem. It's... Probably not, Ahem. It's... Probably not, because we weren't that because we weren't that because we weren't that involved in it, involved in it, involved in it, but I remember a few but I remember a few but I remember a few games where they added games where they added games where they added achievements with achievements with achievements with player nicknames, player nicknames, player nicknames, their avatars, and stuff like that their avatars, and stuff like that their avatars, and stuff like that . But I . But I . But I think it's a cool think it's a cool think it's a cool idea. idea. Thank you. Thank you for your Thank you. Thank you for your thoughts, colleagues. thoughts, colleagues. I actually wanted to I actually wanted to ask a question ask a question ask a question that would connect the that would connect the that would connect the community discussion with community discussion with data-driven solutions, as well as the data-driven solutions, as well as the artificial intelligence artificial intelligence artificial intelligence that we are currently that we are currently that we are currently using in using in using in our processes. And I our processes. And I our processes. And I think this feedback is think this feedback is think this feedback is very important for very important for very important for our audience who has our audience who has joined us today. A lot of joined us today. A lot of indie developers, indie developers, indie developers, a lot of people who a lot of people who a lot of people who are learning to make are learning to make are learning to make games or making their games or making their games or making their games as a side games as a side games as a side project. They also project. They also project. They also probably see probably see probably see some courses from some courses from some courses from teachers where they teachers where they teachers where they use certain use certain use certain tools. They tools. They tools. They want it want it want it all to eventually all to eventually all to eventually form a cohesive form a cohesive form a cohesive product. And sometimes it happens product. And sometimes it happens product. And sometimes it happens that that that the words of the players the words of the players the words of the players contradict what contradict what contradict what they do in the game they do in the game they do in the game when you track when you track when you track in-game in-game in-game events, when you see events, when you see
-
events, when you see how the game is actually played how the game is actually played how the game is actually played , that is, you , that is, you , that is, you observe observe observe them. So the question is them. So the question is them. So the question is , when this , when this , when this happens, how happens, how happens, how do you understand what's do you understand what's do you understand what's really really really going on? How going on? How going on? How to find the root cause of to find the root cause of to find the root cause of this contradiction? I this contradiction? I this contradiction? I hope everyone hope everyone hope everyone here has maybe here has maybe here has maybe some kind of story to some kind of story to some kind of story to share, you know, and share, you know, and share, you know, and some kind of specific some kind of specific some kind of specific example of what you example of what you example of what you did in a did in a did in a situation like that. Should situation like that. Should I start? I start? Certainly. Certainly. So, when I have So, when I have doubts, I honestly doubts, I honestly rely on my rely on my intuition first. And I also intuition first. And I also intuition first. And I also try to get to the bottom of try to get to the bottom of try to get to the bottom of what they what they what they really want to really want to really want to say, because as say, because as say, because as mentioned earlier, mentioned earlier, mentioned earlier, sometimes players sometimes players sometimes players share feedback in share feedback in share feedback in the form of suggested the form of suggested the form of suggested solutions or saying solutions or saying solutions or saying what they want. But what they want. But what they want. But this, as you say, this, as you say, this, as you say, contradicts the data.
-
contradicts the data. contradicts the data. The question then arises, The question then arises, The question then arises, what is their hidden what is their hidden what is their hidden problem? Why do they problem? Why do they problem? Why do they want this? What want this? What want this? What problem did they problem did they problem did they face? And that face? And that face? And that usually leads usually leads usually leads to you having to you having to you having something that something that something that really needs to be really needs to be really needs to be fixed or fixed or fixed or resolved. Regarding the resolved. Regarding the game creation platform we were building, game creation platform we were building, we had an additional we had an additional we had an additional problem: problem: problem: users users users used used used their own terminology. their own terminology. So, sometimes they So, sometimes they said one thing but meant said one thing but meant said one thing but meant something completely something completely something completely different. And then we could different. And then we could different. And then we could see, well, also in the see, well, also in the see, well, also in the data, that it was data, that it was data, that it was actually, well, that they actually, well, that they actually, well, that they meant something else. meant something else. So we could So we could figure out this way figure out this way that, I don't know, they that, I don't know, they that, I don't know, they call it a map or a call it a map or a call it a map or a level, and level, and level, and internally we called internally we called internally we called it something completely it something completely it something completely different and different and different and tracked it tracked it tracked it completely differently. And completely differently. And completely differently. And I would also always I would also always I would also always advise against advise against advise against blindly trusting the data, because it blindly trusting the data, because it blindly trusting the data, because it often happens that you often happens that you often happens that you may not know how the may not know how the tracking events are implemented. You don't tracking events are implemented. You don't know how know how know how the graph the graph the graph you're looking at is filtered, you're looking at is filtered, you're looking at is filtered, how it's configured, and how it's configured, and how it's configured, and how it collects data. And how it collects data. And how it collects data. And everyone in the team is already everyone in the team is already everyone in the team is already discussing only
-
discussing only discussing only one graph where something is one graph where something is one graph where something is falling, but if falling, but if falling, but if you start you start you start digging deeper into the digging deeper into the digging deeper into the project code, you see that there project code, you see that there project code, you see that there is a completely different is a completely different is a completely different hidden problem. hidden problem. So you shouldn't just So you shouldn't just trust the data in trust the data in trust the data in this sense. this sense. Don't trust the data, Don't trust the data, trust the process. trust the process. Yes, just to Yes, just to add to what add to what add to what Anton said, it's Anton said, it's Anton said, it's true that in one true that in one true that in one project, an MMORPG that project, an MMORPG that project, an MMORPG that we were working on, we we were working on, we we were working on, we had tracking of had tracking of had tracking of new activity and new activity and new activity and we saw a high we saw a high we saw a high completion rate. completion rate. But when we conducted But when we conducted a survey, everyone a survey, everyone a survey, everyone said that this said that this said that this activity was activity was activity was extremely boring. extremely boring. So I thought: how is this So I thought: how is this possible? Then, when possible? Then, when possible? Then, when you start talking you start talking you start talking to the players, to the players, to the players, it turns out that they it turns out that they it turns out that they only did it because it was the only did it because it was the only did it because it was the fastest fastest fastest way to progress. way to progress. So you need to So you need to communicate more and communicate more and communicate more and compare the compare the compare the information you information you information you have. have.
-
This is indeed a valid This is indeed a valid observation. And actually, observation. And actually, observation. And actually, to what Anton was saying to what Anton was saying to what Anton was saying , I want to , I want to , I want to redirect this redirect this redirect this question to Jason. question to Jason. question to Jason. Especially when it comes to Especially when it comes to Especially when it comes to deciphering what the deciphering what the players mean. You have good players mean. You have good experience, especially in experience, especially in experience, especially in working with younger working with younger working with younger audiences. Do you have any audiences. Do you have any audiences. Do you have any specific examples specific examples specific examples where things you where things you where things you called one thing in the studio called one thing in the studio , a certain , a certain , a certain terminology, terminology, terminology, were perceived completely were perceived completely were perceived completely differently by your differently by your differently by your audience, children, audience, children, audience, children, etc.? etc.? Yes, I never Yes, I never had that much had that much had that much trouble with trouble with trouble with terminology or terminology or terminology or communication, but a communication, but a communication, but a bigger problem bigger problem bigger problem I faced early in my I faced early in my I faced early in my career was career was career was people saying people saying people saying they liked they liked they liked things that things that things that didn't really didn't really didn't really interest them. And I interest them. And I interest them. And I feel like you'll feel like you'll feel like you'll run into this a lot, run into this a lot, run into this a lot, and that's where analytics and that's where analytics and that's where analytics becomes really useful, becomes really useful, becomes really useful, because you'll notice because you'll notice because you'll notice that people generally don't that people generally don't that people generally don't want to give a lot of want to give a lot of want to give a lot of negative feedback; negative feedback; negative feedback; Sometimes they do Sometimes they do , but most people are , but most people are , but most people are not inclined not inclined not inclined to criticize and say to criticize and say to criticize and say they like they like they like almost everything. Um, and if almost everything. Um, and if almost everything. Um, and if you look at the data you look at the data , you'll find out that's , you'll find out that's , you'll find out that's not true at all. One not true at all. One not true at all. One of the first things I of the first things I of the first things I did when I started did when I started did when I started working in the gaming working in the gaming working in the gaming industry was analyze industry was analyze industry was analyze data about what data about what data about what users were playing in users were playing in users were playing in one of our MMOs, what one of our MMOs, what one of our MMOs, what they were actually they were actually they were actually doing, and at what doing, and at what doing, and at what point they quit the game point they quit the game . Um, they all said . Um, they all said . Um, they all said they liked all the they liked all the they liked all the systems. There were three systems. There were three systems. There were three main main main progression systems, but everyone progression systems, but everyone progression systems, but everyone only played the one that only played the one that only played the one that involved adventures.
-
involved adventures. involved adventures. One of them, I don't want to One of them, I don't want to One of them, I don't want to name it, had almost name it, had almost name it, had almost zero players, and it got to the point where zero players, and it got to the point where when we saw the data , we just , we just , we just stopped working on stopped working on stopped working on it completely and started it completely and started it completely and started focusing on what the focusing on what the focusing on what the players players players actually wanted, actually wanted, actually wanted, even though they said even though they said even though they said they liked it. The they liked it. The they liked it. The same thing happened with same thing happened with same thing happened with child's play, right? child's play, right? child's play, right? They said they They said they They said they really liked the really liked the really liked the mini-games, right? mini-games, right? mini-games, right? These are small, simple These are small, simple These are small, simple mini-games. This is a very mini-games. This is a very mini-games. This is a very popular game in popular game in popular game in children's schools, and children's schools, and children's schools, and they said they they said they they said they really like really like really like these mini-games, but if these mini-games, but if these mini-games, but if you look at the data, you look at the data, you look at the data, they mostly they mostly they mostly play battles with the play battles with the play battles with the pets. Um, and this is where it pets. Um, and this is where it pets. Um, and this is where it all all all happened. So you happened. So you happened. So you have to talk have to talk have to talk to them, listen to them, to them, listen to them, to them, listen to them, but also but also but also back it up with back it up with back it up with data and data and data and make sure that make sure that make sure that they...and just know they...and just know they...and just know that people are going to that people are going to that people are going to lie to you, and people lie to you, and people lie to you, and people are going to be overly are going to be overly are going to be overly nice to you nice to you nice to you about certain things. about certain things. about certain things. You need to see You need to see You need to see what they actually what they actually what they actually play and do, play and do, play and do, compared to what compared to what compared to what they say. they say. Thank you. Ah, so the question is Thank you. Ah, so the question is maybe for you, maybe for you, maybe for you, Jason and Gennady, Jason and Gennady, Jason and Gennady, and maybe Anthony has and maybe Anthony has and maybe Anthony has something to add: how do you something to add: how do you something to add: how do you weigh a problem that weigh a problem that weigh a problem that only affects a few only affects a few only affects a few players versus players versus players versus when the game becomes when the game becomes when the game becomes unplayable, unplayable, unplayable, you know, for everyone, or you know, for everyone, or you know, for everyone, or affects the majority of affects the majority of affects the majority of players?
-
players? Um, in this case, it's Um, in this case, it's pretty simple, pretty simple, pretty simple, at least from an at least from an at least from an engineering engineering engineering perspective. Anything that has a perspective. Anything that has a perspective. Anything that has a mass effect—the mass effect—the mass effect—the broader the effect, if it broader the effect, if it broader the effect, if it affects more than, affects more than, affects more than, say, 1% of players or say, 1% of players or say, 1% of players or something like that—then something like that—then something like that—then it becomes a very, very it becomes a very, very it becomes a very, very high priority, high priority, high priority, depending on depending on depending on how how how critical it is. And then you critical it is. And then you critical it is. And then you just have to just have to just have to weigh it based on weigh it based on weigh it based on how how how widespread it is, how widespread it is, how widespread it is, how critical it is, and critical it is, and critical it is, and how strange an how strange an how strange an exceptional case it is. A exceptional case it is. A exceptional case it is. A random random random isolated incident isolated incident isolated incident on some strange on some strange on some strange Android device is not a Android device is not a Android device is not a big deal, but if it big deal, but if it big deal, but if it affects, say, affects, say, affects, say, 1-2% of your players, you 1-2% of your players, you 1-2% of your players, you should fix it immediately should fix it immediately should fix it immediately . Um, and if . Um, and if . Um, and if you don't do that, and you don't do that, and you don't do that, and you're working on you're working on you're working on mobile devices, mobile devices, mobile devices, you'll, I'm sure, you'll, I'm sure, you'll, I'm sure, run into a bunch of run into a bunch of run into a bunch of other problems. Everyone other problems. Everyone other problems. Everyone knows this. knows this. And I think it's really And I think it's really important to important to important to prioritize, you know, prioritize, you know, prioritize, you know, in terms of category of in terms of category of in terms of category of problems, right? Well, problems, right? Well, problems, right? Well, for example, for example, for example, save files, right? save files, right? save files, right? Even if it Even if it Even if it happened to one happened to one happened to one person, you need to person, you need to person, you need to pay attention to it pay attention to it pay attention to it and make sure and make sure and make sure your your your save system is reliable. save system is reliable. save system is reliable. Another important thing Another important thing Another important thing I didn't understand at first I didn't understand at first is that trophies and is that trophies and is that trophies and achievements are supposed to achievements are supposed to achievements are supposed to work properly, work properly, work properly, right? Because people right? Because people right? Because people will be very, very will be very, very will be very, very disappointed if disappointed if disappointed if they unlocked they unlocked they unlocked everything except one everything except one everything except one achievement that didn't achievement that didn't achievement that didn't work due to a work due to a work due to a bug. So maybe it's bug. So maybe it's bug. So maybe it's worth looking into the worth looking into the worth looking into the graphics issue graphics issue graphics issue a little later, a little later, a little later, because if because if because if only one person is reporting it only one person is reporting it only one person is reporting it , it could be a , it could be a configuration issue or configuration issue or some installed some installed software, software, like like like antivirus, right?
-
antivirus, right? antivirus, right? They create so They create so They create so many problems. So many problems. So many problems. So maybe we'll maybe we'll maybe we'll look into that look into that look into that later. later. So, I think when So, I think when you start to see you start to see you start to see problems, problems, problems, try to get to the try to get to the try to get to the bottom of what's bottom of what's bottom of what's causing them, can causing them, can causing them, can you figure out if it's an you figure out if it's an you figure out if it's an isolated problem isolated problem isolated problem or if it's a widespread or if it's a widespread or if it's a widespread problem? As problem? As problem? As Gennady says, get the Gennady says, get the Gennady says, get the technical technical technical specifications of the specifications of the user's computer, find out why this is happening to them why this is happening to them why this is happening to them . Will . Will . Will this happen to everyone with this happen to everyone with similar similar specs? And specs? And if so, as if so, as if so, as Jason says, the Jason says, the Jason says, the bigger the problem bigger the problem , the faster you , the faster you , the faster you should step in and should step in and should step in and fix it. But fix it. But fix it. But collecting data, collecting data, collecting data, finding out what is finding out what is finding out what is happening and why, and happening and why, and happening and why, and identifying identifying identifying the root causes of problems is the root causes of problems is always important. always important. Just make sure they don't don't don't run out of run out of run out of hard drive space. hard drive space. hard drive space. Yes. Yeah, and I would also Yes. Yeah, and I would also Yes. Yeah, and I would also say: try to say: try to say: try to reproduce these reproduce these reproduce these issues, either yourself issues, either yourself issues, either yourself or your team, or or your team, or or your team, or you reach out to you reach out to you reach out to some players who have had some players who have had some players who have had this this this issue. In issue. In issue. In the best case scenario, the best case scenario, the best case scenario, if we're talking about if we're talking about if we're talking about patterns, you patterns, you patterns, you can also can also can also see it somewhere in the see it somewhere in the see it somewhere in the tracking and tracking and tracking and confirm that something is confirm that something is confirm that something is wrong. We also had the situation where wrong. We also had the situation where wrong. We also had the situation where people who had people who had people who had given consent for given consent for given consent for us to contact them us to contact them us to contact them could just could just could just tell us directly what was tell us directly what was tell us directly what was wrong.
-
wrong. Thank you. So, Thank you. So, to sum up, I to sum up, I to sum up, I think for those of us think for those of us think for those of us watching, watching, watching, community and data community and data community and data should work hand should work hand should work hand in hand. And if you in hand. And if you in hand. And if you see that there are active see that there are active see that there are active players, kind of players, kind of players, kind of community leaders, who are community leaders, who are community leaders, who are communicating with you, communicating with you, communicating with you, say, on Discord or say, on Discord or say, on Discord or whatever other whatever other whatever other platform you platform you platform you use for use for use for moderation. First, moderation. First, moderation. First, you need to you need to you need to understand how understand how understand how big this group is, big this group is, big this group is, right? That is, how many other right? That is, how many other right? That is, how many other players have been affected by this players have been affected by this players have been affected by this problem. And here you will problem. And here you will problem. And here you will have to have to have to rely on some rely on some rely on some data, building data, building information processing pipelines inside information processing pipelines inside your games and your games and your games and products to products to products to see if this is an see if this is an see if this is an isolated feedback or if the isolated feedback or if the isolated feedback or if the problem affects a problem affects a problem affects a larger number of larger number of larger number of players. So, finally, players. So, finally, players. So, finally, maybe you can maybe you can maybe you can share what share what share what tools you tools you tools you used for used for used for this process?
-
this process? this process? Were these completely custom, Were these completely custom, Were these completely custom, in-house developed in-house developed in-house developed dashboards, or did dashboards, or did dashboards, or did you rely on you rely on you rely on something else? Maybe something else? Maybe something else? Maybe you have some advice you have some advice you have some advice for those currently for those currently for those currently developing a game? Is it developing a game? Is it developing a game? Is it just a Discord server, just a Discord server, just a Discord server, Reddit forums, and some Reddit forums, and some Reddit forums, and some in-game in-game in-game events? I mean, events? I mean, events? I mean, it also depends it also depends it also depends on the engine you're on the engine you're on the engine you're using. So, using. So, using. So, I'll change the subject a little. I'll change the subject a little. I'll change the subject a little. We don't have We don't have We don't have much time left, and I much time left, and I much time left, and I want to talk about want to talk about want to talk about artificial intelligence. Are you artificial intelligence. Are you artificial intelligence. Are you using AI, using AI, using AI, like language like language like language models or whatever models or whatever models or whatever we have today, we have today, we have today, to process to process to process community feedback and community feedback and community feedback and maybe close the maybe close the maybe close the feedback loop feedback loop feedback loop where AI changes where AI changes where AI changes game balance or certain game balance or certain game balance or certain features based on features based on features based on player feedback? player feedback?
-
I'm not doing this yet I'm not doing this yet , but a , but a , but a friend of mine is doing friend of mine is doing friend of mine is doing something very similar and something very similar and something very similar and has connected AI to Discord has connected AI to Discord has connected AI to Discord to collect feedback to collect feedback to collect feedback from users and from users and from users and automatically automatically automatically implement implement implement bug fixes. bug fixes. If they submit a If they submit a bug report and bug report and bug report and the system can the system can the system can reproduce it, it reproduce it, it reproduce it, it automatically automatically automatically attempts attempts attempts to fix it and then to fix it and then to fix it and then provides users with a provides users with a provides users with a build they build they build they can test. can test. can test. It's mostly It's mostly It's mostly about art about art assets and simple assets and simple assets and simple code, so the risk of code, so the risk of code, so the risk of breaking anything seriously is breaking anything seriously is breaking anything seriously is small, but for small, but for small, but for his his his workflow it works workflow it works workflow it works great, and I think great, and I think great, and I think game developers would be game developers would be game developers would be interested in having interested in having interested in having something like this. I'm not something like this. I'm not something like this. I'm not sure about the idea of sure about the idea of sure about the idea of sending sending sending the build to users right away, the build to users right away, the build to users right away, but automatic but automatic but automatic bug fixes bug fixes bug fixes could be an interesting could be an interesting could be an interesting solution for certain solution for certain solution for certain projects. Of course, projects. Of course, projects. Of course, depending on the scope and depending on the scope and depending on the scope and scale of the tasks, I scale of the tasks, I scale of the tasks, I can totally imagine this can totally imagine this can totally imagine this as an interesting way to as an interesting way to as an interesting way to work in the near work in the near work in the near future to future to future to gather feedback. gather feedback. At least for collecting At least for collecting and organizing and organizing and organizing feedback, but feedback, but feedback, but automatic automatic automatic responses and responses and error status updates for error status updates for the user are also the user are also the user are also very convenient.
-
very convenient. Yes, AI is useful not Yes, AI is useful not only for writing only for writing only for writing code, we are not constantly code, we are not constantly code, we are not constantly generating new code generating new code generating new code or new functions. It's like or new functions. It's like or new functions. It's like automation, and you automation, and you automation, and you 're working on a 're working on a 're working on a complex pipeline, complex pipeline, complex pipeline, so Gennady, do so Gennady, do so Gennady, do you have similar experience in you have similar experience in you have similar experience in your studio? your studio? Yes, in projects where Yes, in projects where we are allowed to we are allowed to we are allowed to use AI, use AI, use AI, of course. There are projects where of course. There are projects where clients forbid us to use it, and there are those where clients forbid us to use it, and there are those where clients allow us clients allow us clients allow us to use it. to use it. to use it. We did exactly what We did exactly what We did exactly what Jason was talking about Jason was talking about Jason was talking about when a when a when a ticket appears in Jira, right? ticket appears in Jira, right? The agent checks the code and The agent checks the code and tries to find tries to find tries to find the problem, and then the problem, and then the problem, and then usually issues a report that usually issues a report that usually issues a report that lists the probable lists the probable lists the probable cause and three different cause and three different cause and three different ways to ways to ways to fix it. It fix it. It fix it. It asks what asks what asks what you think is appropriate, you think is appropriate, you think is appropriate, and then a human, a and then a human, a and then a human, a programmer, decides programmer, decides programmer, decides whether they like the whether they like the whether they like the suggested suggested suggested fixes and says, " fixes and says, " Okay, the first Okay, the first Okay, the first fix actually fix actually fix actually solves the problem." " solves the problem." " Please Please Please implement it."
-
implement it." implement it." Something like this. Something like this. Something like this. Another thing—we Another thing—we Another thing—we actively actively actively use AI use AI use AI to collect feedback. to collect feedback. to collect feedback. It's great, you know, It's great, you know, It's great, you know, when our port comes out when our port comes out when our port comes out , right? We , right? We , right? We immediately immediately immediately ask ChatGPT or something ask ChatGPT or something ask ChatGPT or something like that: "Okay, gather like that: "Okay, gather like that: "Okay, gather feedback, especially feedback, especially feedback, especially on performance on performance on performance or issues on Switch." or issues on Switch." Then we see what Then we see what people say and people say and people say and start laying the start laying the start laying the groundwork for future groundwork for future groundwork for future updates and updates and updates and fixes. fixes. I've seen people use AI use AI for moderation quite effectively in both for moderation quite effectively in both for moderation quite effectively in both communities and communities and communities and games. There's a company games. There's a company games. There's a company we talked to we talked to we talked to called G G W P, called G G W P, called G G W P, they do exactly that they do exactly that they do exactly that . It's really . It's really . It's really helpful to be able to helpful to be able to helpful to be able to get a ton of get a ton of get a ton of feedback from your feedback from your feedback from your community and community and community and process everything, process everything, process everything, especially if you have a especially if you have a especially if you have a large audience. large audience. large audience. Using it Using it Using it for moderation is a for moderation is a for moderation is a great idea. But I will great idea. But I will great idea. But I will say this: as we have already say this: as we have already say this: as we have already talked about the data, it is talked about the data, it is talked about the data, it is only part of the only part of the only part of the big picture.
-
big picture. So, I think that So, I think that while it's very useful to while it's very useful to while it's very useful to be able to be able to be able to collect collect collect community feedback or community feedback or community feedback or do moderation do moderation , it's also important that it's , it's also important that it's , it's also important that it's done by people done by people done by people who interact with who interact with who interact with users and are users and are users and are part of that part of that part of that community. Because what community. Because what community. Because what AI might AI might AI might label as a label as a label as a problem, a person who problem, a person who problem, a person who sees the big sees the big sees the big picture throughout the day picture throughout the day picture throughout the day will appreciate much will appreciate much will appreciate much better when piecing the puzzle better when piecing the puzzle better when piecing the puzzle together. So I think this is a together. So I think this is a together. So I think this is a great dataset to great dataset to use. We haven't gotten We haven't gotten to that point yet, but we would to that point yet, but we would to that point yet, but we would use AI use AI use AI to interact with the to interact with the to interact with the community. Right now, we're community. Right now, we're community. Right now, we're completely handling completely handling completely handling this on our own. I would be this on our own. I would be this on our own. I would be interested interested interested to know, first, to know, first, to know, first, whether the AI actually understands whether the AI actually understands whether the AI actually understands game slang and how game slang and how game slang and how game features game features game features interact with each interact with each interact with each other, because this can other, because this can other, because this can be very be very be very specific to specific to specific to your project.
-
your project. your project. Additionally, an automated Additionally, an automated Additionally, an automated resume may resume may resume may miss very miss very miss very important points that important points that important points that you may not notice. And you may not notice. And secondly, the gaming secondly, the gaming secondly, the gaming community, as far as community, as far as community, as far as I can see, is very sensitive I can see, is very sensitive I can see, is very sensitive to the use of AI. to the use of AI. Personally, I feel Personally, I feel devalued as a devalued as a devalued as a customer when customer when customer when I talk to a I talk to a I talk to a support chatbot, and support chatbot, and support chatbot, and this is this is this is felt even more felt even more felt even more acutely in games. So I'm acutely in games. So I'm acutely in games. So I'm curious how curious how curious how far far far different teams go and where different teams go and where different teams go and where they draw the line they draw the line they draw the line to maintain a to maintain a to maintain a human approach. human approach. By the way, this is a very By the way, this is a very valid observation. valid observation. When you interact When you interact with the community, it's with the community, it's with the community, it's important to sound sincere; important to sound sincere; important to sound sincere; People should not People should not People should not think that think that think that only an only an only an automated automated chatbot answers them, because this makes chatbot answers them, because this makes chatbot answers them, because this makes their feedback valuable.
-
their feedback valuable. So, do it, So, do it, Jason. Jason. Jason. I was just thinking that I was just thinking that I've been really I've been really liking AI liking AI chatbots lately compared to chatbots lately compared to chatbots lately compared to the support I used to the support I used to the support I used to get. get. Over the past three months, AI chatbots have been very chatbots have been very chatbots have been very useful, useful, useful, helping to quickly helping to quickly helping to quickly resolve issues, resolve issues, resolve issues, unlike humans, unlike humans, unlike humans, with whom you have to with whom you have to with whom you have to spend 10 minutes on spend 10 minutes on spend 10 minutes on verification, and verification, and verification, and then they get confused and do not then they get confused and do not then they get confused and do not give an answer. So give an answer. So give an answer. So I'm curious how this I'm curious how this I'm curious how this will work in the will work in the will work in the gaming industry. Because gaming industry. Because , as Anton said, in , as Anton said, in , as Anton said, in games, many players games, many players games, many players are somewhat are somewhat are somewhat against, well, AI. But if against, well, AI. But if against, well, AI. But if it solves your it solves your it solves your problem and problem and problem and gives you an instant answer, I don't gives you an instant answer, I don't gives you an instant answer, I don't know if that know if that know if that argument would still be as argument would still be as argument would still be as compelling, or if people compelling, or if people compelling, or if people would consider it as much would consider it as much would consider it as much if they if they if they could just could just could just write, "Hey, I'm having a write, "Hey, I'm having a write, "Hey, I'm having a problem with the game." And problem with the game." And problem with the game." And get a response get a response get a response from support from support from support in a few seconds, in a few seconds, in a few seconds, instead of instead of instead of waiting all day or waiting all day or waiting all day or however long the however long the however long the wait usually lasts.
-
wait usually lasts. wait usually lasts. I think this could be I think this could be I think this could be very useful, depending very useful, depending very useful, depending on how on how on how big your big your big your support team is and support team is and support team is and how how how widespread it is. widespread it is. widespread it is. For example, in MMOs we For example, in MMOs we For example, in MMOs we had entire buildings had entire buildings had entire buildings full of game full of game full of game masters masters masters constantly running around and constantly running around and constantly running around and helping players. I helping players. I helping players. I don't know if that's the case don't know if that's the case don't know if that's the case now, but I think an now, but I think an now, but I think an AI assistant that could AI assistant that could AI assistant that could help would be help would be help would be appropriate. However, it would be appropriate. However, it would be appropriate. However, it would be interesting to see what interesting to see what interesting to see what this would lead to. this would lead to. Thank you. So, we have a Thank you. So, we have a little little little time left for one last question, which is time left for one last question, which is time left for one last question, which is quite interesting for quite interesting for quite interesting for me, and me, and me, and one question from the one question from the one question from the community. I'll ask community. I'll ask community. I'll ask our our our stream moderators to give us another stream moderators to give us another stream moderators to give us another minute of extra minute of extra minute of extra time. So I would like to time. So I would like to time. So I would like to hear from each of hear from each of hear from each of you an answer in a few you an answer in a few you an answer in a few words or, you know, words or, you know, words or, you know, one one one sentence at most. What is one sentence at most. What is one sentence at most. What is one decision you would decision you would decision you would never trust to a never trust to a community vote, dashboard, community vote, dashboard, or AI? or AI?
-
Light. It's simple. I will Light. It's simple. I will never let a never let a never let a dashboard or AI dashboard or AI dashboard or AI decide when a decide when a decide when a product is ready. So product is ready. So product is ready. So I have to be the one to I have to be the one to I have to be the one to check everything. And check everything. And check everything. And he will see that yes, everything is he will see that yes, everything is he will see that yes, everything is fine. And we can fine. And we can fine. And we can release it. I want to release it. I want to release it. I want to take this take this take this responsibility. responsibility. responsibility. Thank you. Anton. Thank you. Anton. Of course, creating Of course, creating the vision of the game and, on the the vision of the game and, on the the vision of the game and, on the technical side, technical side, technical side, creating creating creating the architecture of the game. I would the architecture of the game. I would the architecture of the game. I would n't let an AI n't let an AI n't let an AI make that decision make that decision make that decision for me. for me. Thank you. Jason. I agree with I agree with Anton's first part. Anton's first part. Anton's first part. I used I used I used to agree with the to agree with the to agree with the second part about second part about second part about architecture, but architecture, but architecture, but now I've changed my mind. now I've changed my mind. But yeah, it's the game But yeah, it's the game design and the general design and the general design and the general understanding of what the understanding of what the understanding of what the game is that makes it game is that makes it game is that makes it interesting and interesting and interesting and right. I think right. I think right. I think developers developers developers should feel this too.
-
should feel this too. should feel this too. If you don't feel If you don't feel If you don't feel it and don't know that it's it and don't know that it's it and don't know that it's ready, ready, ready, good, and really good, and really good, and really interesting, then it probably isn't interesting, then it probably isn't interesting, then it probably isn't . . Anthony. Yes, I also think that Yes, I also think that the feeling of playing is a the feeling of playing is a the feeling of playing is a purely human thing. And purely human thing. And purely human thing. And your own style your own style will really show in how the will really show in how the game looks game looks game looks and feels. And I don't and feels. And I don't and feels. And I don't think I would trust think I would trust think I would trust artificial artificial artificial intelligence to recreate intelligence to recreate intelligence to recreate that. But I think it would be a that. But I think it would be a that. But I think it would be a really interesting really interesting really interesting experiment if experiment if experiment if your community your community your community built and built and built and directed every directed every directed every decision in your game. decision in your game. decision in your game. This could be This could be This could be quite interesting. quite interesting. Thank you. Thank you, Thank you. Thank you, guys. Very good guys. Very good guys. Very good answers. So, we have a answers. So, we have a answers. So, we have a little time for one little time for one little time for one question from the question from the question from the community. I think I'll community. I think I'll community. I think I'll choose this one. I think choose this one. I think choose this one. I think this is really important, this is really important, this is really important, especially from your especially from your especially from your perspective. How do perspective. How do perspective. How do you build a community you build a community you build a community around your first around your first around your first game without having a game without having a game without having a well-known name? So, well-known name? So, start start publishing publishing publishing information about it.
-
information about it. information about it. Post it Post it Post it online. Make a online. Make a online. Make a video about her. video about her. video about her. Share what you're Share what you're Share what you're doing during the doing during the doing during the development process, and you'll development process, and you'll development process, and you'll start to attract your start to attract your start to attract your first fans. Well, first fans. Well, first fans. Well, first you first you first you will realize that a lot of the will realize that a lot of the will realize that a lot of the things you do are things you do are things you do are terrible, and you will terrible, and you will terrible, and you will adapt and adapt and adapt and change them change them change them based on feedback from the based on feedback from the based on feedback from the few people who few people who few people who listen to you; and then listen to you; and then listen to you; and then that fan base that fan base that fan base will grow as the will grow as the will grow as the game improves and game improves and game improves and you start you start you start responding to that responding to that responding to that feedback. feedback. Yes, I would also advise Yes, I would also advise figuring out who you are figuring out who you are figuring out who you are making this game for, and making this game for, and making this game for, and then finding where then finding where then finding where those those those communities are and communities are and communities are and spending time there. spending time there. So, I guess my advice is So, I guess my advice is always the same: always the same: always the same: start early, start early, start early, start often. start often. Involve your Involve your community while you're still community while you're still community while you're still building your prototype, building your prototype, building your prototype, because once you because once you because once you start start start showing it off, you never showing it off, you never showing it off, you never know if something will go know if something will go know if something will go viral. viral. Make sure you Make sure you put a link put a link put a link to the community on your to the community on your to the community on your store pages, store pages, store pages, where people can where people can where people can add the game to their add the game to their add the game to their wishlist, in any wishlist, in any wishlist, in any articles that articles that articles that appear, because that's how you appear, because that's how you appear, because that's how you can engage your can engage your can engage your audience, especially audience, especially audience, especially if you don't have a if you don't have a wishlist page yet, right? So the wishlist page yet, right? So the earlier you build this earlier you build this earlier you build this community and the community and the community and the more time you more time you more time you spend on spend on spend on social media social media social media building a space building a space building a space for your game, the for your game, the for your game, the better your chances are of finding better your chances are of finding better your chances are of finding and retaining this and retaining this and retaining this audience.
-
audience. Besides Discord, are there Besides Discord, are there any other places you would any other places you would any other places you would host this host this host this community? This is my community? This is my community? This is my default option, default option, default option, I'm just wondering I'm just wondering I'm just wondering if anyone else has one. if anyone else has one. Thank you. Excuse me, can I Excuse me, can I answer this quickly answer this quickly ? ? ? Yes, of course. Yes, of course. Yes, I've worked on Yes, I've worked on projects where a significant projects where a significant projects where a significant portion of the audience portion of the audience portion of the audience was actually on Reddit was actually on Reddit . I think that's also an . I think that's also an . I think that's also an option. And YouTube, you have option. And YouTube, you have option. And YouTube, you have a lot a lot a lot going on on YouTube as well. going on on YouTube as well. Yes, Reddit and YouTube are the Yes, Reddit and YouTube are the right way to go. Ahem. right way to go. Ahem. right way to go. Ahem. Any ideas for Any ideas for Any ideas for finishing? Thoughts. finishing? Thoughts. finishing? Thoughts. I think I think I think Jason Anthony Jason Anthony Jason Anthony did it pretty, did it pretty, did it pretty, pretty well. Ahem. pretty well. Ahem. pretty well. Ahem. I think another I think another I think another idea could be to idea could be to idea could be to collaborate with collaborate with collaborate with other developers other developers other developers who might already be who might already be who might already be making a game in a making a game in a making a game in a similar style or similar style or similar style or genre, and try genre, and try genre, and try to ask them to ask them to ask them to help, you know.
-
to help, you know. to help, you know. Maybe promote Maybe promote Maybe promote your game. Or. You know, your game. Or. You know, your game. Or. You know, something like this. something like this. Okay, that's really Okay, that's really good advice. Well, good advice. Well, good advice. Well, thank you very much, guys, for thank you very much, guys, for thank you very much, guys, for your time. We, we, we've your time. We, we, we've your time. We, we, we've finished our, our finished our, our finished our, our time today. Thanks for time today. Thanks for time today. Thanks for joining, joining, joining, guys, and yes, it was guys, and yes, it was guys, and yes, it was really nice really nice really nice meeting you and meeting you and meeting you and chatting.
No summary available yet.
View original episode ↗