AI in Production

Artificial Intelligence (AI) is a buzzword that has become hard to ignore lately. Despite much attention to the subject at conferences and in the media, it can remain vague what the realistic possibilities are today. In recent years, we have had AI breakthroughs in the field of self-driving cars, voice technology and playing various games. However, a clear picture of how this game, VFX and animation can improve production pipelines is still lacking.

Game testing, creating animations, or designing realistic conversations are just a few examples in which AI can and will play an important role in the future. DAE-Research started this TETRA project to better map out the possibilities. Together with a guidance group consisting of several Games and VFX companies, we believe that using AI will free up more time for the creative process itself. Collaboration and interaction with the support group ensure that our research is applicable and valuable in the field.The current TETRA is the follow-up to a preparatory year that ended in September 2020. In the preparatory year, various use cases were identified together with the guidance group in which AI will have the most impact.

On January 1, 2021, we started to further develop the use cases and broaden the knowledge and research from the first year. In concrete terms, we offer the companies in the support group the following:

6 validated proof of concepts based on the input received:

Basic knowledge about AI & existing tools and methodologies
In-depth knowledge of AI applied to games, VFX and animation
Test and compare existing AI tools
Workshops to train employees
Continuous updates on project results and relevant academic papers through website blog posts and meetings
Networking

LATEST USE CASES

Experiment: Aged-Up Deepfakes

From this TETRA research project AI in production, we have prepared an introductory workshop on deepfakes to give to the DAE students of the VFX major. During the annual creative week, all regular courses for first and second year students are canceled and replaced by creative sessions. Our goal was to provide an introduction to deepfakes from the research group: what is deepfake technology, what can you do with standard software without heavy programming yourself, what are the points of interest if you want to get started with it, … Due to the lockdown, the creation week was canceled this academic year, but the preparations for the workshop were already ready. The workshop with students will be moved to a later date in one of the VFX classes, but we are happy to share the approach of the workshop with the guidance group here. Read about the limits of this technology and how we tackled Star Wars in a hands-on use case with the combination of different tools.

Reinforcement Learning to find bugs

In this overview post we show how Reinforcement Learning (RL) can be applied to testing games. We do this by means of several papers and use cases. We show how you can detect errors in level design and game breaking bugs in this way. It may be helpful to read our introduction to RL first if you are unfamiliar with the concept.

Audio in Games

Audio is an essential element to the success of any game. It provides an immersive experience that can make the difference between the player enjoying a game or becoming frustrated and giving up. Delayed, missing or incorrect sound effects can seriously affect the immersion of the game. Additionally, inconsistent, or sudden changes in volume of the background music can break immersion. With this use case we want to investigate what the impact of AI for audio in games can be, and if problems such as error detection in sound effects and music can be addressed. This may or may not bother players while playing, however, the right sound effects or background music can set the atmosphere while playing a game. Additionally, audio is an important element in determining what is happening in the game at any given moment. This can be illustrated by moments such as enemies sneaking up on you from the side, giving them the advantage to attack. Unfortunately, audio issues still exist in games. They can be caused by several factors, including code changes, assets that are not properly optimized, or simply the way the game is played. We refer to these as bugs. Actively detecting audio bugs requires quite some time. Furthermore, these are sometimes overlooked because game testers give a lower priority to audio. For example, people sometimes test without their headphones or with the volume set to 0, because detecting graphical and functional bugs involves a lot of repetition, which means that sound effects are also played ad nauseum. In this use case, we explore ways to automatically detect audio bugs during development. This can help you identify and resolve them before they cause problems for the players. However, we’ll ignore the more nuanced challenges with audio, as detecting technical things like room temperature are too niche to delve into further.

BLOG POSTS

Code synthesis with LLM

Good news for people without programming experience. You can now put together a game without even typing a letter code. We can now indeed automatically generate code with language models. This is done using simple commands, or the model simply supplements existing code. And for beginners: a language model can check your code for syntax errors and also optimize them automatically. Even for more experienced programmers, there is sometimes still rehearsal or research work. Especially when juggling between different languages. In this blog post we see how programming is now easier than ever before.

Automating Unit tests

Within this experiment a generic open-source model for generating code was created to avoid the repetitiveness of writing unit tests manually. This makes this use case ideal for automation. In the first example two methods for generating unit tests are presented. We will provide one full example and write down the name of the second method that we expect you to supplemented.

Overview: Speech Synthesis and Conversational AI

Over the past year, we’ve noticed a number of recent innovations around speech synthesis and conversational AI. So far, the state of the art in this area is not yet at the point where it can be realistically applied immediately in a game or VFX pipeline. That said, innovation never stops, and new techniques and interesting innovations emerge regularly within this field. In this blog post we bundle these for you.

RELATED EVENTS

AI in Production Closing Event

08/12/2022

The Square, Luipaardstraat 12a, Kortrijk, Belgium

This event is the result of TETRA AI in Production, a 2-year research project focusing on how AI can be used in game, VFX and animation production. Our researchers have closely followed the developments of AI over the past 3 years. We are excited to continue sharing this knowledge with our steering committee and with anyone interested in developments in this area!

CoG 2021

17/08/2021

Online / Copenhagen, Denmark

Games offer a limitless domain for computational creativity, design, technology, education, social sciences, and artificial intelligence. The annual IEEE Conference on Games (CoG) is a unique forum for cutting-edge research related to game technologies and design, covering scientific, technical, social and human aspects of games. CoG was expressly launched to reflect the changing nature of games as technology and media; where concerns merge, overlap, and cross-pollinate. Beginning as an evolution of the Conference on Computational Intelligence and Games (CIG) and later joined by the International Conference on Virtual Worlds and Games for Serious Applications (VS-Games), CoG brings together leading researchers and practitioners from academia and industry, to share recent advances and co-create future directions. This year’s edition of CoG continues forging the path of attracting an evermore competent and diverse audience. Alongside our traditional types of submission (articles for peer review intended to be included in the conference proceedings), we seek proposals for presentations from both academia and industry in the form of abstracts. Furthermore, it is also possible to apply to present work previously published in the IEEE Transactions on Games journal.

AI Summer School 2021

08/07/2021

Online

In 2021, KU Leuven organised the first edition of the Summer School on the Law, Ethics and Policy of Artificial Intelligence (AI). The Summer School aims to provide a comprehensive overview of the various legal, ethical and policy-related issues around AI and algorithm-driven processes more broadly. As these technologies have a growing impact on all domains of our lives, it becomes increasingly important to map, understand and assess the challenges and opportunities they raise. This requires an interdisciplinary approach, which is why we are collaborating across faculties and departments to organise this Summer School. The programme’s goal is to offer participants the latest insights on AI from various perspectives, and in particular the fields of law, ethics and policy.