4th International Aiwolf Contest

4th International AI Werewolf Contest

Can computers play Social Deduction games, such as “Werewolf” and “Among Us”, where the challenge is not so much in strategy or tactics, but rather in being able to manipulate other players through negotiation and deception?

To answer this question, we hold the AI Werewolf contest (AIWolf), where participants are invited to submit computer programs that can play the game of Werewolf (aka Mafia) against each other.

In 2022 the 4th edition of the International AI Werewolf contest will be held at the IEEE Conference on Games , from 21 to 24 of August in Beijing (online). Visit this page often to learn the rules and news about the contest.

Recent News

2022/06/06 — Regulation updated (Ver. 1.2.0) for the Protocol Division
2022/05/05 — IEEE CIS offered a 500 USD prize for 1st place of the NLP Division!
2022/05/05 — Regulation updated for the Protocol Division
Stay tuned for more information in this space.

Table of contents:

• General Information
• Protocol Division Details
• Natural Language Division Details
• Infrastructure Division Details
• More Resources
• FAQ
• Past News

Contest Summary

A participant must submit a computer program that can communicate with the “AIWolf Server” software, and play the werewolf game against other agents.

This year, the competition is composed of three tracks (divisions):

• Protocol Division: The agent communicates with other agents using the AIWolf Protocol. The winning agent is decided by its victory rate. Registration Deadline: July 8th.
• NLP Division: The agent communicates with other agents using Natural Language (English or Japanese). The winning agent is decided by a panel of judges, who will consider the ability of the agent to speak naturally, consistently, etc. Registration Deadline: July 31st
• Infrastructure Division: Submit a tool to improve the AIWolf competition (ex: visualizers, log parsers, new servers, sample agent code, etc). The winning submission is decided by a vote among organizers and participants from all divisions. Registration Deadline: August 10th

Any submission must include the source code, build instructions, and a document describing the submission. Submissions from previous years are available, as well as example code. See more details in the sections below.

Participants are also encouraged to submit academic papers describing their AIWolf results to the “Competition Track” of CoG. The deadline is May 14th.

For more information, see the sections below for each track, or join the AIWolf Competition Slack to contact us directly!

Protocol Division

In the protocol division, the agents communicate with each other through a fixed protocol, which facilitate the exchange of information. The goal in this division is to create agents that can effectively play the game and achieve a high win ratio.

This track of the competition happens in two rounds: In the first round, the agents of all participants play against each other. The 15 agents with highest win ratio are invited to the second round (finalist round), where they play against each other in several 15 and 5 player games.

To assist with agent development, participants can submit early versions of their agents to the contest server. Agents registered in the contest server will play test games several times per day, and the participants can access the logs of these games to debug and improve their agents. After the registration deadline, agents that crash during the contest will be disqualified, so make sure to test your agent before the deadline!

Protocol Division Resources

• Regulation
• Protocol Description
• Contest Server (Test your agent here!)
  • Daily Results of the Contest Server: 15 player games, 5 player games.
• Docker Image of the Contest Server
• Schedule:
  • Deadline to Register Agents in the Contest Server: July 8th (Fri)
  • Deadline to submit Finalist Agents (Agent, Code, Documentaion): August 5th (Fri)
• Sample Agents
  • Python Sample Code, Another Python Library
  • How to create AIWolf agent in C#
  • Java Programming Tutorial
• Past Agents: 2019, 2020, 2021

Natural Language Division

In the Natural Language Division, the agents communicate using natural language (English or Japanese). The goal in this division is to create agents that can play together with human players, and are enjoyable to play with.

Participants in this track have to submit in two runs. In the preliminary run, participants must submit the logs of 50 self-played games of their agent (5-player game). The organizer will examine the logs, and invite the participants for the formal run.

In the formal run, invited participants play against each other in 5-player games. The logs of this run will be evaluated by human judges, who will score the agents based on the quality of dialogue produced by each agent.

IEEE CIS is offering a 500 USD prize for the first place of the AIWolf NLP Division!

NLP Division Resources

• Regulation
• Schedule:
  • Registration (Submission of Self-Play logs): July 31 (Sun) AoE (Fri)
  • Formal Run: August 8-11
• Evaluation Criteria
  • A Natural utterance expressions
  • B Contextually natural conversation
  • C Coherent (not contradictory) conversation
  • D Coherent game actions (vote, attack, divine) with conversation contents
  • E Diverse utterance expressions, including coherent characterization Please note that vague utterances that could be used regardless of context are not always natural in the werewolf game.
• Agent Code:
  • Sample Agent in Java
  • Agent Keldic (Japanese Output)
  • Agent mcre (Japanese Output)
• Werewolf Language Corpuses:
  • MafiaScum Dataset (700 games of Online Werewolf)
  • Game logs of previous competitions
  • Corpus Wolfbbs (Japanese)

Infrastructure Division

The AIWolf project celebrates open source software. In that sense, the infrastructure division recognizes contributions to the project through the creation of tools such as: visualizers, parsers, sample agents, server software, and others.

Tools submited to the infrastructure division will be evaluated by the participants and organizers of the competition, and a vote will choose the best contribution of this year.

• Regulation:
  • A submission to the “Infrastructure Division” consists of some software that assists the research and development of AIWolf Agents. For example, a platform for agent development, sample agents in new languages, viewers to visualize games between agents, etc.
  • To participate in this division, publish your software as a Github repository using an open source license, and send an e-mail to the organizing commitee with the link.
  • The submissions will be evaluated by the organizers and participants of the competition during CoG, who will vote among the participating entries.
  • To facilitate access, evaluation and voting, the AIWolf project will fork the participant’s projects at the deadline of the competition, and post the links in this website.
• Submission deadline: August 10th

General Resources

• 2020 CoG AIWolf Tutorial — 3 youtube videos with linked code
• AIWolf Competition Slack Channel
• 3rd International AIWolf competition webpage (2021)
• AIWolf Papers (TBA)

Frequently Asked Questions

Past News

2022/02/21 — 4th Edition webpage open!
2022/02/25 — Webpage updated with resources and information for each division