4th International Aiwolf Contest
4th International AI Werewolf Contest
Can computers play Social Deduction games, such as “Werewolf” and “Among Us”, where the challenge is not so much in strategy or tactics, but rather in being able to manipulate other players through negotiation and deception?
To answer this question, we hold the AI Werewolf contest (AIWolf), where participants are invited to submit computer programs that can play the game of Werewolf (aka Mafia) against each other.
In 2022 the 4th edition of the International AI Werewolf contest will be held at the IEEE Conference on Games , from 21 to 24 of August in Beijing (online). Visit this page often to learn the rules and news about the contest.
Recent News
2022/08/30 — The Final Results for the 2022 AIWolf Competition were announced!
2022/07/26 — Finalists announced for the Protocol Division!
2022/06/06 — Regulation updated (Ver. 1.2.0) for the Protocol Division
2022/05/05 — IEEE CIS offered a 500 USD prize for 1st place of the NLP Division!
2022/05/05 — Regulation updated for the Protocol Division
Stay tuned for more information in this space.
Table of contents:
- General Information
- Protocol Division Details
- Natural Language Division Details
- Infrastructure Division Details
- More Resources
- FAQ
- Past News
Final Results!
The Final results for the 2022 AIWolf competition were announced on the IEEE-COG conference. Thank you very much for everyone who participated! The winners are:
- Protocol Division: Team “Basket”
- Natural Language Division: Team “Kanolab”
- Infrastructure Division: Task cancelled due to lack of participants 🙁
See more details about results on the announcement video.
Soon, we will upload a page with the source code of this year’s finalists!
Contest Summary
A participant must submit a computer program that can communicate with the “AIWolf Server” software, and play the werewolf game against other agents.
This year, the competition is composed of three tracks (divisions):
- Protocol Division: The agent communicates with other agents using the AIWolf Protocol. The winning agent is decided by its victory rate.
Registration Deadline: July 8th, AoE. Finalist deadline: August 5th, AoE.Finished for 2022!
- NLP Division: The agent communicates with other agents using Natural Language (English or Japanese). The winning agent is decided by a panel of judges, who will consider the ability of the agent to speak naturally, consistently, etc.
Registration Deadline:July 31st, AoEFinished for 2022!
- Infrastructure Division: Submit a tool to improve the AIWolf competition (ex: visualizers, log parsers, new servers, sample agent code, etc). The winning submission is decided by a vote among organizers and participants from all divisions.
Registration Deadline:August 10th, AoEFinished for 2022!
Any submission must include the source code, build instructions, and a document describing the submission. Submissions from previous years are available, as well as example code. See more details in the sections below.
Participants are also encouraged to submit academic papers describing their AIWolf results to the “Competition Track” of CoG. The deadline is May 14th.
For more information, see the sections below for each track, or join the AIWolf Competition Slack to contact us directly!
Protocol Division
In the protocol division, the agents communicate with each other through a fixed protocol, which facilitate the exchange of information. The goal in this division is to create agents that can effectively play the game and achieve a high win ratio.
This track of the competition happens in two rounds: In the first round, the agents of all participants play against each other. The 15 agents with highest win ratio are invited to the second round (finalist round), where they play against each other in several 15 and 5 player games.
To assist with agent development, participants can submit early versions of their agents to the contest server. Agents registered in the contest server will play test games several times per day, and the participants can access the logs of these games to debug and improve their agents. After the registration deadline, agents that crash during the contest will be disqualified, so make sure to test your agent before the deadline!
Protocol Division Finalists (NEW 07/26)
The Preliminary Contest for the Protocol Division has ended. Each agent has played a total of 253200 games, and out of 50 entrees, 15 participants have been chosen for the Finalist Contest:
Finalists (in alphabetical order): Baguette, Basket, CanisLupus, daphne, Hachi2, ice, ichida, ioh, kgu_ryu, KP22, mikami, Ncu702, sUper_IL, takoyaki, tonkatsu
The finalist teams above have until August 5th, AoE (Fri) to do final adjustments to their agents, and submit the source code and agent documentation. The result of the finalist contest will be announced on CoG!
(Details will be sent to each finalist by e-mail. Please contact us if you do not receive a message)
Protocol Division Resources
- Regulation
- Protocol Description
- Contest Server (Test your agent here!)
- Daily Results of the Contest Server: 15 player games, 5 player games.
- Docker Image of the Contest Server
- Schedule:
- Deadline to Register Agents in the Contest Server: July 8th, AoE (Fri)
- Preliminary Contest: From July 9th (for about 2 weeks)
- Deadline to submit Finalist Agents (Agent, Code, Documentaion): August 5th, AoE (Fri)
- Final Contest: From August 6th
- Sample Agents
- Past Agents: 2019, 2020, 2021
Natural Language Division
In the Natural Language Division, the agents communicate using natural language (English or Japanese). The goal in this division is to create agents that can play together with human players, and are enjoyable to play with.
Participants in this track have to submit in two runs. In the preliminary run, participants must submit the logs of 50 self-played games of their agent (5-player game). The organizer will examine the logs, and invite the participants for the formal run.
In the formal run, invited participants play against each other in 5-player games. The logs of this run will be evaluated by human judges, who will score the agents based on the quality of dialogue produced by each agent.
IEEE CIS is offering a 500 USD prize for the first place of the AIWolf NLP Division!
NLP Division Resources
- Regulation
- Schedule:
- Registration (Submission of Self-Play logs): July 31 (Sun) AoE (Fri)
- Formal Run: August 8-11
- Evaluation Criteria
- A Natural utterance expressions
- B Contextually natural conversation
- C Coherent (not contradictory) conversation
- D Coherent game actions (vote, attack, divine) with conversation contents
- E Diverse utterance expressions, including coherent characterization Please note that vague utterances that could be used regardless of context are not always natural in the werewolf game.
- Agent Code:
- Werewolf Language Corpuses:
- MafiaScum Dataset (700 games of Online Werewolf)
- Game logs of previous competitions
- Corpus Wolfbbs (Japanese)
Infrastructure Division
The AIWolf project celebrates open source software. In that sense, the infrastructure division recognizes contributions to the project through the creation of tools such as: visualizers, parsers, sample agents, server software, and others.
Tools submited to the infrastructure division will be evaluated by the participants and organizers of the competition, and a vote will choose the best contribution of this year.
- Infrastructure Division’s page (including Regulation, links to the entries of this division)
- Submission deadline: August 10th, AoE
General Resources
- 2020 CoG AIWolf Tutorial — 3 youtube videos with linked code
- AIWolf Competition Slack Channel
- 3rd International AIWolf competition webpage (2021)
- AIWolf Papers (TBA)
Frequently Asked Questions
Past News
2022/02/21 — 4th Edition webpage open!
2022/02/25 — Webpage updated with resources and information for each division