Bringing AI to the Metaverse, and viceversa
Do you want to earn some NCR while doing fun stuff you enjoy, and at the same time contribute to science and the future? Well, then you may wanna participate in the following challenge^^ We need your help to train a really awesome AI!
The MetaGen Data Challenge is the first initiative to engage social VR users in AI research, so that they can contribute to it, and benefit from it. For the challenge, we are looking for people who want to record their VR activities and share them to a public dataset for AI research. We will be using the MetaGen Recording tool, and will be offering two bounties for the first people to reach certain milestones:
500 NCR for the first person or group to reach 24h of public domain recordings of general and social activities. The recordings can be of anything that involves social interaction (acting, role playing, chatting), but also other activities like dancing, or playing games. More details below.
500 NCR for the first person or group to reach 12h of public domain recordings of dancing. This is particularly aimed at the VR dancing community, like members of IDA and others:)
The idea is that if you do acting, roleplaying, streaming, playing social games, dancing, etc., then you can do any of those things, and use the bot to record them (which is as easy as pressing a couple of buttons, as explained int the video). Below, I’ll explain in more detail what kind of things it would be interesting to record (from the perspective of being useful/fun for an AI to learn from), as well as how to use the tool in more detail.
This is intended to be a very broad category, but with an emphasis on social activities, but also “active” games. Examples of things that count:
Examples of things that don’t count:
I mean some of these can be in the recordings, but they shouldn’t account for the majority of the recorded time.
Tip: I think a good idea is to participate in this while you are streaming. That way you already have the expectation that what you are doing is public, and many people stream social activities too (e.g. podcasts):)
This one is much more straightforwad. The only requirement is: Full body tracking, and to enjoy dancing^^
For each of the categories, you can enter the challenge as one person or as a group. You will need to organize yourselves for this, and tell me who your group is so that I can check the total time for the group. The reward will be shared among the group of people. The max group size is 5. For example, if 5 people participated in the first category as a group, then each of them will only need to record 5h (or some may do more, some may do less), and each would get 100NCR (or you can share it however you wish too).
The exact same rules apply as to what kind of content counts for each category, whether participating as a person or in a group.
You don’t need to tell me now whether you are participating as a group, but you will need to, if you are claiming the price.
You can check this video for a quick tutorial on how to use the tool. Note that in the current version the baked animation will not be produced (unless you check the checkbox “Generate Animation”), so that if you leave the tool recording for a long time or with many people, it wont spawn large animation objects.
Here are some more details
The tool only records friends of the bot, by default. Any person can override this by checking the “Record me” local checkbox in the tool.
You can check how many hours, both total and public, you have recorded by sending a message to the bot saying “info”.
On the tool, you can check whether you are submitting the current recording to the public dataset (necessary to count for the MetaGen Data Challenge). Friends have this checked by default, but it can also be overriden by changing the checkbox in the bot’s UI. You can also change the default by sending a message to the bot saying “default no public”, to set the default to be private, or “default public” to set the default back to public.
Sometimes the bot may crash, or perhaps someone deleted the UI. You can tell the bot to generate a new UI by sending it a message saying “reset”, or by inviting it to a new session.
There is also a version of the puglin you can use locally, but which doesn’t allow you to connect to sessions with people who are not running the plugin. If you want to use the local version, let me know (@guillefix on twitter or guillefix#5692 on discord), and I’ll explain how to use it. You can also check the source code here if you are programmer.
Also do contact me about any bugs, problems, ideas, or feedback about the bot!
Hopefully this is just the first of many more fun activities and challenges at the intersection between AI and the metaverse! More rewards and things will come to participants:) I will also list anyone who has donated to the public dataset on the acknowledgments of a sientific publication which presents the dataset.
Join our discord server to keep track of updates or to ask questions