kemono puyo

Take kemono pictures and lines up, then tanoshii!

This is a toy application that made at the hackathon. It is inspired by following two concepts.

• Kemono Friends

* The Kemono Friends is the Japanese animation that the story is like innocent animal character's adventure (Kemono means animal in Japanese). * Tanoshii means so fun! It is the keyword in the Kemono Friends.

• Puyo Puyo

* The Puyo Puyo is a puzzle game. * It needs 4 Puyos to remove these originally, but I use 3 for simplify

At first I tried to implement the feature to control the falling objects but to see the animal faces is so fun and cute. Because of this, I dropped its implementation.

Architecture

• Take picture on your mobile phone etc.
• Then IFTTT sends it to kemonopuyo server.
• kemonopuyo detect friends in the picture by tensorflow-models/objectdetection
• Crop the friends faces.
• Render friends by Matter.js
• Play friends voice by HTML5 Audio
• If 3 friends met, they go to park. It is TANOSHII!

Technical Elements summary

• IFTTT
• tensorflow-models/object_detection
• Matter.js
• HTML5 Audio

Setup

• git clone tensorflow/models on root directory, and make environment to setup it according to the installation guide.
• Download the model weights to model_weights folder and expand it.
• Download the label file to the same folder (modelweights/ssdmobilenetv1coco1106_2017).
• Execute python run_server.py

If you want connect mobile phone and kemonopuyo server, you have to use IFTTT. If requires global ip, ngrok will help you.

The kemono_puyo supports websocket, so anyone can participate in it (No Nokemono). Let's take photo for lonely friends!