GitHub - Harpita-P/Kiro-InteractionKit: Winner of the Kiroween 2025 Grand Prize. Build creative gesture-controlled games & apps with Kiro! · GitHub Skip to content Navigation Menu Sign in Appearance settings * Platform * AI CODE CREATION * GitHub Copilot Write better code with AI * GitHub Copilot app Direct agents from issue to merge * MCP Registry Integrate external tools * DEVELOPER WORKFLOWS * Actions Automate any workflow * Codespaces Instant dev environments * Issues Plan and track work * Code Review Manage code changes * Code Quality Enforce quality at merge * APPLICATION SECURITY * GitHub Advanced Security Find and fix vulnerabilities * Code security Secure your code as you build * Secret protection Stop leaks before they start * EXPLORE * Why GitHub * Documentation * Blog * Changelog * Marketplace View all features * Solutions * BY COMPANY SIZE * Enterprises * Small and medium teams * Startups * Nonprofits * BY USE CASE * App Modernization * DevSecOps * DevOps * CI/CD * View all use cases * BY INDUSTRY * Healthcare * Financial services * Manufacturing * Government * View all industries View all solutions * Resources * EXPLORE BY TOPIC * AI * Software Development * DevOps * Security * View all topics * EXPLORE BY TYPE * Customer stories * Events & webinars * Ebooks & reports * Business insights * GitHub Skills * SUPPORT & SERVICES * Documentation * Customer support * Community forum * Trust center * Partners View all resources * Open Source * COMMUNITY * GitHub Sponsors Fund open source developers * PROGRAMS * Security Lab * Maintainer Community * GitHub Stars * Archive Program * REPOSITORIES * Topics * Trending * Collections * Enterprise * ENTERPRISE SOLUTIONS * Enterprise platform AI-powered developer platform * AVAILABLE ADD-ONS * GitHub Advanced Security Enterprise-grade security features * Copilot for Business Enterprise-grade AI features * Premium Support Enterprise-grade 24/7 support * Pricing Search / Sign in Sign up Appearance settings You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert Harpita-P / Kiro-InteractionKit Public * Notifications You must be signed in to change notification settings * Fork 1 * Star 15 * Code * Issues 0 * Pull requests 0 * Actions * Projects * Security and quality 0 * Insights Additional navigation options * Code * Issues * Pull requests * Actions * Projects * Security and quality * Insights main Branches Tags Go to file Code Open more actions menu Latest commit   History 51 Commits 51 Commits Folders and files Name Name Last commit message Last commit date .kiro .kiro     kiro_interaction_kit kiro_interaction_kit     my_apps my_apps     tests tests     xmedia xmedia     .gitignore .gitignore     LICENSE LICENSE     README.md README.md     requirements.txt requirements.txt     setup.bat setup.bat     setup.sh setup.sh     View all files Repository files navigation * * README * MIT license More items Kiro InteractionKit A clean, starter-friendly template for building gesture-controlled games, creative apps, and interactive experiences using Kiro. Kiro InteractionKit gives developers a lightweight, flexible foundation for turning real-time hand, face, and head tracking into simple, intuitive controls. This code skeleton removes all the complexity of MediaPipe + Computer Vision code and gives you a clear Python interaction layer you can plug directly into games, creative apps & accessibility tools. Want to build a Mario-style game where jumping = pinch your fingers ? Make music just by moving your head ? Or draw in mid-air with your fingertip for a fresh twist on Pictionary? Speed up development and build creative apps with the Kiro InteractionKit. Featured Applications Built With Kiro InteractionKit 1. Math-O-Lantern (Interactive Game) 🎃 A fun, hand-controlled pumpkin-slicing game where players solve quick math problems by pinching to slice the correct pumpkins. Play the PyGame → Test the Featured Applications 2. Holo-Board (Lightboard-Inspired Tool for Videos) ✏️ A transparent, gesture-controlled glassboard recorder that lets you draw in mid-air while your webcam keeps you visible on screen. Control the board with simple gestures: * Point → Draw * Open Hand → Stop drawing * Fist → Change color * Rock Sign → Clear canvas Create floating annotations like a studio lightboard and export a single clip with recorded video, audio, and ink . Try the App → Test the Featured Applications Get Started with InteractionKit 1. Clone and Open in Kiro IDE git clone https://github.com/Harpita-P/Kiro-InteractionKit.git cd Kiro-InteractionKit ./setup.sh # macOS / Linux . \s etup.bat # Windows The setup script tests your camera and prepares a virtual environment with Mediapipe, OpenCV, Pygame, and PyAutoGUI. A webcam or built-in laptop camera is required. Don't forget to grant camera access to Kiro. 2. Test the Featured Applications After completing the setup above, you can run the 2 app inside the my_apps folder. 🎃 Run Math-O-Lantern (Interactive Game) python my_apps/Math-O-Lantern/main.py ✏️ Run Holo-Board (Lightboard-Inspired Video Tool) python my_apps/Holo-Board/main.py To customize the images in your video, please add your images to the Annotate folder. 3. Leverage Kiro's Superpowers This starter kit is designed to work the Kiro IDE, which automates key parts of building gesture-controlled apps. Hooks Kiro uses the 3 Hooks in .kiro/hooks/ to automatically integrate any new hand, head, or face gestures you request in your spec. If a gesture doesn't already exist, Kiro generates the detection logic and wires it into the correct controller—you don't have to write any MediaPipe or Motion Tracking code. Steering Docs The Steering Docs in .kiro/steering/ guide Kiro on intended app architecture, proper gesture usage, and recommended testing approaches. These documents help ensure your InteractionKit project stays organized and scalable. MCP Through MCP in .kiro/settings , Kiro connects to Context7 , giving it access to real-time MediaPipe and Pygame reference material. This allows it to generate accurate gesture-tracking logic and appropriate game components. To enable MCP, open Kiro Settings → MCP and add your Context7 API key. Get your key at https://context7.com/dashboard Spec Kiro uses a spec-driven workflow: you describe what your app should do and how gestures should behave, and Kiro converts that into a full design and task plan. This keeps your architecture clean and ensures gesture logic is integrated correctly. 4. Preview Hand, Face & Head Tracking Features Before building a new app, preview the gesture tracking system. The InteractionKit template includes pre-built logic for hand, head, and face gestures using a clean controller-based API. You can preview all of the available gestures by running these tests: python tests/CV-Test-Head.py python tests/CV-Test-Hands.py python tests/CV-Test-Face.py A full list of pre-defined gestures can be found here . Now, let's build a new InteractionKit app with Kiro by creating a spec! 5. Start a New Project & Create a Spec Delete the 2 existing applications in the my_apps folder and create a new folder for your app. Next, in the Kiro IDE, create a new spec from the Specs panel in the left sidebar using the + button, or by opening the command palette and searching for “New Spec.” When writing a spec, keep it focused and clear. Describe what the app does and how gestures should control the experience. Example Spec for a Hand-Controlled Fruit Ninja Game Build an app called Fruit Ninja, a basic fruit-slice game controlled by hand gestures. Fruits and bombs fall from the top of the screen. The player moves a cursor using an open hand and slices by performing a pinch gesture. Slicing a fruit awards 5 points. The player begins with 3 lives shown as hearts, and pinching a bomb causes it to explode and removes one life. When all lives are gone, the game ends. The game will include background music and sound effects, and all assets such as images and audio have been provided. After creating your spec, Kiro will use the Hooks, Steering Docs, and MCP integration to design and build your app. All development occurs inside the my_apps folder, and any assets (images, audio, fonts) should be placed in your app’s assets directory. Kiro will automatically decide which gestures to implement—or generate new ones if needed. 6. Run Your App python my_apps/my-game/main.py That’s all it takes! Pre-Defined Gestures Hand Gestures Head Gestures Face Gestures Fist Nod Up Blink Pinch Nod Down Smile Peace Turn Left Mouth Open Thumbs Up Turn Right Thumbs Down Tilt Left Rock Sign Tilt Right Open Hand Pointing OK Sign Cursor Position About Winner of the Kiroween 2025 Grand Prize. Build creative gesture-controlled games & apps with Kiro! Resources Readme MIT license Activity Stars 15 stars Watchers 0 watching Forks 1 fork Report repository Releases Packages Contributors Languages Footer (c) 2026 GitHub, Inc. Footer navigation * Terms * Privacy * Security * Status * Community * Docs * Contact * Manage cookies * Do not share my personal information You can’t perform that action at this time.