📺 Turning raw hardware sensor data into music with Gemini
An approach to building a browser-based digital music synthesizer that uses a laptop’s built-in sensors and Gemini as a development assistant is presented. The aim is to generate music in real time by moving, tilting, or shaking the laptop, without requiring additional hardware.
■ Project concept and setup
- Repurposing a laptop as a musical instrument through its existing sensors
- Avoiding extra devices by working in the browser
- Using Gemini to help build a prototype
■ Sensor integration and real-time data
- Accessing device sensors such as orientation angle
- Referencing open-source projects and documentation for sensor access
- Streaming sensor data to a hub for real-time visualization
- Exploring how the data can be used for musical control
■ Musical interaction and outcome
- Creating music live by moving, tilting, or shaking the laptop
- Designing movement-based control that feels natural for a musician
- Realizing a vision for an interactive digital instrument
This is suitable for viewers interested in music technology, creative coding, AI-assisted development, and DIY instrument prototyping. It offers an overview of how built-in sensors and Gemini can be combined to experiment with new musical interfaces. Viewers may gain ideas for applying similar workflows to their own interactive projects.
この動画を紹介した Google for Developers の最新動画も、紹介付きで読めます。
📄 このページの紹介文は AI が独自に生成したものであり、著作権をはじめとする他者の権利(商標権・名誉権・プライバシー等)を侵害しないよう配慮しています。動画の著作権は各作成者に帰属します。