AIM: This workshop aims to empower live performers and art practitioners with the skills to integrate various sensors for creating live demonstrations of real-time sensor data for creative coding applications. Participants will learn to collect data from various sensors (using standard protocols such as USB and serial communication), visualize the real-time data stream, and employ pretrained neural networks for insightful data analysis, data augmentation, and creative applications. The framework and software used are OpenFrameworks (https://openframeworks.cc/) and C/C++.
AUDIENCE: Live performers and art practitioners with very little programming knowledge. For the non-expert, we will ask ChatGPT for help with coding! We will provide code examples, slides, and help in getting started.
WORKSHOP STRUCTURE:
- Session 1: Creative coding, OpenFrameworks, the basic of programming, interactivity.
- Session 2: OpenFrameworks, creating add-ons in OFX, sensors (Kinect, Camera) and MIDI (in/out).
- Session 3: Neural networks basics, working with data, and neural networks in OFX.
- Session 4: Let's build a demo together: sensors, OFX, and neural nets - interpretation, augmentation, and generative AI.
METHODOLOGY:
- Hands-on, practical approach.
- Following and building upon a single example.
- Real-time development of a demo project with audience participation.
MATERIALS:
- Participants to use their laptops.
- Provided sensors (radar, camera, lights).
- Course materials: Slides, example add-ons for sensor integration.
- Post-workshop: Release of materials for public access.
TOOLS AND TECHNOLOGIES:
- Open Frameworks
- PyTorch/TensorFlow
- Various open-source software
- Various sensors, 24Ghz radar, cameras, Kinect 360 (Microsoft).
WORKSHOP FORMAT: Interactive, project-based learning. Emphasis on collaboration among participants of varying skill levels to address different learning curves.
SLIDES AND EXAMPLES (github repo): https://github.com/federicohyo/real-time-sensors-and-artificial-intelligence-for-live-performative-arts/tree/main
AUDIENCE: Live performers and art practitioners with very little programming knowledge. For the non-expert, we will ask ChatGPT for help with coding! We will provide code examples, slides, and help in getting started.
WORKSHOP STRUCTURE:
- Session 1: Creative coding, OpenFrameworks, the basic of programming, interactivity.
- Session 2: OpenFrameworks, creating add-ons in OFX, sensors (Kinect, Camera) and MIDI (in/out).
- Session 3: Neural networks basics, working with data, and neural networks in OFX.
- Session 4: Let's build a demo together: sensors, OFX, and neural nets - interpretation, augmentation, and generative AI.
METHODOLOGY:
- Hands-on, practical approach.
- Following and building upon a single example.
- Real-time development of a demo project with audience participation.
MATERIALS:
- Participants to use their laptops.
- Provided sensors (radar, camera, lights).
- Course materials: Slides, example add-ons for sensor integration.
- Post-workshop: Release of materials for public access.
TOOLS AND TECHNOLOGIES:
- Open Frameworks
- PyTorch/TensorFlow
- Various open-source software
- Various sensors, 24Ghz radar, cameras, Kinect 360 (Microsoft).
WORKSHOP FORMAT: Interactive, project-based learning. Emphasis on collaboration among participants of varying skill levels to address different learning curves.
SLIDES AND EXAMPLES (github repo): https://github.com/federicohyo/real-time-sensors-and-artificial-intelligence-for-live-performative-arts/tree/main
Duration (minutes)
720
What is needed
What is needed:
- 1 classroom
- some chair and tables
- power plugs
- projector for slides (or large monitor)
What the artists brings
Laptops with any of the following operative systems: Win, Linux, or Mac.
- Workshop
Authors
Federico Corradi
Netherlands Eindhoven, Italy Parma
Lorenzo Pes
Netherlands Eindhoven, Italy Perugia
Events
LPM 2024 Morocco
March 06 // 09 2024
March 06 // 09 2024
Videos (1)
