01Opening
Guest Lecture · Universitas Bunda Mulia, Jakarta

Keynote / 2026

Sound, Systems,
and Computational
Imagination.

From electroacoustic practice
to AI and beyond.
Dr. Patrick Hartono
Lecturer in Digital Media (Interaction) · RMIT University Vietnam
~45 slides · 40–60 min
↓ press →
01Opening
02 / Who I am
02 / 49

Why am I speaking about this?

I am an Indonesian-born composer
who became a maker of systems.

Born in Makassar. Trained as an electroacoustic composer, then drifted — from sound, to image, to interactive systems, to AI. I now teach and research at the seam where listening meets computation.
composer audiovisual new media researcher

01Opening
03 / Trajectory
03 / 49

A trajectory, not a CV

Codarts IRCAM Melbourne Goldsmiths RMIT.

Rotterdam
Codarts · Sonology (minor)
London
MMus Sonic Arts · Goldsmiths
Paris
Live Electronics · IRCAM
Melbourne
PhD · Interactive Composition
London
Lecturer · Computational Arts
Ho Chi Minh City
Lecturer · Digital Media (Interaction)
— now —
Researcher · AV + AI + Pedagogy
02Context
04 / Selected context
04 / 49

Not as self-claim — as context

A handful of verifiable footholds.

  • Ars ElectronicaHutan Plastik in the Listening Room.
  • Stanford CCRMA — Linux Audio Conference 2019.
  • Journal for Artistic Research — editorial board engagement.
  • iiicon (Harvard) — conference presentation.
  • SIGGRAPH DAC — profile + SPARKS 2026 involvement.
  • NIME 2025Harmonix Series publication.
  • Organised SoundSoundscapes of Papua.
  • Organised Sound 28(2)Algorave: Paguyuban Algorave (w/ Sutanto, 2023).
03From Sound to Computational Arts
05 / 49
03
— Section
From Sound
to Computational
Arts.
03From Sound to Computational Arts
06 / What computer music taught me
06 / 49

Computer music trained me to think beyond conventional musical notation — to compose with systems, processes, algorithms, spatial sound, synthesis, interaction, and uncertainty.

— Personal framing
03From Sound to Computational Arts
07 / Sound as material
07 / 49

Material #1

Sound as material,
not just signal.

  • Electroacoustic — composing with recorded, synthesised, processed sound.
  • Sonology — sound as structure, space, and perception.
  • Spatial sound — composition extended into the listening room.
Pierre Schaeffer's question still holds:
what does this sound do — not what does it mean?
03From Sound to Computational Arts
08 / Image as computed behaviour
08 / 49

Material #2

Image as computed behaviour,
not surface.

  • Generative visuals — image as the running of a process.
  • TouchDesigner & real-time systems — performance as dataflow.
  • VR & game technology — space as interactive composition.
There is solidarity between scientific development and the progress of music. Throwing new light on nature, science permits music to progress — or rather to grow and change with changing times — by revealing to our senses harmonies and sensations before unfelt. On the threshold of beauty, science and art collaborate.
— Edgard Varèse, The Liberation of Sound, 1936
03From Sound to Computational Arts
09 / From PhD to now
09 / 49

Material #3

Body, gesture, myth —
and now intelligence.

PhD · Melbourne
Myth, body, gesture, and interactive audiovisual composition. Performers and machines as co-compositional agents.
Now · RMIT Vietnam
AI, text, perception, machine learning, intermediality. Audiovisual works that ask what machine listening, seeing, and judging actually do to a composition.
03From Sound to Computational Arts
10 / Central thesis
10 / 49

Working definition

Computational Arts is not simply art made with computers.
It is a way of composing systems: sound systems, visual systems, interactive systems, social systems, and now intelligent systems.

04Added Value
11 / 49
04
— Section · After Chion
Added Value
as compositional
ground.
04Added Value
12 / Chion's idea
12 / 49

After Michel Chion

Sound does not just accompany image.

  • Sound can transform what an image appears to mean.
  • Meaning emerges between perception, image, sound, and context.
  • The audiovisual contract is productive, not additive.
REFMichel Chion, Audio-Vision: Sound on Screen (Columbia UP, 1994). READmonoskop.org/Michel_Chion
04Added Value
13 / Beyond synchronisation
13 / 49

My extension

Meaning emerges when sound, image,
and text reorganise each other.

Added value is not only sound enriching image. In my work it becomes a compositional condition — text operates alongside sound and image as an agent that re-tunes perception, not as caption or decoration.
TEXT
SOUND
IMAGE
a three-way contract
04Added Value
14 / Manuscript in review
14 / 49

Current paper

Intermediality Beyond Synchronisation:
Text as a Compositional Agent in Electroacoustic Audiovisual Performance.

Organised Sound under final review private manuscript
Not yet published. No DOI yet. URL forthcoming.
STATUSunder final review · Organised Sound · private manuscript
05Case Studies
15 / 49
05
— Section · Four works
Case studies.
01 · Ciung Wanara 02 · Hutan Plastik 03 · F2 04 · Peripersonal
05.1Case Studies · Ciung Wanara
16 / Ciung Wanara
16 / 49

Case study 01

Ciung Wanara.
Interactive audiovisual composition.

  • Foundation from my PhD research.
  • Inspired by Indonesian shadow puppet battle.
  • Rooster avatars respond to performer gesture.
  • Composing not material, but behaviour.
Ciung Wanara live performance — rooster avatars projected on a large screen
live performance · rooster avatars + gestural control
05.1Case Studies · Ciung Wanara
17 / Ciung Wanara · video
17 / 49

In performance · AIMC 2024, Oxford

↗ open on YouTube
Key transition

From composing fixed AV material
→ to composing interactive audiovisual behaviour.

presented at   AIMC 2024
AI Music Creativity Conference
University of Oxford
05.2Case Studies · Hutan Plastik
18 / Hutan Plastik
18 / 49

Case study 02

Hutan Plastik.
Forest, plastic, electroacoustic listening.

Audiovisual / electroacoustic work concerned with forest destruction, West Papua, palm oil, environmental memory. Exhibited in the Ars Electronica Listening Room.
05.2Case Studies · Hutan Plastik
19 / Hutan Plastik · still
19 / 49

From the work

Hutan Plastik — still from the work: a glitched, posterised landscape with burning flames above a forest line
still from the work · forest, flame, glitched surface
Key idea

Electroacoustic listening,
visual imagination,
ecological anxiety — held together.

05.3Case Studies · F2
20 / F2
20 / 49

Case study 03

F2.
Text as a compositional agent.

F2 still — May 1998 testimony text on the left, glowing 3D point-cloud form on the right inside a wireframe cube
still from F2 · May 1998 testimony + computed form
  • Sound, image, and text do not need to be synchronised in the conventional sense.
  • Text shapes perception, memory, narrative tension.
  • Connected to my current Organised Sound manuscript.
STATUSpaper in final review · private manuscript · URL forthcoming
05.3Case Studies · F2
21 / F2 · key claim
21 / 49
F2 still — closing testimony text on the left, glowing point-cloud figure inside a wireframe cube on the right
still from F2 · closing testimony + computed presence

Text does not describe the audiovisual work.
It composes how the audiovisual work is perceived.

STATUSpaper in final review · private manuscript · URL forthcoming
05.4Case Studies · Peripersonal
22 / Peripersonal Modular Interfaces
22 / 49

Case study 04 · with Wing Hei Cheryl Hui

Peripersonal Modular Interfaces.
Accessible Digital Musical Instruments for care ecologies.

Peripersonal Modular Interfaces — a young musician playing a wooden, six-stringed hexagonal sensing tile placed on a starry-print fabric table during a community music workshop
  • NIME 2026 · London — paper.
  • Wireless sensing tiles · TPU lattice + Hall-effect.
  • Decoupled sensing from surface: tunable compliance, hygienic, robust.
  • Co-designed with a London community music charity (N = 12).
VENUENIME 2026 · 23–26 June · London, UK
05.4Case Studies · Peripersonal
23 / Peripersonal · the tile
23 / 49

One sensing tile

Peripersonal hexagonal sensing tile — wooden hexagonal panel with gold lattice keys arranged across the top surface, sitting on a desk
Key result

End-to-end haptic–audio latency:
≈ 7 ms average, < 12 ms max.


Each tile is an independent network node — reconfigurable across tabletops, wheelchair trays, or floors. The instrument is wherever the ensemble decides it should be.

REFHui & Hartono (2026). Peripersonal Modular Interfaces for Care Ecologies. NIME ’26, London.
06Current Research
24 / 49
06
— Section · Collaborators & students
A research
network in
motion.
06Current Research
25 / Network overview
25 / 49

Six active threads · 2026

Patrick · RMIT Vietnam
with Shuang LiGorgon Loop · SIGGRAPH 2026
with Fioretta ZhangOnycho Lab · ACM C&C 2026
with FedericoLinea Viva · ACM C&C 2026
with C. Berg & B. Yountricity-flux.xyz · Ars Electronica
with Zhiqi WangMycortex · ARTECH 2025
06Current Research
26 / Gorgon Loop
26 / 49

06A · with Shuang Li

Gorgon Loop.

Gorgon Loop — installation: ceiling-mounted rig with hanging displays and mirrors, SIGGRAPH 2026 banner above
  • SIGGRAPH 2026 Art Papers — camera-ready submitted.
  • Algorithmic judgement & smart mirrors.
  • Collective social behaviour as installation.
  • Machine vision + generative language revealing how systems classify us.
forthcoming · SIGGRAPH 2026 · Los Angeles · 19–23 Jul
06Current Research
27 / Onycho Lab
27 / 49

06B · with Fioretta Zhang

Onycho Lab.

Onycho Lab — five fingertip prostheses in pink, peach, blue, magenta and crimson, mounted upright in a row
  • ACM Creativity & Cognition 2026 — demo paper.
  • Wearable fingertip prostheses.
  • Feminist hapticism · artificial nails as bodily technology.
  • Touch, ornament, and labour re-framed through a clinic-style ritual.
conditionally accepted · in final submission
06Current Research
28 / Linea Viva
28 / 49

06C · with Federico (Fede)

Linea Viva.

Linea Viva — performer at laptop console drawing into a canvas with a light-pen; projected contour lines glow against a deep blue field

[TODO · placeholder — awaiting Fede's draft.]

accepted · ACM C&C 2026
URL forthcoming
06Current Research
29 / tricity-flux.xyz
29 / 49

06E · with Christian Berg + Bin Youn

tricity-flux.xyz.

tricity-flux — stacked stills: point cloud figure, object-detection bounding boxes over abstracted scene, particle explosion

Triangulating urban change through pixel-to-particle translation: a triangular prism installation exploring Ho Chi Minh City through point cloud aesthetics and particle simulation.

submitted · Ars Electronica Expanded 2026
06Current Research
29 / Mycortex
29 / 49

06F · with Zhiqi Wang

Mycortex.
Non-human symbolic communication through art and bioelectric signals.

Mycortex installation — forest setting with projected light symbol on the left and a hand touching electrode-wired mushrooms on the forest floor on the right

An interactive installation juxtaposing fungal electrical signals with human brainwaves — transforming both into non-narrative language and symbols. A “third space” for interspecies translation, non-anthropocentric, posthuman.

ARTECH 2025 · Braga, Portugal
06Current Research
29 / TDYolo
29 / 49

06G · open-source · MIT

TDYolo.
Real-time YOLO object detection inside TouchDesigner — no Python required.

TDYolo running inside TouchDesigner — node network on the left, detection parameter panel in the centre, four live detection output panels on the right with bounding boxes overlaid on a video feed

A drop-in .tox component that runs YOLOv11 inside an embedded headless browser — inference via WebGPU (WASM fallback), zero Python environment, zero pip install. Real-time bounding boxes and class labels flow straight into the TouchDesigner node graph.

open-source · MIT · 74★
06Current Research
29 / Machine perception
29 / 49

What ties it all together

My current work moves toward machine perception — how computational systems see, classify, distort, and respond to human presence — and how artistic research can hold that conversation honestly.

07AI · The Tool
29 / 49
07
— Section · A personal reading
AI: the tool
I was
waiting for.
07AI · The Tool
29 / Not a rupture
29 / 49

A long tradition continued

Coming from computer music, AI did not feel like a rupture.
It felt like an extension.

Using unfamiliar systems, non-conventional methods, algorithms, randomness, synthesis, and computation to move beyond conventional musical thinking — that is exactly what electroacoustic practice has always done.

07AI · The Tool
29 / The Tony Stark moment
29 / 49

Honestly

When these AI tools appeared, I felt something close to a Tony Stark moment. Things I could not previously do — because of time, technical limitation, or lack of specific knowledge — suddenly became prototypable.

07AI · The Tool
29 / The danger
29 / 49

But — and it is a serious but

The danger is not only ethical.
It is cognitive and artistic.

When everything becomes possible,
direction becomes harder.

07AI · The Tool
29 / Stronger judgement
29 / 49

The shift

The question is no longer how to use the tools.
It is how to filter, judge, select, direct.

For experienced practitioners
AI accelerates prototyping. It compresses time-to-trying.
For young makers
Without strong fundamentals, infinite possibility becomes overwhelming. AI needs stronger artistic judgement, not weaker.
08The 50/50 Principle
29 / 49

Section 08 · A working equation

50% concept + 50% technical skill
=
creative agency.
08The 50/50 Principle
29 / Think through making
29 / 49

Why both halves matter

The artist of the AI era
must be a thinker-doer.

Concept without technique
— often stays abstract.
Technique without concept
— often becomes empty demonstration.

The future belongs to people who can think through making.

REFSteve Jobs on "doers" — source needed.
09Quantum Horizon
29 / 49
09
— Section · Speculative but grounded
Quantum
horizon.
09Quantum Horizon
29 / Metaphors, not only speed
29 / 49

I am not pretending to be an expert

For artists, quantum is not only about speed.

  • New conceptual models for multiplicity.
  • New tools for uncertainty.
  • New ways of non-binary thinking.
  • Simultaneity and superposition as compositional metaphors.

Quantum may give us
new metaphors
for thinking about reality,
uncertainty, and composition.

10Indonesia · Where are we now?
29 / 49
10
— Section · Honest, not cynical
Where are
we now
in Indonesia?
10Indonesia · Where are we now?
29 / Potential ≠ ecosystem
29 / 49

Opening claim

Indonesia is full of creative potential.
But potential alone is not an ecosystem.

10Indonesia · Where are we now?
29 / Infrastructure gaps
29 / 49

The shape of the gap

Talent is here. The system around it is still being built.

  • Higher education is fragmented and uneven.
  • Research culture still maturing.
  • Long-term mentorship under-resourced.
  • Internationalisation only partially integrated.
  • Peer-review culture not yet critical mass.
  • Ecosystem-building treated as optional.
10Indonesia · Where are we now?
29 / The mental transition
29 / 49

A delicate point

Scholarships are opportunities,
not end-states.

The phase many get stuck in

"I can study overseas."

The deeper goal

"I am here to build knowledge, discipline, methods, ethics, and an ecosystem."

10Indonesia · Where are we now?
29 / Tall poppy
29 / 49

A careful note

A healthy ecosystem
does not cut down expertise.

In some contexts, people who stand out are treated as threats rather than assets. This prevents expertise from growing.

The question is not whether Indonesia has creative talent.
It does.

The question is whether we can build the systems, cultures, and institutions that allow that talent to mature into expertise.

11Closing
29 / Closing reflection
29 / 49

Where this leaves us

We are entering a moment where sound, image, text, AI, and computation are no longer separate tools. They are becoming one expanded field of creative systems.

The task for artists is not only to use these systems — but to understand them, question them, and compose with them responsibly.

11Closing
29 / Final statement
29 / 49

— Final statement —

Do not only
use the tool.
Compose the system.

12References & Sources
29 / References
29 / 49

All sources referenced in this deck

Public profile
rmit.edu.vn/profiles/h/patrick-hartono
gold.ac.uk/computing/people/hartono-patrick
calls.ircam.fr/profiles/individual/7315
extended.asia/contributor/patrick-hartono-v3
dac.siggraph.org/person/patrick-hartono
Selected venues & publications
ars.electronica.art · Listening Room
lac.linuxaudio.org/2019
jar-online.net
dac.siggraph.org/sparks/2026
nime.org/proc/nime2025_22
cambridge.org · Soundscapes of Papua
cambridge.org · Paguyuban Algorave (OS 28/2, 2023)
Case studies
nime.org/proc_music/nime2024_music_45 (Ciung Wanara)
beast.cal.bham.ac.uk/beast-feast-2025
Current research · conferences
cc.acm.org/2026/demos
dl.acm.org/doi/10.1145/3773699.3773722 (Mycortex · ARTECH 2025)
Indonesia context
intechopen.com/chapters/86650
reuters.com · AI roadmap (2025)
reuters.com · sovereign AI fund (2025)
reuters.com · "Dark Indonesia" protests (2025)
Theoretical reference
Chion, M. (1994). Audio-Vision: Sound on Screen. Columbia UP.
Steve Jobs on "doers" — source needed.
Unverified / forthcoming
Hartono, P. Intermediality Beyond Synchronisation · Organised Sound · under final review
Gorgon Loop (Li & Hartono) · SIGGRAPH 2026 · final URL forthcoming
Onycho Lab (Zhang & Hartono) · ACM C&C 2026 · URL forthcoming
tricity-flux.xyz · Ars Electronica Expanded 2026 · submitted
13Q&A · Thank you
29 / Q&A
29 / 49

Now

Terima kasih.
— and now, your questions.

QR code linking to RMIT profile of Patrick Hartono
scan → rmit profile
also on linkedin · instagram