Patrick Hartono
← Works
Machine Perception

Jakarta Witness

Browser-based interactive installation · runs entirely client-side · 2026

Real Jakarta traffic footage is analysed frame by frame by an object-detection network, its restless bounding boxes counting motorbikes, cars and pedestrians. A small language model reads those counts and proposes a solution in a cold, clinical voice — ban the motorbikes, meter the cars, lift the traffic onto an elevated road.

Each solution is logical on its own terms and quietly catastrophic, because each is reasoned from densities and knows nothing of the lives those densities stand for. A third panel completes the thought: the city reduced to coloured rectangles on a grid. That flattening is the subject of the work.

Year
2026
Medium
Browser-based interactive installation — real-time object detection (YOLOv8s / ONNX Runtime Web), vision–language model (Qwen 2.5), generative simulation in p5.js
System
Runs entirely client-side on WebGPU. No server, no cloud API, no data leaves the viewer's device.
Exhibition
Gold Award, 4th International iNVENTX Creative Exhibition, Multimedia University Malaysia · ICAD 16 "Being: Becoming," Jakarta
Publication
Paper accepted, ACM SIGGRAPH Asia 2026
Live work
jakarta-witness.com
Detection panel — bounding boxes over real Jakarta traffic footage, with live class counts.
Three simultaneous detection feeds across different traffic scenes.
Detection panel with dense motorbike and car traffic, bounding boxes overlaid.

Detection, the model's account, and the reduced simulation. Figures as published with the SIGGRAPH Asia paper.

← Trapped All works GUILTY →