
DD: From Me to You
A shared field of signals that arrive without being fully deciphered
Image: DD manga, work in progress
A private letter, a shared field
Within the memories of DD residents in a black-and-white shōjo manga, a visitor writes a letter using DD characters whose meanings cannot be fully deciphered. Through AI interpretation and calculation, the character sequence becomes a digital pigment. The letter does not return to its intended addressee. Instead, its pigment reaches a shared field of other traces and leaves colour on a being.
The first field: a letter within the manga
On a portrait touchscreen, visitors enter the memories of DD residents through black-and-white manga. DD questions and choices appear intermittently, without a supplied explanation of their meanings. Each choice changes the order of scenes and reveals relationships between characters differently. At the end, a visitor writes a letter using DD characters.
The second field: DD: Landscape
A floor display between three terminals becomes a shared field. It is not the ending of the manga: it is a space in which the residues of earlier participants coexist during the exhibition. The letter intended for a DD resident arrives among the traces of others. The “You” is no longer a fixed recipient; it slides towards strangers the visitor has not met.
This misdelivery is not a technical failure. It is the work’s central movement: an utterance leaves its author’s intention and understanding, and enters a new relationship.
An utterance becomes colour
DD consists of 22 characters. Visitors are not given a dictionary or a one-to-one translation. They infer relationships from repeated characters, images and the scenes before and after each choice.
At the end of the manga, a letter of up to 11 characters passes through AI interpretation and calculation to become colour data: a digital pigment. The system does not present a German or English translation as a correct answer.
What the AI does
The external AI’s interpretation is an input to the pigment calculation. It is not proof that the letter’s meaning has been recovered. Visitors may observe relationships between a character sequence and its colour, but receive no answer key for their intended meaning. The work does not claim that communication is impossible. It asks what remains, and what changes, when an utterance is transformed into a sensory form.
What has been verified
It has not yet been tested whether a new request containing exactly the same character sequence produces exactly the same pigment. The proposal therefore makes no claim of exact colour reproducibility between separate requests. Once a result has been confirmed, it is stored and can be retrieved.
A trace of one utterance
The pigment belongs to a submitted utterance, not to a participant’s essence or identity. The calculation uses the final submitted sequence; hesitation and earlier choices are not used to infer a visitor’s inner state. The pigment is applied to a human or butterfly form, and a separate real-time movement system drives the beings’ motion and interactions. The colour trace leaves the visitor’s hand and enters relationships with other traces.
From a personal screen to a shared field
- 1
Encounter
Three large black-and-white manga pages stand on the lawn around a field of moving colour. The vertical pages act as markers from a distance; the floor becomes visible on approaching.
- 2
Enter
Each page contains a portrait touchscreen. A public edition lasting approximately 3–4 minutes is planned. Its pen lines and screentones connect the screen to the printed pages.
- 3
Choose without a key
Intermittent DD questions and choices ask visitors to orient themselves through repeated glyphs, images and memories, rather than a supplied translation.
- 4
Write a letter
The visitor addresses a DD resident using a sequence of up to 11 characters.
- 5
Receive a pigment
AI interpretation and pigment calculation produce a confirmed RGB result on the exhibition PC. The terminal then returns to a grey wall of manga masks: one mask takes on the received colour while the others stay uncoloured. The colour is held by a mask, not by the visitor, before it leaves for the shared field.
- 6
Arrive elsewhere
The pigment is misdelivered to DD: Landscape and becomes the colour of a being. Neutral human forms and human–butterfly transformations are planned for the exhibition.
- 7
Share the surface
Visitors can walk across the field or watch from its edge. A body obscures the image and casts a shadow; it does not control the beings. The work does not track positions.
With three terminals, the target is approximately 35–45 participants per hour, to be validated against processing waits and concurrent use. Bystanders can also witness letters arriving without participating.
Relations beyond decoding
SIGNAL — NOISE asks how we identify signals within a field of stimuli. This work extends that question to relationships: what reaches another person, and what escapes the meanings we intend?
Not every noise must be eliminated.
Complete decodability can also erase difference. Here, translation does not recover a hidden correct meaning; it transforms an undeciphered DD utterance into colour. Meaning remains unfixed, while the submitted trace becomes visible.
The work draws on Édouard Glissant’s right to opacity: a relationship need not demand the other’s total transparency. That opacity also applies to one’s own letter. A participant may not fully know what they have sent, or what it becomes elsewhere. At the terminal, the received colour appears on a mask: a face that is not the sender’s own.
Tuning perception
Repetition and difference between characters, images and scenes after each choice offer an uncertain orientation. Attention grows without resolving into a complete key.
Making meaning
Meaning arises through connections between choices, images and subsequent actions, rather than the discovery of a concealed answer.
Translating signals
AI interpretation and pigment calculation distinguish understanding a message from transforming it into a sensory form.
Creating resonance
A new being joins an existing field of movement. Different voices remain different, while changing their relationships with the movements of others.
A walkable digital paper
The work uses the visual grammar of East Asian shōjo manga from the 1990s and 2000s as a partially legible cultural signal in Munich. Faces, gazes and distances may be felt immediately, while screentones and the ordering of relationships are read differently according to a viewer’s background. This echoes the opacity of DD.
At the centre, an approximately 3.0 × 2.0 m walkable outdoor LED field is proposed. Broad empty space surrounds sparsely distributed, moving, matte-coloured forms. Humans and butterflies coexist unevenly in the same space, at different scales and depths.
Human forms are planned to stand on differently oriented ground layers. They occupy the same surface without sharing a single ground plane, so a viewer looking down cannot see every figure upright from any one position. Future transformations between human and butterfly retain a cool, artificial quality rather than simulate lush nature.
Day and night
By day, a warm white or light grey background connects the field to the black-and-white pages as a “walkable digital paper”. This also addresses readability on a horizontal screen exposed to sunlight. As ambient light falls, the background transitions to black over 30–60 seconds. Coloured forms then move through black emptiness at different depths and speeds.


Conceptual visualisations. These images do not accurately reconstruct the actual site. The final layout and dimensions will be confirmed after a site survey and technical review.



Representative images from the DD manga. Final pen-and-screentone artwork will be enlarged on the vertical pages.
Three pages around a field
Three approximately 2.4 m high manga pages face inward from three directions, leaving a fourth side open. Final pen-and-screentone artwork, cropped panels and enlarged DD characters replace the provisional imagery. Each page includes a portrait terminal.
The pages act as beacons, enlarge black-and-white manga into public space, offer a sheltered place to participate, and create a threshold between private reading and collective observation. The letter is written privately in front of a page, while its trace is collectively overlooked and crossed. The DD resident is a flat, intended recipient inside the manga; in the field, the letter becomes colour and a being.
| Element | Proposed dimension / arrangement |
|---|---|
| Total footprint | Approx. 5.5 × 5.0 m, including ramp |
| Walkable outdoor LED | Approx. 3.0 × 2.0 m; 6 × 4 modules at 500 mm |
| Vertical manga pages | Three; approx. 1.5 × 2.4 m each, measured from ground |
| Maximum structure height | Approx. 2.5 m above ground |
| Platform and maximum fall height | 150 mm or less |
| Access ramp | Approx. 1.5 × 2.5 m; maximum gradient 6% |
| External public passage | Minimum clear width 1.5 m |
| Three terminals | Identical content; operating heights above finished deck: LOW 850–1,000 mm / MEDIUM 950–1,100 mm / HIGH 1,050–1,200 mm |
| Wheelchair turning space | Ø1,500 mm in front of the LOW terminal |
Orientation will respond to sunlight and access. Full-scale tests will assess brightness, reflections and colour; output brightness and contrast may be adjusted while preserving the stored pigment result. At night the screen dims automatically. The work uses neither sound nor water. The official mcbw sign stands beside the ramp entrance.
Plan, elevation and ramp section
Production with AI
DD: From Me to You was produced through repeated dialogue with generative AI and code-generating AI throughout its entire production process, including narrative development, manga imagery, animation, interface design, coding, and system development.
A nonhuman interlocutor
In this work, AI is not treated as a transparent tool for making production more efficient. It is a nonhuman interlocutor that processes language and images differently from a human being. During production, the AI did not simply execute the artist’s intentions. It altered characters’ forms and expressions, interpreted image sequences in reverse, generated objects that had not been requested, and distorted bodies and spaces. Even identical instructions produced different results each time.
Judging and negotiating
The artist did not accept these results uncritically. He reviewed, rejected, or selected the generated outputs; redefined the conditions; revised the instructions; and edited and rearranged the images and code. The artist’s role was not to produce a finished result through a single command, but to judge and negotiate the differences generated by another system of perception, thereby constructing the work’s meaning and form.
The same structure as the visitor’s
This production process is structurally connected to the viewer’s experience within the work. Just as the artist collaborated with AI without fully understanding its language or mode of judgment, the viewer forms a relationship with an Other through the undecipherable DD language. In both cases, communication is not a process in which an original intention is reproduced without alteration. It is a process through which an event occurs by passing through mistranslation, failure, revision, and choice. The production of the work is therefore itself an experiment that asks how human beings might communicate with nonhuman beings.
Which errors to keep
The errors and deviations produced by AI are technical defects that must be corrected during production. At the same time, they are traces of human intention transformed through its passage across another system of perception. Rather than unconditionally aestheticizing these errors, the work treats the decision of which errors to remove and which differences to retain as part of the creative process itself.
“Even identical instructions produced different results each time.”
A verified digital connection


Implemented and tested
- Black-and-white interactive manga with nonlinear branching, DD questions and choices.
- Input with 22 DD characters; a final letter of up to 11 characters.
- AI interpretation and pigment calculation; RGB delivery to TouchDesigner.
- A TouchDesigner landscape of humans and butterflies with an 18-active-slot lifecycle, motion, collision and repulsion.
- PC-browser end-to-end verification: input, AI/pigment processing, TouchDesigner application and completion status.
The current external AI result feeds the pigment calculation and RGB delivery. Motion is handled separately; a link from AI output to movement or density has not been verified. Android development is tested separately; the end-to-end evidence here is from the PC browser. Exact colour reproduction for repeated strings has not been tested. Confirmed results are stored and retrieved.
