← DD: From Me to You
MCBW 2027 · Open Call Public Space · Signal — Noise

DD: From Me to You

A shared field of signals that arrive without being fully deciphered

Artist
Jaeyong Jeong · Independent artist
Uijeongbu, Republic of Korea · didiwebel.com
Preferred site
Südwiese at the Alte Pinakothek
Subject to site availability and coordination with bayern design

Image: DD manga, work in progress

Conceptual visualisation. This image does not accurately reconstruct the actual site. The final site, equipment, dimensions and layout will be agreed with bayern design and local technical partners. Images on the vertical pages will be replaced with the final original DD manga artwork.
01 · Concept

A private letter, a shared field

Within the memories of DD residents in a black-and-white shōjo manga, a visitor writes a letter using DD characters whose meanings cannot be fully deciphered. Through AI interpretation and calculation, the character sequence becomes a digital pigment. The letter does not return to its intended addressee. Instead, its pigment reaches a shared field of other traces and leaves colour on a being.

The first field: a letter within the manga

On a portrait touchscreen, visitors enter the memories of DD residents through black-and-white manga. DD questions and choices appear intermittently, without a supplied explanation of their meanings. Each choice changes the order of scenes and reveals relationships between characters differently. At the end, a visitor writes a letter using DD characters.

The second field: DD: Landscape

A floor display between three terminals becomes a shared field. It is not the ending of the manga: it is a space in which the residues of earlier participants coexist during the exhibition. The letter intended for a DD resident arrives among the traces of others. The “You” is no longer a fixed recipient; it slides towards strangers the visitor has not met.

This misdelivery is not a technical failure. It is the work’s central movement: an utterance leaves its author’s intention and understanding, and enters a new relationship.

02 · Language and pigment

An utterance becomes colour

DD consists of 22 characters. Visitors are not given a dictionary or a one-to-one translation. They infer relationships from repeated characters, images and the scenes before and after each choice.

At the end of the manga, a letter of up to 11 characters passes through AI interpretation and calculation to become colour data: a digital pigment. The system does not present a German or English translation as a correct answer.

What the AI does

The external AI’s interpretation is an input to the pigment calculation. It is not proof that the letter’s meaning has been recovered. Visitors may observe relationships between a character sequence and its colour, but receive no answer key for their intended meaning. The work does not claim that communication is impossible. It asks what remains, and what changes, when an utterance is transformed into a sensory form.

What has been verified

It has not yet been tested whether a new request containing exactly the same character sequence produces exactly the same pigment. The proposal therefore makes no claim of exact colour reproducibility between separate requests. Once a result has been confirmed, it is stored and can be retrieved.

A trace of one utterance

The pigment belongs to a submitted utterance, not to a participant’s essence or identity. The calculation uses the final submitted sequence; hesitation and earlier choices are not used to infer a visitor’s inner state. The pigment is applied to a human or butterfly form, and a separate real-time movement system drives the beings’ motion and interactions. The colour trace leaves the visitor’s hand and enters relationships with other traces.

03 · Visitor experience

From a personal screen to a shared field

  1. 1

    Encounter

    Three large black-and-white manga pages stand on the lawn around a field of moving colour. The vertical pages act as markers from a distance; the floor becomes visible on approaching.

  2. 2

    Enter

    Each page contains a portrait touchscreen. A public edition lasting approximately 3–4 minutes is planned. Its pen lines and screentones connect the screen to the printed pages.

  3. 3

    Choose without a key

    Intermittent DD questions and choices ask visitors to orient themselves through repeated glyphs, images and memories, rather than a supplied translation.

  4. 4

    Write a letter

    The visitor addresses a DD resident using a sequence of up to 11 characters.

  1. 5

    Receive a pigment

    AI interpretation and pigment calculation produce a confirmed RGB result on the exhibition PC. The terminal then returns to a grey wall of manga masks: one mask takes on the received colour while the others stay uncoloured. The colour is held by a mask, not by the visitor, before it leaves for the shared field.

  2. 6

    Arrive elsewhere

    The pigment is misdelivered to DD: Landscape and becomes the colour of a being. Neutral human forms and human–butterfly transformations are planned for the exhibition.

  3. 7

    Share the surface

    Visitors can walk across the field or watch from its edge. A body obscures the image and casts a shadow; it does not control the beings. The work does not track positions.

With three terminals, the target is approximately 35–45 participants per hour, to be validated against processing waits and concurrent use. Bystanders can also witness letters arriving without participating.

04 · Signal — Noise

Relations beyond decoding

SIGNAL — NOISE asks how we identify signals within a field of stimuli. This work extends that question to relationships: what reaches another person, and what escapes the meanings we intend?

Not every noise must be eliminated.

Complete decodability can also erase difference. Here, translation does not recover a hidden correct meaning; it transforms an undeciphered DD utterance into colour. Meaning remains unfixed, while the submitted trace becomes visible.

The work draws on Édouard Glissant’s right to opacity: a relationship need not demand the other’s total transparency. That opacity also applies to one’s own letter. A participant may not fully know what they have sent, or what it becomes elsewhere. At the terminal, the received colour appears on a mask: a face that is not the sender’s own.

Tuning perception

Repetition and difference between characters, images and scenes after each choice offer an uncertain orientation. Attention grows without resolving into a complete key.

Making meaning

Meaning arises through connections between choices, images and subsequent actions, rather than the discovery of a concealed answer.

Translating signals

AI interpretation and pigment calculation distinguish understanding a message from transforming it into a sensory form.

Creating resonance

A new being joins an existing field of movement. Different voices remain different, while changing their relationships with the movements of others.

05 · Visual and spatial proposal

A walkable digital paper

The work uses the visual grammar of East Asian shōjo manga from the 1990s and 2000s as a partially legible cultural signal in Munich. Faces, gazes and distances may be felt immediately, while screentones and the ordering of relationships are read differently according to a viewer’s background. This echoes the opacity of DD.

At the centre, an approximately 3.0 × 2.0 m walkable outdoor LED field is proposed. Broad empty space surrounds sparsely distributed, moving, matte-coloured forms. Humans and butterflies coexist unevenly in the same space, at different scales and depths.

Human forms are planned to stand on differently oriented ground layers. They occupy the same surface without sharing a single ground plane, so a viewer looking down cannot see every figure upright from any one position. Future transformations between human and butterfly retain a cool, artificial quality rather than simulate lush nature.

Day and night

By day, a warm white or light grey background connects the field to the black-and-white pages as a “walkable digital paper”. This also addresses readability on a horizontal screen exposed to sunlight. As ambient light falls, the background transitions to black over 30–60 seconds. Coloured forms then move through black emptiness at different depths and speeds.

Day
Night

Conceptual visualisations. These images do not accurately reconstruct the actual site. The final layout and dimensions will be confirmed after a site survey and technical review.

Representative images from the DD manga. Final pen-and-screentone artwork will be enlarged on the vertical pages.

05 · Spatial proposal

Three pages around a field

Three approximately 2.4 m high manga pages face inward from three directions, leaving a fourth side open. Final pen-and-screentone artwork, cropped panels and enlarged DD characters replace the provisional imagery. Each page includes a portrait terminal.

The pages act as beacons, enlarge black-and-white manga into public space, offer a sheltered place to participate, and create a threshold between private reading and collective observation. The letter is written privately in front of a page, while its trace is collectively overlooked and crossed. The DD resident is a flat, intended recipient inside the manga; in the field, the letter becomes colour and a being.

ElementProposed dimension / arrangement
Total footprintApprox. 5.5 × 5.0 m, including ramp
Walkable outdoor LEDApprox. 3.0 × 2.0 m; 6 × 4 modules at 500 mm
Vertical manga pagesThree; approx. 1.5 × 2.4 m each, measured from ground
Maximum structure heightApprox. 2.5 m above ground
Platform and maximum fall height150 mm or less
Access rampApprox. 1.5 × 2.5 m; maximum gradient 6%
External public passageMinimum clear width 1.5 m
Three terminalsIdentical content; operating heights above finished deck: LOW 850–1,000 mm / MEDIUM 950–1,100 mm / HIGH 1,050–1,200 mm
Wheelchair turning spaceØ1,500 mm in front of the LOW terminal

Orientation will respond to sunlight and access. Full-scale tests will assess brightness, reflections and colour; output brightness and contrast may be adjusted while preserving the stored pigment result. At night the screen dims automatically. The work uses neither sound nor water. The official mcbw sign stands beside the ramp entrance.

05 · Preliminary drawing

Plan, elevation and ramp section

Preliminary drawing for coordination, not a construction drawing. Dimensions in millimetres. Final dimensions and orientation will be confirmed after the site survey and structural review. Terminal heights are measured from the finished deck surface.
06 · Production process

Production with AI

DD: From Me to You was produced through repeated dialogue with generative AI and code-generating AI throughout its entire production process, including narrative development, manga imagery, animation, interface design, coding, and system development.

A nonhuman interlocutor

In this work, AI is not treated as a transparent tool for making production more efficient. It is a nonhuman interlocutor that processes language and images differently from a human being. During production, the AI did not simply execute the artist’s intentions. It altered characters’ forms and expressions, interpreted image sequences in reverse, generated objects that had not been requested, and distorted bodies and spaces. Even identical instructions produced different results each time.

Judging and negotiating

The artist did not accept these results uncritically. He reviewed, rejected, or selected the generated outputs; redefined the conditions; revised the instructions; and edited and rearranged the images and code. The artist’s role was not to produce a finished result through a single command, but to judge and negotiate the differences generated by another system of perception, thereby constructing the work’s meaning and form.

The same structure as the visitor’s

This production process is structurally connected to the viewer’s experience within the work. Just as the artist collaborated with AI without fully understanding its language or mode of judgment, the viewer forms a relationship with an Other through the undecipherable DD language. In both cases, communication is not a process in which an original intention is reproduced without alteration. It is a process through which an event occurs by passing through mistranslation, failure, revision, and choice. The production of the work is therefore itself an experiment that asks how human beings might communicate with nonhuman beings.

Which errors to keep

The errors and deviations produced by AI are technical defects that must be corrected during production. At the same time, they are traces of human intention transformed through its passage across another system of perception. Rather than unconditionally aestheticizing these errors, the work treats the decision of which errors to remove and which differences to retain as part of the creative process itself.

“Even identical instructions produced different results each time.”

06 · Current development

A verified digital connection

01
02

Implemented and tested

  • Black-and-white interactive manga with nonlinear branching, DD questions and choices.
  • Input with 22 DD characters; a final letter of up to 11 characters.
  • AI interpretation and pigment calculation; RGB delivery to TouchDesigner.
  • A TouchDesigner landscape of humans and butterflies with an 18-active-slot lifecycle, motion, collision and repulsion.
  • PC-browser end-to-end verification: input, AI/pigment processing, TouchDesigner application and completion status.
03
Prototype components, captured separately: (01) a DD question within a resident’s memory, (02) letter input with 22 DD characters, (03) coloured beings in DD: Landscape. The panels are not a single continuous run. The anatomical base mesh is temporary and is used to test motion, colour, collision and compositing; floor composition and final forms remain in development.

The current external AI result feeds the pigment calculation and RGB delivery. Motion is handled separately; a link from AI output to movement or density has not been verified. Android development is tested separately; the end-to-end evidence here is from the PC browser. Exact colour reproduction for repeated strings has not been tested. Confirmed results are stored and retrieved.