DX Portfolio
LuminLeaf
The LuminLeaf is an installation that enhances urban well-being by responding to emotional states through biofeedback. Using Galvanic Skin Response (GSR) sensors, it visualizes users’ emotions with dynamic light and sound, adapting in real-time to reduce stress and anxiety. Tested across Columbia University, LuminLeaf has shown potential in libraries and public spaces, offering an interactive way to improve mental health in cities. By bridging the gap between techno-logical innovation and mental health, LuminLeaf offers an approach to enhancing life quality in urban settings, making it a valuable addition to smart city initiatives.
We consider three design questions:
• How can we visualize people’s emotional conditions in a clear and obvious way?
• How can we ensure the installation is usable in various envi-ronments?
• How can the installation serve as a reminder of negative emo-tional states and help soothe people’s emotions?
TEAMMATES
Hongqian Li, Mina Wei, Zihao Zhang
INSTRUCTOR
Professor Anthony Vanky
DURATION
March 2024 - April 2024
AFFILIATION
Columbia University
CATEGORY
Affective Computing, Locative Installation
DELIVERABLE
Interactive Installation
MY WORK
Concept Design, Prototype
TOOLS
GSR, Audrino Uno, Laser Cutting
DEMO VIDEO
STEP ONE: THE CHALLENGE AND THE METHOD
-
CHANLLENGE
Often, adults may feel restricted in openly expressing their emotions, leading to misunderstandings and a lack of emotional support. Perceiving emotions accurately can be challenging. To tackle this issue, we propose developing a method to visualize emotions effectively. This approach is designed to enhance individuals’ awareness of their own emotional states and to cultivate a supportive environment where others can understand and respond to these emotional cues with empathy.
-
METHOD
Input: People’s skin sweating is used to measure the emo-tion condition. This sweating response is linked to emo-tional states like stress or excitement.
Sensor: GSR, or Galvanic Skin Response, is used to mea-sure the skin’s electrical conductance, which changes with moisture levels driven by the autonomic nervous system. Output: The illuminating plant utilizes LED lighting in various colors and modes to reflect people's emotional states. Accompanied by a fan, it helps individuals experiencing stress to meditate and find calmness.
THE RESULT OF THE BRAINSTORM
THE OVERALL WORKFLOW OF THE PROJECT
STEP TWO: PROTOTYPING
To prototype our idea, we first established how to cor-relate GSR data with emo-tional conditions. We con-ducted initial testing using a GSR sensor and observed our emotions to calibrate the data. We then considered how the installation should react when different emotions are detected. We decided to use various colors of lighting as a clear way to visualize emo-tional states. Additionally, if negative or extremely nega-tive emotions are detected, it triggers a fan blade to make the leaves move and sway, helping to soothe the user. Next, using Arduino and coding, we enabled the GSR sensor to communicate with the LED ring and used optical fiber to create illuminating leaves.
THE RELATION BETWEEEN GSR DATA AND THE RELATION OF THE INSTALLATION
THE TECHNICAL DIAGRAM
THE ASSAMBLY OF THE PROTOTYPE
THE SKETCH OF THE PROTOTYPE
STEP THREE: USER TESTING
Lastly, we designed a user testing protocol to evaluate the effectiveness of the instal-lation under various circum-stances. Below are the details of the experiment.
Pilot Site: Libraries, Classrooms in GSAPP, Columbia University Morningside & Manhattanville Campus
Time: April 18, 2024 - May 1, 2024
Number of Participants: 4
Number of Experiments: 12
Experiments:
Experiment 1: One person did different types of work in the same environment setting.
Experiment 2: One person did the same type of work in the different environment settings.
Experiment 3: Different people did similar work in the same environment setting.
EXPERIMENT 1: ONE PERSON TOOK DIFFERENT ACTIVITIES
EXPERIMENT 2: ONE PERSON STUDIED IN DIFFERENT LIBRARIES
EXPERIMENT 3: DIFFERENT PEOPLE STUDIED IN THE SAME LIBRARY
DESIGN RESUITS
DIFFERENT COLORS OF LIGHTINGS CAUSED BY EMOTIONAL CHANGES
ILLUSTRATION OF THE INSTALLATION AT THE LOCAL SCALES
In a 1-meter scale interaction, the LuminLeaf’s color changes enable users to monitor their emotional fluctuations during activities. This feedback helps determine the most suitable space for specific tasks. Placed at the edge of a table, it detects the user’s emotional shifts, enriching personal experiences.
In a 10-meter scale interaction, within a small classroom setting, the emotions of a user are visible to others when the LuminLeaf is activated. This visibility can prompt interactions with the user, thereby influencing the overall emotional atmosphere of the room.
ILLUSTRATION OF THE INSTALLATION AT URBAN SCALES