FutureDraw

futuredraw;

CLASS

DURATION

INSTRUCTOR

TEAM

PROJECT AREA

SCOPE

MDes IxD Studio: Prototyping

2023; 6 weeks

Pierluigi Dalla Rosa

Nikhila Isukapally
Gokul Beeda

Rapid prototyping, software development, industrial design, speculative design, ambient interfaces, human-computer interaction, gesture tracking, projection mapping

Conceptualizing and detailed design of the . Designing with Microsoft Co-Pilot for technology and Accenture engineering.

Brief:

Create a knowledge navigator interface that allows users to seamlessly navigate information in circa 2035.

The goal is to challenge convenience culture and frictionless scrolling.

human learning

Piaget identified three stages of learning:

However, the evolution of human-computer interfaces has been the reverse, with early computers relying on symbolic dialogues.

We need dynamic mediums that engage all modes of thought to realize technology's potential, and reinvent thought representation

Philosophical values

Dynamic

In conversations, miscommunication is common.

A new medium where people can show-and-tell, improvise dynamic simulations, and explore data spaces can solve this.

Reading is media-to-person, but words fail to transfer ideas well.

The need is of a multi-channel written communication that's skim-able, transformable, and context-sensitive.

Use your hands to think. Most intellectual work relies on flat, intangible representations.

Handheld objects as tools are rare but transformative.

Contextual

Humane

Exploring and experimenting

Phase 1

[data-wf-bgvideo-fallback-img] { display: none; } @media (prefers-reduced-motion: reduce) { [data-wf-bgvideo-fallback-img] { position: absolute; z-index: -100; display: inline-block; height: 100%; width: 100%; object-fit: cover; } }

How are people going to communicate in the future, plausibly?

The idea of an intangible interface that is dynamic and moulds itself to suit the agency is so that the human detaches itself from a tangible artifact - the smartphone.

In this speculation - applying brain machine interfaces for interaction can seamlessly communicate information.

Ambient health navigator bracelet

Phase 2

Drawing in augmented reality

Using google tilt brush and gravity sketch

Wizard of Oz-ing the pretense of drawing in spatial medium

Phase 3

The machine learns

Chalktalk is a communication NLP that helped us build further on the concept of primitive drawing and the machine to interpret our ideas on the basis of data collection.

Github repository ↗

Phase 4

Art dancing to our fingertips

The camera can track our hand gestures and with the help of LiDaR the machine can aid in manipulating the 3D objects.

The device.
The gestures.
The tool.

The device

futurecast; is a portbale device that facilitates manipulation of augmented objects with hand gestures intuitively without having to learn. The modular projector piece comes with 2 bands one for recreation use and one for power users with an extended battery life.

The gestures

The tool

We need dynamic mediums that engage all modes of thought to realize technology's potential, and reinvent thought representation

Technologies used

Software

For Hand Tracking:
Open CV Virtual Mouse Handtracking, written in Python 3.8 Version.

Following modules used:
1. OpenCV
2. Mediapipe
3. Autopy

For the drawing & 3d Model:
1. Processing- Java

Hardware

1. LiDaR (Light Detection and Ranging) to measure distances and create detailed 3D maps of the environment.
2. Laser projection
3. Image stabilization through gimbal and AI caliberation methods

Impact

Enhanced communication

The device enables dynamic visual expression, revolutionizing how humans communicate complex ideas effectively.

Accessibility & inclusivity

The wearable tool empowers individuals with limited mobility or speech impairments to express themselves visually, promoting inclusivity.

Creative exploration

The device fosters creativity and imaginative thinking, providing a portable and interactive medium for artistic expression.

Learning & skill development

The wearable tool facilitates skill development in art, design, and engineering through interactive practice and immediate feedback.

Future scope

Social media

Such platforms may be reimagined to be out of a mobile screen towards a more dynamic, spatial immersion.

Holographic projections

Combining the device with holographic representations will further enhance user experience.

Social interaction

The wearable drawing tool fosters social interaction and community engagement through collaborative sessions and sharing creations.

Collaborative & remote work

The device supports remote collaboration by enabling real-time visual communication regardless of physical location

Showcase

Prototyping Demo held in May, 2023 at California College of the Arts, San Francisco, for anyone to come and interact with the FutureDraw.

‍

I

am

Brooke

How might we communicate better

so that nothing is lost in translation?

Brief:

Create a knowledge navigator interface that allows users to seamlessly navigate information in circa 2035.

The goal is to challenge convenience culture and frictionless scrolling.

Recent work

I

am

Brooke

How might we communicate better

so that nothing is lost in translation?

Brief:Create a knowledge navigator interface that allows users to seamlessly navigate information in circa 2035. The goal is to challenge convenience culture and frictionless scrolling.

Recent work

Brief:

Create a knowledge navigator interface that allows users to seamlessly navigate information in circa 2035.

The goal is to challenge convenience culture and frictionless scrolling.