Course website of DS/CS/ISyE 518: Wearable Technology Spring 2019
VR Muscle Armband
Use pressure armband to simulate muscle according to mass of the rigidbody so that users can have a more interactive experience when using VR.
Light up Heating Hoodie
Overview: A hoodie that lights up according to light and temperature, then use the same sensory technology to heat up few parts of the upper body.
Technology: light and temperature sensor, LED light, heating panel
Audience: people who want to look cool at the same not freeze to death
My idea for a wearable tech project is a mobile game with a wearable component and plushies. The intent of this project is to create a game with wearable tech with dirt-cheap wearable tech components that can be given away practically for free.
The main summary of the game is that users find and collect animals in their game by going to locations with the plushies and scanning their pendants against the plushie’s body to unlock that animal in their game.
This idea can be broken down into 3 components, each of which is considered a milestone:
Below are some mockups for the game’s UI and some ideas for the plushie designs. The two plushie ideas that people seemed to really like were a Sheep and an Otter, although close runner-ups were a Corgi and “A Loaf Of Cat”
I feel fairly confident in building the mobile app, and feel as though the hardware components will be rather easy to setup once I have one working model.
I feel like I could use some improvement in setting up the networking aspect of this, as well as the plushie designs.
Natalie Tack
Sketch
Description
This project is designed to solve the problem of people not knowing when they are overheating or experiencing hypothermia. This product is specifically designed to be worn under a large winter coat and is specifically for people who enjoy spending time outdoors in the winter months (athletes, enthusiasts, etc.).
The high-level idea of this product is that the temperature sensor monitors the body’s temperature within the coat. It is Bluetooth connected to a person’s phone and sends updates to it when there are big degree changes. For example, hypothermia can set in when the body’s temperature is 95 degrees or below, and overheating occurs when the body’s temperature is 104 degrees or higher. However, I am not sure if the temperature inside a coat will be the same as internal body temperature. However, either way, if the person’s body temperature is nearing one of these extremes, it would notify the user so that they can do something to combat either of these two conditions from occurring.
This design is meant to be pragmatic and preventative, it is easier to stop hypothermia/overheating from happening than to fix them when they do happen.
Confident
I am confident in getting the circuit constructed and the Bluetooth connected with a phone.
Less Confident
I am not confident in designing something that is comfortable. I am also not confident in sending the Bluetooth information to any app other than the default application that comes with the Flora Bluefruit LE Module.
A note: In thinking further about this product, this product may also be useful for mountain climbers, and in that regard, it may be useful to have a SPI barometric pressure/altitude sensor as well (Adafruit also makes these). These sensors in combination could help prevent a number of conditions from setting in.
Author: Curt Henrichs
I propose to make a supernumerary robotic finger (SRF) with position detection glove. This will consist of a robotic thumb mounted near the pinky, mirroring the biological thumbs location and movement. This thumb will be constructed with 3D printed mounting brackets and high torque micro servos. The thumb will be mounted to a modified wrist guard as used in skateboarding in order to distribute the weight of the thumb onto the wrist. The wrist guard must not impede normal hand function. Finally, there will be a series of flex sensors mounted onto a glove to detect the joint state of the wearer’s fingers. This along with an inertial measurement unit will report the hand pose information to an algorithm to control the SRF. For this project the algorithm will be constrained to a simple hard-coded heuristic approach, but future work will use data driven AI to learn the wearer’s intent off their hand position.
I am primarily developing this project for my own curiously. Specifically, I would like to wear the device for a full day to record hand position data, record failures and inconveniences, record interactions with others and their perception, and explore contexts of applicability. This in turn allows me to further develop a machine learning algorithm, iterative design improvements, HCI insight, and further general SRF usage taxonomy respectively.
As for the eventual end-user, this technology could potentially augment any life task however I am mostly interested in applying the technology to the manufacturing and construction spaces where the ability to do self-handovers is an important aspect of the task. An example would be screwing an object overhead while on a ladder. The constraints are that a person should keep three points of contact while holding both the object and the screwdriver. If they need to do all three, they may lean the abdomen onto the ladder which is less effective than a grasp. Instead with several robotic fingers (or a robotic limb) the object and screw driver could be effectively held/manipulated while grasping the ladder. Another example the should relate to this class is soldering where the part(s), soldering iron, and solder need to be secured. This could be overcome with an SRF thumb to feed the solder to the tip of the soldering iron while holding the parts down with one’s other hand.
Academically I am motivated by the research opportunities in the space. There are many unanswered questions as this technology has not been popularized yet. Though my interest stems from the philosophy that I adhere to, that being humans are not the end state of evolution. I am excited to construct technology that not only affects my physical appearance but my physical capacities.
As far as I am aware in the SRF literature I am providing a modest incremental improvement. Wu & Asada worked with flex sensors however they were only interested in the first three fingers and did not attempt to model the hand position directly [1,5]. Arivanto, Setiawan, & Arifin focused on developing a lower cost version of Wu & Asada’s work [2]. One of Leigh’s & Maes’ work is with a Myo EMG sensor which is not included in the project [3]. They also present work with modular robotic fingers though they never explore the communication between finger and human in that piece [4]. Finally, Meraz, Sobajima, Aoyama, et al. focus on body schema where they remap a wearer’s existing thumb to the robotic thumb [6].
My project will take inspiration from Wu & Asada (along with other work in flex sensors as to detect finger movement), Meraz, Sobajima, Aoyama, et al. will provide inspiration of using a thumb as the digit being added, and Leigh’s & Maes’ work in modular fingers will be the inspiration for how I construct the wrist connection. The novelty is bringing these pieces together to form a wearable that I can run a long-term usability test with myself as the subject.
Figure 1: Supernumerary robotic fingers found in literature.
Figure 2 displays my thoughts on how the glove will be laid out. My first experiment will be whether one flex sensor is sufficient to capture the joint position for a finger. The position of the IMU is mounted on the glove instead of the wrist in order to capture more accurate absolute orientation of the fingers. Figure 3 shows the mounting location of the finger along with sketches of the robotic finger itself. This is inspired off of Wu & Asada’s work though I am going to building one with micro-servos instead of standard scale. These sketches are subject to change as I construct the glove.
Figure 2: Glove sketch with alternate approaches.
Figure 3: Robotic finger sketch (top) fusion 3D image, (bottom) top and bottom view of finger mounting position.
First major challenge that I have accounted for is that one flex sensor may not be enough to determine the joint state of a finger. Thus, as I will outline later, my first experiment is to see if this is the case. The next is that I do not have time to develop all components. This would be the worst case but if it does happen, I believe that I will prioritize the sensor glove before the fingers. While I have to learn more about 3D printing, I am also not a novice so given access and time I should be able to print out several parts for a robotic finger. Finally, the algorithm to convert from pose to finger position will most likely be a simple heuristic based on gesture. This could mean inadvertent triggering of a movement even if this was not the intent. While a failure of the algorithm, I am least concerned with this aspect for the term.
I have already purchased (though as of writing this still in shipping) the parts I need for my first hardware experiment. I need to figure out whether I can determine which of three finger joints is bending using one 4.5” flex sensor. If this is successful, then I will use 5 of these to capture pose information. Otherwise I will need to purchase 10 2” flex sensors to detect the finger position in one direction. As for the spread between fingers, I plan on using 1” flex sensors but for the initial prototype 2” flex sensors will work. I also plan on using an IMU to determine absolute orientation with respect to the Earth. All of this will be mounted on a relatively thin winter glove that I have purchased.
I will need to sew on the flex sensors for the one finger and one spread sense along with some mounting for the IMU. This will be connected to an Arduino Uno clone that I have to report the data back to my PC for visualization. The most challenging portion of this prototype is developing the code to determine position followed by with visualizing the hand state.
Lydia Schweitzer
NIRS or EEG based hat that gathers brain responses and changes color/produces visualization
Different way of communicating.
People can see elements of emotional/mental state.
For creative, poetic, experimental output, research purposes.
Future research- collect data over time for mental health field.
Confident:
Not so Confident
Lydia Schweitzer
Gloves/conducting stick that sense(s) sounds and movement, connecting with a screen to generate visualization.
Creates the ability to provide a visual component in response to the environment, accounting for human interpretation and creativity.
Could be used at concerts, performances, conducting an orchestra, DJing.
For creative, poetic, experimental output.
Confident:
Not so Confident
What does it do?
This is a self-lacing shoe controlled by buttons on the shoe or via an app on your phone.
What technology does it include?
The shoe includes a motor to pull the laces tight, a lace cable, a battery, led lights, buttons, accelerometers, a gyroscope, a pressure sensor and a bluetooth module.
Who is the user or target audience?
Nike is targeting basketball players to start with but is looking to expand in the future.
How could it be better? What would you improve?
The sounds is a compliant from almost everyone. I also wonder if bluetooth is the correct interface. I feel like a gesture interface might not be a better way to interact with a system like this. Overall the user experience still feels lacking.
What differentiates it from what is on the market?
Previous self-lacing shoes were big and bulky. The integration of technology definitely is huge improvement over previous generations.
Is it on the market? How much does it cost?
It will be on the market soon for a cost of $350.