Spray-on smart skin allows users to type on their phone using a virtual QWERTY keyboard

by

Many smartphone users would prefer to avoid the cramped QWERTY keyboard available on their handsets and use a virtual QWERTY that can be displayed like a hologram on a table in front of them. These virtual keyboards can be the size of the QWERTY used on desktop computers, giving the user more room to type. This will result in faster and more accurate text input being typed by smartphone users.

Or let’s say you want to play mobile games on your phone without using controllers or even without touching your handset. Sure, your hands may be flying in the air like the conductor of an orchestra, but once the audience knows what you’re doing, they’ll be in awe. You’ll be able to navigate through your apps while doing the same thing.

Spray on Smart Skin lets you use a virtual keyboard instead of your phone’s QWERTY

According to Nature Electronics (via the dailybeast), researchers at Stanford University are working on a smart skin that would use artificial intelligence (AI) to interpret a person’s movements. This smart skin can be sprayed from a can like shaving cream. The spray is called “nanomesh,” and it’s a mesh-like stretchable material that can move and bend with your skin. It uses tiny electrical sensors that pick up your movements and send them to a Neuro Processing Unit (NPU) for interpretation. Using machine learning, the system learns how each user interacts with the Smart Skin in the context of custom hand gestures.
The sensitive mesh network is embedded in polyurethane and composed of millions of nanowires coated in gold and silver. The trap stays on the skin until it is washed off with soap and water. It also conforms to the wrinkles and folds that each individual finger has. A light bluetooth transmitter is attached to the mesh which allows the transmission of signal changes.

“As the fingers bend and twist, the nanowires in the mesh are squeezed together and pulled apart, changing the electrical conductivity of the mesh,” said Zhennan Bao, professor of chemical engineering at Stanford and senior author of the study. There can be changes. To measure and analyze to tell us how the hand or finger or joint is doing.”

Smart Skin washes off with soap and water

Kyun Kyu “Richard” Kim, a post-doctoral scholar in Bao’s lab and the study’s first author, said, “We have come across aspects of human learning that are known only in a few tests, known as ‘meta-learning’.” ‘ This allows the device to rapidly recognize arbitrary new hand tasks and users with just a few quick tests.” “Moreover, this is a surprisingly simple approach to this complex challenge, which means we can achieve faster computational processing time with less data because our nanomesh captures the subtle details in its signals,” said Kim. “

The future uses of this technology go far beyond smartphones, apps and games. Surgeons would be able to spray the smart skin onto their arms and control a robotic surgeon in an operating room hundreds of miles away. Skin can also be used to touch an object and find out everything about that particular object. the daily beast Likened the feature to a “wearable Google Lens” which is a good analogy.

Let’s see how Virtual QWERTY will work. Using machine learning, an algorithm can learn the speed required to type the letter “X” on a keyboard based on patterns of electrical conductivity. Once the algorithm is “trained” to recognize all letters, numbers, punctuation marks, etc., the physical keyboard is no longer needed. And it will open up the ability to type on a virtual keyboard that may be easier to type on and more accurate than your phone’s QWERTY.

Source link

Leave a Comment