Sesame touch-free smartphone

You might have heard about the Sesame touch-free phone in 2014.  The Sesame Phone is powered by both Voice-Control and Computer-Vision technologies. The technology was made for people who have limited or no use of their hands so that they can operate a cellphone with head movements. Persons with Spinal Cord Injuries (SCI), multiple sclerosis (MS), cerebral palsy (CP), and arthritis can benefit from a touch-free phone.


Sesame touch-free phone was designed by co-founders Giora Livne, a quadriplegic veteran and electrical engineer, and computer vision expert Ben Dov.  They have won various awards: Verizon Powerful Answers (2014), Nominet Trust 100 (2014), and the Michael Bloomberg’s Genesis Generation Challenge awards (2015).

In Israel, the company is offering its devices for free to disabled according to the recent news in December 2015.  So I have started looking for if any companies are offering the sesame phone in US.

The Sesame phone is a specially configured Nexus 5 smartphone, and the phone can be purchased online. It sells for about $700 (US) plus shipping through the Indiegogo online site. They’re offering a full money-back guarantee, including shipping both ways, if you are unhappy with your device. However, it does not seem there are any US-based stores you can walk into.  I tried to contact via e-mail through both the Sesame enable and Indegogo websites to find out their current updates. Unfortunately I have not received any replies from them at this time for this blog.  Instead I have only received a request for donation; if I get any updates, I will post additional information.

In the meantime, here is the Sesame enable website:

Sesame touch-free smartphone videos

How the sesame touch-free smartphone works

Additional information from Sesame Enable (2/1/2016):

Sesame Enable informed that it is available over SIM Card only ( i.e.Verizon, Sprint, T-Mobile is not an option yet, and AT&T is plausible). You need consult your carrier by a bring your own phone plan. For now, Sesame Phone is available exclusively on an Lg/Google phone Nexus 5.

Contact information in US:

Robert Felgar




Posted in Accessibility Features, Assistive Technology, AT_Apps, Home Automation | Tagged | Leave a comment

Senior Services – Nursing Homes

Technology is rapidly changing, but the evaluations of ‘Services’ are important areas for the successful delivery model. Take for example, nursing homes or long-term care environments in the Baltimore area were reported for negligence by a local news channel. This is actually quite common as many nursing homes in US were cited for repeated violations of health, safety, and quality care. However, they are still permitted to operate and take in new residents at their facilities (Coalition for Quality Care). Often many facilities fail to create individual care plans for residents or do not permit residents to participate in their own planning.

One article reported 1.5 million nursing facilities in US, and there is a need for interventions that are tied to standardized measurement and quality improvement programs. For example, one of their research studies was conducted among 164 residents at three not-for-profit nursing homes in Pittsburgh, PA area.  The items are organized into 12 domains: comfort, security, food enjoyment, privacy, meaningful activities, religious practices, relationships, functional competence, dignity, individuality, autonomy, and spiritual well-being.

The findings from the research suggest that effective interventions need to be personalized to the individual resident. Facility-wide improvements should not be neglected. However, the best improvements are ones that assist staff to recognize and act on individual residents’ preferences.

A chart referenced by the QOL study.

A chart referenced by the QOL study.

Note: The QOL (Quality of life) care plan related to security focuses on relationships with staff. Each category description: click here.

What about overseas? An article in the New Ergonomics Perspective reported that the available resources for taking care of elderly at home are gradually diminishing in Taiwan. As a result, it presents a considerable change to meet the needs of Taiwan’s ageing society and review the quality of services at nursing homes. In the article, the researchers addressed the importance of identifying resident’s feeling and preferences into the service design specifications.

Nagamachi, a Japanese professor, founded the Kansei Engineering (KE) method that translates customer’s feeling into a design specification and minimizes the subjective interpretation of emotion.

A study using the Kansei Engineering method and Kano model was conducted among 42 elderly from four nursing homes from November 2013 and March 2014. The researchers interviewed each resident for about 30-50 minutes. They residents expected the employees’ dependability and competency. However, the result shows that the three service attributes with the highest requirements are: 1) medical instrument & physical facilities are visually appealing; 2) feel safe and feel at home; 3) quick medical treatment response when patient needs it. On the other hand, the residents do not expect their activities are well scheduled.

The study conducted in US showed their residents’ desire toward security is high. In this case, the security focuses on their relationship with the staff and how well their needs and daily personal cares are provided for. On the other hand, the study conducted in Taiwan concluded that the needs of appealing medical instruments & pristine physical facilities ranked highest among the residents. Depending on the locations and the facilities the residents’ priorities can vary based upon their preferences and needs in their environments. However, both studies state that the elderly should be involved in their daily life planning and how the nursing homes can help them to achieve their desires. Evaluating the service quality of nursing homes or long-term facilities should be done periodically. Technology helps the independence of persons with disabilities or elderly, but its careful monitoring individual’s needs toward the desired outcomes is essential.


Improving Quality of life in Nursing Homes

New Ergonomics Perspectives

Posted in Assessment, Elderly, Services | Tagged | Leave a comment

AutoMath Photo app for Android

AutoMath Photo app for Android has been downloadable from Google Play for over a year so you might have already tried the app by now. Unfortunately, it still cannot always recognize your handwritten equations, as AutoMath answers math questions by taking a photo of equations.

AutoMath app screenshot

AutoMath screenshots (from left to right: Photo, Edit equation, and Graph modes)

The features include:

Step by step answers
No internet required
Can solve simple to advanced math questions
250+ Mathematical Functions

AutoMath Photo Calculator Currently supports:

Addition, Subtraction, Multiplication, Fractions, Division, Inequalities, Powers, Polynomials, Linear Equations, Square Roots, Trigonometry, Algebra, Simplification, and Basic Algorithms

Not supported: Any other math problems such as calculus, systems of equations, complex math, graphing, table of values, and any functions not specifically mentioned.

However, Pocket Math Tutor is available if you sign up with fee: 24/7 Answers & Steps to all your math problems (including math word problems). It says your first question is free though.

It looks like how you take the picture of the printed equation matters the accuracy. For example, while testing, I have found out that if there is an extra line above of the equation, it takes as a fraction and ended up 0 divided by the equation. If you can take a picture by eliminating white spaces and focusing to the equation itself, Automath returns an accurate answer. The Edit mode option, which allows you to modify the equation or enter the equation instead of taking a picture, is helpful.

Automath provides step-by-step guidance to get the answer so you can understand how to solve the problem or graph it. The app may help you to recheck your work or learn to solve problems on the supported Math functions. Just be aware that a step-by-step solution may not be available depending upon the equation. Some users stated that taking a picture of each equation or understanding how to use the app is not easy.

Example Video :

Graphing Example :

Quick Mode Example :

You can download the app from this link: AutoMath

You may also want to compare another app called PhotoMath.

Posted in Assistive Technology, AT_Apps, AT_Math | Tagged , , | Leave a comment

Honda Walking Assist Device

Honda Motor Co., Ltd has been working on the development of the Walking Assist Device since 1999. As with the ASIMO robot, Honda’s humanoid robot, the Walking Assist Device uses new control technologies. The Honda Walking Assist Device has been tested at 50 hospitals in Japan as well as a clinical research study which has been conducted at the Rehabilitation Institute of Chicago (RIC) since 2013. Honda has received positive feedback from users, physical therapists, medical professionals, and researchers, all of which acknowledge the effectiveness of the device for rehabilitation.

Now this coming November, the Honda will start leasing the Walking Assist Device (approx. 450 units/1st year) to Japanese hospitals and rehabilitation facilities. The device can help training of walking and guiding to achieve effective walking for persons with reduced walking ability due to injury, illness or other causes (i.e. stroke). The key features of the Walking Assist Device are compact, lightweight, and easy to put it on because it is worn outside of clothing. The Walking Assist Device influences the user to achieve motions such as bending and extending both legs. It also helps user’s leg motions which enable smooth shifting of weight from heel to sole and sole to toe. One article in the Honda Website described as follows: “the control computer activates motors based on information obtained from hip angle sensors while walking to improve the symmetry of the timing of each leg lifting from the ground and extending forward and backward, and to promote a longer stride for easier walking.”

Honda Walking Device

Honda Walking Device



Posted in Assistive Technology, AT_Device, Employment, Robots, Wearable Computing, Wearable devices | Tagged , , | Leave a comment

Naida CI Q30 and Q90

The Global Elderly and Disabled Assistive Technology market will grow at a Compound Annual Growth Rate of 5.59 percent during the period 2014 to 2019 according to an article (PRNewswire).

We may see variety of products with simple or complex designs among hearing devices, mobility and ambulatory devices (i.e. Wheelchairs, scooters, and walkers), vision and reading aids, and Ergonomic Furniture and Bathroom Safety Equipment.

For example, Advanced Bionics(AB), a part of the Sonova Group, will introduce FDA approval of enhanced Naida CI Q30 and Q90 sound processors in Canada and US sometime this year. AB is known as a global leader of cochlear implant technology. Some advanced features in Q Series include new microphone technology for focusing on speech and can block prominent sounds, such as wind and echoes, to enhance hearing in challenging settings.

Naida CI Q90 - hearing aid

Posted in Assistive Technology | Leave a comment

Be My Eyes – helping blind see

iOS devices (iPhone/iPad) are very popular among the visually impaired mobile device users. For example, most of them use VoiceOver, which is a gesture-based screen reader, and comes on IOS devices. Voice commands let the user schedule meetings, make phone calls, and look up the nearest stores or restaurants.

Be My Eyes app may be also helpful to have on their iOS devices. If blind persons are living alone or in new environments, they may need to identify the detailed descriptions of the pictures or objects. For example, they may want to know the expiration date on a food label, a picture description or identify something in their new surroundings, but no one is around to help them, this app could help them. Be My Eyes is an app that visually impaired persons can connect with volunteer helpers from the world via live video chat.

Be My Eyes – helping blind see

After you install this app, you sign up as either a person needing help or as a volunteer person, who can help blind or a visually impaired person. If you speak more than one language, you can help people around the world.  When the CBS news talked about this app in February 2015, the volunteer number was about 114k. Now the number of volunteers increased more than double in August 2015 (289k).

Technology solutions for the visually impaired are not all available, and unfortunately, when it comes to funding, iOS devices are not easy for those with low-income to acquire. However, if you are an iOS user, you can be one of remote volunteer helpers by installing “Be My Eyes” app in new ways to help the visually impaired.   Here is the Be My Eyes app link to download.

Posted in Accessibility Features, AT_Apps, iOS app | Leave a comment

Home, “Smart Home”

Smart Home, equipped with electronic appliances that can be controlled remotely, has been marketed as the house of the future. This trend will help everyone including seniors and persons with disabilities. A few years ago, when I was looking for inexpensive remote control systems, there were not many products readily available. Assistive technology companies were selling environmental control devices, which they sold anywhere from $600 to $6500 and possibly more.  Besides, I found some of them were difficult for the users and their family members to configure and learn. The cost of smart homes can be difficult to obtain because insurance companies may not currently cover the cost of smart home technology.

However, today, you can find environmental control units at hardware stores or online.  For example, some elderly persons or wheelchair users may not be able to easily turn on and off lights because light switches are beyond their reach. Then, you can use a product like ConnectSense by Connect Grid. The technology (i.e. X10) has been on the market for many years, but the updated smart types can now be operated from apps on Smartphones.  If you are looking for more features, most basic kits start from $100, and you can expand your home automation options later depending upon your needs. These products are easy to install and include notifications or alerts to your Smartphone even when you are away from home if you have Internet wireless connectivity in the home.

Some features of Smart home products (Insteon, SmartThings, and more) include:

  • Secure your home with or without monthly cost
  • Receive notifications when people, pets, and cars come and go
  • Flood prevention
  • Remotely adjust the thermostat to save energy
  • Lock and unlock doors
  • Control and monitor your home from your smartphone or tablet, anywhere in the world
  • Schedule lights to turn on and off at sunrise, sunset or any time of your choosing
  • Detect leaks and motion and even monitor doors and windows
  • Get immediate alerts by text messages or e-mail
  • Receive text message and email
  • See and control your WiFi camera from your smartphone

You can buy a specific product you are interested in or buy their basic starter kit and add-on more later. You can review some product comparisons from this link: click here.



Smart Home options have been expanded to a few service sectors as well. For example, AT&T and Comcast have started working on developing products to protect and monitor the elderly from dangerous falls (EverThere–AT&T) or help disabled persons to access and control their services (Talking TV guide – Comcast).

Challenges to house automation still exist.  For example, signal strength issues can lead to distance limitations. Protecting privacy and cyber-security are other issues. However, this new wave of house automation is becoming affordable and getting easier for anyone to implement at home. These products may still not cover all of the needs for individuals with disabilities or may not be compatible with all assistive technology devices (i.e. AAC), but the future “Jetsons” home is nearly here!

Jetsons future of technology

Jetsons future of technology


Posted in Accessibility Features, Assistive Technology, Home Automation, Smart Home | Tagged , | Leave a comment

Pepper – Intelligent robot

Many researchers and developers have been working on robotic applications to support the physical and educational needs of persons with disabilities.  S0me examples are medical devices that can be used during surgery procedures, robot-assisted rehab to enhance human motor controls and strength, and personal robots that can perform human interactions with real-time feedback.

One of the personal robots that can perform human interactions with real-time feedback is Pepper from a French firm, Aldebaran Robotics (, owned by SoftBank corp., the world’s largest mobile phone company in Japan. Pepper is under 4 feet tall and weighs about 61 pounds. He can be programmed in 16 languages and is designed to live with humans at home. He doesn’t clean or cook (so what good is he?), but he is a social robot that can interact with voice, touch and emotions. The Aldebaran website says, “Pepper can translate what state you are in using his knowledge of universal emotions (joy, surprise, anger, doubt and sadness) and his ability to analyze your facial expression, body language and the words you use.” So you can have a cheerful or lonely Pepper at home based on your preference. However, it seems that Pepper will need more improvements and enhancements on apps so that he can understand each real-time question correctly.


Pepper – intelligent robot

Meet Pepper, the Friendly Humanoid Robot

The first consumer launch in Japan made only 1000 units available to the public this June 2015. All units were sold within a minute. Unfortunately, Pepper isn’t reasonable for everyone. The base price is 198,000 yen ($1,600), but you also need to sign a 3-year contract ($200 month) and additional insurance pack, which adds up to a total of $9,000. SoftBank also plans to launch “Pepper for Biz” in the fall and make the robot available for business. It looks like we may see this robot, Pepper, in the US within 12 months.

Many researchers and developers continue to focus their research to overcome the real-world obstacles to the use of robots as an effective assistive technology. It is exciting to know that robotic applications have been effectively applied not only to motor rehabilitation but also to support psychological and emotional interactions.  We may not be too far away from seeing robots like Pepper greeting customers in stores, teaching and interacting with students at schools, and being companions in assistive living facilities.

Robot Pepper Sells Out In 60 Seconds | Tech Bet | CNBC


Posted in Accessibility Features, Assessment, Assistive Technology, AT_Apps, AT_Device, Robots, Sensors, Technology in Education | Tagged , , , | Leave a comment

Wearable medical devices and sensors

Wearable technologies have been one of the exciting developments to expand possibilities in our daily life for everyone including persons with disabilities. You may be familiar with a wearable device like smartwatches that can provide real-time access to information online and advanced features to make your daily activities easier. In addition some wearable devices are used to monitor your health such as measuring your blood pressure or heart rate. For example, smart wristband (i.e. Jawbone UP3) has a heart rate tracking system built into the device. Other types of wearable devices can be used to monitor your family or loved one. Interests in wearable technologies are even growing among young developers. For example, Kenneth Sinozuka, one of the Google Science finalists, developed a wearable sensor to monitor his grandfather, who suffers from Alzheimer’s disease. The wearable sensor devices which is installed to his grandfather’s shoes and triggers whenever his grandfather steps out his bed. As a result, his family members were able to monitor and prevent his grandfather from wandering away.

Kenneth Shinozuka – Wearable Sensors for Aging Society

So what is next? Many scientist and engineers have been developing the next generation of wearable devices and sensor systems (i.e. Bio-sensing) for clinical research and health monitoring. Wearable devices, installed with variable resistance bend sensors, enable applications for human posture recognition and motion capture by recovering human joint bend angles. Some wearable sensor systems provide real-time feedback including chemical information such as monitoring potassium or lactic acid levels through their sweat or saliva. For example, without using a needle, a sensor system can gauge someone’s blood glucose level that would help for persons who suffer from diabetes. The next generation of these E-skin sensor systems (i.e. glucose-measuring tattoo) are not ready yet to market, but many scientists are working on these technologies worldwide.

More information about Wearable Medical devices and sensor systems:

Heat and motion-powered wearable electronics for improved health – CES 2015

UC San Diego Researchers Develop Next Generation of Wearable Medical Devices

Monitor Your Health with Electronic skin!

The benefits of both wearable devices and sensor systems are providing significant assistance for daily living, monitoring of persons with disabilities, seniors, infants, or patients, and allowing the early detection of potential life-threatening events. However, some people who would benefit from wearing a medical device or sensors may not willingly wear them. A few of other challenges are how to control the user’s privacy and security while wearing it.

Posted in Assistive Technology, AT_Device, Sensors, Wearable Computing, Wearable devices | Tagged , , | Leave a comment

Self-driving cars (Autonomous cars)

Most people have wished to avoid hectic driving experiences and dream about a self-driving car. Traveling is one of the challenges for persons with disabilities or the elderly. Some of them may have never driven a car. Others may have been forced to give up driving. Autonomous cars (self-driving cars) could help persons with disabilities to expand their transportation options in the future.

Since the first self-sufficient cars appeared in the 1980s, automobile manufactures have been working on prototypes. The main manufactures include Google, Audi, Mercedes-Benz, Toyota, Nissan, and Volvo. You might have seen a Google self-driving car on Youtube a few years ago (the YouTube video links are at the bottom of this blog.)

Steve Mahan & a Google self-driving car (2012)

Steve Mahan & a Google self-driving car (2012)

Today Mercedes and Audi have tested speed and long distance driving in both Europe and US. British-based auto-firm Delphi has completed a trip from coast-to-coast (San Francisco to New York – 3500 miles) with its self-driving car this year. Self-driving vehicles may become officially available to public by 2020 (Wikipedia).

Self-Driving Car Completes Drive Across America 99% Autonomously (March 2015)

Autonomous driving cars use a combination of cameras, laser and radar, sensors, maps, GPS, high-end microprocessors, and software to mimic human-like decisions such as parking, driving through congested areas, and traffic. Some designs have touch-sensitive sensors that monitor the driver to keep his hands on the wheel periodically.

Manufacturers still face challenges and need to clear hurdles of their self-driving car designs such as driving in hazardous road conditions (heavy rain and snow), navigating in a congested parking lot, protecting the car’s software from computer glitches and hackers, and distinguishing between police officers or pedestrians. It may be necessary to establish additional traffic regulations and smart-road infrastructure standards, such as systems that can relay traffic and accident data in real time. On the other hand, most of automobile accidents are based on human errors. According to an article appeared on Wall Street Journal (March 2015), a new report by a consulting firm McKinsey & Co states that self-driving vehicles could eliminate 90% of all auto accidents in the U.S.; prevent up to $190 billion in damages and health-costs annually and save thousands of lives.

For persons with disabilities, they may have challenges in accessibility to get in-and-out of a self-driving car, the limited space for a wheelchair, and the identification and location to unfamiliar places. For example, if a self-driving car needs to adjust a regular drop-off location to avoid a new construction site, which may appear overnight, the unexpected changes will create challenges for persons with disabilities (i.e. Blind). I hope that manufacturers will continue their designs with handicapped drivers in mind (i.e. accessibility to the car or a space for a wheelchair user or various prompt options). A paratransit system could implement including self-driving cars as an individual or a shared-ride transportation to provide a door-to-door service for the handicapped (i.e. MetroAccess). Then self-driving cars will make transportation available to more handicapped persons and reduce the waiting time for each rider. In addition, self-driving cars can expand more employment opportunities for disabled and those who live a far distance away.

Here are a few  more videos about self-driving cars from YouTube.

Google Self-Driving Car Test: Steve Mahan (Audio Described) – published May 2012

A First Drive Google self-driving car project – published May 2014

CES 2015 Trying to crash in a self-parking BMW – published January 2015

AUDI RS7 NO DRIVER 149mph – published January 2015

Mercedes Self Driving Future Truck test – published January 2015

Posted in Accessibility Features, Assistive Technology, Transportation for wheelchair users, Transportations | Leave a comment