American Friends of Bar-Ilan University
  • HOME
  • ABOUT US
    •  
      • AMERICAN FRIENDS OF BAR-ILAN UNIVERSITY
      • BAR-ILAN UNIVERSITY NEWS
      • 2025 PRESIDENT’S REPORT
      • Browse past reports
      • 2024 PRESIDENT’S REPORT
      • 2023 PRESIDENT’S REPORT
      • 2022 PRESIDENT’S REPORT
      • 2021 PRESIDENT’S REPORT
  • SCIENCE & TECHNOLOGY
    •  
      • LIFE SCIENCES
      • COMPUTER SCIENCE & CYBERSECURITY
      • NANOTECHNOLOGY
      • ROBOTICS & ENGINEERING
      • SUSTAINABLE ENERGY
  • JEWISH STUDIES
      •  
      • JEWISH STUDIES – Communicating the relevance of Jewish Studies and Jewish values.
      • THE LOOKSTEIN CENTER FOR JEWISH EDUCATION
      • MIDRASHA INSTITUTE FOR WOMEN
      • LUDWIG AND ERICA JESSELSON INSTITUTE
        FOR ADVANCED TORAH STUDY
    •  
      • JEWISH STUDIES – Communicating the relevance of Jewish Studies and Jewish values.
      • THE LOOKSTEIN CENTER FOR JEWISH EDUCATION
      • MIDRASHA INSTITUTE FOR WOMEN
      • LUDWIG AND ERIKA JESSELSON INSTITUTE
        FOR ADVANCED TORAH STUDY
      • BIBLICAL ARCHAEOLOGY
      • Tel Zafit Archaeological Site
  • MEDICINE
    •  
      • AZRIELI FACULTY OF MEDICINE
        IN THE GALILEE
        – Bar-Ilan’s School of Medicine in the Galilee is an institution offering enhanced education and care. 
  • CENTERS FOR ISRAEL
    •  
      • CLINICS – Giving back to the community.
      • OPTOMETRY CLINIC
      • LEGAL CLINIC
      • PSYCHOLOGY CLINIC
      • MUSIC DEPARTMENT
      • BESA
        BEGIN SADAT INITIATIVE
      • THE RUTH AND EMANUEL RACKMAN CENTER
        FOR THE ADVANCEMENT OF WOMEN’S STATUS
  • DONATE
  • Contact
Bar-Ilan University Online Newsletter
Newsletter No. 7, February 2017

Disease, Distress & Quality of Relationships: All in the Voice

Beyond words, volumes may be learned from the human voice: Is a cry for help genuine or fake? Does a person unknowingly suffer from a vocal cord disorder? What is the relationship between spouses, or the compatibility of a therapist and patient? BIU computer scientist Dr. Joseph Keshet, a foremost authority on voice analysis, has developed sophisticated systems and software to address such questions and tap the vast potential in this exciting frontier field.

All in the Voice

“When I started exploring speech recognition, I realized that an opportunity was being missed — not enough academic research was being done to keep pace with this rapidly industrialized field,” recalls Dr. Joseph Keshet. Since then the BIU computer scientist has made some impressive strides which are generating interest worldwide. He uses novel voice analysis techniques to diagnose vocal cord disorders, and to extract personal and physical information about the speaker, as well as details about his environment.

Prof Joseph Keshet
Dr. Joseph Keshet

“There are many parameters in speech that are subconscious and uncontrollable, such as the duration of the ‘stop consonants’ pronounced by the speaker”, he explains, referring to the T, D, B, P, G, and K sounds in American English, which are formed by completely stopping the flow of air and then releasing it. “When I wish to communicate with someone, I tend to match the length of my consonants to that of my partner, who does the same, so we are synchronized.” He also notes the tendency to match accents and styles with speaking partners. “We take advantage of this phenomenon to measure the quality of the potential connection between the speakers, for example, the relationship between a therapist and patient. Keshet and his team base their research on analysis and processing of all existing international voice databases. “The parameters that we’re developing for speech analysis can work in any language and under severe noise conditions,” he stresses. For this big data challenge, he employs machines with powerful computational capacities — a vast improvement over previous research methods when manual linguistic analysis would take some 3,000 hours! “Currently we are working on ten times the data in just a few minutes.”

Diagnosing Disease from the Human Voice

“The computer receives a very large set of voice samples from patients with particular illnesses. The machine statistically analyzes the speech signals within their context in order to learn about the characteristics of those illnesses,” says Keshet. “Through ‘machine learning’, we are provided with a very accurate diagnosis of the specific disease and the precise clinical condition of the damaged vocal cords.”

The systems and algorithms devised by Keshet’s team – in cooperation with Dr. Jacob T. Cohen of Rambam Medical Center’s Head and Neck Surgery Department – can uninvasively diagnose cases of paralysis of the vocal cords, and soon papilloma, polyps (benign tumor), and cancer. The system can be used at any clinic and, in theory, can be activated with a mobile phone application. Says Keshet, “Until now the diagnosis was done by inserting a laryngoscope into the throat. Now it’s possible to identify the disease and its severity via a voice recording.”

Voice Analysis in the Service of Security and Interpersonal Relations

Advanced voice analysis capabilities are also enlisted to maintain security and to combat terrorism. Software developed in Keshet’s lab, which is evaluated in various US universities, has improved upon the software of the US Department of Homeland Security in gathering physical information about a speaker. “We were able to reach a more accurate resolution of weight and height,” relates the Israeli researcher. In addition, algorithms developed in Keshet’s lab can divulge details about the speaker’s environment, e.g., whether there is a concrete floor or even a fan.

In another study which analyzed the voices of a large number of English speakers in the United States, researchers were able to accurately identify the origin of the parents of children born and raised in the US who had never visited their parents’ country of origin. “We can detect the father’s Portuguese accent in the child’s voice,” says Keshet. The researchers were able to repeat this experiment successfully in German, Portuguese and Spanish.

Voice and speech obviously play an important role in both professional and personal relationships. Together with Dr. Dana Atzil-Slonim and Dr. Eran Bar-Kalifa of BIU’s Department of Psychology, Keshet analyzes the voice and compatibility of Israeli psychologists and patients in consentually recorded conversations in clinics, in order to gauge the quality of the interaction and level of trust between therapist and patient. In another joint study researchers analyze the level of support, reciprocity, and intimacy between spouses based on the analysis of their voice samples.

Clearly then, it’s not just what you say, but how you say it. And judging from the positive vibes his pioneering voice analysis research is making, chances are good that we have not heard the last word from BIU’s noted Dr. Joseph Keshet.

Also in this issue:

President's Message - February 2017 »

BIU Ambassadors' Forum Draws Over 60 Top Diplomats

Senior diplomats from more than 60 countries convened at BIU's 15th Ambassadors' Forum to hear about "Israel's New Normal? Expanding International and Regional Ties" from Col. (res) Dr. Eran Lerman, former deputy chief of the National Security Council and senior IDF Military Intelligence division director. Now a senior research associate at BIU's Begin-Sadat (BESA) Center for Strategic Studies, Lerman stated that in addition to the commonality of values and strategic interest and concerns which Israel shares with the US and Canada, it has "tools of cooperation" such as gas resources, state-of-the-art agricultural technology and other vital assets that have brought it closer to other countries.

The Healing Power of Hasidic Stories

Hasidic stories can do more than fascinate the reader. They can inspire and foster introspection, encourage emotional growth, and even heal. "The connection between bibliotherapy and Hasidic literature is very natural, and today there's greater awareness among therapists that if you want to reach people, you need to speak their 'language,'" says BIU Hebrew Literature Prof. Zvi Mark, academic head of BIU's new diploma studies program, The Healing Power of Hasidic Stories.

 read more »

 
Palm trees in a lush garden with a modern tower in the background, showcasing a blend of nature and architecture.

1. WELCOME

An essential partner in Bar-Ilan University’s development, American Friends of Bar-Ilan University provides vital philanthropic support for one of the fastest growing institutions of higher education in Israel.

3. LOOK FOR

4. READ ABOUT

BIU News Topics
  • All News
  • AFBIU News
  • Archeology
  • Biomedical Research
  • BIU Happenings
  • Engineering
  • Geopolitics
  • Health
  • History
  • Innovation
  • Jewish Studies
  • Literature
  • Medical School
  • Nanotechnology
  • Profiles
  • Science
  • Torah Studies

5. GET INVOLVED

Vibrant red roses in a garden with the word "DONATE" prominently displayed, encouraging charitable contributions and support for a cause.

ABOUT US

  • HOME
  • Bar-Ilan University
  • American Friends of Bar-Ilan (AFBIU)
  • AFBIU Financial Information
  • Board of Directors
  • Contact us

BAR-ILAN HIGHLIGHTS

  • Science & Technology
  • Jewish Studies and Archaeology
  • Outreach: Centers for Israel
  • School of Medicine in the Galilee

GET INVOLVED

  • Scholarship Fund
  • Computer Science Building
  • Medical School
  • Faculty Recruitment
  • Planned Giving
  • IRA Giving
  • Israel Bonds

SEARCH

©2018 American Friends of Bar-Ilan University, all rights reserved | Privacy Policy