Vibrotactile Captioning of Musical Effects in Audio-Visual Media as an Alternative for Deaf and Hard of Hearing People: An EEG Study

Standard captioning for the deaf and hard of hearing people cannot transmit the emotional information that music provides in support of the narrative in audio-visual media. We explore an alternative method using vibrotactile stimulation as a possible channel to transmit the emotional information contained in an audio-visual soundtrack and, thus, elicit a greater emotional reaction in hearing-impaired people. To achieve this objective, we applied two one-minute videos that were based on image sequences that were unassociated with dramatic action, maximizing the effect of the music and vibrotactile stimuli. While viewing the video, using EEG we recorded the brain activity of 9 female participants with normal hearing, and 7 female participants with very severe and profound hearing loss. The results show that the same brain areas are activated in participants with normal hearing watching the video with the soundtrack, and in participants with hearing loss watching the same video with a soft and rhythmic vibrotactile stimulation on the palm and fingertips, although in different hemispheres. These brain areas (auditory cortex, superior temporal cortex, medial frontal cortex, inferior frontal gyrus, superior temporal pole and insula) have been consistently reported as areas involved in the emotional perception of music. We conclude that vibrotactile stimuli can generate cortex activation while watching audio-visual media in a similar way to sound. Thus, a further in-depth study of the possibilities of these stimuli can contribute to an alternative subtitling channel for enriching the audiovisual experience of hearing-impaired people.

View this article on IEEE Xplore

 

Absorption of 5G Radiation in Brain Tissue as a Function of Frequency, Power and Time

The rapid release of 5G wireless communications networks has spurred renewed concerns regarding the interactions of higher radiofrequency (RF) radiation with living species. We examine RF exposure and absorption in ex vivo bovine brain tissue and a brain simulating gel at three frequencies: 1.9 GHz, 4 GHz and 39 GHz that are relevant to current (4G), and upcoming (5G) spectra. We introduce a highly sensitive thermal method for the assessment of radiation exposure, and derive experimentally, accurate relations between the temperature rise (ΔT), specific absorption rate (SAR) and the incident power density (F), and tabulate the coefficients, ΔT/ΔF and Δ(SAR)/ΔF, as a function of frequency, depth and time. This new method provides both ΔT and SAR applicable to the frequency range below and above 6 GHz as shown at 1.9, 4 and 39 GHz, and demonstrates the most sensitive experimental assessment of brain tissue exposure to millimeter-wave radiation to date, with a detection limit of 1 mW. We examine the beam penetration, absorption and thermal diffusion at representative 4G and 5G frequencies and show that the RF heating increases rapidly with frequency due to decreasing RF source wavelength and increasing power density with the same incident power and exposure time. We also show the temperature effects of continuous wave, rapid pulse sequences and single pulses with varying pulse duration, and we employ electromagnetic modeling to map the field distributions in the tissue. Finally, using this new methodology, we measure the thermal diffusivity of ex vivo bovine brain tissue experimentally.

View this article on IEEE Xplore