US20140327527A1
2014-11-06
14/335,902
2014-07-19
A control device configurable to couple to one or more devices having different control functions and a method of facilitating remote control of at least one device having different control functions includes a processor that receives an instruction for at least one of the control functions and additional information from the at least one device, the processor including a plurality of processing algorithms, the additional information received from the at least one device including at least a locally transmitted data signal. The processor selectably processes the additional information using at least one of the processing algorithms and controls a touch sensitive display reconfigurable for the different control functions, such that the at least one control function and the selectably processed additional information are presented on the touch sensitive display. The processor also generates at least one control signal responsive to receiving the locally transmitted data signal. Other embodiments are disclosed.
Get notified when new applications in this technology area are published.
G08C17/02 » CPC main
Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
G06F3/041 » CPC further
Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements; Input arrangements or combined input and output arrangements for interaction between user and computer; Arrangements for converting the position or the displacement of a member into a coded form Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
This application is a continuation of U.S. application Ser. No. 12/111,005 filed on 28 Apr. 2008 and further claims the benefit of U.S. provisional patent application No. 60/914,319 filed on 27 Apr. 2007, the disclosure of which are both incorporated herein by reference in their entirety.
The present invention relates to designer control devices, and in particular, though not exclusively, to a wearing customizable remote control device.
Several methods and devices have been developed to monitor the biometrics of a wearer. Additionally, several devices exist to remotely control some electronic devices (e.g., a TV remote). No device currently on the market exists that is externally wearer customizable and configured to control an audio device.
At least one exemplary embodiment is directed to a wearable remote control assembly configured to control media devices and which may promote brand loyalty, longevity and continuity of a marketing message, such as a hearing-safety awareness campaign or music artist. The remote control device may be worn as a finger ring, badge, broche, or as a bracelet, and may have an appearance customized by the user with a web-based program, and the appearance may be dynamically changed using a programmable LED, LCD or plasma display. The remote control device may contain transducers such as microphones, loudspeakers, which may be detachable, as well as biometric sensing systems to monitor user health such as user heart rate, blood pressure or blood oxygen content. In some exemplary embodiments, audio signal processing may be undertaken on the remote control device with a microprocessor. Computer memory housed in the remote control assembly may also store biometric data such as personal or security clearance information or data for financial transactions such as for wireless purchasing, and audio data may also be stored in RAM computer memory on the remote control device.
At least one exemplary embodiment of the present invention provides for a functional marketing tool that serves as a remote control device to operate different media devices such as a headset for sound reproduction or recording. In some embodiments, the remote control can receive data from biometric sensors such as heart-rate monitors, and can transmit control data to audio devices such as Portable Media Players (PMPs) and audio headsets.
At least one exemplary embodiment of the remote control system is for a design comprising no user display and a small number of control buttons. The remote control device in this particular embodiment is intended to be worn as a finger ring or bracelet, though could be worn as a pendant from a necklace, around the user's ankles or upper arm. A marketing logo may be located on the device, such as an engraving on a bracelet advertising a particular brand, person, icon or campaign such as a hearing damage awareness campaign.
In at least one exemplary embodiment, the remote control device operates not just level control of reproduced audio content (e.g. music audio from a PMP or voice audio from a telecommunications network), but also recording operations using one or more microphone signals in the headset device. If these microphones are located substantially near the entrance to the user's occluded or partly occluded ear canal, then a binaural recording can be made. Sound recordings can also be made using microphones housed within the remote control assembly, or connected to the remote control assembly using a wired or wireless data communication system.
At least one exemplary embodiment is directed to a remote control device that can display a sound exposure profile that takes into account the sound exposure at the user's eardrum over a recent history (e.g. the last day). The sound pressure level (SPL) may be measured empirically using microphones in the user's occluded ear canal, or externally with microphones at or near to the entrance to the user's ear canal. The remote control device can display the “SPL Dose” as a numerical value corresponding to the accumulated dose as a percentage before temporary or permanent threshold shift may occur, or it can display a remaining time value, which informs the user how long (e.g. in minutes) the user has until temporary or permanent threshold shift may occur based on current ambient sound levels and levels of reproduced audio content.
In at least one exemplary embodiment the appearance of the remote control may be modified dynamically by the user (customization) or automatically depending on the operating mode to display different control interface screens or user-defined text and/or logos or text and/or logos for marketing purposes. This is accomplished by changing the display of the touch-screen, or changing the display behind fixed buttons, or changing the colors of the components used to create the remote control assembly. The appearance may change dynamically in response to a locally transmitted data signal, e.g. to inform the user of a nearby product vending machine or particular location or event which may be of interest to the user (e.g. a special offer on a product or a nearby museum).
In at least one exemplary embodiment the remote control assembly includes a low battery warning system to inform the user of the remaining battery status of the remote control device, and the remaining battery status of other audio devices that the remote control device communicates with, such as audio headsets, PMPs, mobile phone. Depending on user specifications, the system either: presents a series of audio warning signals; updates a visual display with information and a warning message; automatically attenuates (attenuation) audio output using the DSP; stops audio playback entirely; generates a tactile warning (vibration, pressure, etc); or any combination of the methods described.
In at least one exemplary embodiment the remote control may be worn as a wrist-strap bracelet or necklace. In these embodiments, a provision is made for a biometric sensor, such as a heart-rate sensor. This may function by detecting micro-electronic modulations between sensors on either side of the remote control caused by electro-cardiac signals. In the exemplary embodiment, the user is provided with a visual display of the current heart-rate, and a corresponding auditory display. Depending on the operating mode, this auditory display may be as a simple beep synchronized with the heart-beat, or it may be in the form of a spatialized audio scene. For instance, if the user's ideal BPM is higher than the present BPM, then a spatial sound image (e.g. a beep or reproduced music) could be spatialized using HRTF processing to seem in front of the user. Furthermore, the current invention allows for transmission of the user's current blood-related health (e.g. heart rate) to be logged and/or transmitted to a second party, such as an emergency worker or military HQ to inform the remote party of the health of the user.
In at least one exemplary embodiment there exists a loudspeaker for monitoring audio signals transmitted from different audio devices which are controlled, such as mobile-phones or PMPs. This allows the user or other individuals to monitor such audio content without necessarily wearing a headset. Loudspeaker driving circuitry is housed within the remote control assembly, consisting of a digital-to-analog converter and analog amplification and frequency equalization circuitry to compensate for the sensitivity of the loudspeaker driver. In some embodiments, the loudspeaker assembly is detachable using a wired connection or self-powered wireless assembly.
Yet another exemplary embodiment includes a microphone for monitoring the local ambient sound field of the remote control device, and for transmitting the resulting microphone audio signal to different audio devices such as mobile-phones or PMPs. This facilitates the user or other individuals to speak directly into a microphone that may be mounted on the wrist-worn remote control device, which is especially useful in high-noise environments to bring the microphone closer to the individual's mouth. The microphone receiving circuitry is housed within the remote control assembly, consisting of a digital-to-analog converter and analog amplification and frequency equalization circuitry to compensate for the sensitivity of the microphone. In some embodiments, the microphone assembly is detachable using a wired connection or a wireless self-powered assembly.
Further areas of applicability of exemplary embodiments of the present invention will become apparent from the detailed description provided hereinafter. It should be understood that the detailed description and specific examples, while indicating exemplary embodiments of the invention, are intended for purposes of illustration only and are not intended to limit the scope of the invention.
Exemplary embodiments of present invention will become more fully understood from the detailed description and the accompanying drawings, wherein:
FIG. 1 is an illustration of an earpiece in an ear;
FIG. 2 is a block diagram of a system in accordance with at least one exemplary embodiment;
FIG. 3A is a block diagram of a system connected to an internet in accordance with at least one exemplary embodiment;
FIG. 3B is a block diagram of a system that can control several devices in accordance with at least one exemplary embodiment;
FIG. 4A is a block diagram of a system that can control several devices with access to an internet;
FIG. 4B is a block diagram of a system that can control several devices with access to an internet and can access remote audio data storage;
FIG. 5 illustrates an example of a wearer piece of jewelry in accordance with at least one exemplary embodiment; and
FIG. 6 illustrates a Graphic User Interface (GUI) in accordance with at least one exemplary embodiment.
The following description of exemplary embodiment(s) is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses.
Exemplary embodiments are directed to or can be operatively used to control various wired or wireless earpieces devices (e.g., earbuds, headphones, ear terminal, behind the ear devices or other acoustic devices as known by one of ordinary skill, and equivalents). Note that other non-earpiece devices can also be controlled and the invention is not limited by controlling an earpiece.
Processes, techniques, apparatus, and materials as known by one of ordinary skill in the art may not be discussed in detail but are intended to be part of the enabling description where appropriate. For example specific computer code may not be listed for achieving each of the steps discussed, however one of ordinary skill would be able, without undo experimentation, to write such code given the enabling disclosure herein. Such code is intended to fall within the scope of at least one exemplary embodiment.
Additionally exemplary embodiments are not limited to earpieces, for example some functionality can be implemented on other systems with speakers and/or microphones for example computer systems, PDAs, BlackBerry® smartphones, cell and mobile phones, and any other device that emits or measures acoustic energy. Additionally, exemplary embodiments can be used with digital and non-digital acoustic systems. Additionally various receivers and microphones can be used, for example MEMs transducers, diaphragm transducers, for example Knowles' FG and EG series transducers.
Notice that similar reference numerals and letters refer to similar items in the following figures, and thus once an item is defined in one figure, it may not be discussed or further defined in the following figures.
Encouraging usage of a high-visibility marketing tool for consumers is enhanced by providing an incentive for the user. The present invention discloses a marketing device in the form of a user-wearable badge or item of jewelry that promotes wearability based upon the device serving functional control of at least one audio device. Additionally, the invention provides for bi-directional in-situ processing of audio signals, and provides the ability to record the user's ambient sound field using one or more microphones housed within the remote control device, or to monitor audio content user a loudspeaker that is housed in the remote control device.
In at least one exemplary embodiment of the present invention disclosed herein can undertake audio signal processing from a first portable media device such as a PMP, and transmits the processed audio to a second device, such as a headset.
In at least one exemplary embodiment of the present invention, this audio signal processing can be bi-directional, i.e. simultaneously processing audio from a first audio device to a second whilst processing audio from the second device and then transmitting this processed signal to the first device. The present invention furthermore an be designed as a marketing tool whereby the remote control unit undertaking the signal processing and controlling the portable media player devices is used to display a product logo or other insignia.
At least one exemplary embodiment of the present invention is designed to promote enhanced visibility for a marketing campaign, while it can control media devices, and is further designed to affect functionality of audio devices such as audio reproduction and recording with a user-worn headset.
At least one exemplary embodiment of the present invention allows for activation of recording and subsequent playback of a user's local ambient sound field using microphones mounted near or at the entrance to the user's occluded eardrum (in other words; a binaural recording) or microphones housed within the remote control device itself.
At least one exemplary embodiment of the present invention may simultaneously operate a plurality of devices, and at least one exemplary embodiment of the present invention can be designed to operate at least one headset for purposes such as audio recording, monitoring and reproduction, using loudspeakers and microphones embedded in the headset and/or loudspeakers and microphones embedded in the remote control device.
Furthermore, at least one exemplary embodiment the present invention can be designed to be worn by the user as jewelry, such as in the form of a wrist strap or necklace. Also, the remote control device in the present invention allows for user customization, such as different colors, different clasp mechanisms (such as fabric or metallic straps) using a web-based customization process.
At least one exemplary embodiment of the present invention provides for heart-rate information (e.g. beats-per-minute) to be transmitted to the user-worn headset system and to (optionally) auralize the auditory display using personalized or non-personalized head-related transfer function (HRTF) processing. This could give the effect of spatializing a target or optimum heart-rate feature (e.g. BPM or blood pressure) so as to act as an incentive for the user. For instance, if the user's ideal BPM is higher than the present BPM, then a spatial sound image (e.g. a beep or reproduced music) could be spatialized using HRTF processing to seem in front of the user. Furthermore, at least one exemplary embodiment of the current invention allows for transmission of the user's current blood-related health (e.g. heart rate) to be logged and/or transmitted to a second party, such as an emergency worker or military HQ to inform the remote party of the health of the user.
At least one exemplary embodiment is directed to a headset which can be used with the present invention as is illustrated in FIG. 1. The embodiment is a small headphone that is inserted in the ear of the user. The headphone can include the sound-attenuating earplug 100 inserted into the ear canal. At the inner (eardrum-facing) surface of the plug, an ear-canal loudspeaker receiver (ECR) 102 is located for delivering the audio signal to the listener. At the outer (environment-facing) surface of the plug, an ambient-sound microphone (ASM) 104 is located. Both the loudspeaker 102 and the microphone 104 are connected to the electronic signal processing unit 106. The signal processing unit 106 also has a connector 108 for input of the audio signal. This connector medium 108 may be a wireless signal such as a conventional radio or Bluetooth protocol. Additionally, an ear-canal microphone (ECM) 110 is placed at the inner (eardrum-facing) surface of the plug and an external loudspeaker 112 is placed on the outer (environment-facing) surface of the plug for performing other functions of the headphone system not described here (such as monitoring of sound exposure and ear health conditions, headphone equalization, headphone fit testing, noise reduction, and customization).
FIG. 2 gives an overview of the User Wearable Remote Control device showing components that may be present or absent depending on the particular embodiment. The remote control device can include, as its principle components, a user interface 134, which may include a miniature keyboard, one or more scroll wheels, push buttons, or (in the exemplary embodiment) a touch-sensitive screen that can also be used as a visual display 136, or a combination of the above. The central processing unit 144 is a general purpose processor and in some embodiments is combined with an Application-Specific Integrated Circuit (ASIC) (not shown), or in some other combination involving a general purpose processor and an ASIC combined in one unit (such as an FPGA). The processor 144 undertakes control of the transmission of audio input and output signals to and from the computer memory RAM unit 138, signal processing for the low battery warning system 140, control and processing of data from the local (wired) biometric sensor (e.g. heart-rate detector) 142 or remote, second biometric sensor 143, and control of the audio and control data communication assembly 146. The processor 144 detects the presence of a power (battery) charging device such as an inductance or wired charging unit, and may initiate charging of the built-in battery with system 141. Computer memory in RAM form 138 for containing user data or audio, and computer memory in ROM form 139 for storing program code, are housed in the remote control device assembly.
In some embodiments there exists a loudspeaker 147 for monitoring audio signals transmitted from different audio devices which are controlled, such as mobile-phones or PMPs. This allows the user or other individuals to monitor such audio content without necessarily wearing a headset. Loudspeaker driving circuitry 145 is housed within the remote control assembly, consisting of a digital-to-analog converter and analog amplification and frequency equalization circuitry to compensate for the sensitivity of the loudspeaker driver. In some embodiments, the loudspeaker assembly is detachable using a wired connection or self-powered wireless assembly.
Another embodiment includes a microphone 151 for monitoring the local ambient sound field of the remote control device, and for transmitting the resulting microphone audio signal to different audio devices such as mobile-phones or PMPs. This allows the user or other individuals to speak directly into a microphone that may be mounted on the wrist-worn remote control device, which is especially useful in high-noise environments to bring the microphone closer to the individual's mouth. The microphone receiving circuitry 149 is housed within the remote control assembly, consisting of a digital-to-analog converter and analog amplification and frequency equalization circuitry to compensate for the sensitivity of the microphone. In some embodiments, the microphone assembly is detachable using a wired connection or wireless self-powered assembly.
The data communications assembly 146 undertakes control of audio and non-audio (control) data between the central processor and other audio devices such as a PMP 148 (FIG. 3B) and one or more headsets such as that described in FIG. 1. The audio data may be relayed directly from one device to the other, or may be processed first by the central processor 144. The communication assembly 146 may consist of either or both wired and wireless communication devices; such as radio transceivers for Bluetooth or conventional radio audio and non-audio data transmission and associated signal processing assemblies (such as ADC and DACs, signal amplifiers etc. familiar to those skilled in the art), or assemblies for directly transceiving analog audio signals such as with one or more conventional stereo ⅛″ input jacks or optical SPDIF input jacks.
FIG. 3A gives an overview of the User Wearable Remote Control device 116 in relation to various audio technology devices and systems it is intended to be used with. The connections to these devices and systems are shown as bi-directional or single-ended arrows. As shown in box legend 132, these arrows may be double-walled (A, B) or single walled (C,D). The notation used through the drawings is that mixed audio and control signals are represented with double-walled arrows, and control-only signals with single walled. Control signals mean any signal that does not directly represent audio signals. The direction of the arrow indicates the direction of audio or control signal flow from one unit to the other, as familiar to those skilled in the art. Typical audio devices the remote control device is used with in its exemplary embodiment are: cell phones 112, headset systems 114 and 122 such as that described in FIG. 1 (but conventional headphone systems could also be used); user biometric sensors 118; Portable Media Players 120 such as hard-drive or RAM-chip mp3 players, digital radio players, portable DVD players or portable electronic gaming units; and computer devices 124 such as laptops, PDAs, or desktop computers. The audio devices in the previous list may be used simultaneously with remote control device 116 and at least one headset 114, or in any combination thereof. The computer devices 124 may be connected to the internet 126 allowing the user to upload audio content (from audio content server 129) to a PMP device 120 via the remote control device 116 or directly from the computer device 124 to the PMP 120. Audio content may also be downloaded via computer device 124, the internet 126 to a back-up audio data server 130. Such audio content may be from recordings made with ASM signals (from ASM 104 (FIG. 1)), microphones 151 (FIG. 2) housed in the remote control assembly or Ear Canal Microphone signals (from ECM 110 (FIG. 1)) with one or more headsets 114, 122. These recorded audio signals may also be analyzed by an audio forensic analysis system 128 for purposes such as speech-to-text analysis, or accident determination. Data analysis by forensic system 128 may be presented to the user via a visual or auditory display with the remote control device 116. The optional loudspeaker 147 and microphone 151 housed shown in FIG. 2 are not shown in this figure.
FIG. 3B gives a more detailed overview of user wearable remote control device and some particular audio devices described in the embodiment presented in FIG. 3A, as well as biometric data analysis system 145. The central processing unit 144 may undertake audio signal processing on input signals from a number of devices, such as a cell-phone 112 and/or PMP 148 (e.g. mp3 player, portable DVD player). FIG. 3B also illustrates that headsets 114, 122 may include respective input/output (IO) and CPU 150, sound generator (receiver) 152 and sound sensor (microphone) 154.
FIGS. 4A and 4B show another embodiment of the remote control device shown in FIGS. 3A and 3B. The difference between the two embodiments is that in FIGS. 4A and 4B there is no transmission of audio signals through the remote control device itself; in this embodiment the audio signals are transmitted directly between audio devices such as a PMP 120 and headset 114.
FIG. 5 shows example artwork of the current invention in a particular embodiment as a tool for increasing awareness of a non-commercial listening awareness campaign. In the particular example, the logo “keep listening” 160 is engraved on the remote control device bracelet 161, and shows that the user endorses this campaign and advertises the campaign with a fashionably pleasing aesthetic. The controls for the device in this particular embodiment consist of two simple buttons 156, 158 which may be used to control volume level, power (e.g. by pressing the two buttons together), or controlling the currently auditioned song track (e.g. advancing track by holding down button 158). Signal processing and battery power may be contained within the body of the bracelet 161, and the control data transmission circuitry may use a wireless system with the wireless aerial embedded in the user-worn remote control.
FIG. 6 gives an overview of a combined user-interface display and response screen, as might be worn on a wrist band (the screen may wrap around with a flexible or articulated joint), or as a necklace pendant. Alternatively, a smaller screen may be used as shown in the lowest figure. In some embodiments, the screen may be non touch sensitive, and scrolling wheels and buttons used to select different operating modes and system control parameters.
While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all modifications, equivalent structures and functions of the relevant exemplary embodiments. For example, if words such as “orthogonal”, “perpendicular” are used the intended meaning is “substantially orthogonal” and “substantially perpendicular” respectively. Additionally although specific numbers may be quoted in the claims, it is intended that a number close to the one stated is also within the intended scope, i.e. any stated number (e.g., 90 degrees) should be interpreted to be “about” the value of the stated number (e.g., about 90 degrees).
Thus, the description of the invention is merely exemplary in nature and, thus, variations that do not depart from the gist of the invention are intended to be within the scope of the exemplary embodiments of the present invention. Such variations are not to be regarded as a departure from the spirit and scope of the present invention.
1. A control device configurable to couple to one or more devices having different control functions comprising:
a touch sensitive display reconfigurable for the different control functions of the one or more devices; and
a processor coupled to the touch sensitive display, the processor including a plurality of processing algorithms, the processor configured to receive at least one of the control functions and additional information from among the one or more devices, the processor configured to selectably process the additional information using at least one of the processing algorithms based on the respective device and to control the touch sensitive display such that the at least one control function and the selectably processed additional information peculiar to the respective device of the one or more devices are presented on the touch sensitive display,
where the processor, responsive to an indication by the touch sensitive display, generates at least one control signal, where the processor sends the at least one control signal to the corresponding device among the one or more devices being controlled and sends the selectably processed additional information to at least one of the plurality of devices, and
where the additional information received from among the one or more devices includes a signal generated from at least one of the plurality of processing algorithms including a locally transmitted data signal.
2. The control device of claim 1, wherein the locally transmitted signal is a signal resulting from analysis by an audio forensic analysis system.
3. The control device of claim 1, wherein the processor processes data from either a local biometric sensor or a remote biometric sensor or both.
4. The control device of claim 1, wherein the processor processes data from a biometric sensor to detect electro-cardiac signals.
5. The control device of claim 1, wherein the processor processes data from a biometric sensor for presentation via an auditory display.
6. The control device of claim 1, wherein the processor processes data from a biometric sensor and sends data to a heart-rate logging system using a memory on the control device or on the one or more devices.
7. The control device of claim 1, wherein the locally transmitted data signal is a signal from a nearby product vending machine offering a product or from a particular location or event of interest matching a user profile.
8. The control device according to claim 1, where the control device is a piece of jewelry.
9. The control device according to claim 5, where the at least one control function is received or sent by the processor via at least one of a wired connection or a wireless connection.
10. The control device according to claim 1 where the processor generates a plurality of control signals for the one or more devices.
11. The control device according to claim 1, wherein the control device includes a low battery warning system that provides a remaining battery status of the control device or of the one or more devices.
12. The control device of claim 1, wherein the processor provides for bi-directional in-situ processing of audio signals by controlling an ambient microphone coupled to the processor to record an ambient sound field.
13. The control device of claim 1, wherein the processor dynamically modifies a user interface of the control device based on an operating mode of the control device.
14. The control device of claim 1, wherein the locally transmitted data signal provides heart-rate information transmitted to a headset system.
15. The control device of claim 14, wherein the heart-rate information is auralized using head-related transfer function processing.
16. The control device of claim 14, wherein the touch sensitive display indicates an operational status of an earphone device operationally coupled to the control device.
17. A method of facilitating remote control of at least one device having different control functions comprising:
receiving, by a processor, an instruction for at least one of the control functions and additional information from the at least one device, the processor including a plurality of processing algorithms, the additional information received from the at least one device including at least a locally transmitted data signal;
causing the processor to selectably process the additional information using at least one of the processing algorithms and to control a touch sensitive display reconfigurable for the different control functions of the at least one device, such that the at least one control function and the selectably processed additional information are presented on the touch sensitive display; and
generating at least one control signal by the processor responsive to receiving the locally transmitted data signal.
18. The method according to claim 17, where the at least one device includes at least one of a cell phone, a personal media player, a computer device, a biometric sensor system or a headset.
19. The method according to claim 17, where the at least one control signal is configured to control at least one of sound reproduction, sound recording or sound exposure monitoring of the corresponding device.
20. The method according to claim 17, wherein the locally transmitted data signal is a signal from a biometric sensor operatively coupled to the processor.