US20180332160A1
2018-11-15
16/003,886
2018-06-08
A computing device is operable to work in conjunction with a companion electronic device. The computing device and the companion electronic device each have their own electronics and/or own operating system and each is able to construct a partial or complete user environment. The computing device is operable to send data to the companion device, on request of the companion device, which the companion electronic device then uses to locally construct its own user environment, in whole or in part.
Get notified when new applications in this technology area are published.
G06F1/1692 » CPC further
Details not covered by groups - and; Constructional details or arrangements for portable computers; Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups  - ; Constructional details or arrangements related to integrated I/O peripherals not covered by groups  - the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes the I/O peripheral being a secondary touch screen used as control interface, e.g. virtual buttons or sliders
G06F1/1686 » CPC further
Details not covered by groups - and; Constructional details or arrangements for portable computers; Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups  - ; Constructional details or arrangements related to integrated I/O peripherals not covered by groups  - the I/O peripheral being an integrated camera
G06F1/1684 » CPC further
Details not covered by groups - and; Constructional details or arrangements for portable computers; Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups  - Constructional details or arrangements related to integrated I/O peripherals not covered by groups  -Â
G06F1/1649 » CPC further
Details not covered by groups - and; Constructional details or arrangements for portable computers; Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups  - ; Details related to the display arrangement, including those related to the mounting of the display in the housing including at least an additional display the additional display being independently orientable, e.g. for presenting information to a second user
G06F1/1639 » CPC further
Details not covered by groups - and; Constructional details or arrangements for portable computers; Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups  - ; Details related to the display arrangement, including those related to the mounting of the display in the housing the display being based on projection
G06F1/1632 » CPC further
Details not covered by groups - and; Constructional details or arrangements for portable computers External expansion units, e.g. docking stations
G06F1/1626 » CPC further
Details not covered by groups - and; Constructional details or arrangements for portable computers with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
G06F1/1633 » CPC further
Details not covered by groups - and; Constructional details or arrangements for portable computers Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups  -Â
H04M1/725 IPC
Substation equipment, e.g. for use by subscribers; Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection Cordless telephones
G06F8/60 » CPC further
Arrangements for software engineering Software deployment
G06F1/16 IPC
Details not covered by groups - and Constructional details or arrangements
This application is a continuation of U.S. application Ser. No. 13/643,680, filed on Jan. 7, 2013, which claims the priority of PCT/GB2011/050825, filed on Apr. 26, 2011, which claims priority to Great Britain Application No. 1006943.3, filed on Apr. 26, 2010; Great Britain Application No. 1017446.4, filed Oct. 14, 2010; and Great Britain Application No. 1021736.2, filed Dec. 22, 2010, the entire contents of each of which are hereby incorporated in total by reference.
This invention relates to a computing device operable to work in conjunction with a companion electronic device. The computing device may be a mobile telephone or other kind of fixed or mobile device: the invention has the potential to revolutionise the way people use fixed or mobile devices, mobile phones and computers. The system and product embodiments plug the gap which has not been filled by smartphones, netbooks or smartbooks or other PDA style devices, and other consumer electronic devices, by bringing computer and media connectivity to mobile device users throughout the world, including in emerging markets which are looking to save on the cost of devices and infrastructure development.
In this invention, the computing device and the companion electronic device each have their own electronics and/or own operating system and each is able to construct a partial or complete âuser environmentâ. A âuser environmentâ is the complete set of software and hardware components that together provide for output to and input from a user, where a user is a person, persons or another device (for example, for machine to machine (M2M) applications).
Four factors have been cited as the key drivers for the growth in smartphone computing devices in the coming years: â
Although both smartphones and notebooks markets and other computing and consumer electronic devices have benefitted from many breakthrough products in recent years, no device has yet been capable of providing a single solution that spans all user scenarios in a flexible and cost effective way. See Market Drivers, FIGS. 1 and 2.
Until recently mobile data consumption has been enabled mainly through two types of device, both predominantly the preserve of business customers:
However, as consumer demand for data services and downloadable mobile applications has increased, a host of alternatives devices have emerged as manufacturers and service providers seek to define the âidealâ consumption and creation device and their share of the associated revenues. Emerging mobile data category devices now include:
But still there is a gap. The PC can use the bandwidth provided by mobile broadband networks but does not have the portability, where as a mobile phone has the portability but has a limited user environment and this limits the functionality and the ability to use the bandwidth that is available. Apple's iPad and other tablets try to solve some of these issues but have many limitations:
The invention is a computing device operable to work in conjunction with a companion electronic device, in which the computing device and the companion electronic device each have their own electronics and/or own operating system and each is able to construct a partial or complete user environment;
This approach enables the companion electronic device to leverage off the computational resources of the computing device. In one implementation, the computing device is a smartphone and the companion electronic device has the form factor of a clamshell laptop or netbook; the smartphone provides the data that the companion device uses to locally construct its own user environment, in whole or in part. The smartphone need have no understanding of the configuration (e.g. display size) of the companion device and hence the data it sends is may be âgenericâ data that is not specific to one type or model of companion device but instead can be used by a broad range of different companion devices.
By distributing the computational load in this manner across both the mobile device and the companion device, enables a combined system that is flexible, powerful and also efficient.
An implementation of the invention is called the PPCâthe âPhone Powered Computerâ. The invention can be implemented in a very broad range of forms.
The invention will be described with reference to the accompanying drawings:
FIG. 1 Market Drivers
FIG. 2 Market Drivers 2
FIG. 3 User Experience Flow Example
FIG. 4 Device Discovery & Connection Flow Example 1
FIG. 5 Device Discovery & Connection Flow Example 2
FIG. 6 Sample Computing Device Architecture
FIG. 7 Sample Companion Electronic Device Architecture Example
FIG. 8 Example Laptop Style PPC system
FIG. 9 Example Laptop PPC System
FIG. 10 Example Laptop PPC System
FIG. 11 Example Laptop PPC System
FIG. 12 Example PPC System Computing Device close up
FIG. 13 Example PPC System Computing Device Detail
FIG. 14 Example PPC system Bluetooth headset close up
FIG. 15 Example PPC system Laptop style
FIG. 16 Example PPC system Tablet style
FIG. 17 Example PPC Enabler Distribution Options
FIG. 18 HW/OS Configuration Options
FIG. 19 HW/OS Configuration Options 2
FIG. 20 Software Configuration Option Example A
FIG. 21 Software Configuration Option Example B
FIG. 22 Software Configuration Option Example C
FIG. 23 Software Configuration Option Example D
FIG. 24 Software Configuration Option Example Z
FIG. 25 Possible Smart Computing Device/Smart Companion Electronic Device System
FIG. 26 PhoneTube (TV/Desktop Dock) System Overview Examples
FIG. 27 PhonePad (Tablet-style) System Overview Examples
FIG. 28 PhoneBook (Laptop-style) System Overview Examples
FIG. 29 Companion Electronic Device or Computing Device Hardware Block Diagram Example
FIG. 30 Computing Device Docking Example
FIG. 31 Computing Device & Companion Electronic Device
FIG. 32 Laptop-style Companion Electronic Device Example with Rotating Display (Presentation Mode)
FIG. 33 Laptop-style Companion Electronic Device Example with Rotating Display (Closed)
FIG. 34 TV/Desktop dock-style Companion Electronic Device Example
FIG. 35 PhoneWrap Dock Example
FIG. 36 PhoneWrap Detail Example
FIG. 37 PhoneWrap Dongle Example
FIG. 38 Shoe Adapter Example
FIG. 39 Adapter Example
FIG. 40 Tablet-style Companion Electronic Device Docking Option Example
FIG. 41 Laptop-style Companion Electronic Device Example
FIG. 42 Laptop-style Companion Electronic Device Docking Example
FIG. 43 Laptop-style Companion Electronic Device Docking Example
FIG. 44 Compartment Docking Example
FIG. 45 Tablet-style Companion Electronic Device Drawer Docking Example
FIG. 46 Tablet-style Companion Electronic Device Slot Docking Example
FIG. 47 Tablet-style Companion Electronic Device Slot Docking Example
FIG. 48 Tablet-style Companion Electronic Device Example
FIG. 49 Laptop-style Companion Electronic Device Docking Example
FIG. 50 Laptop-style Companion Electronic Device Docking Example
FIG. 51 Laptop-style Companion Electronic Device Docking Example
FIG. 52 Laptop-style Companion Electronic Device Docking Example
FIG. 53 Laptop-style Companion Electronic Device Docking Example
FIG. 54 Laptop-style Companion Electronic Device Docking Example
FIG. 55 Laptop-style Companion Electronic Device Docking Example
FIG. 56 Alternative Device Form Factor Example
FIG. 57 Alternative Device Form Factor Example
FIG. 58 Alternative Device Form Factor Example
FIG. 59 Alternative Device Form Factor Example
FIG. 60 Alternative Device Form Factor Example
FIG. 61 Alternative Device Form Factor Example
FIG. 62 Alternative Device Form Factor Example
FIG. 63 Alternative Device Form Factor Example
FIG. 64 Alternative Device Form Factor Example
FIG. 65 Alternative Device Form Factor Example
FIG. 66 Tablet-style Device Mechanical Stack Example
FIG. 67 Dock-style Device Mechanical Stack Example
FIG. 68 Laptop-style Device Mechanical Stack Example
FIG. 69 Dock-style Device Form Factor Example
FIG. 70 Tablet-style Device Form Factor Example
FIG. 71 Dock-style Gaming System Form Factor Example
FIG. 72 Multiple Computing Device and Multiple Companion Electronic Device Example
FIG. 74 Folio-style PPC system Example with Tablet-style Companion Electronic Device
FIG. 75 Desktop-style Dock Alternative Example
FIG. 76 Desktop-style Dock Alternative Example
FIG. 77 Desktop-style Dock Alternative Example
FIG. 78 Desktop-style Dock Alternative Example
FIG. 79 Desktop-style Dock Alternative Example
A PPC is a highly differentiated proposition that offers an innovative solution to emerging hardware, software and service models in relation to current and future network rollouts, emerging high-bandwidth value-added services, constantly shifting user-scenarios and existing and future business models such as cloud computing.
Essentially, a PPC system leverages the computing and communication capability of a smartphone (or other mobile or fixed electronic device) along with its applications, data, user interface elements, media, content, etc., making these available in form factors and/or use case scenarios that are more convenient, more optimized, or simply provide an alternative to using the smartphone (or other device) directly. This is achieved through a physical and or logical and or wireless connection to another device or devices that may resemble (but may not necessarily be) a familiar device category, such as a desktop, notebook or tablet computer. These other device or devices can have varied amounts of processing, storage, applications, user interaction, user feedback, input/output and data capabilities of their own, but may be less capable, less expensive and less complex than the familiar device type that they resemble.
Through its innovative multi-part architecture, a PPC may combine (as an example) a 3.5âł display smartphone with an innovative 11.1âł netbook computer (or a device that looks like one) to deliver a series of benefits that are both consumer wise and commercially very attractive.
Other examples of phone-powered computing include a phone or other electronic device referred to in this document as a Computing Device, connected wired or wirelessly directly or indirectly to a Companion device, also referred to throughout this document as a Companion Electronic Device, either or both of which may be, or may in turn be connected to:
The above are also examples of Companion Electronic Devices.
Although the concept is referred to as phone-powered computing, the mobile device need not be a phone. It could be any mobile (or fixed) device, also referred to through this document as Computing Device, including but not limited to:
Using fast, power efficient, processing, media and communications electronics, a PPC system creates a solution that delivers:
For the purposes of this disclosure, âuser environmentâ (UE) refers to the complete set of software and hardware components that together provide for output to and input from a user. A user may be a person or persons or another machine. These components may provide for any or all of the following, in whole or in part, and may also provide for additional means of output to or input from a user: Display screen, graphical user interface, textual user interface, motion user interface, audio user interface, camera, other optical sensor, LED or other light output, IRDA transceiver, proximity sensor, audio output, speaker(s), microphone(s), vibrator, haptics, touchscreen, buttons, keypad, trackpad, mouse, trackball, accelerometer, e-compass, other position/movement sensors, NFC transceiver, gesture capture mechanisms. In some cases, user environment may specifically refer to a subset of the above, for example, the graphical user interface and audio output.
The PPC concept will exert a disruptive influence compared to conventional wireless-device business models to deliver increased value at lower costs throughout the value chain.
For example, the Companion Electronic Device leverages the WAN connection (e.g. cellular) and subscription associated with the handheld device, saving cost for the cellular network operator in maintenance of multiple SIM cards and subscriptions and for the user in the cost of those multiple subscriptions.
PPC could reduce network operator subsidization cost because the BOM costs and hence selling price of the Computing Device and/or Companion Electronic Device are lower than standalone device and multiple subscription costs (âTwo lower performance processors [Computing Device/Companion Electronic Device] are cheaper than one higher performance processor.â)
A PPC has two or more key parts, a Computing Device (âC1â) and a Companion Electronic Device (or âC2â . . . âCnâ), with the ability to plug-in and add other units, devices, tokens and similar.
A key characteristic of the multipart architecture is a âPPC enablerâ. The PPC enabler is the collection of hardware and software components that allow the mobile device Computing Device user experience (or a modified version thereof), applications, data, connectivity, etc., to be displayed, accessed and/or controlled using elements of a second device Companion Electronic Device, or vice versa. Components of the PPC enabler may be distributed across the Computing Device, the Companion Electronic Device (s), or another element or elements as part of a physical or logical system between the Computing Device and the Companion Electronic Device.
See also later discussion of the PPC Enabler.
Key functions of the PPC enabler include:
In addition to encompassing many potential physical form factors and usage methods, there are many potential underlying, multipart hardware and software architectures which could form a PPC system.
These architectures may be described in two categories:
Hardware and Operating System Configuration options include the placement of different hardware, operating system and enabler components variously in Computing Device, Companion Electronic Device or in other devices in the system. Relevant components may include but are not limited to:
Software configuration options relate mainly to distribution of various software tasks, such as UE element generation, application execution and data storage/access, around the system. Relevant components may include but are not limited to:
There are many possible embodiments of Phone Powered Computing, both for the externally visible form factors/use scenarios of the devices/systems and for the underlying architecture of those devices/systems. These embodiments can divide into three complementary areas:
Potentially, any embodiment within each of the three complimentary areas could be used with any embodiment of the architectures or systems in any combination.
Many different form factors and use scenario embodiments are possible with the PPC concept some examples but not limited to are
Wired and wireless connections between Computing Device and Companion Electronic Device, or single to multiple Computing Device and Companion Electronic Device configurations are possible.
These example embodiments include many novel mechanical, electromechanical and software elements, and which may be wired or wireless, for example:
Examples of alternative embodiments are also shown in FIGS. 57-59, 61-63 and 66.
Base architecture embodiments could take the form of almost any combination of the HW/OS and software elements described above. Examples of possible combinations include (refer to FIGS. 18-24):
A given device within a system will, of course, have its own internal architecture. An example hardware block diagram for a Companion Electronic Device is shown in FIG. 29.
Example PPC enabler embodiments include the following. These examples do not preclude any others.
PPC enabler embodiment 5, âSmart Computing Device/Smart Companion Electronic Deviceâ, (FIG. 25) above has many advantages over other possible embodiments and is elaborated here.
As described in PPC enabler embodiment 5 above, Companion Electronic Device with its own OS builds and displays its own UI/UE that could include requested or provided elements of the Computing Device UE and/or content, data, application results, applications themselves, input/output, etc. The Companion Electronic Device could have its own storage, applications, input/output, etc., and may or may not be functional when the Computing Device is not connected.
Potential characteristics of the ââSmart Computing Device/Smart Companion Electronic Deviceâ embodiment include:
Distribution of application, input/output, and user element generation tasks between Computing Device and Companion Electronic Device could take many forms and could vary from time to time, for example according to the current use case, or according to optimum use of and or to enable the conservation of system resources. Example use cases and task distribution scenarios:
The novel step in many of these embodiments is a significant reduction amount of the data and the number of times it is moved around the system.
The PPC concept pioneers many new technology features. Some of these features may apply to one or a number of the possible form factor/use scenario, architecture and PPC enabler combinations, while others may be applicable all possible combinations.
The concept allows and enables context scaling, in particular but not necessarily exclusively, a âSmart Computing Device/Smart Companion Electronic Deviceâ embodiment could include:
The PPC concept includes a number of functionalities to intelligently or manually manage status and modes.
1.6. Companion Electronic Device could automatically detect the Computing Device and ask if it wants to connect; Computing Device answers based on a user preference on Computing Device.
The PPC concept provides for many benefits of intelligent power and processing management.
Traditional charging schemes for Computing Devices and laptops are very simple relating only to the charging of the battery in a single device from any external power source and the operation of that Computing Device when certain charge levels are met within the battery. The new scheme which describes the interaction between the two sets of batteries will require adaptations to the Computing Device charging software, which may be provided dynamically by the Companion Electronic Device on a case by case basis, additional icons on the Computing Device screen and the development of a âconfigurationâ or âsettingsâ application to allow the user to modify the charging behavior and limits.
Adding to the power and charging options of the Computing Device is one of the benefits of PPC. The additional set of batteries that can be contained in the Companion Electronic Device âdockâ provides a benefit to the user even without the much broader use options that the dock affords.
There are five separate modes to consider:
In addition it is important that the amount of charge left in the Computing Device and dock, when a device is being charged and the source of that charge are all clear to the user via the displays of the Computing Device and or the Companion Electronic Device dock. This could be achieved by way of example by using icons in the display of the Computing Device and or Companion Electronic Device and arrows to show the direction of charge.
The batteries will be charged whenever the external power is connected. This can be signaled to the user by the presentation of a simple display (e.g. A battery filling up) or if there is no display by way of example a colour changing LED which will show red when the battery is below a usable limit, for example flash when charging and become green when fully charged. When external power is connected the dock could be driven from this source to conserve the battery charge, excess charge current will be used to charge the Computing Device and Companion Electronic Device batteries if required.
If the Computing Device battery is below a set limit x % and the dock batteries are above y % then the Computing Device battery will be recharged from the dock battery and the Computing Device will be operated from either its own battery or the Companion Electronic Device dock battery.
If the Computing Device battery is below a set limit m % and the Companion Electronic
Device dock batteries are below n % then both could conserve their power for themselves. This assumes the batteries are running low and the user would want to keep the function of the dock Companion Electronic Device. This behavior can be changed by the user. By way of example, it can be overridden by the user in the âsettingsâ application to allow âemergencyâ use of the dock battery to power the Computing Device.
These limits x, y, m and n should be configurable via software. The limits can be factory defined in the software prior to shipment or can be set up by the user.
The display of the Companion Electronic Device may show that the dock is charging the Computing Device as well as showing its own charge statusâit may use of two different symbols for the two batteries to avoid confusion. The system may also use different warnings to indicate that low battery condition exists on either the Computing Device or Companion Electronic Device.
All indications related to charging and charge status of the Computing Device may be visible at all times on the Companion Electronic Device dock display as the Computing Device display may be turned off in some situations to conserve power or be used for another application (e.g. as a mouse).
When connected the external power may be used to provide power to the Companion Electronic Device dock and or the Computing Device and recharge all or some of the batteries of either device.
The display of either the Companion Electronic Device and or Computing Device shows which battery is charging as well as the charge status of the other batteryâthe system may use different symbols for the different batteries to avoid confusion.
If the Companion Electronic Device dock does not have a display it may have another indicator which indicates to the user that it is charging the Computing Device. One method of controlling the charging schemes is the use of USB âon the goâ with the dock and Computing Device able to interchange their master/slave identities within the scheme.
It is critical in any mobile solution to maximise the usage time between charges and to efficiently manage the power and thermal characteristics of the unit. The greater the usage time the greater the utility provided to the user. This element of the invention governs the way in which the processors (especially multicore units) in the Computing Device are controlled to maximise performance and reduce current drain and heating impact. This control covers but is not limited to, Computing device and companion electronic device system and processor and memory clock rates the number of cores active at any time and overall processor active periods, the variability of clock rate selection dependent on battery charge state as well as a deep sleep mode used in the computing device and or companion electronic device(s) when not connected to each other. The clock rates used will vary by mode as defined elsewhere in this document and may also depend on the intensity of CPU usage required. Prior art exists for the manipulation of clock rates within a PC or Computing Device as a single device. The novel part of the invention is that the clock rate used for a given state or for a given type of content e.g. web browsing or game play will vary based on the available power to the overall system specifically the case where a Computing Device unit or a Companion Electronic Device is wirelessly and or physically docked and connected to external power this may take the form of additional batteries and or power for another source such as mains power in a physically docked mode the Computing Device and Companion Electronic Device units will be able to increase/decrease the System voltage and or current (or an element of the system voltage, and or current eg processor or memory only) to in addition the system clock speed (processor, memory, bus, and internal/external interfaces), can be adjusted as can settings such as the display brightness, system element power states (e.g., audio electronics is switched off if no audio required), enabling/disabling I/O ports or internally buses etc enabling an optimum overall configuration of the Computing Device and Companion Electronic Device dependent on the application and the available power to the system. The effect of physically docking and or connecting wirelessly or otherwise the Computing Device or Companion Electronic Device may enable an enhanced active or passive thermal solution such as a fan or a heat sink to be enabled with the Computing Device and or Companion Electronic Device or in another device in one embodiment a cooling system on the companion electronic device could be used to cool a physically connected (docked) Computing device, Cooling systems will allow the Computing Device and or the Companion Electronic Devices to be kept cooler allowing System voltage and or current (or an element of the system, e.g., processor or memory only) to increase in addition the system clock speed (processor, memory, bus, and internal/external interfaces) could also increase their speeds in an extreme case to in effect allow âoverclockingâ of the system of the Computing Device or Companion Electronic Device in a connected mode e.g. to operate outside of its typically performance boundaries through the use of this enhanced cooling system Further changes to the performance of the system could be made depending on the system preferences such as display brightness, system element power states (e.g., audio off if no audio required), enabling/disabling ports, etc. This will allow an optimum configuration of the system based upon the application being executed on the Computing Device and or Companion Electronic Device, the available power to the system and the thermal environment of the Computing Device and or the Companion Electronic Device.
In another embodiment the computing device(s) and the Companion Electronic Device(s) can communicate to each other their respective battery and or thermal states and based upon a policy, preference or procedure can reassign the computational tasks currently being executed or scheduled to be executed to each other or to a server they may be connected to in order to reduce power consumption on either device or to reduce the thermal activity on either device or to put the activity on to a device or server which has enhanced thermal capabilities so as to more effectively deal with thermal loads in the overall system.
The upscaling/downscaling of the Computing Device or the Companion Electronic Device docked/connected system parameters could be invoked by these application-specific power availability or thermal characteristic based on one or any combination of these methods.
Additionally, Computing Device and/or Companion Electronic Device could request or require to distribute processing tasks between each other dynamically, based upon battery voltage and or thermal status for example, when the two devices come into close proximity of one another or when one's battery power is low.
In these or in other embodiments, the Computing Device and the Companion Electronic Device may additionally communicate other status information to each other in order to facilitate upscaling/downscaling or other behavior modifications, such as one device using capabilities of the other device in preference to its own. Examples of such status communications could include but are not limited to: Available general purpose processing power, availability or presence of specific processing capability (such as the presence of a graphic processing unit). available runtime or storage memory, battery capacity, peripheral availability, function availability (e.g., camera).
This invention can be implemented via specific hardware or software/firmware changes to the processors used with the computing devices and or the companion electronic devices or servers connected to them or by software on the devices by an application or at the OS kernel or firmware level or other software means or be used alone or in conjunction with the invention below to create new p states for the smart Computing Device processor when the unit is docked. It is also possible to generate multiple new p states for any processor depending on the charge levels of the batteries within the dock.
It is critical in any mobile solution to balance performance (including speed) with the usage time between charges and to efficiently manage the thermal characteristics of the unit. This element of the invention governs the way in which the operational voltages of key components in the system are altered when the Computing Device is docked and therefore able to access an additional power source and different thermal resources. This control covers but is not limited to amending the voltage and current supply within and to the processor units and memory depending on the type of activity being performed e.g. lower voltage for playing background music, higher voltage for encoding video or playing games. It also covers the amendment of the voltage and current of processor units and memory depending on the battery charge status and also the amendment when physically connected to the Computing Device. E.g. the computing device uses a higher voltage when able to access the companion electronic device power source and able to utilise its enhanced thermal capabilities. Prior art exists for the manipulation of silicon voltage within a PC or Computing Device as a single device. The novel part of the invention is that the voltage used for a given type of content e.g. web browsing or game play will vary based on the available battery charge and can therefore be higher when the Computing Device is physically connected and able to use the thermal resources and power supply capability within the companion electronic device.
The Computing Device could have multiple or variable power supplies of different voltage, or power for example, that could be used for lower power/higher performance, etc. software and or hardware contained within the processors present with the computing device or elsewhere within the computing device and or software running on the computing device such as Firmware, RTOS, OS and or applications could enable or invoke these modes. The companion electronic device could also have multiple or variable power supplies of different voltage, or power for example, that could be used for lower power/higher performance, etc. software and or hardware contained within the processors present with the companion electronic device(s) or elsewhere within the companion electronic device(s) and or software running on the companion electronic device(s) such as Firmware, RTOS, OS and or applications could enable or invoke these modes.
This invention can be implemented via specific software on the devices at the kernel level or firmware level or be used alone or in conjunction with the invention above to create new p states for the smart Computing Device processor when the unit is docked. It is also possible to generate multiple new p states for any processor depending on the charge levels of the batteries within the dock.
The Companion Electronic Device can instruct the Computing Device to operate in particular modes and therefore to use (or not) particular Computing Device resources. Different classes of Companion Electronic Devices could instruct the Computing Device to operate in different ways. See, for example, PPC enabler architecture splits.
There may also be thermal/mechanical/electromechanical elements in the dock which are designed to work in conjunction with the Computing Device and provide additional cooling and or heat dispersion, for example to allow the Computing Device processor to operate at a higher clock rate (for example but not limited to outside of its nominal performance envelope, i.e., overclocking) without overheating than it could when not docked with such a thermal solution not present.
Alternatively or additionally, the Companion Electronic Device could invoke physical dispersion of memory usage in either the Computing Device or Companion Electronic Device. This physical dispersion of memory usage would result in heat generated by memory usage to be spread out over a larger physical area that it would be if the Computing Device or Companion Electronic Device continually accessed physically adjacent portions of memory. In addition to reducing overall heat generated, an additional benefit could lower power consumption, for example, by making the use of active cooling measures such as fans or other techniques, or passive cooling measures, less necessary. Furthermore, bill of material cost and system complexity could be reduced by the exclusion of these cooling elements. Also, the elimination of these cooling components could enable smaller, lighter, thinner and less complex devices.
Additionally, because the Companion Electronic Device contains its own processor and memory, the Computing Device will generate less heat and use less processing power than it would if it were generating the Companion Electronic Device environment as well as operating its own system. Additionally, memory, processing power, etc., that would otherwise be needed on the Computing Device to run the Companion Electronic Device environment as well as the Computing Device environment are not necessary, also enabling smaller, lighter, less complex devices.
Arm (or other Auxiliary) Antennas
As previously mentioned, either Computing Device or Companion Electronic Device could have auxiliary antennas, or could bridge antennas, for use by the other device. In the case of a laptop-style Companion Electronic Device, for example, these antennas could be located in the display arms.
Computing Device and/or Companion Electronic Devices could include WiFi or other wireless communication capability. The devices could allow for WiFi functionality to be managed in common.
WiFi provides an alternative to the Computing Devices cellular connection. It provides many advantages to both the user and operator in reducing cost. The disadvantage of WiFi is that it requires a relatively high current and therefore has a significant negative impact on battery life. This invention maximizes the use of and users control of WiFi as a lower cost connection whilst protecting the overall battery life.
Could implement policies to turn on or off WiFi based on Computing Device/Companion Electronic Device configurations, and location or other methods. For example, a feature could enables the Computing Device to switch off the WiFi in the Computing Device. This and other WiFi functionality could be controlled through preferences, policies and procedures. Examples include:
Future embodiments of the phone powered computing concept may have a wireless display to allow the display to fully rotate, be separate or to be removed from the Computing Device, e.g.,
Different types of Computing Devices and Companion Electronic Devices have their own characteristics, such as different screen sizes, input methods, etc. The multi-modal PPC solution allows both Computing Devices & Companion Electronic Devices to work with essentially infinite different Companion devices, and in many different ways.
Some examples of the multi-modal nature the PPC concept include:
Furthermore, TV mode may optimize the experience of typical living room use cases, such as streaming media consumption, by for example, prioritizing those tasks above other system tasks which may be less important for the usage environment, such as realtime incoming email handing.
Also, notification or other behaviors may be adapted to the usage environment. For example, text message or email previews may be displayed on the screen automatically in a handheld or desktop usage environment, where the user can reasonably expect privacy. In TV mode, however, it is more likely that the user may not have privacy and may, therefore, wish that message preview not be displayed. In this example, TV mode could include discrete notification of incoming messages without displaying previews or correspondent details.
A user may be looking for the low cost, optimal performance and portable solution for a given usage case. The nature of the solution will vary between users and even for the same user in different scenarios. This variety means that a modular based approach may provide the greatest utility.
For example, a tablet style device.
In a low cost embodiment the Computing Device will physically dock with the display utilizing all the key components of the Computing Device (accelerometer, compass etc.). This would be an example of an âall in one solutionâ. However the user may wish to keep the Computing Device easily accessible to be able to receive calls whilst using the tablet and choose to connect to the display with a wireless connection. The user will then slide a wireless module into the tablet in place of the Computing Device, enabling wireless connectivity to the Computing Device.
The wireless (or other) capability of the Computing Device may not be sufficient to provide the performance that the user requires in which case an accessory, referred to as PhoneWrap is connected to the Computing Device to improve amongst other things its battery and antenna performance and additional wireless radios if required.
Alternatively, Computing Devices may connect directly without the need for a phone wrap device to a Companion Electronic Device, if it has sufficient capability to do so.
Finally, the user may wish to connect additional speakers, keyboards or other peripherals to the Computing Device or Companion Electronic Device. The elements when used together form a multi modular concept.
See also possible form factor & use scenario figures.
Computing Device could also be used in a laptop like configuration, either docked or wirelessly connected. If Computing Device is not sufficiently capable, the same PhoneWrap could be used with a laptop like solution already described hence the modules can be reused in multiple embodiments.
A further embodiment could be to connect Computing Device to a television or monitor, possibly with an keyboard, trackball or mouse.
Additional configurations of the multi-modular concept include:
Electronic Device, which can be plug-ins.
The displays, cameras, and sensing capabilities of Computing Device and Companion Electronic Device could be used in multiple ways, including:
Electronic Device
This allows the user to switch environments from one device to another; the computing device and or the companion electronic device allow and enables the storing of the device state or device status of themselves respectively and or each other.
Device Status may refer to, for example current hardware or software settings or requirements of any of the devices in the system, which may be related to the usage environment of any of the devices, including for example, the Computing Device, the Companion Electronic Device or another device such as a server.
Device State may refer to, for example, the past, current or scheduled/planned activities running on the device, such as the fact that the web browser is open and the page which is being viewed or the recently viewed page history. This may be the device state of any of the devices in the system, including for example, the Computing Device, the Companion Electronic Device or another device such as a server.
See also earlier state retention, persistence, etc., discussions.
This allows independent management of displays in the Computing Device or Companion Electronic Device or other devices/units, such as peripherals devices or a server(s)
In this embodiment of the invention the independent management of the displays provides for one or more of the following, which could be initiated by Computing Device, Companion Electronic Device or another device, such as server, according to proximity, preference, policy, procedure an event or a user action:
This independent control is achieved by software on the Computing Device and/or Companion Electronic Device, for example alterations to the driver, library or kernel layers of the Computing Device and possibly the provision of one or more API's for Application Developers to access the operational modes above. Computing Device and/or Companion Electronic Device can also manage/change/generate display attributes and characteristics dependent on activity, conditions or characteristics of the other device.
The device can interact with other types of token, including by way of example only:
An embodiment of multitoken interaction could be through incorporation of NFC capability into Computing Device or Companion Electronic Device. Information exchanged could include profile, security or access rights and could be used to enable or disable specific functionality on the Computing Device or Companion Electronic Device. Examples include:
Another embodiment is that the above and other examples could be enabled by the Computing Device and Companion Electronic Devices themselves coming in close proximity of each other.
2 or more batteries on the front, back or sides with hot-swappable cells.
In many but not all embodiments, it is intended that the Computing Device or Companion Electronic Device be a mobile solution and hence will require their own batteries as well as the ability to connect to an external power source. These batteries can also charge or be charged by the other device's batteries, including but not limited to Computing Device or Companion Electronic Device. As there may be several separate batteries or battery cells these will also be able to be âhot swappedâ meaning that a one or more batteries can be removed without losing power to the Companion Electronic Device or Computing Device even if no external power source is available. The battery can then be replaced with a different charged battery. Individual batteries that have been replaced can then be charged by use of a separate charging station or by reinserting them in the dock and connecting the dock to an external power source or by the other batteries.
This embodiment is considered unique because phones and PC's today do not contain âhot swappableâ batteries and lose power if the battery is removed without an external power source connected.
Back up could take place immediately when you plug in the phone and or other Computing Device/Companion Electronic Device type. Alternatively, this could take place with other alternative connection methods, including wireless.
As the Computing Device becomes a replacement for your PC it is essential that a range of backup options are available within the PPC concept. Here the term âplugâ can be defined as a physical or wireless connection. Existing solutions do not rely on the docked status of the Computing Device or Companion Electronic Device to trigger the back-up process.
The options include:
The back-up process could be initiated as soon as the presence of the Computing Device/Companion Electronic Device is detected by the Computing Device or vice versa. The user will select the destination and content types for the back-up storage in the settings part of the software that runs on the Computing Device or Companion Electronic Device.
When data is backed up to a source that may be deemed by the user as âless secureâ e.g. a memory card it will be possible to encrypt all or some of the data or add a security code to access it. This security code could be as simple as data from the users SIM card or a 4 digit user code. Some organisations are likely to want a far more secure access in which case an application on the Computing Device will encrypt all data prior to storing it with a key based algorithm that will also be required to read or restore the data stored.
Back-up could also extend to back-up of the memory of other connected or integrated devices, for example the content of a SIM card or the content of a connected USB flash drive or memory card.
An alternative or additional embodiment of the automatic backup capability would be for the system to automatically back up Computing Device to Companion Electronic Device or vice versa when wireless signal strength began to degrade. Signal strength degradation (as measured by RF power, quality of service, bit error rate or other metric) could indicate that the user was taking one device out of range of the other. The backup could instead be automatically prompted, giving the user the opportunity to agree to backup and to remain within the coverage area until the backup is complete.
In the case of a non-wireless connection, the system could prompt for back-up before the device is physically disconnected. If no removal prompt is required before disconnection, the system could prompt the user to reconnect the device for back-up/sync following a disconnection if back-up/sync were not complete.
Similarly, automatic or automatically prompted backup could also be triggered by other cases such as:
Automatic backup behaviour could be determined by preferences, policies or procedures. This could include monitoring the amount of data changed or added and triggering backup either with any change or with change of a set amount or percentage.
This embodiment could be especially useful, for example, in a public Companion Electronic Device âkioskâ scenario to ensure that all changes or additions were backed-up and synchronized to Computing Device before the user left the public kiosk.
In another embodiment, as mentioned elsewhere in the document, automatic back-up could take the form of periodic or continuous data and or software (including but not limited to OS, apps, etc.) synchronization between, for example, a mobile Computing Device and a home, office, network or cloud (e.g. a server) based Companion Electronic Device (or vice versa), in order to ensure data consistency between or among the devices. This back-up could be triggered and managed as with any of the above methods, or with other methods.
In the case that the devices are not in proximity with one another but each has a connection to the internet (or to another public or private network), the devices could be periodically or continuously backed up and/or synchronized via that network connection based on preferences, policies or procedures and/or some or all of the above methods.
See also multi-use display, camera and sensor section and Independent Display Management section.
See also Computing Device/Companion Electronic Device peripheral device management and sharing throughout the document.
The PPC concept enables and could be supported a number of security features, including:
Wireless connections between Computing Device and Companion Electronic Device (and also other devices) could offer many practical and convenience benefits compared to wired connections. For example, a Computing Device could be left in a briefcase and or a pocket while accessed through a Companion Electronic Device. Or a tablet-style/notebook style/display Companion Electronic Device could be made especially thin and light without the need to physically dock a Computing Device into it.
However, wireless video/display transmission, especially, presents challenges. The connection between the devices must be robust, of sufficient bandwidth or if bandwidth is limited use techniques such as real time compression to reduce the signal's bandwidth requirements the use of compression can cause problems in situations where low latency is required such as gaming and or GUI interactions such as pinching or zooming on a Companion Electronic Device display, In many embodiments of Companion Electronic Device's video/display transmission, audio and use input/output events will be done concurrently also be sent in the same and/or opposite direction, and may require the adoption of a schema. This schema could use standardised protocols such as H.264 and MP3 for video and audio encoding and standardised USB protocols for data transmission and the passing of control signals between the Computing Device and the Companion Electronic Devices. Furthermore, other video or data streams, such as a live camera video stream, may also need to be sent concurrently. Such systems could also use non standardised or proprietary protocols to function
In a wireless embodiment, wireless video transmission with low latency could be achieved using:
A computing device operable to work in conjunction with a companion electronic device, in which the computing device and the companion electronic device each have their own electronics and/or own operating system and each is able to construct a partial or complete user environment;
The user environment for the computing device and the companion electronic device is the complete set of software and hardware components that together provide for output to and input from a user, where a user is a person, persons or another device (for example, for machine to machine (M2M) applications).
The following features may be implemented in the above device, and may also each be independently novel and inventive over the above concepts:
The computing device may include at least one processor core and that core is used, under the instruction of the companion electronic device, to provide and/or generate the data that is sent from the computing device to the companion electronic device and to provide services to the companion electronic device. The core may be used in conjunction with other electronics, (e.g., application-specific ICs) to provide and/or generate the data that is sent from the computing device to the companion electronic device and to provide services to the companion electronic device.
The computing device may communicate over an interface or interfaces with the companion electronic device, where the interface(s) include one or more of the following: a physical connection, a wireless connection, or a network connection, and in which the computing device and companion electronic device may be local or remote to one another.
The computing device may send data to the companion electronic device that:
The computing device may provide:
The computing device may be operable to detect the presence of the companion electronic device, or the companion electronic device may be operable to detect the presence of the computing device. The computing device and/or the companion electronic device adjusts its functionality in accordance with this detection. Where the computing device is not operable to detect the configuration of the companion electronic device, then the companion electronic device may be operable to (i) detect the configuration of the computing device or (ii) to inform the computing device of the companion electronic device's configuration, or (iii) to instruct the computing device to operate in a manner which is suitable for the companion electronic device's configuration without actually sharing configuration information.
The computing device in conjunction with the companion electronic device, when in a linked state, act independently to display information
The computing device may send data that is an abstraction or generalisation of data and/or information that defines a user environment and therefore may not be specific to any single type or class of companion electronic devices, but instead can be used by the companion electronic device to construct the user environment appropriate to fit with its own configuration, settings or capabilities. The data abstractions may be tokens. The data abstractions may use industry standard or de facto standard methods such as XML or Flash. A graphical image may be described and sent by the computing device using a method such as the Scalable Vector Graphics (SVG) specification of XML or another standards or non-standards based method and be interpreted and rendered by the companion electronic device.
User environment elements may be sent from the computing device as commands or library calls which are then received, interpreted and executed by the companion electronic device.
The computing device may receive changes back from the companion electronic device, or from another devices/servers connected to the companion electronic device, so that the computing device maintains the master, definitive data set.
The companion electronic device may receive changes back from the computing device, or from another device connected to the computing device, so that the companion electronic device maintains the master, definitive data set. The computing device may receive changes back from the companion electronic device, so that data coherency is maintained between the devices. The companion electronic device may receive changes back from the computing device, so that data coherency is maintained between the devices.
The changes on either the computing device or the companion electronic or devices or servers connected to them may include any of: OS changes, user data, application changes and status; configuration changes and status; and/or device settings, configuration and status. The changes may be exchanged continuously and asynchronously based upon an event, policy, preference or procedure.
The computing device may retains its device status, and/or the status of the companion electronic device or any connected server. The companion electronic device may retains the status of the computing device and/or any connected server. A connected server may retains the status of the computing device, and/or the companion electronic device.
The computing device and or the companion electronic device may retain state persistency, information, such as maintaining browsing session, open applications, application state, device state, etc., when connecting to, operating with, or disconnecting from one another.
The companion electronic device may also retains state persistency information, such as maintaining browsing session, open applications, application state, device state, etc., when connecting to, operating with, or disconnecting the companion electronic device.
Applications resident on one device (the computing device, the companion electronic device or a local or remote server) may be executed in whole or in part on one or more of the other devices/servers; the application execution may be switched from one device to the other device and/or server at any time. Application status or data may be acquired from or shared among any of the devices to be used with the running application. The functionality, capability or behaviour of the application being executed on one device may be extended or modified by utilizing additional or different capabilities of any of the other device or devices.
The computing device may share:
The computing device may itself have no knowledge of the capabilities of the companion electronic device. The computing device may be manufactured by a different manufacturer than the companion electronic device. The computing device may not originally have been intended to be operable with the companion electronic device but may be made so operable through the addition of hardware components, software components and/or intermediary or peripheral devices, whether local or remote to the computing device and companion electronic devices.
The computing device may not have continuous interaction with the companion electronic device or continuous access to computational resources on the computing device, hence reducing resource requirements on the computing device, and the companion electronic device interface bandwidth requirements, and power requirements.
The computing device may transmit a video signal (or a data representation thereof) to the companion electronic device, and the video signal (or a data representation thereof) may then be modified/enhanced/adapted on the companion electronic device to be suitable for the user preferences capabilities and/or configuration of the companion electronic device, for example for output on a larger or smaller display or in a larger font size or in 3D.
The companion electronic device may transmit a video signal (or a data representation thereof) to the computing device, and the video signal (or a data representation thereof) may then be modified/enhanced/adapted on the computing device to be suitable for the user preferences capabilities and/or configuration of the computing device, for example for output on a larger or smaller display or in larger font size or in 3D.
The computing device may transmit over an interface an audio signal (or a data representation thereof) to the companion electronic device, which is then enriched or adapted on the companion electronic device for output to the user, for example at a louder sound level or an original mono signal (or a data representation thereof) output as stereo or vice versa, or an original stereo signal (or a data representation thereof) output in surround sound.
The computing device may receive from the companion electronic device over an interface an audio signal (or a data representation thereof), which is then enriched or adapted on the computing device for output to the user, for example at a louder level or an original mono signal (or a data representation thereof) output as stereo, or vice versa, or an original stereo signal (or a data representation thereof) output in surround sound.
The computing device may adapt, switch off or put into sleep mode its resources when in a linked state to the companion electronic device, thus reducing, amongst other things, the power consumption of the computing device. The companion electronic device may instruct the switch off or sleep/reduced activity mode.
The devices may be in a linked state and resources on either device are switched on dependent on one or more of the following: policies; preferences and application instructions.
The companion electronic device may adapt, switch off or put into sleep/reduced activity mode one or more of the following of the computing device: display, display driver, audio drivers, portions of memory, communication systems and components, input and output devices and capabilities and other system elements.
The companion electronic device may adapt, switch off or put into sleep/reduced activity mode its resources in a linked state to the computing device, thus reducing, amongst other things, the power consumption of the companion electronic device.
The computing device may be connected over an interface to multiple companion electronic devices at the same time.
The computing device may be connected over an interface and may be able to switch the interface to another interface or adjust the interface characteristics dependent on the capabilities or resources available to either the companion electronic device or the computing device, or based on the software running on or activities of either the computing device and or the companion electronic device
The companion electronic devices may be connected over an interface to each other, whereby one or more companion electronic devices acts as a computing device.
The computing device and any number of other computing devices may be connected over an interface to a single or to multiple companion electronic devices at the same time.
The computing device may enable the control or simultaneous use of the same applications, in whole or in part, or modified versions of the same applications, in whole or in part, or different applications, in whole or in part, on different companion electronic devices.
The computing device and/or the companion device may distribute and/or share computing and or software tasks between the computing device and/or the electronic computing device, in accordance with a preference, policy, procedure or application requirement.
The computing device or the companion device may distribute and/or share data and/or applications between the computing device and/or the companion electronic device in accordance to a preference, policy, procedure or application requirement.
The computing device or the companion electronic device may be able to detect appropriate companion electronic devices for the use of resources and or services or the running of applications dependent on applications being run on either the computing device and or the companion electronic device.
The computing device and the companion electronic device may combine or share their physical, hardware and software resources to make an enhanced system, to reduce power consumption on either device or to improve performance. The computing device may use the antenna system of the companion electronic device. The computing device may offload some or all processing to the companion electronic device. The devices may share power resources. A schema may manage the charging and the priority of charging between the devices.
The computing device and/or the companion electronic device may adjust their computing clock speed for either the processor or the memory or both, individually or in combination in accordance with a preference, policy, procedure or application requirement based upon the system voltage of either the computing device or the companion electronic device.
The computing device and/or the companion device may distribute computing and/or software tasks between the computing device and/or the companion electronic device in accordance with a preference, policy, procedure or application requirement based upon the system voltage of the computing device and/or the companion electronic device.
The computing device and/or the companion electronic device may enable or disable system resources on either the computing device and/or the companion electronic device in accordance with a preference, policy, procedure or application requirement based upon the system voltage of the computing device and/or the companion electronic device.
The computing device and/or the companion electronic device communicate status information to one another in order to facilitate upscaling/downscaling or other behavior modifications, such as one device using capabilities of the other device in preference to its own. The status information communicated may be thermal state information.
The status information communicated may also be one or more of: available general purpose processing power, availability or presence of specific processing capability (such as the presence of a graphic processing unit). available runtime or storage memory, battery capacity, battery voltage, peripheral availability, function availability (e.g., camera). Software, or firmware or hardware may implement a function of communicating the status information; a hardware implementation may be a modification to a microprocessor.
The computing device and/or the companion electronic device may adjusts its computing clock speed for either the processor or the memory or both in accordance with a preference, policy, procedure or or RTOS, OS, application or other software requirement based upon the thermal capabilities available to the computing device and/or the companion electronic device and may switch tasks between the computing device and the companion electronic device based upon any combination of these.
The computing device and/or the companion electronic device may distribute computing tasks in accordance with a preference, policy, procedure, or application requirement based upon the thermal capabilities available in on either the computing device and or the companion electronic device and or the current or scheduled tasks required to executed on either the computing device and/or the companion electronic device.
The computing device and/or the companion electronic device may enable or disable system resources on either the computing device and/or the electronic device in accordance with a preference, policy, procedure or application requirement based upon the thermal capabilities available to the computing device and/or the companion electronic device.
The computing device and/or the companion device may enable or disable system resources on either the computing device and/or the electronic device in accordance with a preference, policy, procedure or application requirement based upon the thermal status and or based upon the scheduled tasks required to be executed on either the computing device and/or the companion electronic device.
The computing device may in whole or in part instruct or enable the companion electronic device to generate or deploy a user environment or a skin that corresponds, in whole or in part, to the user environment or skin of the computing device. The skin may be a skin associated with the operating system of the computing device.
The display orientation of information in either device can be controlled by the companion electronic device.
The companion electronic device may instruct the computing device to function in a specific manner, such as a remote control, or to display subtitles, or as a game controller for the companion electronic device, such as when the companion electronic device is displaying a movie or playing a game.
The computing device may switch between being a master to the companion electronic device and being a slave to that companion electronic device.
The computing device may be informed, or the companion device may instruct or inform the computing device of its presence based upon hardware or software means, including connector type, a hardware configuration, a protocol, or IP address, or by another identifier.
The devices alone or in conjunction with another device or system may be aware of each other's location and can track each other's movement, and/or act as an enabler for access or control of software or hardware on the devices or devices connected to either device.
The computing device may functions as a peripheral, such as a mouse, when connected to the companion electronic device.
The devices may each have an integrated or attached camera and these cameras' function may then be modified to behave in alternative modes such as a wide angle video conferencing mode by either adaption of the cameras' settings or by post processing of the image taken by the camera on either the computing device the companion electronic device an intermediate device or a server connected to the devices.
The devices may each have an integrated or attached camera and these cameras adapt the characteristics of the computing device and or the companion electronic device such as reducing back lighting levels and or contrast on the displays of the computing device and or the companions electronic devices, or make adaptations based upon the type of activity eg the type of running applications being run and or displayed on either device.
The computing device may function as a security or access control device to either the hardware or software or both on the companion electronic device or other hardware or software or devices the companion electronic device may be connected to.
The computing device may, in conjunction with another device or token, function as a security or access control device to either the hardware or software or both on the companion electronic device or other software or devices the companion electronic device may be connected to.
The computing device and the companion electronic device may, in conjunction with each other and/or with software resident on both or either device, function as a security or access control to either the hardware or software or both on the companion electronic device or the computing device and to devices/servers connected to them. This functionality may also extend to other devices, such as door locks or other forms of physical access control.
The computing device may include settings that can tell the companion electronic device what preferences the user or an application wants and what mode it needs to be in, or vice versa, based on criteria such as the companion electronic device's or the computing device's capabilities, or the capabilities of peripheral devices attached to either of the computing device or the companion electronic device.
The computing device may be automatically or manually detected by the companion electronic device, or vice versa; the computing device or the companion electronic device is then asked whether it wishes to connect and does so or not based on a user preference or system policy.
The communications capabilities of the devices may be enabled and/or disabled, in accordance with resources available to either the computing device and/or the companion electronic device and/or based upon a policy, preference, procedure.
The computing device may takes on a context-dependent role that takes advantage of the combined capabilities of the computing and the companion electronic devices.
The computing device may be a portable, personal computing device, which may be selected from the list: Feature phone; Smartphone; Electronic navigation device; PDA; Media player; Camera; eReader; Tablet; Netbook/smartbook; Laptop; Convertible computer (e.g., netbook/tablet), or Devices with the appearance and or function in whole or in part of any of the preceding devices.
A system may include a computing device and a companion electronic device as described above. The companion electronic device may be selected from the list: Secondary display; Peripherals such as memory, printer, etc; Tablet computers; Automobile or other transport displays; Desktop Computer; Server; Gaming console; Keyboard; Remote control; Game controller; Electronic Kiosk; Electronic navigation device; Television; Multimedia receiver/player; Other multimedia system; Point of sale device; Industrial PDA; Feature phone; Smartphone; Digital Camera; eReader; Netbook/smartbook; Laptop; Convertible computer (e.g., combined netbook/tablet); docking stand; or Devices with the appearance and or function in whole or in part of any of the preceding devices. Hardware, software, and processing components and tasks may be distributed across any or all devices in the system.
A companion electronic device may operate as a stand-alone system independent of the computing device once the data is sent from the computing device.
UE generation, adaptation, transformation, etc., functions of the companion electronic device may in addition be handled by a remote or local server, with the results then relayed to the companion electronic device or multiple companion electronic device either through local or remote connections, including for example, over a private network or over the internet.
The companion electronic device may receive changes back from the computing device, or from another device connected to the computing device so that the companion electronic device maintains the master, definitive data set.
The companion electronic device may receive changes back from the computing device so that data coherency is maintained between the devices.
The companion electronic device may adjust its computing clock speed either the processor or the memory or both in accordance with a preference, policy, procedure or application requirement based upon the system voltage of the companion electronic device.
The companion electronic device may under its own control or in conjunction with the computing device, in whole or in part generates or deploys a user environment or a skin that corresponds, in whole or in part, to the user environment or skin of the computing device.
The skin may be a skin associated with the operating system of the computing device.
An application or operating system/graphical user interface of the companion electronic device may behave differently, either enhanced, reduced or otherwise, depending on criteria such as user preferences, the type or number of displays, peripherals, companion devices, and/or other device or software capabilities are that available to it or connected to it either directly or over an interface or network connection.
The companion electronic device may provide peripherals, capabilities, or connections to the computing device for the computing device to use, in preference to its own peripherals, capabilities, or connections, on instruction from the companion electronic device. The companion electronic device may function as a peripheral, such as memory storage, when connected to the computing device. The companion electronic may function as a security or access control device to either the hardware or software or both on the companion electronic device or other hardware or software or devices such as a server the companion electronic device may be connected to.
The companion electronic device may, in conjunction with another device or token, functions as a security or access control device to either the hardware or software or both on the companion electronic device or other hardware or software or devices the companion device may be connected to.
The companion electronic device may be operable to detect the presence of the computing device.
The companion electronic device may provide services or additional capabilities on request to the computing device.
The computing device or the companion electronic device may change roles or functions at any time, with the computing device assuming the role or function of the companion device and the companion device assuming the role or function of the computing device.
An application running on either device, or the operating system it runs on, may select or recommend whether a display on the computing device or the companion electronic device is used, or whether multiple displays are used.
The computing device nay be connected over an interface and may switch the interface to another interface or adjust the interface characteristics dependent on the capabilities, requirements of software running on the companion electronic device or the computing device or a server connected to either of them or resources available to either the companion electronic device or the computing device.
The original interface may be one of: physical and/or wireless and/or network interface and the new interface switched to is a different type selected from that list and the switch to a different type of interface is done to suit the capabilities of either the computing device(s) or the companion electronic device(s) or the resources available to them. The switch to a different type of interface may be done if there is interference on a particular type of interface. The switch to a different type of interface may also be done if an application requires or is more suited to a different type of interface connection. The switch to a different type of interface may be triggered by other characteristics, statuses or states, such as available system power of either device, thermal status and/or capability of either device, or the presence of additional hardware or interfaces (e.g., one device is compliant with the faster 802.11n standard while the other device is only compliant with the slower 802.11g).
An intermediary device may be attached to a computing device as described above, in which the intermediate device supplements or improves the capability of the computing device to work in conjunction with the companion electronic device.
The capability that is provided by the intermediary device may include but is not limited to one or more of the following: Auxiliary wireless data or A/V transmission; A/V conversion, encoding, decoding or transformation; Auxiliary memory; Auxiliary battery capacity; mechanical adaption of computing devices to integrate with and into companion electronic devices, Connector adaptation and/or transformation; Mechanical adaptation and/or transformation.
A consistent external interconnection scheme may be both mechanically and electronically employed allowing the creation of a standardized physical and electronic interface between computing devices and companion electronic devices, having the benefit of multiple companion electronic devices being able to physically interconnect with multiple computing devices.
A system in which a laptop housing comprising a display and a keyboard, is configured to mechanically and electrically attach to a computing device to form a single unit, and is characterized in that:
A system in which a docking stand comprises a first port to connect to a display apparatus and a second port to connect to a keyboard, the docking stand configured to mechanically and electrically attach to a computing device, and is characterized in that:
A system in which a tablet comprising a display and a which may include buttons and/or a keyboard, is configured to mechanically and electrically attach to a computing device to form a single unit, and is characterized in that:
1. A method of constructing a constructed complete user environment in a companion electronic device, the method including the steps of:
(i) the companion electronic device connecting to a mobile phone computing device, using an interface of the companion electronic device in communication with an interface of the mobile phone computing device;
(ii) the mobile phone computing device enabling the use of elements of a complete user environment of at least one application executing on the mobile phone computing device for use in conjunction with the companion electronic device;
(iii) the companion electronic device is enabled to receive from the mobile phone computing device elements of a complete user environment, wherein a complete user environment is a complete set of software and hardware components that together provide for output to and input from a user;
(iv) the companion electronic device receiving from the mobile phone computing device directly or via a server connected to the companion electronic device or mobile phone computing device elements of the complete user environment;
(v) the companion electronic device using the received elements of the complete user environment to locally construct its own constructed complete user environment, wherein the constructed complete user environment is adapted to a form factor of the companion electronic device, wherein the form factor of the companion electronic device is different to a form factor of the mobile phone computing device.
2. The method of claim 1, wherein the constructed complete user environment is adapted to a modality of usage of the companion electronic device.
3. The method of claim 1 wherein microprocessor cores and other electronics, (e.g., application-specific ICs) present in the mobile phone computing device and the companion electronic device are used to provide or generate or receive or process data that is sent from the mobile phone computing device to the companion electronic device and to provide services to the companion electronic device.
4. The method according to claim 1 in which the complete user environment for the mobile phone computing device and the companion electronic device is the complete set of software and hardware components, including applications on either device, that together provide for output to and input from a user, where a user is a person, persons or another device (for example, for machine to machine (M2M) applications).
5. The method according to claim 1 in which the mobile phone computing device is selected from the list: Feature phone; Smartphone; Portable media player, PDA; media player, Tablet; Netbook/smartbook; Laptop; Convertible computer (e.g., netbook/tablet), a smart watch, smart glasses, or Devices with the appearance and or function in whole or in part of any of the preceding devices.
6. The method according to claim 1 in which the companion device is selected from the list: Secondary display(s), Peripherals such as memory, etc; Tablet computers; Automobile e.g. Human Machine Interface (HMI) displays, In vehicle infotainment (IVI), Dashboard/Driver display(s), Passenger displays, Heads Up Display (HUD), HMI or IVI devices with multiple displays, or other transport displays; e.g, motorbike dashboards, aircraft passenger displays, train passenger displays, truck driver displays, e-bike and pedal bike displays; Server; Keyboard; Remote control; Electronic navigation device; Multimedia receiver/player; Other multimedia system; e.g. Car Audio system; Smartphone; Netbook/smartbook; Laptop; Convertible computer (e.g., combined netbook/tablet); automobile docking stand; or Devices with the appearance and or function in whole or in part of any of the preceding devices.
7. The method of claim 1, wherein the data the mobile phone computing device sends to the companion electronic device includes elements that are directly or indirectly used in the constructed complete user environment of the companion electronic device, using mechanisms on either the mobile phone computing device and or the companion electronic device.
8. The method of claim 1 wherein an application resident on the mobile phone computing device enables other applications running on the mobile phone computing device to adapt their complete user environment or elements of their complete user environment which are sent to the companion electronic device for use by the companion electronic device to create it's constructed complete user environment.
9. The method of claim 1 wherein an application resident on the mobile phone computing device, modifies or converts the complete user environment or elements of the complete user environment of other applications running on the mobile phone computing device which are sent to the companion electronic device for use by the companion electronic device to create it's constructed complete user environment
10. The method of claim 1, wherein the data the mobile phone computing device sends to the companion electronic device is, at the companion electronic device, combined with elements generated locally at the companion electronic device to build the companion electronic device constructed complete user environment.
11. The method of claim 1, wherein the data the mobile phone computing device sends to the companion electronic device includes one or more of: content (for example, audio or video information and or media, and or graphics), data (for example device data, system data, network data, user data, application data), application results, applications themselves, input/output, user feedback, information and/or data, wherein graphics data is described using methods such as scalable vector graphics (SVG), XML or other standards and non-standards based methods.
12. The method of claim 1 wherein the mobile phone computing device or the companion electronic provides services or peripherals, or connections or hardware/software capabilities to each other.
13. The method of claim 1, wherein functionality may be distributed between the mobile phone computing device and the companion device(s) or between the devices or devices servers connected to them, or any or all devices in the system.
14. The method of claim 1, wherein the mobile phone computing device provides functions or services including application execution on the mobile phone computing device, for use by the companion electronic device, or users of the companion electronic device.
15. The method of claim 1, wherein the companion electronic device or servers connected to it provide functions or services including application execution on the companion electronic device, for use by the mobile phone computing device or data such as user input data which is sent from the companion electronic device to the mobile phone computing device.
16. The method of claim 1, wherein the mobile phone computing device is operable to detect or informs or is informed of the presence of the companion electronic device, or in which the companion electronic device is operable to detect or inform or is informed of the presence of the mobile phone computing device, wherein the mobile phone computing device or the companion electronic device is operable to connect and does so or not based on a device setting, hardware configuration, application, setting or status, user preference, software policy or command or system policy.
17. The method of claim 16, wherein the mobile phone computing device or the companion electronic device modifies or adjusts its functionality in accordance with the detection.
18. The method of claim 1, wherein the mobile phone computing device is not operable to detect the configuration of the companion electronic device, but in which the companion electronic device is operable to (i) detect the configuration of the mobile phone computing device or (ii) to inform the mobile phone computing device of the companion electronic device's functionality or capability or configuration, or (iii) to instruct the mobile phone computing device to operate in a manner which is suitable for the companion electronic device's configuration or modality of use.
19. The method of claim 1, in which the mobile phone computing device or the companion electronic device, or peripherals connected to them when in a linked state, act independently to display information shared between them in a manner consistent with policies, preferences or procedures on each device or servers connected to them.
20. The method of claim 1 in which the computing device or the companion electronic device(s) or peripherals connected to them when in a linked state, act to display information sent from the mobile phone computing device to one or more companion electronic device(s) or to one or more displays connected to the companion electronic device(s) in accordance with an application or software command or instruction or with policies, preferences or procedures or settings on the mobile phone computing device or companion electronic device.
21. The method of claim 1, wherein changes received by the mobile phone computing device including hardware or software devices changes, OS changes, user data, system data, application changes and status; configuration changes and status; and/or device settings, configuration and status, are changes from the companion electronic device, or from peripherals/servers connected to the companion electronic device, so that the mobile phone computing device retains and maintains a master, set of data.
22. The method of claim 1, wherein the mobile phone computing device operating in conjunction with a companion electronic device which receives changes including hardware or software devices changes, OS changes, user data, system data, application changes and status; configuration changes and status; and/or device settings, configuration and status changes back from the mobile phone computing device, or from servers or, another device connected to the mobile phone computing device, so that the companion electronic device retains and maintains a master, set of data.
23. The method of claim 1, wherein the mobile phone computing device and companion electronic device receive changes including status, data, settings configuration, wherein the changes are exchanged with each other so that data coherency is retained and maintained between the devices.
24. The method of claim 1, wherein a connected server retains the status of the mobile phone computing device, or the companion electronic device, or peripherals connected to either device.
25. The method of claim 1, wherein the mobile phone computing device or the companion electronic device retains and or shares its state persistency information, such as maintaining browsing session, open applications, application state, device state, etc., when connecting to, operating with, or disconnecting from each other.
26. The method of claim 1, wherein the mobile phone computing device and/or the companion electronic device communicate status or setting information or capabilities to one another in order to facilitate upscaling/downscaling or other behavior modifications, such as one device using capabilities of the other device in preference to its own, wherein the status, setting or capabilities information communicated is one or more of: available general purpose processing power, the availability or presence of specific processing capability (such as the presence of a graphic processing unit), available runtime or storage memory, battery capacity, battery voltage, peripheral availability, function availability (e.g., camera), audio systems, antennas systems navigation systems or components, peripherals connected to the computing device or companion electronic device or servers connected to them.
27. The method of claim 1, wherein the mobile phone computing device or the companion electronic device(s) or a local or remote server connected to either the mobile phone computing device or the companion electronic device(s) is used, where user interaction on one device or the applications resident on one device may be executed in whole or in part on the other device and/or on a server(s) connected to them, and where the user interaction or application execution in whole or in part may be switched from one device to the other device and/or server(s) at any time.
28. The method of claim 1, wherein the mobile phone computing device, companion electronic device, peripherals or server(s) are connected, where data or instructions such as video data, audio data, device data, navigation data, automobile system data, sensor data, user input/output data or instructions, user voice data or instructions may be acquired from or shared amongst any of the devices or peripherals to be used with applications running on the mobile phone computing device and or companion electronic device.
29. The method of claim 28, wherein the functionality, capability or behavior of the application being executed on one device may be extended, modified or enhanced or take on a context dependent role, such as for use in an automotive application by utilizing additional or different capabilities of either device or any of the peripherals or devices/sensors connected to them.
30. The method of claim 1, wherein the mobile phone computing device shares a common file management system or physical memory or logical memory for the storage and or manipulation of data with the companion electronic device.
31. The method of claim 1, wherein the mobile phone computing device is intended to be operable with the companion electronic device or the companion electronic device is intended to be operable with the mobile phone computing device.
32. The method of claim 1, wherein the mobile phone or computing device are not originally intended to be operable with each other but which may be made so operable through the addition of hardware components, software components, servers, and/or intermediary or peripheral devices, whether local or remote to the mobile phone computing device or the companion electronic devices.
33. The method of claim 1, wherein the mobile phone computing device sends application related data, one or more video signal(s) or one or more data representation of a single or multiple video signals to the companion electronic device(s), which is modified/enhanced/adapted on the companion electronic device(s) and incorporated into a constructed complete user environment to be suitable for the user preferences capabilities and/or configuration/modality of use of the companion electronic device(s), for example for output on a larger or smaller display or in a larger font size or in 3D, or for displays on multiple companion electronic devices or companion devices some of which may have multiple displays, which displays may have different configurations and or functions, and may require a different modification, or adaptation of the video signal or data representation of the video signal for each companion electronic device display.
34. The method of claim 1, wherein the companion electronic device transmits a video signal or data representation of a video signal to the mobile phone computing device, and the video signal or data representation of a video signal is then modified/enhanced/adapted on the mobile phone computing device to be suitable for the user preferences capabilities and/or configuration of the mobile phone computing device, for example for output on a larger or smaller display or in larger font size or in 3D.
35. The method of claim 1 wherein the mobile phone computing device sends data, or changes including hardware or software devices changes, OS changes, user data, system data, application changes and status; configuration changes and status; and/or device settings, configuration and status related to an application or to multiple applications running on the mobile phone computing device or a server or servers connected to it wherein the data or changes that are sent to the companion electronic device, it's display or displays connected to it is under the instruction of the mobile phone computing device is combined with elements of the companion electronic devices complete user environment to create a constructed complete user environment wherein the constructed complete user environment is adapted for each companion electronic device display or displays connected to it based on the modality of use.
36. The method of claim 1, wherein the mobile phone computing device in conjunction with a companion electronic device transmits over an interface an audio signal or a data representation of an audio signal to the companion electronic device, which is then enriched or adapted on the companion electronic device for output to the user, for example at a louder sound level or processed differently to suit for an example an automobiles acoustics.
37. The method of claim 1, in which the mobile phone computing device or the companion electronic device or server(s) connected to either when in a linked state adapts, limits, puts into the background, switches off/on, suspends, or puts into sleep or into a reduced activity mode including but not limited to one or more of the following display, display driver, audio drivers, portions of memory, communication systems and components, input and output devices, device capabilities and other software or system elements, of the mobile phone computing device or companion electronic device or applications running on either device based on one or more of the following: the device(s) status, motion, location, polices, settings, preferences, application results, modality e.g., such as when a user is operating a automobile or other form of transport.
38. The method of claim 1, in which one or more mobile phone computing device is connected over an interface or interfaces to one or more companion electronic devices, where the interface is one of: physical and/or wireless and/or network interface and the interface characteristics are adjusted or is switched to a new interface and the adjustment or switch is done to suit the state or status of either the mobile phone computing device or the companion electronic device or the capabilities of either the mobile phone computing device(s) or the companion electronic device(s) or the resources available to them or by an application being run on either the mobile phone computing device or the companion electronic device or in response to a user action or to a limitation on an interface such as the presence of interference on that interface.
39. The method of claim 1, wherein the mobile phone computing device, or software running on the mobile phone computing device, executes or selects or enables the control or simultaneous use of the same applications, in whole or in part, or modified versions of the same applications, in whole or in part, or different applications, in whole or in part running on the mobile phone computing device, for use with one or more companion electronic devices with one or more displays wherein a complete constructed user environment appropriate for the modality of use is created for each display of a companion electronic or displays connected to it.
40. The method of claim 1, wherein the mobile phone computing device or the companion electronic device are operable to detect appropriate companion electronic devices or peripherals connected to them, for the use of their capabilities, hardware or software resources or services or the servicing of or running of applications.
41. The method of claim 1, in which the mobile phone computing device and/or the companion device distributes or shares, combines, exchanges, substitutes, enables, hardware or software capabilities or computing tasks, data, software tasks or applications when in a linked state such that the devices behave differently than when operated in a standalone state in accordance with a preference, policy, procedure, or software application or other software requirement or in accordance with the status and or capabilities available to the mobile phone computing device and/or the companion electronic device such that the resulting system forms a context dependent system suitable for automobile and transport vehicular use.
42. The method of claim 1, wherein the mobile phone computing device or an application running on it in whole or in part provides elements of a complete user environment including branding or skinning that corresponds, in whole or in part, to the complete user environment branding or skinning of the mobile phone computing device, or an application running on the mobile phone computing device or is associated with the operating system of the mobile phone computing device for use by the companion electronic device to create its own constructed complete user environment.
43. The method of claim 1 wherein the companion electronic device, under its own control or in conjunction with the mobile phone computing device, in whole or in part generates or deploys a complete constructed user environment including a skin that corresponds, in whole or in part, to the complete user environment, operating system or skin of the mobile phone computing device or an application running on the computing device.
44. The method of claim 1, wherein the constructed complete user environment including but not limited to the: display orientation or presentation, language, layout, font, style texture, focus, size, scale, resolution of information in either device can be formatted, defined or controlled by the companion electronic device(s), or servers connected to it.
45. The method of claim 1, wherein elements of the constructed complete user environment of the companion electronic device such as: language, layout, font, style, texture, focus, size, scale, resolution are formatted or defined, or controlled by the mobile phone computing device and combined with elements of a complete user environment of the companion electronic device to create a constructed complete user environment on the companion electronic device.
46. The method of claim 1, wherein the mobile phone computing device can switch between being a master to a companion electronic device and being a slave to a companion electronic device.
47. The method of claim 1, wherein the companion electronic device or devices connected to the companion electronic device function as a peripheral, such as a mouse or controller, or sensor for the mobile phone computing device or the companion electronic device when the companion electronic device is connected to the mobile phone computing device.
48. The method of claim 1, wherein the mobile phone computing device is used in conjunction with the companion electronic device, another device, server, a token or peripherals which in conjunction with each other and/or with software resident on both or either device functions as a security or access control to either the hardware, software or systems both on the companion electronic device or the mobile phone computing device and to devices/servers connected to them.
49. The method of claim 1, in which the settings or state persistency information on the mobile phone computing device are used to inform or are used in whole or in part to control the companion electronic device or devices or peripherals, connected to the companion electronic device and set the preferences the user wants or an application wants and what mode or settings the companion electronic device or devices connected need to be in such as climate control mode/settings, navigation mode/settings, telephony mode/settings, language mode/settings, seat position mode/settings, audio mode/settings etc. based on criteria such as the user preferences, system defaults, companion electronic device's or the mobile phone computing device's capabilities, or the capabilities of peripheral devices attached to either device.
50. The method of claim 1, wherein constructed complete user environment generation, adaptation, transformation, etc., functions of the companion electronic device are performed in whole or in part by a remote or local server, or intermediary device with the results then relayed to the companion electronic device or multiple companion electronic device either through local or remote connections, including for example, over an interface, private network or over the internet.
51. The method of claim 1, wherein peripherals are selected from a list including displays, touch screens, buttons, microphones, speakers, cameras, control knobs, memory, mirrors, lights, smart watches, smart glasses, wearable electronic devices, T.V's, multi media systems, access devices e.g. electronic keys, a electronic mouse, controller, antennas.
52. The method of claim 1 wherein the mobile phone computing device can update the software of the companion electronic device including applications, OS and other software on the companion electronic device or devices connected to the companion electronic device.
53. The method of claim 1, in which an application running on either device, or the operating system it runs on, or extensions to the operating system, or an application running on the operating system, selects or instructs or recommends, or informs as to whether a display on the mobile phone computing device or the companion electronic device is to be used, or whether multiple displays that are connected to the companion electronic device are to be used to display information in whole or in part, including information from applications running on the mobile phone computing device, elements of which may be used in the constructed complete user environment of the companion electronic device on one or more displays and which may be displayed differently on each display, based upon each displays modality of use.
54. The method of claim 38, in which the original interface connecting the mobile phone computing device and the companion electronic device is one of: physical and/or wireless and/or network interface and the interface characteristics are adjusted or is switched to a new interface and the adjustment or switch is done to suit the state or status of either the mobile phone computing device or the companion electronic device or the capabilities of either the mobile phone computing device(s) or the companion electronic device(s) or the resources available to them or by a user preference or by an application being run on either the mobile phone computing device or the companion electronic device or in response to a user action or to a limitation on an interface such as the presence of interference on that interface.
55. The method of claim 1, in which an intermediary device or peripheral is attached to the mobile phone computing device or companion electronic device, wherein the intermediary device supplements or improves the capability of the mobile phone computing device or companion electronic device including any of the following data transmission, data conversion, wireless data or audio/video transmission; audio/video conversion, encoding, decoding or transformation, formatting, user element generation or description or elements of a complete user environment Connector adaptation and/or transformation; Mechanical adaptation and/or transformation between the mobile phone computing device and the companion electronic device.to allow the mobile phone computing device and the companion electronic device to to operate as an automotive system.