Category: Mobile Computing

Bose offers headphones optimised for Google Assistant

Article – From the horse’s mouth

Bose QuietComfort QC35 II noise-cancelling Bluetooth headset optimised for Google Assistant - Press picture courtesy of Bose Corporation

Bose QuietComfort QC35 II noise cancelling Bluetooth headset optimised for Google Assistant – a sign of things to come for mobile audio accessories

Google

Headphones optimized for the Google Assistant (Blog Post)

Bose

Redefines Sport Headphones with Truly Wireless SoundSport Free (Press Release)

QuietComfort QC35 II Wireless Headphones (Product Page – USA)

– Bluetooth circum-aural closed-back noise-cancelling headset

My Comments

A trend that will be surfacing with the voice-driven personal assistants is that the speaker or headset device doesn’t need to be directly connected to a home network to access the Internet.

Here, some of these devices will connect to a computer or mobile device via Bluetooth or a similar technology but work in an “app-cessory” manner with a vendor-supplied app. Here, this app will serve as a gateway to a voice-driven personal assistant platform which can be hosted natively or through an add-on app, with this function activated through a dedicated button on the audio accessory device.

The first example of these is the Bose QuietComfort QC35 II which is an active noise-cancelling over-the-ear headset, but this setup will also appear with more headphones products from Bose. In this case, the headset connects to the smartphone via Bluetooth and works with a Bose-supplied control app but works hand in glove with the Google Assistant app, available for Android and iOS.

But all audio accessories should be able to work with Siri, Google Now, Bixby and Cortana

There is a special button on the Bose QuietComfort headset that is mapped by the control app to trigger Google Assistant while messages that come in are read by Google Assistant in a text-to-voice manner. You will expect the Google Assistant to do what it can including providing voice-driven access to resources. This is while the headset is optimised to work at its best with voice recognition even when faced with noisy environments like public transport.

As I was highlighting in the last paragraph, such devices will be acoustically optimised for error-free voice recognition, preferably with the chosen platform. One method that will be commonly used would be to implement a microphone array that uses the multiple microphones to focus on the user’s voice.

This will be augmented with dynamic sound enhancement for the voice-driven personal assistant platform so that you can hear the personal assistant clearly when it replies.

But could these headphones and speakers be seen as a gimmick when any wired or Bluetooth headset can work with your mobile platform’s integral voice assistant without the need for any extra software? This is where you can, for example, dwell on the “call” button on your headset to invoke Siri or Google Now, then interact with that assistant to make a call or send a message for example.

Personally, I would just like to see the voice-recognition abilities of an audio accessory improved so that they can work with whichever voice-driven personal assistant you use. This would be in the form of something like microphone arrays or something similar, along with a standard function mapping for voice-assistant buttons. Similarly, audio adaptors and wearables like smartwatches and fitness bands could be focused towards supporting the “visual component” of voice-driven personal-assistant platforms by showing visual information on their displays that augment the voice-driven experience.

Controlling Wi-Fi and Bluetooth on your iOS 11 device

Articles

If you can’t manage your iOS 11 device’s WiFi or Bluetooth from the Control Center, you may have to go to the Settings App.

iOS Control Centre’s Wireless Toggles Don’t Turn Off Wireless Radios | Lifehacker Australia

My Comments

Apple has just rolled out iOS 11 as an update for your iPhone’s or iPad’s operating system and, as expected with “.0” versions of operating systems’ major functionality updates, there will be a few bugs and issues here and there. This is typically due to Apple, like other software vendors, rushing the major-functionality version of the software out the door to satisfy the vendor’s marketing team’s needs. In this case, the goal here is to get the new iPhone X and new iPhone 8 range, which will be loaded with this operating-system version, ready to sell to the crowds queueing outside the Apple stores and mobile phone retailers on the day they are released i.e. 22 September for the iPhone 8 and 8 Plus, and 3 November for the iPhone X.

One of these is the inability to manage Wi-Fi and Bluetooth from the Control Center on your iOS device even though the buttons do exist there to enable and disable this function. Here, you may want to disable one or both of these functions for your privacy when in the vicinity of Wi-Fi networks you don’t trust, to save battery runtime when you are not connected to a Bluetooth peripheral or a Wi-Fi network or simply as part of troubleshooting a Wi-Fi network or Bluetooth peripheral connection.

The symptom shows up in the form where pressing the Wi-Fi or Bluetooth icons in the Control Center has no effect on the Wi-Fi or Bluetooth functionality. But you can work around this by going to the Settings app on your iOS device. Then you tap on WiFi or Bluetooth to select the appropriate function you want to control.

Disable the appropriate function by sliding the switch to the Off position whereupon you will see no references to Bluetooth or Wi-Fi activity and the green marker will disappear. Or enable the appropriate function by sliding the switch to the On position where you will see the green marker appear and references to the Bluetooth or Wi-Fi activity appear.

Of course, keep an eye on the Settings app for newer “point-release” versions of the iOS operating system and update your iOS device with these newer versions as they arrive. Here, these versions will typically rectify bugs, security exploits or weaknesses that become knowledge to Apple.

Setting up a mobile NAS to work with your home network

WD MyPassport Wireless mobile NAS

The WD MyPassport Wireless mobile network-attached storage – can offer data to the host Wi-Fi network when set up in hotspot mode

Increasingly, data-storage device manufacturers are adding to their mobile network-attached storage devices the same kind of network-based data storage and access features typically offered with a standard desktop NAS device. This is rather than these devices just being a lightweight file server for smartphones and tablets connected to the device’s own Wi-Fi access point.

I had previously reviewed one of these devices in the form of the WD MyPassport Wireless mobile NAS which demonstrated this kind of functionality. In the review, I had called out the DLNA-compliant media server that was part of that mobile NAS’s feature set, where you had the ability to show your photos and videos on one of the latest Smart TVs via the home network the TV is connected to.

Mobile NAS with hotspot mode set for “secure” or “private” mode

As well, some of the increasingly-sophisticated devices like the WD MyPassport Wireless Pro also are offering the same kind of Samba-based (SMB / CIFS) file transfer method that you can do with other NAS devices so you can transfer resources to these devices using your regular computer’s operating-system’s file manager and its network file transfer protocols. Similarly, the devices may implement FTP, WebDAV or other common network-file-transfer protocols primarily to allow you to upload photos and footage from your Wi-Fi-capable digital camera or camcorder to the mobile NAS if the camera honours these standard protocols.

How to have this work properly?

Here your mobile NAS unit needs to be set up for connection to an existing small Wi-Fi network as a client device of that network. It also needs to be set up to share its resources to that client network in addition to the network it creates using its own wireless access point.  Most of this configuration that I would be talking about here would be something you would do using the vendor-provided native mobile-platform app or, perhaps, a Web page that the mobile NAS creates as its management page.

Mobile NAS with hotspot functionality set up for file sharing mode

Typically, you may set this up as part of enabling a “Share Wi-Fi Connection”, “Wi-Fi Hotspot” or similar function that effectively shares a logical network connection between multiple devices that connect to the portable NAS’s access point. This function is similar to what most travel routers offer as a way to share the one logical (and usually permitted) connection to a hotel’s guest-access Wi-Fi service amongst the personal computing devices you and your travelling companions own. Similarly, this same function creates a “trust circle” between multiple devices connected to the mobile NAS’s access point allowing them to be discovered by each other even if the public-access Wi-Fi network that the NAS is connected to is configured properly with client isolation enabled.

When you enable the “hotspot” function on a sophisticated mobile NAS like the WD MyPassport Wireless / Wireless Plus series or the Seagate Wireless Plus, you will have an option to set this function to work in a “private” or “secure” mode or a “sharing” mode.  In the “private” mode, the data held on the NAS becomes available only to devices on the Wi-Fi network created by the mobile NAS’s access point. Conversely, the “sharing” mode will make the data available to devices on the network which has the Wi-Fi segment you connected the mobile NAS to as part of the “hotspot” mode.

Availability of data held on mobile NAS Sharing mode Secure / Private mode
Host wireless network Yes No
Wireless network created by mobile NAS’s access point Yes Yes

To allow the mobile NAS to share its resources on your home network, you need to enable the “sharing” mode or disable the “secure” or “private” mode while setting up the “hotspot” functionality. It is a wise practice not to use the “sharing” mode on a Wi-Fi network used as a public-access network and this function wouldn’t work with these networks that are properly set up with client isolation enabled.

What can the manufacturers do to improve the Wi-Fi bridging functionality on these devices?

The “Wi-Fi hotspot” or “Shared Wi-Fi” functionality could be improved upon by allowing users to create preset operating modes for particular Wi-Fi networks. This would work in a similar way to the way Windows allows the user to classify each network they connect to as being a “home”, “work” or “public” network, causing it to adopt an exposed persona suitable for your home or office network or a private person for that public-access Wi-Fi network. Such parameters could be to determine whether to share resources with the host network or to always clone the client device’s MAC address when connecting along with remembered Wi-Fi network passwords.

Here, as a user connects the mobile NAS to a Wi-Fi network for “Shared Wi-Fi” operation, they are invited to save the configurations they have established for that network. Then, when they reconnect to that network, the mobile NAS assumes the operating modes that the user previously defined. These details can be referenced by the host network’s ESSID or a user-defined name for that network.

Conclusion

Once you know how to set up that highly-capable mobile NAS device and exploit the “private” or “shared” operating modes that these devices offer with setting up the “Shared Wi-Fi” or “hotspot” mode, you can then use them to make resources held therein available to other small networks you connect them to.

Another effort to turn a smartphone in to a pathology lab

Article

Android main interactive lock screen

An add-on could allow a smartphone to become a portable pathology lab

Researchers create tech that turns your smartphone into a medical diagnostic tool | Fast Company

University resources

Multimode smartphone biosensing: the transmission, reflection, and intensity spectral (TRI)-analyzer | Professor Brian Cunningham, University of Illinois

My Comments

In most situations, pathology testing has required that the samples be sent away to a central laboratory to be analysed in to something meaningful for the professionals who prescribe them. This would typically take more than a day unless the laboratory was co-located with the facility that collected the sample such as in a hospital.

But there are some steps being taken to use a common smartphone as the equivalent of a pathology lab for most of the common tests. The goal with these devices is to allow the analysis of the sample and communication of the results to the end-user with a very short lead-time.

The first one of these solutions was a portable spectrograph device developed by Columbia University that connected to a smartphone’s headphone jack and worked with a special app to identify the presence of pathogens associated with certain diseases. There was also a view to have it work with less-expensive devices that could run user-installed software like the iPod Touch or low-tier Android phones, along with the ability to work on very low power.

The second one of these solutions attaches to an existing compatible smartphone and makes use of that phone’s camera and LED “flash” light to analyse the sample. It could also be set up to work with an integrated green-light laser diode as an alternative analysis light source.

This time, the sample of blood, saliva or urine is collected in a special microfluidic cartridge which means that the same “lab” could be used for multiple tests. There is a goal with this technology to adapt most of the common pathology tests to be performed with this hand-held “path-lab” and the goal can be achieved by reprogramming the software that is the companion app for this device to suit the test.

Personally, I would see these technologies initially work with the common ailment-specific “screening” tests or various “wellness” tests like cholesterol tests. There will also be an appeal to implement them with various drug tests where there isn’t a goal to achieve forensic-level accuracy. Similarly, medicine-level tests associated with chronic-illness treatment could be evolved to this technology.

But why is the idea of purposing a smartphone or similar device as a portable pathology lab appealing?

The key driver is to obtain there-and-then results suing highly-portable cost-effective equipment.

One use case is to do one or more pathology tests on a patient as they are transported in an ambulance to hospital and have the results communicated to the emergency department before the patient arrives. This also extends to situations where there are many casualties such as on a battlefield or other disaster zone. In this case, the smartphone with the handheld “path-labs” would be able to provide better-quality information for on-site treatment teams, rather than having to transport many samples to ultra-busy laboratories who may not communicate the results in time.

The rural community will also benefit in the context of routine tests especially where the nearest capable pathology lab is a long distance away from the village or town. Here, flying-doctor services, district nurses and the like can perform the common tests at the patient’s home and pass them on to regular general-practice doctors or specialists as well as making the patient and carer known of these results. It also augments the use of mobile devices as part of telemedicine efforts that can benefit this community.

But the same situation also applies to delivering healthcare in to third-world countries, something typically facilitated by the many volunteer organisations who answer this need. Here, the volunteer organisations can use this technology for identifying disease risks or organising the right treatment in a “there-and-then” manner.

Then there is the ability to use this technology as part of at-home healthcare programs including supporting the concept of ageing-at-home. This can be about using it as part of medicine management or monitoring long-term illnesses and assessing the effect of treatments without needing to go to a doctor’s clinic or hospital.

What is being seen here is the ability for cost-effective smartphones and similar highly-mobile devices that are based on platforms that support user-installable software to be used as part of personal healthcare in any part of the world.

Are Siri and Alexa being seen as personal companions?

Article

Is Siri ending up as your personal companion?

Conversations with virtual assistants like Siri, Alexa may be signs of loneliness | First Post

Talking to Siri often? You’re probably lonely | Times Of India

Do YOU rely on your phone for company? Human-like gadgets can offer relief from loneliness in the short term | Daily Mail

Older adults buddy up with Amazon’s Alexa | MarketWatch

My Comments

Hey Siri! Why am I alone now?

A situation that has been drawn out lately is someone feeling comfortable with their iPhone in their hand or sitting at the kitchen table beside an Amazon Echo speaker, trying to build a conversation with Siri or Alexa rather than simply asking something of these voice-driven assistants.

Amazon Echo on kitchen bench press photo courtesy of Amazon USA

Is this smart speaker becoming your personal companion?

Here, a Kansas University study found that Siri, Alexa and co are being seen as a short-term panacea for social exclusion and loneliness. This is something that is being brought on by broken relationships or an increasing number of work situations where one is spending significant amounts of time away from their significant other or their normal communities. It is also symptomatic of a loss of community that has come about in this day and age.

It is also worth knowing that older and disabled adults are using Alexa or Google Home as a companion in the context of managing lights, or simply asking for the time or a music source. These devices are deliberately designed to look like other pieces of consumer-electronics or IT hardware rather than the typical bland look associated with assistive devices. They also do serve as an aide-memoire for dementia sufferers but only in early stages of this condition before it becomes worse.

But Siri, Alexa, Cortana and co are not perfect replacements for real-life friends, There is the long-term risk of you losing real human interaction if you rely on them as your companions. Here, you simply keep them serving you as a voice-operated “digital concierge” that helps with finding information or setting up your smart home rather than the be-all-and-end-all digital companion.

Mixing audio and Bluetooth Low Energy–what is happening

Article

Sony SBH-52 Bluetooth Headphone Audio Adaptor

Audio over Bluetooth Low Energy could make these devices last for a long time on a single battery charge

Apple Used Bluetooth Low Energy Audio for Cochlear Implant iPhone Accessory | MacRumors

My Comments

Any of you who have used Bluetooth headsets with your smartphones may have come across situations where the headset ceases to function or sounds the “low battery” signal when you use these devices a lot. This can happen more so if you are listening to music then make or take a long phone call using the headset and is something I had experienced many times with the Sony SBH-52 audio adaptor. But the audio protocol is being worked on to avoiding consuming too much battery runtime.

Plantronics BackBeat Pro Bluetooth noise-cancelling headphones

.. as it could with Bluetooth headsets

Apple and Cochlear, who are behind the Australian-invented Cochlear Implant hearing-assistance technology, have developed Bluetooth Low Energy Audio to provide a high-quality audio link between mobile devices and headsets but make very little demands on the battery. As well, the Bluetooth Special Interest Group are working on a similar protocol to achieve these same gains, with the goal to have it part of Bluetooth 5.0. But this has to be supported in a vendor-independent manner in the same context as the current Bluetooth audio technologies that are in circulation.

But why is there an imperative to develop a low-energy audio profile for Bluetooth?

One key usage class is to integrate Bluetooth audio functionality in to hearing aids and similar hearing-assistance devices that are expected to run for a very long time. Here, we are also talking about very small intra-aural devices that may sit in or on your ear or be integrated in a set of eyeglasses. The goal is to allow not just for audio access to your smartphone during calls or multimedia activity but even to have an audio pathway from the phone’s microphone to the hearing-assistance device as well as the phone being a control surface for that device.

Similarly, there is a usage goal to improve battery runtime for Bluetooth headsets and audio adaptors such as to avoid the situation I have described above. It can also cater towards improved intra-aural Bluetooth headset designs or lightweight designs that can, again, run for a long time.

Let’s not forget the fact that smartwatches are being given audio abilities, typically to allow for use with a voice-activated personal assistant. But devices of this ilk could be set up to serve full time as a Bluetooth headphone audio adaptor with the full hands-free operation. The expectation here as well could even be to have the display on the wearable active while in use, whether to show the time, steps taken or metadata about the call in progress or whatever you are listening to.

Once audio over Bluetooth Low Energy technology is standardised, it could be a major improvement path for Bluetooth-based audio applications.

Challenges that face the Windows 10 2-in-1 user

Dell Inspiron 13 7000 2-in-1 in viewer mode

These 2-in-1s are as important as the iPads and Android tablets out there

The Windows-10-based 2-in-1 portable computer like the Dell Inspiron 13 7000 Series that I reviewed just lately is appealing as a viable alternative to the iPad or Android tablet. For some users, it may be about a single device that they can use for creating material like writing that memoir; or enjoying content including playing some casual games like Words With Friends or watching online video. The same can also hold true for people who use clamshell laptops, especially the thin-and-light or entry-level variety and want to engage in these activities.

Here, these computers are seen by Microsoft and developers as another “PC-class” device i.e. a regular computer in the same vein as the typical desktop or laptop computer. It is in contrast to how the iPad and Android tablets are seen by their respective operating systems as a distinct mobile device which can be developed for separately.

Apple iPad Pro 9.7 inch press picture courtesy of Apple

But there is a lot more casual games, catch-up TV front-ends and other software being developed for these devices

But the mobile platforms have acquired a large range of software behind them that appeals to people who want to consume content. Here, the iOS App Store and the Google Play Store are replete with many respected social-play and casual games along with official native client apps for various media and information services including catch-up TV or video-on-demand services.

As well, most if not all, communications platforms and social networks implement a native client for the mobile platforms with a large percentage running a Windows 10 native client that can work on a regular computer and available through the Microsoft Store.

Let’s not forget that the Microsoft Store is full of the well-known games with different variants providing different user experiences and capability levels for these games, For example, no personal computing platform has ever existed without one or more variants of the common board games like chess or backgammon that you play against a hard-to-beat computer opponent.

SBS On Demand Windows 10 platform app

SBS On-Demand – one of the few catch-up TV / video-on-demand apps on the Windows 10 PC platform

But there are some online media services, games and apps that have been engineered for the touch experience but haven’t been ported to Windows 10 as Universal Windows Platform applications that can run on the 2-in-1 computers. If an app or game is ported to Windows 10, it typically may just be ported to the Mobile variant which means the Windows-10-based mobile phones. This affects some of the popular mobile-platform games like Plants vs Zombies or Piano Tiles, along with the “TV Everywhere” or “catch-up TV” apps that TV broadcasters and pay-TV platforms offer.

Similarly, a lot of the smart-home devices that work on the app-cessory model offer most of these apps only on the iOS App Store or the Google Play Store. Here, I have had to run an article about how to use the Web to set up or manage an Amazon Echo but most of the other devices wouldn’t work further without an app from these stores.

The only other option that people have for playing a favourite casual game or using an online media service is to use Web-based resources such as playing a Web-app version of the game or visiting the service’s Web page. In some cases, the pages aren’t really optimised for a touch-driven user interface like what these computers offer, nor do they take full advantage of what Windows and your 2-in-1 computer has to offer. Similarly, some of these services use Adobe Flash as the preferred advanced user interface rather than HTML5 and this has been highlighted as a security and performance risk.

Time to port those apps to Windows 10 PC

Microsoft is now simplifying the process for porting mobile-platform apps from iOS or Android to the Windows 10 Universal Windows Platform and having them available through the Windows Store thanks to Xamarin or Apache Cordova or various Windows Bridge frameworks. Some of these tools also simplify the process of writing and targeting an app to Windows 10, iOS and Android all at once, something that can work for those of us who are writing an app from scratch with the goal to target those platforms.

The challenge here for developers who have written iPad or other tablet apps would be to port them to Windows 10 and maintain a similar user experience to the iPad package. Then the developers would benefit from making tweaks to the app to exploit the Live Tiles and other Windows 10 user-interface features.

There also has to be some importance towards maintaining the same level of “touch-ability” between the tablet platforms thus yielding the same experience. Let’s not forget the issue of maintaining the same level of performance and playability across the different platforms so you are not finding that the Windows 10 port of that iPad game appears more sluggish than the original version.

By making sure that the mobile apps and games are available across iOS, Android and Windows 10 UWP including PC users who use the 2-in-1s, it can be feasible for app developers to cover all their bases and reach every platform effectively. In some cases, it could place the likes of the Dell Inspiron 13 7000 2-in-1 as viable personal-computer devices for the family house where Grandma lives.

Do the large 2-in-1 convertible laptops still earn their keep?

Lenovo IdeaPad Yoga 13 courtesy of Lenovo

This style of 13″ or 15″ 2-in-1 convertible notebook is becoming more common in computer manufacturers’ product ranges

Increasingly most computer manufacturers are supplying at least one 2-in-1 convertible laptop that has a screen size of between 13” and 16” in their product lineups.

These work in a similar vein to the Lenovo Yoga range which made this concept more cost-effective. Here, the computer has a hinge that swivels through 360 degrees so that it changes between a laptop and a tablet, with the ability to be angled to be a viewer with the screen on a slant or to be set up in a “tent” mode that looks like an A-frame signhoard.

Some manufacturers like Dell, HP and Lenovo are offering a range of these computers with some models offering the kind of performance and storage expectations akin to most mainstream laptop computers for a price very close to one of these computers. This is while they offer the premium Ultrabook variants like HP’s Spectre X360 along with business-rated variants like HP’s Elitebook X360 that have all the security features desired by enterprise IT.

Lenovo Yoga 2 Pro convertible notebook - tablet view

A large screen tablet for video viewing or e-book reading

These large convertible laptops have a screen size that appeals to regular laptop use which would underscore a lot of content-creation activity. But a significant number of people will consider them to be too large for use as a tablet, especially if the idea is to use it as something that takes over the iPad’s or Android tablet’s role. This is because these tablets have a screen size of between 10″ and 11″ that that yields a highly-portable device best suited to personal media consumption.

Some people may appreciate the large screen for these computers while used as a tablet compared to the conventional 10”-11” size pitched for tablet devices. For example older people and those who don’t have good eyesight will appreciate the large screen especially when it comes to reading or casual gameplay. It can also appeal to people who find the traditional laptop as their “comfort zone” but want to dabble with the tablet feel with that same screen size.

Lenovo Yoga 2 Pro convertible notebook - image-viewer view

The viewer position that appeals for watching video content or flicking through photos on the sofa

Similarly, you could easily share the screen between two people.This is augmented by the use of that “presentation viewer” position which has the screen at that comfortable viewing angle while the keyboard serves as a base. In some cases, the larger area allows the weight of the base to be spread more easily. A classic example could be for the two of you to relax on the couch or in bed and watch that online video, or you to read through that PDF recipe file with the computer resting on the kitchen bench.

The large size screen in these tablet-based modes also allows us to see more text-based context without needing to zoom in and out or scroll the text. This can be useful for those of you who are presenting from material like notes stored on one of these computers.

Lenovo Yoga 2 Pro convertible notebook - as a tent card

The tent view that can also appeal to use on the dining table or kitchen bench

The limitation with these larger convertible 2-in-1s regarding their size is that it may not appeal as something that is light enough to be pocketed away. Here, these computers would end up being transported in the same manner as the traditional laptop.

Lenovo Yoga 2 Pro convertible notebook at Phamish St Kilda

Yet it still can be a laptop for writing up what you want to write up

Similarly, there hasn’t been much effort taking place to port the mobile-platform games and apps to Windows 10, which just about all of these computers run. Here, a lot of these games that exist on the mobile platforms are optimised to exploit the touchscreen user experience which this class of computer offers as well. There is also the practice amongst a large number of “catch-up TV” and similar video-on-demand providers to expect the user to use the Web browser to visit their Web presence, but Windows 10 native apps written for these services can make for improved performance from these computers along with a sleek user experience.

I still see this class of computer earning their keep as a viable alternative to the traditional clamshell laptop computer and the 10” mobile-platform tablet that is always just used at home. Here, the large 2-in-1 convertible laptop can appeal to a large class of people who use a laptop or iPad just for the typical computing tasks such as video and photo viewing, word processing, Web browsing and online communications but who appreciate the large screen. As for the cost, even if the sticker price seems to be expensive, you are effectively buying two devices in one housing and are likely to end up likely to make heavy use of these computers rather than thinking of dealing with the two separate devices.

Dual-device videocalling–how about it?

Arcam of Cambridge: Solo Movie system incorporate the latest technology and components from Arcam’s 2016 AVR & Hi-Fi ranges, including the acclaimed Class G amplification, High-End Blu-ray and DVD Replay and full App Controlled music networking / streaming. www.arcam.co.uk. PR by Robert Follis Associates Global - www.robfollis.com

TV setups with large screens and powerful sound systems could also appeal to videocalls where many people wish to participate

A reality that is surfacing with online communications platforms is the fact that most of us prefer to operate these platforms from our smartphones or tablets. Typically we are more comfortable with using these devices as our core hubs for managing personal contacts and conversations.

But there are times when we want to use a large screen such as our main TV for group videocalls. Examples of this may include family conversations with loved ones separated by distance, more so during special occasions like birthdays, Thanksgiving or Christmas. In the business context, there is the desire for two or more of us to engage in video conferences with business partners, suppliers, customers or employees separated by distance. For example, a lawyer and their client could be talking with someone who is selling their business as part of assessing the validity of that potential purchase.

Old lady making a video call at the dinner table press picture courtesy of NBNCo

This is more so when there is that family special moment

But most of the smart-TV and set-top platforms haven’t been engineered to work with the plethora of online-communications platforms that are out there. This is although Skype attempted to get this happening with various smart-TV and set-top platform vendors to allow the smart TV to serve as a Skype-based group videophone once you purchased and connected a Webcam accessory supplied by the manufacturer.

The Skype situation required users to log in to the Skype client on their TV or video device along with buying and installing a camera kit that worked with the TV. This was a case of entering credentials or searching for contacts using a “pick-and-choose” or SMS-style text-entry method which could lead to mistakes. This is compared to where most of us were more comfortable with performing these tasks on our smartphones or tablets because of a touchscreen keyboard or hardware keyboard accessory that made text entry easier.

Apple TV 4th Generation press picture courtesy of Apple

An Apple TV or Chromecast that has the software support for and is connected to a Webcam could simplify this process and place the focus on the smartphone as a control surface for videocalls

The goal I am outlining here is for one to be able to use a smart TV or network-connected video peripheral equipped with a Webcam-type camera device, along with their mobile device, all connected to the same home network and Internet connection to establish or continue a videocall on the TV’s large screen. Such a goal would be to implement the large-screen TV with its built-in speakers or connected sound system along with the Webcam as the videocalling-equivalent of the speakerphone we use for group or “conference” telephone calls when multiple people at either end want to participate in the call.

Set-top devices designed to work with platform mobile devices

A very strong reality that is surfacing for interlinking TVs and mobile devices is the use of a network-enabled video peripheral that provides a video link between the mobile device and video peripheral via one’s home network.

One of these devices is the Apple TV which works with iOS devices thanks to Apple AirPlay while the other is the Google Chromecast that works with Android devices. Both of these video devices can connect to your home network via Wi-Fi wireless or Ethernet with the Apple TV offering the latter option out of the box and the Chromecast offering it as an add-on option. As well, the Chromecast’s functionality is being integrated in to various newer smart TVs and video peripherals under the “Google Cast” or “Chromecast” feature name.

Is there a need for this functionality?

As I have said earlier on, the main usage driver for this functionality would be to place a group videocall where multiple people at the one location want to communicate with another . The classic examples would be for families communicating with distant relatives or businesses placing conference calls that involve multiple decision makers with two or more of these participants at one of the locations.

Social networks and mobile messaging

Most of the mobile messaging platforms offer some form of videocalling capability

In most cases, the “over-the-top” communications platforms like Facetime, Skype, Viber, Facebook Messenger and WhatsApp are primarily operated using the native mobile client app or the functionality that is part of the mobile platform. This way of managing videocalls appeals to most users because of access to the user’s own contact directory that exists on their device along with the handheld nature of the typical smartphone that appeals to this activity.

It is also worth knowing that some, if not all, of the “over-the-top” communications platforms will offer a “conference call” or “three-way call” function as part of their feature set, extending it to videocalls in at least the business-focused variants. This is where you could have multiple callers from different locations take part in the same conversation. Such setups would typically show the “other” callers as part of a multiple-picture “mosaic” on the screen. Here, the large screen can come in handy with seeing the multiple callers at once.

How is this achieved at the moment?

At the moment, these set-top platforms haven’t been engineered to allow for group videocalling and users would have to invoke screen-mirroring functionality on their mobile devices once they logically associate them with the video endpoint devices. Then they would have to position their mobile device on or in front of the TV so the other side can see your group, something which can be very precarious at times.

How could Apple, Google and co improve on this state of affairs?

Apple TV - Mirroring on - iPad

Should this still be the way to make group videocalls on your Apple TV or Chromecast?

Apple and Google could improve on their AirPlay and Chromecast platforms to provide an andio-video-data feed from the video peripheral to the mobile device using that peripheral. This would work in tandem with a companion Webcam/microphone accessory that can be installed on the TV and connected to the set-top device. For example, Apple could offer a Webcam for the latest generation Apple TV as an “MFi” accessory like they do with the game controllers that enable it to be a games console.

When users associate their mobile devices with a suitably-equipped Apple TV / Chromecast device that supports this enhancement, the communications apps on their phone detect the camera and microphone connected to the video peripheral. The user would then be able to see the camera offered as an alternative camera choice while they are engaged in a videocall, along with the microphone and TV speaker offered as a “speakerphone” option.

What will this entail?

It may require Apple and Google to write mobile endpoint software in to their iOS and Android operating systems to handle the return video feed and the existence of cameras connected to the Apple TV or Chromecast.

Similarly, the tvOS and Chromecast platforms will have to have extra endpoint software written for them while these devices would have to have hardware support for Webcam devices.

At the moment, the latest-generation Apple TV has a USB-C socket on it but this is just serving as a “service” port, but could be opened up as a peripheral port for wired MFi peripherals like a Webcam. Google uses a microUSB port on the Chromecast but this is primarily a power-supply and network-connection port. But they could, again, implement an “expansion module” that provides connectivity to a USB Webcam that is compliant to the USB Video and Audio device classes.

These situations could be answered through a subsequent hardware generation for each of the devices or, if the connections are software-addressable, a major-function firmware update could open up these connections for a camera.

As for application-level support, it may require that the extra camera connected to the Apple TV or Chromecast device be logically enumerated as another camera device by all smartphone apps that exploit the mobile phone’s cameras. The microphone in the camera and the TV’s speakers also would need to be enumerated as another communications-class audio device available to the communications apps. This kind of functionality could be implemented at operating-system level with very little work being asked of from third-party communications software developers.

User privacy can be assured through the same permissions-driven setup implemented in the platform’s app ecosystem that is implemented for access to the mobile device’s own camera and microphone. If users want to see this tightened, it could be feasible to require a separate permissions level for use of external cameras and audio-input devices. But users can simply physically disconnect the Webcam from the video peripheral device when they don’t intend to use it.

An alternative path for app-based connected-TV platforms

There is also an alternative path that smart-TV and set-top vendors could explore. Here, they could implement a universal network-based two-way video protocol that allows the smart TV or set-top device to serve as a large-screen video endpoint for the communications apps.

Similarly, a smart-TV / set-top applications platform could head down the path of using client-side applications that are focused for large-screen communications. This is in a similar vein to what was done for Skype by most smart-TV manufacturers, but the call-setup procedure can be simplified with the user operating their smartphone or tablet as the control surface for managing the call.

This could be invoked through techniques like DIAL (Discovery And Launch) that is used to permit mobile apps to discover large-screen “companion” apps on smart-TV or set-top devices in order to allow users to “throw” what they see on the mobile device to the large screen. As well, the connection to the user’s account could be managed through the use of a session-specific logical token established by the mobile device.

This concept can be taken further through the use of the TV screen as a display surface, typically for communications services’ messaging functions or to show incoming-call notifications.

Update

Apple has answered this issue with their tvOS-based Apple TV set-top box platform in June 2023. Here, they are implementing a dual-device approach with iPhones or iPads running iOS/iPadOS 16 being linked with Apple TV set-top boxes that run tvOS 17. Here, both devices can be used to handle a videocall on FaceTime, Zoom or an increasing number of other popular platforms with the TV’s screen and audio system handling the picture and sound of the caller at the other end while the iOS device’s microphone and camera picks up your face and voice for the other party to see and hear.

You can start the call on the iPhone’s handheld interface and “throw it over” to the Apple TV or you can start the call from the Apple TV’s lean-back interface and use the iPhone associated with your Apple TV for microphone and camera functionality. Apple is to sell a cradle for the iPhone so that it can be positioned in fromt of the TV with the rear camera facing the participants.

Conclusion

What we still need to think of is to facilitate “dual-device” videocalling with the popular mobile platforms in order to simplify the task of establishing group videocalls using TVs and other large-screen display devices.

Consumer Electronics Show 2017–Computer Trends

I am writing up a series of articles about the trends that have been put forward at the 2017 Consumer Electronics Show in Las Vegas. The first article in this series covers all of the trends affecting personal computers.

1: Computer Trends

2: Accessories And The Home Network

Computers

Most manufacturers were exhibiting refreshed versions of their product ranges. This is where the computers were being equipped with up-to-date chipsets and had their RAM, storage and other expectations brought up to date.

  • Key trends affecting mainstream computers included:
  • the use of Intel Kaby Lake processors for the computers’ horsepower
  • solid-state storage capacity in the order of up to 1 Terabyte
  • RAM capacity in the order of up to 16Gb
  • at least one USB Type-C socket on mainstream units with Thunderbolt 3 on premium units and / or ultraportables using just USB-C connections with some having 2 or more of these connectors

    Lenovo ThinkPad X1 Carbon USB-C Thunderbolt-3 detail image - press picture courtesy of Lenovo USA

    More of this year’s laptop computers will be equipped with these USB Type-C or Thunderbolt 3 sockets

  • Wi-Fi connectivity being 802.11ac multi-band with MU-MIMO operation

Another factor worth noticing is the increase in detachable or convertible “2-in-1” computers being offered by most, if not all, of the manufacturers; along with highly-stylish clamshell ultraportable computers. This class of computer is being brought on thanks to Microsoft’s Surface range of computers with some of of the computers in these classes also being about performance. The manufacturers are even offering a range of these “2-in-1” computers targeted towards business users with the security, manageability, durability and productivity features that this use case demands.

Dell XPS 13 2-in-1 convertible Ultrabook press picture courtesy of Dell USA

More of these convertibles and detachable 2-in-1 computers will appear in manufacturers’ product ranges

Nearly every manufacturer had presented at least one high-performance gaming laptop with the Intel Core i7 processor, at least 16Gb RAM and 128Gb solid-state storage, dedicated graphics chipset. Most of these computers are even equipped with a Thunderbolt 3 connection to allow for use with external graphics docks, considered as a way for core gamers to “soup up” these machines for higher gaming acumen.

Lenovo had refreshed most of their laptop range, especially the ThinkPad business range. Here, this is a product range that makes no distinction between the small-business/SOHO user class where a few of these computers are managed and the large-business/government user class where you are talking of a large fleet of computers handling highly-sensitive data.

Lenovo ThinkPad X1 Carbon press image courtesy of Lenovo

Lenovo’s ThinkPad X1 Carbon has been refreshed to newer expectations

The new ThinkPads come in the form of a newer ThinkPad Yoga business convertible, a refreshed ThinkPad X1 Carbon Ultrabook and a refreshed ThinkPad X1 Yoga convertible. For example, the ThinkPad Yoga 370 has the 13.3” Full HD screen, the classic ThinkPad TrackPoint button as a navigation option but is driven by Intel Kaby Lake horsepower. This machine can be specified up to 16Gb RAM and 1Tb solid-state storage and has a Thunderbolt 3 connection along with 2 USB 3.0 ports. Lenovo even designed in protection circuitry for the USB-C / Thunderbolt 3 port to protect the ThinkPad against those dodgy non-compliant USB-C cables and chargers. Like the rest of the new ThinkPad bunch, this computer comes with the Windows 10 Signature Edition software image which is about being free of the bloatware that fills most of today’s laptop computers. The computer will set you back US$1264.

Other ThinkPads will also come with either a USB-C or Thunderbolt 3 connection depending on their position in the model range. For example the T470 family and the T570 family will be equipped with the Thunderbolt 3 connections. Let’s not forget how the ThinkPad X1 Carbon and Yoga have been refreshed. The Carbon implements horsepower in the Intel Kaby Lake Core i family, a 14” Quad HD display, 16Gb RAM and 1Tb SSD storage, and an expected battery runtime of 15 hours along with Thunderbolt 3 connectivity. The X1 Yoga has been given the similar treatment with similar RAM and secondary-storage capacity but can be outfitted with an LTE-A wireless-broadband modem as an option.

Lenovo Legion Y720 gaming laptop - press picture courtesy of Lenovo USA

Lenovo Legion Y720 gaming laptop with Dolby Atmos sound

Gamers can relish in the fact that Lenovo has premiered the Legion range of affordable high-performance gaming laptops. The Legion Y720 is the first of its kind to be equipped with Dolby Atmos sound. The Y520 has a Full HD IPS screen driven by NVIDIA GeForce GTX1050Ti dedicated graphics chipset, the choice of an Intel Core i5 or i7 CPU, 16Gb RAM and hard disk storage between 500Gb and 1Tb or solid-state storage between 128Gb and 512Gb, and network connectivity in the form of 802.11ac Wi-Fi and Gigabit Ethernet. Peripheral connectivity is in the form of 1 x USB-C, 2 x USB 3.0 and 1 x USB 2.0 and an audio jack, with this computer asking for at least US$900. The better Y720, along with Dolby Atmos, has a bright IPS screen either as a Full HD or 4K resolution and driven by NVIDIA GeForce GTX1060 graphics chipset with 6Gb display memory. Lenovo was also offering a MIIX 720 creative-arts mobile workstation that eats at the Apple MacBook Pro and Microsoft Surface Pro lineup.

Dell XPS 15 Notebook press image courtesy of Dell USA

Dell XPS 15 ultraportable in a 15″ size

Dell had refreshed the XPS 13 lineup of Ultrabooks, known for offering the right combination of features, durability, comfort and price. But they also offered a convertible 2-in-1 variant of the XPS 13, again offering that right combination of features, durability, comfort and price. They also released the XPS 15 which is the smallest 15,6” laptop with Intel Kaby Lake processors, NVIDIA GeForce dedicated graphics and a fingerprint reader.

Dell XPS 27 all-in-one computer press image courtesy of Dell USA

Dell XPS 27 all-in-one computer with best bass response in its class

The XPS and Precision all-in-one desktop computers have had their sound quality improved rather than having it as an afterthought. This has led to audio quality from the XPS 27 and the Precision business equivalent being equivalent to that of a soundbar, thanks to the use of 10 speakers working at 50 watts per channel, including two downward-firing speakers to make the work surface augment the bass. Two passive radiators also augment the system’s bass response. Both have a 4K UHD touchscreen  while the Precision certified workstation can work with AMD Radeon graphics and Intel Xeon CPUs.

Like Lenovo, Dell had exhibited their business-grade computers at a trade fair typically associated with goods targeted at the consumer. This could underscore realities like people who use business-tier computers for “work-home” use including those of us who are running a business or practising a profession from our homes. Dell have been on a good wicket here because of themselves selling computers direct to the public and to business users for a long time.

Here, Dell had refreshed their XPS, Inspiron, Optiflex, Latitude and Precision computer lineups with new expectations. They would come with Kaby Lake horsepower under the bonnet, USB-C or Thunderbolt 3 connectivity depending on the unit along with newer dedicated-graphics options from NVIDIA or AMD. The business machines would be equipped with Intel vPro manageability features to work with business-computer management software.

Dell Latitude 5285 business detachable 2-in-1 - press picture courtesy of Dell USA

Dell Latitude 5285 business detachable 2-in-1 – the most secure of its class

In the case of business computers, Dell had underscored a desire to integrate the aesthetics of consumer-tier ultraportable computers with the security, manageability and productivity wishes that the business community crave for. For example, the latest Latitude Ultrabooks and 2-in-1s show the looks but come up with the goods as a business “axe” computer. One of the systems in the Latitude lineup is the Latitude 7285 detachable 2-in-1s which implement WiTricity wireless charging and WiGig docking while the Latitude 5285 detachable 2-in-1 sells on a highly-strong security platform with Dell-developed data-protection / endpoint-protection software and the option for a fingerprint reader or smartcard reader.

Samsung had shown some Windows 10 tablets but they also presented the Notebook Odyssey gaming laptop, available as a 15” variant or a 17” higher-performing variant. Both of these implement “dual-storage” with a solid-state drive in the order of 256Gb for the 15” variant or 512Gb for the 17” variant along with a 1Tb traditional hard disk. RAM is in the order of 32Gb or 64Gb for the 17” variant while these are driven by Intel Core i7 CPUs. Graphics is looked after by NVIDIA GTX dedicated GPU with 2Gb or 4Gb display memory but the 17” variant also has a Thunderbolt 3 connection for external graphics units.

There is also the Notebook 9 which implements a 15” HD display driven by NVIDIA 940MX graphics processor and Core i7 processor. Of note, the Notebook 9 implements a Windows Hello fingerprint reader along with a USB-C port which is its power socket thanks to USB Power Delivery.

HP was not silent but had fielded the Spectre x360 15” convertible Ultrabook, one of the few 15” portable computers that can be a tablet or laptop. It is driven by Intel Core i7 Kaby Lake horsepower and has the quota of 16Gb RAM and either a 256Gb or 512Gb solid-state storage. The 15” 4K IPS screen is driven by an NVIDIA GeForce 940MX graphics processor with 2Gb display memory, but the sound-reproduction has been tuned by Bang & Olufsen while there is an HP-designed noise-cancelling microphone array. The Webcam is an HP infra-red type which is Windows Hello compatible for facial recognition login. Connectivity is in the form of an HDMI socket, 1 USB-C socket, 1 Thunderbolt 3 socket, 1 traditional USB Type-A socket and an SD-card drive. Expect this convertible’s battery to run for 12 hours and be ready to go after 90 minutes of quick charging. The expected price is US$1299 for the 256Gb variant and US$1499 for the 512Gb variant.

Another interesting trend highlighted at CES 2017 has been an increase in the number of “Next Unit Of Computing” midget computers.  This is thanks to use cases like augmented-reality / virtual-reality gaming and an emphasis on aesthetics for desktop-based computing and has been brought about by the likes of the Intel Skull Canyon NUC. One of these was a range offered by Elitegroup with computers powered by Intel Braswell, Apollo Lake and Kaby Lake processors.

Zotac Mini PC press photo courtesy of Zotac

The latest Zotac Mini PC that is the hub of a “hi-fi” approach to computing

But Zotac approached the NUC trend in a manner not dissimilar to the “micro component” hi-fi systems, especially some of the premium offerings that emerged from Japan through the early 80s. These premium “micro-component” systems offered for their amplification needs a control amplifier and a power amplifier so as to provide more power output, along with their source components being a tuner and a cassette deck. In the case of Zotac, they offered the C-Series NUC midget computer which could be powered through its USB-C port thanks to USB Power Delivery. It came with the Intel Kaby Lake processors, NVIDIA GeForce dedicated graphics, a Thunderbolt 3 connector along with a few other features. The C-Series even has corporate manageability and security abilities such as Intel vPro and AMT system management along with the UNITE secure conferencing feature.

But Zotac offered an external “card-cage” graphics dock with a PCI Express x 16 expansion slot for graphics cards, 3 standard USB 3.0 ports and one USB 3.0 port supporting QuickCharge, but being able to supply power to the host computer via the Thunderbolt 3 port using USB Power Delivery. The graphics module’s power supply has a power budget of 400 watts and the module is known to be compatible with NVIDIA and AMD graphics cards.  They even offered their own NVIDIA GeForce GTX 1080 Mini graphics card as a partner card for this dock.

The goal here was to supply a two-piece high-performance computer setup with a system unit and a module that can serve as its graphics subsystem and power supply. But users still had the ability to install better equipment when they felt like it. Or the graphics module could be purposed to provide extra graphics horsepower to portable, “all-in-one” and other small computers that are Thunderbolt-3-equipped as well as supplying necessary power through this port to host computers that honour USB Power Delivery.

Mobile Devices

Even though Samsung had suffered a deep blow with the exploding Galaxy Note 7 phablets, the mobile-computing platform has not died yet. It is although we may be hanging on to our smartphones for longer than the typical two-year contract period in order to save money.

At the moment, the phones that are being given an airing are the mid-tier Android smartphones like the Huawei Honor 6X with a dual camera and the ASUS Zenfone 3 Zoom which is one of the first to have an optical zoom on the rear camera’s lens.

Samsung launched their Galaxy A3 and A5 Android smartphones which are still positioned in the mid-tier segment. This is while Sony came to the fore with the XPeria X2 premium smartphone which has a 5.5” 4K display and 5Gb RAM, just above the baseline expectations for RAM capacity in a desktop computer.

LG had launched a range of low-tier Android smartphones that are equipped with user-replaceable batteries. The K3 is a compact unit with a 4.5” display while the K4 comes with the standard 5” display. There is the K8 5” selfie smartphone which has a highly-optimised front camera for taking those selfies to appear on Instagram or Facebook. Then LG brought the 13 megapixel camera featured in the G series lineup to the K10 5.3” smartphone. They also offered a Stylus 3 phablet with an integrated fingerprint scanner.

The next in the series will cover high-resolution monitors, computer accessories and the home network including the distributed-WiFi trend.