Tag: Google Home Hub

Zoom now extends to popular smart-display platforms

22/08/2020 Current and Future Trends, Home / building automation and security, IP-based telecommunications, Video-conferencing, Voice-driven home assistant platforms No Comments

Articles

Zoom (MacOS) multi-party video conference screenshot

Zoom video conferences will soon be able to take place on smart displays

Zoom Meetings Coming Soon to Smart Displays | Droid Life

Zoom video calls come to smart displays from Google, Amazon, and Facebook | Android Authority

Zoom expands to every major smart display as coronavirus keeps us home | CNet

From the borse’s mouth

Zoom

Zoom Expands to Smart Displays at Home (Blog Post)

My Comments

Amazon Echo Show in kitchen press picture courtesy of Amazon

.. like the Amazon Echo Show

The COVID-19 coronavirus plague is increasing our use of Zoom as a multiparty videoconferencing platform especially for social and community purposes. This is thanks to measures in place to encourage social distancing and reduce travel to curb the spread of this virus. Zoom’s trademark for this service even ended up as a generic trademark word for a any multiparty videoconference just like one often referred to a common ballpoint pen as a biro.

But Zoom is primarily offered on most regular-computer and mobile-device platforms like Windows, MacOS, iOS and Android. This is because these devices have integrated or accessory Webcams supported by their operating system and can take on software from third-party developers.

JBL Link VIew Press image courtesy of Harman International

… or Google-Assistant devices like this JBL Link View smart display

Recently Zoom tried out the idea of a dedicated videoconferencing appliance in the form of a 27” group videophone that can also be a display screen for a computer, TV set-top box or similar video peripheral. It is similar to previous efforts by smart-TV and video-peripheral vendors to provide Skype support if the device is equipped with an expensive accessory Webcam offered by the manufacturer.

But Zoom took a better step to partner with Google, Amazon and Facebook to integrate their platform in to the Amazon Echo Show smart displays, Facebook Portal smart display and smart displays running the Google Assistant (Home) platform. Here, these devices have the hardware that is needed to make or take videocalls i.e. a camera, microphone, screen and speakers. As well, the three vendors are more supportive of programming these devices to take on additional functionality.

These devices have some sort of videophone functionality built in to them through support for some other videoconference platforms: Skype and Amazon’s IP-telephony platform in the case of Amazon’s Echo Show devices; Google’s Duo and Meet in the case of Google-powered devices; and Facebook Messenger with its Rooms function as well as GoToMeeting, BlueJeans and WebEx in the case of the Facebook Portal. The addition of Zoom doesn’t displace the platform vendor’s own products or products the vendor has already licensed from other partners. As well, it recognises that different people and organisations tend to prefer working with particular videoconference platforms over others.

The Zoom software is engineered to take advantage of what the platforms offer including tying in with the platform’s native calendar function if you have linked your calendar to it, or joining a videoconference at your voice command. In the case of the Facebook device, you can tap the screen to join a meeting. All classes of Zoom account can be bound to these devices so you can use the account paid for by your work or school or a personal one you set up for free for social use.

This function will start to appear on most Facebook Portal devices in September then roll out across all the other smart-display platforms over October and November.

But why allow Zoom and similar videoconferences on a smart display or similar appliance? One reason is to have one device dedicated to the videoconference while you use another device to take notes or read supporting material for business, education or religion use cases. It may also be about the desire for an “appliance-simple” approach for making and taking videocalls, something that may be desired for older users who may find the process of creating or joining a multiparty videoconference daunting. As well, there is the encouragement to use an endpoint device that fits in with where it will be used such as the small smart displays that are typically installed in a kitchen or similar room.

What need to eventually happen is for Zoom and similar multiparty videoconferencing platforms to be part of connected-TV / set-top box platforms typically used for viewing Netflix or similar video-on-demand services on the big-screen TV. This is as long as the TV or set-top box can work with an accessory Webcam. As well, the device has to support multiple videoconferencing platforms, especially the common ones; while each platform has to offer a user interface suitable for 10-foot “lean-back” operation.

Here, such implementations, when done right, can be about the use of a big-screen TV as a group videophone for situations where the whole household participates in a videoconference like the many Zoom-based family or community video “catch-ups”.

Using Google Assistant as part of an in-home-care service

04/03/2020 Current and Future Trends, Home / building automation and security, Voice-driven home assistant platforms No Comments

Article

The Google Home now part of ageing-at-home and working with a home healthcare service

Feros Care plugs into Google Assistant to boost seniors’ independence | IT News]

My Comments

The technology industry is working on making themselves relevant to the “ageing-at-home” sector where senior citizens, including the ageing Baby Boomer population, can live in their own homes or in supported accommodation but preserve their own privacy and dignity. But the goal of improved dignity for these seniors includes using the technology that doesn’t look out of place in an ordinary home environment.

This system, ran by Feros Care, implements Google Assistant technology as a base platform and uses Google Home smart-speaker devices as a voice-driven interface with the client who the agency is looking after. It also facilitates visual display through the Android TV smart-TV platform and the Google Home Hub smart display.

This is facilitated through the development of Google Actions and DialogFlow natural-language processing with some custom application-programming-interface (API) software “hooks” to work with the agency’s MyFeros IT portal. It provides the client access access to details about carer appoints, further assistance amongst other things while the MyFeros portal captures service-provider to client interactions.

It is more about allowing senior citizens who use this agency for assisted living to manage their experience with the agency themselves and maintain their independence.

The use of the Google Home / Assistant voice-interaction technology can work around situations where the senior has had a fall and cannot gain access to the phone to summon help. Similarly it works well when they are recovering in bed and don’t have a tablet or phone at their bedside. The Android TV / Home Hub smart-TV technology can be used to show up visual information like details of alternate carers who are “filling in” for a regular carer who is ill or on leave and cannot attend

Even smart-lock technology is coming in to play in order to allow staff who are rostered on to care for a particular client access to that client’s home for the duration of their shift. This is due to older people with limited mobility taking a long time to reach their front door to admit the carer in to their home. The smart-lock integration will also work in hand with “visit-verification” requirements that will be demanded within the home-based healthcare industry thanks to various health-insurance or public-healthcare requirements.

Feros Care underscores that the technology is not about staff efficiency and productivity by to serve the needs of their service’s end-users and protect their dignity and independence.

But what I like about this approach is that they aren’t reinventing the wheel in implementing this technology and having to implement new devices for their field of work. Rather they use common “horizontal-market” technology like Google-Home-compatible smart speakers and smart displays compliant with Google’s smart-display technologies – such equipment able to be purchased “off the shelf” at any consumer electronics outlet and blend in to an ordinary home.

I also see Feros Care in a position to offer the necessary software logic as a “white-label” solution for all sorts of home healthcare agencies, supported-housing facilities and the like who want to implement it in their client-carer IT-portal setups. But there will be issues like adapting to other consumer-focused voice-driven home assistant platforms like Alexa, along with making it work with the widest range of home-automation devices.

Here, it is about implementing whatever common home-networking technology as part of assisted-living simply through using software to provide this kind of integration.

Ultrasound being used as a way to measure user proximity to gadgets

05/12/2019 Current and Future Trends, Home / building automation and security, Voice-driven home assistant platforms No Comments

Article – From the horse’s mouth

Google Nest

How ultrasound sensing makes Nest displays more accessible {The Keyword blog post)

My Comments

Google is implementing in their Nest Hub smart-display products an automatic display-optimisation technology that is based on technology that has been used for a very long time.

Ultrasonic technology has been used in various ways by nature and humans to measure distance. In nature, bats and dolphins which don’t have good vision use this approach to “see” their way. It is used extensively in military and civillian marine applications to see what is underneath a boat or around a submarine and is also used as a common medical-imaging technique.

As well, in the late 1970s, Polaroid implemented ultrasound as part of their active autofocus system, which ended up as a feature for their value-priced and premium instant-picture cameras. Here, this was used to measure the distance between the camera and the subject in order to adjust the lens for proper focus. There were limitations associated with the technology like not being able to work when you photograph through a window due to the ultrasonic waves not passing through the glass.

But Google has implemented this technology as a way to adjust the display on their Nest Hub smart displays for distant or close operation. The front of a Google Nest Hub has an ultrasonic sensor that works in a similar way to what was used in a Polaroid auto-focus instant-picture camera.

But rather than the Polaroid setup being about using the distance measurement from the ultrasonic sensor to adjust a camera’s lens, this application adjusts the display according to the user’s distance from the Nest Hub. If you are distant from the Nest Hub, you would see reduced information but the key details appear in a larger typeface. Then if you come closer to the Nest Hub, you would see more detail but at a smaller typeface.

Nest Hub Directions display press picture courtesy of Google

The Google blog article described this as being suitable for older users and those of us who have limited vision. The fact that you have the ability to see key information in a large typeface at a distance can make the Nest Hub accessible to this user group. But others can’t see deeper information unless they are very close to the device.

End-user privacy is still assured thanks to the use of a low-resolution distance-measurement technology whose results are kept within the device. As well, there is a menu option within the Google Home app’s Device Settings page to enable or disable the feature.

At the moment, it is initially being used for timer and current-time display as well as displaying travel time and traffic conditions for a planned journey that you set up with Google Maps. But Google and other software developers who develop for the Google Home ecosystem will add distance-sensitive display functionality to more applications like appointments and alerts.

Some people could see this technology not just for optimising the readout on a smart display but could even be used to ascertain whether people are actually using these devices. This could then be used for such functionality like energy-saving behaviour where the display turns off if no-one’s near it.

But what Google has to do is to license out this technology to allow others to implement it it to other fixed-display-based devices. Here, it could become of more use to many who don’t go for a Google Nest Hub.

but to add more functionality like appointments, alerts, reminders