Category: Voice-driven home assistant platforms

Articles

Google Nest video doorbell – to support season-specific custom sounds

Special Ringtones Coming to Your Google Nest Doorbell for Halloween, Diwali, Oktoberfest – CNET

More festive doorbell chimes arrive on Google Nest | ZDNET

From the horse’s mouth

Google

Learn how we fine-tune the Nest doorbell ringtones (blog.google)

My Comments

Desktop operating systems started using audio customisations since the late 1980s

From the late 1980s to the mid 1990s, regular computers and their desktop operating systems introduced various multimedia abilities including file-based audio recording and playback. This came along with various user-experience customisation options like background wallpapers and interface elements that can be set to a user’s preferred colours.

These functions came together in the form of the ability for users to determine what kind of sound the computer makes for particular events like the startup sound, error sound or new message notification.

This kind of customisability was extended in the 2000s with mobile phones supporting ringtone customisation including downloadable ringtones. This feature was seen as important as a way for people to know if it is their phone that is ringing when it rings.

But Google has added this kind of customisability to their Nest Doorbell which is a video doorbell that works via your home network and Internet. Here, they have started offering special ringtones for this product that people can use for particular occasions like Halloween, Thanksgiving or Diwali. This goes hand-in-glove with you decorating your house in particular ways for particular seasons.

These devices would support the seasonality of particular occasion thus allowing the customised sound to play for the duration of that occasion. This avoids the audible equivalent of leaving decorations up beyond the applicable season which can look tacky.

I most likely would see a lot of companies who sell network-connected doorbell / intercom systems start investing in ringtone customisations for these devices. This could include user-supplied ringtones usually in common audio file formats, enabling ringtones to be applicable for particular seasons or user-defined periods, or bringing in brands and talent to create custom ringtones.

You just never know what other “Internet-of-Things” devices and platforms will end up with user experiences that are customisable by the end-user in the same way that computers and smartphones have been customised by their users.

Article

Alexa partners with The Betoota Advocate (mumbrella.com.au)

Betoota Teaches Alexa Aussie Slang – (smarthouse.com.au)

Alexa Looks To Expand Her Knowledge Of Australia By Teaming Up With The Betoota Advocate – B&T (bandt.com.au)

My Comments

Australia does have its own slang and culture which has been celebrated through Australian films and television like “Crocodile Dundee” or “Neighbours”; or the 1980s Paul Hogan “Throw A Shrimp On The Barbie” ad. There was even a book called “G’Day Teach Yourself Australian” (Amazon link) which conveyed the look of a foreign-language courseware book but taught Australian slang and culture to English-speaking travellers in a humourous way. Even the current popularity of “Bluey” amongst families in other countries is putting Australian culture increasingly on the map.

Amazon Alexa is now learning Australian slang and culture

But the voice-driven assistants like Amazon Alexa or Google Assistant weren’t taught that kind of information. This made it difficult for Australians to use these assistants in a manner that is comfortable to them.

A previous approach to supporting dialects within a language including regional dialects was the BBC’s effort at a voice assistant. This responded to British English and even supported the various regional accents and dialects used within various parts of the UK. But it has been focused towards access to its own content and currently isn’t able to work with other voice-assistant platforms as a linguistic “module”.

Now Amazon have worked with the Betoota Advocate to “teach” Alexa about Aussie slang and culture. It is not just the slang and colloquial speech that she had to understand but items relating to Australian life and culture. For example, being able to answer which AFL or NRL club won their respective code’s Grand Final or to summon up the latest Triple J Hottest 100 as a playlist.

In the case of the football Grand Finals, there may be an issue about which football code is referred to by default when you ask about the winner of one of these penultimate matches and don’t identify a particular code. This is because of New South Wales and Queensland “thinking of” the NRL rugby-league code while the other States think of the AFL Australian-Rules code.

It could be even something like “How do I pay the rego on the ute” which could lead you to your State government’s motor registration office or, if they support it, instigate the workflow for paying that vehicle registration.

Australians and foreigners can even ask Alexa the meaning of a particular slang term or colloquialism so they can become familiar with the Australian vernacular. This would be required of Alexa anywhere in the world especially if you are talking with Australian expats or finding that a neighbourhood is becoming a “Little Australia”. Or if you are from overseas and show interest in Australian popular culture, you may find this resource useful.

A feature that may have to come forward for this Australian-culture addition to Amazon Alexa is to support translation of Australian idioms to and from languages other than English. This is more so where Australian culture is being exposed in to countries that don’t use English as their primary language or where these countries acquire a significant Australian diaspora. An example of the first situation is the popularity of MasterChef Australia within the Indian subcontinent and the existence of Australians within Asian and European countries.

This addition of Australian slang and culture to Alexa is available to all devices that support the Amazon Alexa voice-driven assistant. This ranges from Amazon-designed equipment like the Amazon Echo smart speakers to third-party devices that implement Amazon Alexa technology.

At least this is an example of how a voice-driven assistant provider can work towards courting countries and diasporas that are being seen as viable. It may have to be about encouraging the use of modular extensions to enable voice-driven assistants to work with multiple languages, dialects and cultures.

Article

These new Echo speakers can work as temperature sensors for a room

How to Get an Amazon Echo to Tell You a Room’s Temperature (lifehacker.com)

My Comments

Newer Amazon Echo smart speakers are being equipped with room-temperature sensors that contribute this data to the Alexa smart-home subsystem.

Here, the devices you need to use in the rooms you want to measure the temperature of are:

• Amazon Echo 4th Generation (spherical) or newer generation
• Amazon Echo Plus 2nd Generation (cylindrical) or newer generation

To confirm your Amazon Echo device’s room-temperature measuring ability, you need to open the Alexa app or http://alexa.amazon.com and log in to your Amazon account. Then you go to “Devices”, then “Echo & Alexa” and select the name of your Echo smart speaker that you want to verify. Here, you need to look for the “Temperature Sensor” field which will come up with the current room temperature if your Echo speaker is suitably equipped.

Each Echo device that you want to use as a temperature sensor has to be given a unique room name. Then to ask Alexa for the current room temperature of a particular room, you say “Alexa, what is the temperature for <desired room name>?”

There are limitations with this setup at the moment. You can’t ask for a house-wide indoor temperature or the indoor temperature of a room cluster like upstairs. This is because Amazon hasn’t worked out what way whether to assess the room temperature of an area covered by multiple devices as an average or what other way. Nor have they added the necessary logic to do so.

But you can create a temperature-based routine that works with this temperature for the Alexa smart home. For example, you may have a fan or heater come on if the room reaches or falls below a minimum temperature. This may be a situation where you don’t have an occasionally-used room that isn’t part of your central HVAC setup and you use portable heating or cooling equipment for this purpose.

Or you want to be alerted if a room of yours falls below a critical temperature level so you can undertake procedures to mitigate frost or pipes freezing up.

What Amazon will need to do for Alexa in relation to this is to make this more useful is to allow averaging of multiple temperature sensors so you can measure areas larger than a room. As well, it could cater to environments where you have multiple suitably-equipped Echo speakers in one room like in a large kitchen / dining area for example.

Article

Sharp’s first smart countertop microwave oven features Wi-Fi connectivity and certified Works with Alexa compatibility for hands-free operation using voice commands.

Sharp’s New Alexa-Powered Microwave Is Even More Confusing Than Amazon’s | Gizmodo

From the horse’s mouth

Sharp USA

Sharp Launches its First Smart Countertop Microwave Ovens (Press Release)

My Comments

Most of us who use a microwave oven tend to specify cooking times and power intensities for each cooking job. This is even though most of today’s microwave ovens use job-specific cooking functions that are available to us. But some of us may decide to use a “popcorn” cooking function to cook most microwave popcorn.

These functions can confuse most of us due to different approaches to invoking them that exist between different makes and models of microwave oven.  As well, other differences that will crop up include how long these tasks are expected to take. It is also analagous to working from any recipes that are part of your microwave oven’s documentation, because these may not work out correctly if you end up using a different appliance.

Here, this issue will be considered important as more of us place value on the microwave as a cooking option for something like, perhaps, those green vegetables. It can also bamboozle anyone who uses traditional cooking techniques like the conventional oven but finds themselves in a situation where they have to primarily rely on the microwave oven for cooking needs like when they stay in a serviced apartment or AirBnB.

Amazon had released to the US market the AmazonBasics microwave that works with their Alexa voice-assistant ecosystem. But this is seen as an elementary appliance, answering most common cooking tasks. Sharp has now come to the fore with two of their microwaves that are released to the US market.

Here, the difference is to use Alexa as a gateway to the advanced cooking tasks that these microwaves offer. The press release talked of us saying to an Amazon Echo device “Alexa, defrost 2 pounds of meat” and the microwave will be set up to thaw out two pounds of frozen meat. The larger model of the two will have the ability for you to ask Alexa to set the microwave up for something like cooking broccoli or other veggies.

I see this as being about using voice assistant platforms to open up a common user interface for the advanced microwave-cooking tasks that your microwave would offer. But for this to work effectively, the user needs to know what the expected cooking time would be for the task and when they need to intervene during the cooking cycle.

As well, more of the voice assistant platforms need to come on board for this approach to advanced microwave cookery. Let’s not forget that the display-based voice assistants can even come in to their own in this use case such as to list ingredients and preparation steps for what you intend to cook.

Here, the voice assistants will become a way to lead users to use the microwave beyond reheating food, melting butter and chocolate or cooking microwave popcorn/

Articles

New Amazon Echo devices

Everything Amazon announced at its September event | Mashable

Amazon hardware event 2020: Everything the company announced today | Android Authority

Use of edge computing in new Echo devices

Amazon’s Alexa gets a new brain on Echo, becomes smarter via AI and aims for ambience | ZDNet

From the horse’s mouth

Amazon

Introducing the All-New Echo Family—Reimagined, Inside and Out (Press Release)

New Echo (Product Page with ordering opportunity)

New Echo Dot (Product Page with ordering opportunity)

New Echo Show 10 (Product Page with ordering opportunity)

My Comments

Amazon are premiering a new lineup of Echo smart-speaker and smart-display devices that work on the Alexa voice-driven home assistant platform.

These devices convey a lot of the aesthetics one would have seen in science-fiction material or “future living” material written from the 1950s to the 1970s. It is augmented by an indoor camera drone device that Amazon released around the same time.

As well, all of these devices have the spherical look that conveys that retro-futuristic industrial-design style that was put forward from the 1950s to the early 1970s like with the Hoover Constellation vacuum cleaner of the era or the Grundig Audiorama speakers that were initially designed in the 1970s thanks to the Space Race. You might as well even ask Alexa to pull up and play space-age bachelor-pad music from Spotify or Amazon Music through these speakers.

It is even augmented further with the base of the Echo and Echo Dot lighting up as a pin-stripe to indicate the device’s current status. This industrial design also permits the implementation of a 360-degree sound approach that can impress you a lot. It also is a smart-home hub that works with Zigbee, Bluetooth Low Energy and Amazon Sidewalk devices so you don’t need to use a separate hub for them.

Amazon Echo Dot Kids Edition that is available either as a panda or tiger – for the young or young at heart

The small Echo Dot comes in two different variants where one of these has a clock on the front while the other doesn’t. It also comes also as a “Kids’ Edition” with an option of a panda face or a cat face. It is offered as part of Amazon’s Alexa Kids program which provides a child-optimised package of features for this voice assistant. But I also wonder whether this can be ran as a regular Echo Dot device, which may appeal to those adults who are young at heart and want that mischievous look these devices have.

The Echo Show 10 smart display uses a microphone array and automatic panning to face the user. This is driven by machine vision driven by the camera and microphone array. But the camera has a shutter for your privacy. Of course you can use this device as a videophone thanks to the Alexa platform’s support for Amazon’s calling platforms, Zoom and Skype.

Amazon Echo Show 10 that can swivel towards you

What makes this generation of Echo devices more interesting is that they implement an edge-computing approach to improve sound quality and intelligibility when it comes to interacting with Alexa. This is even opening up ideas like natural-flow conversations with Alexa or allowing Alexa to participate as an extra person in a multiple-person conversation. It is furthering Amazon’s direction towards implementing ambient computing on their Alexa voice-driven assistant platform.

But Google was the first to implement this concept in a smart-speaker / voice-driven assistant use case. Here, they used it in the Nest Mini smart speaker to improve on the Google Assistant’s intelligibility of your commands.

Oh yeah, you can make and take Zoom or Skype videocalls on an Amazon Echo Show 10

I do see this as a major direction for smart-speaker and voice-driven-assistant technology due to improving responsiveness and user interaction with these devices. It may even be about keeping premises-local configurations and customisations on the device’s memory rather than on the cloud, which may improve a lot of use factors. For example, it may be about user privacy due to minimal user data held on remote servers. Or it could be about an optimised highly-responsive setup for the home-automation setups we build around these devices.

What needs to be looked at is a way to implement localised peer-to-peer sharing of data between smart speaker devices that are on the same platform and are installed within the same home network. This can allow users to have the same quality of experience no matter which device they use within the home.

There also has to be support for localised processing of data by devices with the edge-computing smarts for those devices that don’t have that kind of operation. This would be important if you bring in a newer device with this functionality and effectively “push down” the existing device to a secondary usage scenario. In this use case, having another device with the edge computing smarts on your home network and bound to your voice-driven-assistant platform account could assure the same kind of smooth user experience as using the new device directly.

These Amazon Echo devices are showing a new direction for voice-driven home assistant devices to allow for improved intelligibility and smoother operation.

Article

Amazon has improved on the way you can order documents to be printed via the Echo or Alexa-compatible device

Amazon launches Alexa Print, a way to print lists, recipes, games and educational content using your voice | TechCrunch

From the horse’s mouth

Amazon Alexa

Introducing: Alexa Print (Product Page)

What Can I Print (Product Page with Key phrases)

My Comments

Initially, Amazon partnered with HP to offer voice-activated document printing. That is where you could ask Alexa to print out colouring pages, sudoku puzzles, ruled paper and the like. But this tied HP’s ePrint documents-on-demand ecosystem to the Amazon Alexa voice-driven home assistant platform and limited this feature to HP ePrint-capable network printers. Some other manufacturers then bound their online printing functionality to Amazon Alexa so as to provide some form of voice-driven printing functionality.

.. even through printers like this Brother DCP-J562DW multi-function printer

Now Amazon evolved this feature to work with any network printer that supports IPP-based driver-free printing. That is usually a machine that supports Apple AirPrint or the Mopria driver-free printing protocols, which encompasses most of the printers made over the last five years. Here, the documents would be held on or constructed by Amazon’s servers rather than on HP’s servers.

To get going, you have to say “Alexa, discover my printer” to get started. This would have your Amazon Echo or similar Alexa-capable device discover any network printer on the same logical network as itself. On the other hand, you could use the Alexa app to discover the printer. This would require you to tap the “+” icon then select “Add Device”, then choose “Printer” as the device class to add. It will list any compatible printers on your home network so you can add them.

The Alexa app gives you fine-grained control so you can rename printers like the “Upstairs printer” or “Kitchen printer”; or allow you to delete or disable discovery of specific machines.

Amazon has, at the moment, partnered with particular publishers to offer printable items and has set up some basic printable items like ruled paper, arithmetic worksheets and the like to get you going. There is the ability to turn out crosswords including their answers along with recipes, which may be a rough-shot.

.. or this HP OfficeJet 6700 desktop multifunction printer

It also ties in with the ability for you to use Alexa to buy first-party (genuine) ink or toner for your printer through their online storefront. Here, it will know which cartridges fit your machine, but the question is whether there will be the ability for you to specify standard-yield or high-yield consumables. That is because some manufacturers like HP and Brother offer their consumables in differing yield levels which may suit your needs or budget better.

At the moment, the number of printable resources will be limited until Amazon encourages Alexa Skills developers to build out Skills for this platform that support printing. Here, it could he things like asking for a rail timetable to be printed out or Amazon could even exploit Alexa Print to facilitate transactional printing like turning out tickets and boarding passes.

It will be interesting to see whether Google or Apple will bind the driver-free printing platforms that they own or partner with and their voice-driven assistant platforms to allow this kind of printing using them.

Articles

Zoom video conferences will soon be able to take place on smart displays

Zoom Meetings Coming Soon to Smart Displays | Droid Life

Zoom video calls come to smart displays from Google, Amazon, and Facebook | Android Authority

Zoom expands to every major smart display as coronavirus keeps us home | CNet

From the borse’s mouth

Zoom

Zoom Expands to Smart Displays at Home (Blog Post)

My Comments

.. like the Amazon Echo Show

The COVID-19 coronavirus plague is increasing our use of Zoom as a multiparty videoconferencing platform especially for social and community purposes. This is thanks to measures in place to encourage social distancing and reduce travel to curb the spread of this virus. Zoom’s trademark for this service even ended up as a generic trademark word for a any multiparty videoconference just like one often referred to a common ballpoint pen as a biro.

But Zoom is primarily offered on most regular-computer and mobile-device platforms like Windows, MacOS, iOS and Android. This is because these devices have integrated or accessory Webcams supported by their operating system and can take on software from third-party developers.

… or Google-Assistant devices like this JBL Link View smart display

Recently Zoom tried out the idea of a dedicated videoconferencing appliance in the form of a 27” group videophone that can also be a display screen for a computer, TV set-top box or similar video peripheral. It is similar to previous efforts by smart-TV and video-peripheral vendors to provide Skype support if the device is equipped with an expensive accessory Webcam offered by the manufacturer.

But Zoom took a better step to partner with Google, Amazon and Facebook to integrate their platform in to the Amazon Echo Show smart displays, Facebook Portal smart display and smart displays running the Google Assistant (Home) platform. Here, these devices have the hardware that is needed to make or take videocalls i.e. a camera, microphone, screen and speakers. As well, the three vendors are more supportive of programming these devices to take on additional functionality.

These devices have some sort of videophone functionality built in to them through support for some other videoconference platforms: Skype and Amazon’s IP-telephony platform in the case of Amazon’s Echo Show devices; Google’s Duo and Meet in the case of Google-powered devices; and Facebook Messenger with its Rooms function as well as GoToMeeting, BlueJeans and WebEx in the case of the Facebook Portal. The addition of Zoom doesn’t displace the platform vendor’s own products or products the vendor has already licensed from other partners. As well, it recognises that different people and organisations tend to prefer working with particular videoconference platforms over others.

The Zoom software is engineered to take advantage of what the platforms offer including tying in with the platform’s native calendar function if you have linked your calendar to it, or joining a videoconference at your voice command. In the case of the Facebook device, you can tap the screen to join a meeting. All classes of Zoom account can be bound to these devices so you can use the account paid for by your work or school or a personal one you set up for free for social use.

This function will start to appear on most Facebook Portal devices in September then roll out across all the other smart-display platforms over October and November.

But why allow Zoom and similar videoconferences on a smart display or similar appliance? One reason is to have one device dedicated to the videoconference while you use another device to take notes or read supporting material for business, education or religion use cases. It may also be about the desire for an “appliance-simple” approach for making and taking videocalls, something that may be desired for older users who may find the process of creating or joining a multiparty videoconference daunting. As well, there is the encouragement to use an endpoint device that fits in with where it will be used such as the small smart displays that are typically installed in a kitchen or similar room.

What need to eventually happen is for Zoom and similar multiparty videoconferencing platforms to be part of connected-TV / set-top box platforms typically used for viewing Netflix or similar video-on-demand services on the big-screen TV. This is as long as the TV or set-top box can work with an accessory Webcam. As well, the device has to support multiple videoconferencing platforms, especially the common ones; while each platform has to offer a user interface suitable for 10-foot “lean-back” operation.

Here, such implementations, when done right, can be about the use of a big-screen TV as a group videophone for situations where the whole household participates in a videoconference like the many Zoom-based family or community video “catch-ups”.