Tag: Apple Siri

You can prevent mistaken voice-assistant behaviour from your smart speakers

Article

Amazon Echo on kitchen bench press photo courtesy of Amazon USA

The mute button on your Echo or other smart speaker is important if you want greater control over the voice assistant

You Should Mute Your Smart Speaker’s Mic More Often | Lifehacker Australia

My Comments

An issue that will plague people who own smart speakers like the Amazon Echo or Google Home is the device interjecting with responses when you or someone else unintentionally say certain words.

This is because these devices are typically set up to listen all the time for a particular “wake word” that actually invokes the voice assistant. It is part of the machine-learning that drives these voice-assistant platforms to understand what you say.

But you can have some control over these smart speakers to avoid this behaviour. Each smart speaker or similar device will have a hardware mic-mute switch on them, highlighted with a microphone icon on that switch. This effectively turns the device’s microphones on or off as you need and the article recommended that if the device is too “hair-trigger”, you should enable this function unless you are actually intending to interact with the voice assistant. This procedure would be similar to how you would work a voice-driven personal assistant that is part of your smartphone’s operating system where you deliberately press a button on the device or a Bluetooth headset to invoke that assistant before you say the wake word.

Beware of the situation where the button will light up when you enable microphone muting on your smart speaker. Here this may be a point of confusion because some users may think that the device is “ready” to speak to when it is infact not able to take commands. You may have to be familiar with how your smart speaker looks when it is ready to accept commands, including any lights that are on.

If your voice-assistant platform has the function to “edit” what has been captured like what Amazon Alexa can do, this function can be used to fine-tune what the voice-assistant is meant to respond to. The same control app or Website can be used to manage your smart speaker’s microphone sensitivity or change the “wake command” that you say when you start interacting with the assistant.

They even recommend that you disconnect the smart-speaker device from the power if you don’t intend to use them. Privacy advocates even suggest doing that in areas where you value your privacy like your bedroom or bathroom.

But personally I would at least recommend that you are familiar with the hardware controls that exist on your smart speaker or similar device so you are able to have greater control over that platform.

Sonos launches the first soundbar that works with multiple voice-driven home assistants

Articles

Sonos Beam soundbar connected to TV - press picture courtesy of Sonos

Sonos Beam under the TV

Sonos says its new Beam speaker will be able to talk to Siri, Alexa, and Assistant | FastCompany

A closer look at Sonos Beam: Smaller, smarter and more connected | Engadget

Sonos introduce cheaper, smarter Sonos Beam soundbar | PC World

From the horse’s mouth

Sonos

Sonos Beam (product page – direct purchase opportunity, press release)

My Comments

Sonos Beam soundbar (black finish) press picture courtesy of Sonos

Sonos Beam soundbar

Sonos has offered a smart speaker that not just is part of their own multi-room ecosystem but can work with multiple different voice assistants. Now they have taken this concept further by offering the Sonos Beam compact sound bar which can do this same trick.

They have taken this approach due to a reality with people operating two or more different voice-driven assistants. The classic reality would be someone who has an Amazon Echo at home but uses Siri in their iPhone or Google Assistant in their Android smartphone. But these assistants don’t complement each other effectively or even work with each other at all.

But this has been taken further with the Sonos Beam soundbar which is seen as a competitor to JBL’s Link Bar soundbar that has integrated Android TV set-top box functionality and can work with the Google Assistant. Initially it will come with Amazon Alexa but Siri and Google Assistant will be delivered as firmware updates through the year. A firmware upgrade will fully enable the Sonos Beam for Apple’s AirPlay 2 ecosystem which is Apple’s take on a full-blown multiroom setup centred around their products.

Sonos multiroom system press picture courtesy of Sonos

Works equally well with the rest of the Sonos multiroom system

For the sound, the Sonos Beam soundbar uses a digital-enhancement approach to draw out the bass from its compact cabinet. But you could team it with Sonos’s “Sub” subwoofer if you find that this may offer a better job at providing that extra bass. As well, thanks to the Sonos setup, you could team two of their standard speakers if you want to set up the full surround-sound experience.

The Sonos Beam “hears” you through an integrated far-field microphone array. But you can control whether it hears you or not by pressing a microphone-mute button on the speaker – this will have a “mic” icon located on it. The ability to control the microphone on this device reduces the risk of nuisance triggering which can easily happen when TV content is being played. Thanks to the HDMI-CEC standard facilitated by the HDMI-ARC connection, there is the ability to voice-control your TV in relation to sound volume (including muting the advertisements) or power status.

A limitation most of us will find with this soundbar is that it only has one HDMI connection for HDMI-ARC connectivity to the TV for its sound. This can be very constraining for those of us who use a TV that has very few HDMI connections and you use all these connections for various video peripherals.

But it is another effort by Sonos to prove that a smart-speaker device could support multiple voice-driven assistant platforms on the same device. Could this also be a reality with other equipment manufacturers soon? On the other hand, could this device become a virtual friend for that lonely person by providing better sound for daytime TV or being someone to talk to?

Politics creeps in to the world of the voice-driven assistant

Articles

Amazon Echo on kitchen bench press photo courtesy of Amazon USA

Is Amazon Alexa and similar voice-driven assistants becoming a new point of political influence in our lives?

Amazon’s Alexa under fire for voicing gender and racial views | The Times via The Australian

Alexa, are you a liberal? Users accuse Amazon’s smart assistant of having a political bias after she reveals she is a feminist who supports Black Lives Matter | Daily Mail

Amazon’s Alexa is a feminist and supports Black Lives Matter | Salon

My Comments

An issue that has started to come on board lately is how Amazon Alexa, Google Assistant, Apple Siri and Microsoft Cortana respond to highly-polarising political questions especially in context to hot-button topics.

This talking point has come up just lately in the USA which has over the last year become highly polarised. It has been driven by the rise of the alt-right who have been using social media to spread their vitriol, the fake news scandals, along with Donald Trump’s rise to the White House. Even people from other countries who meet up with Americans or have dealings with any organisation that has strong American bloodlines may experience this.

Could this even apply to Apple’s Siri assistant or Google Assistant that you have in your smartphone?

What had been discovered was that Amazon’s Alexa voice-driven assistant was being programmed to give progressive-tinted answers to issues seen to be controversial in the USA like feminism, Black Lives Matter, LGBTI rights, etc. This was causing various levels of angst amongst the alt-right who were worried about the Silicon-Valley / West-Coast influence on the social media and tech-based information resources.

But this has not played off with the UK’s hot-button topics with Alexa taking a neutral stance on questions regarding Brexit, Jeremy Corbyn, Theresa May and similar lssues. She was even challenged about what a “Corbynista” (someone who defends Jeremy Corbyn and his policies) is. This is due to not enough talent being available in the UK or Europe to program Alexa to achieve answers  to UK hot topics in a manner that pleases Silicon Valley.

The key issue here is that voice-driven assistants can be and are being programmed to answer politically-testing questions in a hyper-polarised manner. How can this be done?

Could it also apply to Cortana on your Windows 10 computer?

The baseline approach, taken by Apple, Google and Microsoft, can be to give the assistant access to these resources that matches the software company’s or industry’s politics. This can be pointing to a full-tier or meta-tier search engine that ranks favourably resources aligned to the desired beliefs. It can also be about pointing also to non-search-engine resources like media sites that run news with that preferred slant.

The advanced approach would be for a company with enough programming staff and knowledge on board could programmatically control that assistant to give particular responses in response to particular questions. This could be to create responses worded in a way to effectively “preach” the desired agenda to the user. This method is infact how Amazon is training Alexa to respond to those topics that are seen as hot-button issues in the USA.

Government regulators in various jurisdictions may start to raise questions regarding how Alexa and co are programmed and their influence on society. This is with a view to seeing search engines, social media, voice-driven assistants and the like as media companies similar to newspaper publishers or radio / TV broadcasters and other traditional media outlets, with a similar kind of regulatory oversight. It is more so where a voice-driven assistant is baked in to hardware like a smart speaker or software like an operating system to work as the only option available to users for this purpose, or one or more of these voice-driven assistants benefits from market dominance.

At the moment, there is nothing you can really do about this issue except to be aware of it and see it as something that can happen when a company or a cartel of companies who have clout in the consumer IT industry are given the power to influence society.

Companies now to support multiple voice-driven home assistants

Articles

Harman now has smart speakers for Alexa, Cortana and Google Assistant | Engadget

The Sonos smart speaker with microphone hits the FCC | The Verge

Sonos to announce new smart speaker on October 4th | The Verge

From the horse’s mouth

Harman

WHEN VOICE MEETS SOUND (Press Release)

Introducing JBL® LINK Series: Immersive JBL Sound Now Available with the Google Assistant (Press Release)

HARMAN introduces Harman Kardon Allure with Amazon Alexa to the Voice Activated Speaker Family (Press Release)

My Comments

Harman Allure smart speaker press image courtesy of Harman

Harman Allure smart speaker powered by Amazon Alexa

The Internationaler Funkaustellung trade show has been and gone but this time more manufacturers were premiering smart-speaker products based on either the Amazon Alexa or Google Assistant platforms.

One of these is the Sony LF-S50G speaker that looks like Apple’s Siri-based HomePod smart speaker but has an integrated display while Panasonic were also launching the GA10 which is a box-like smart speaker. Both of these speakers work with Google Assistant.

But a few companies have put their feet in multiple ponds by supporting two or more platforms. One way is to offer different models or product ranges that are based on different platforms. The other is to attempt to have the one smart speaker able to be set up to work on one of many platforms that the user chooses.

JBL Link smart speaker range press picture courtesy of Harman

JBL Link smart speaker range powered by Google Assistant

The former approach has been taken by Harman who have multiple names of respect in the hi-fi, sound-recording, PA and allied industries under their wings. Initially, they offered the Invoke smart speaker that is based on the Microsoft Cortana platform. Now the premiered the JBL Link range of smart speakers that work on the Google Assistant platform as well as offering the Harman-Kardon Allure smart speaker that is based on the Amazon Alexa platform.

Pioneer and Onkyo recently underwent a “Renault-Nissan” merger of their home audio and AV businesses and offered a few smart speaker models based on the different platforms. Here, Pioneer premiered the Smart Speaker F4 which is based on the Amazon Alexa platform while Onkyo launched the Smart Speaker G3 based on the Google Assistant platform while maintaining the Alexa-based VC-FLX1 smart speaker that was launched at CES 2017.

The latter approach has been taken by Sonos with their S13 prototype smart speaker that is intended to be released on October 4. Here, they put forward the idea of having the user to have this speaker work with Siri, Alexa or Google Assistant rather than being stuck with one platform. It is seen as a premium-level attack at the Apple HomePod which will be based on Siri.

The approach of a manufacturer supporting different voice-driven-assistant platforms like Alexa or Google Assistant in different product ranges may appeal to companies who see one of the platforms offer a particular premium-level cachet which can tie in with their premium product ranges. This is while a popular platform like Alexa or Google Assistant could end up being focused on to popularly-targeted products.

Compare this with the idea of having multiple platforms supported by the same smart-speaker or similar device. Here, it can appeal to TVs, hi-fi / home-theatre components and allied devices that are expected by customers to run for the long haul or with premium network speaker products.

Either trend could be support by many different manufacturers while the devices that you interact with for these platforms could end up being more than just the cylindrical benchtop speakers.

Are Siri and Alexa being seen as personal companions?

Article

Is Siri ending up as your personal companion?

Conversations with virtual assistants like Siri, Alexa may be signs of loneliness | First Post

Talking to Siri often? You’re probably lonely | Times Of India

Do YOU rely on your phone for company? Human-like gadgets can offer relief from loneliness in the short term | Daily Mail

Older adults buddy up with Amazon’s Alexa | MarketWatch

My Comments

Hey Siri! Why am I alone now?

A situation that has been drawn out lately is someone feeling comfortable with their iPhone in their hand or sitting at the kitchen table beside an Amazon Echo speaker, trying to build a conversation with Siri or Alexa rather than simply asking something of these voice-driven assistants.

Amazon Echo on kitchen bench press photo courtesy of Amazon USA

Is this smart speaker becoming your personal companion?

Here, a Kansas University study found that Siri, Alexa and co are being seen as a short-term panacea for social exclusion and loneliness. This is something that is being brought on by broken relationships or an increasing number of work situations where one is spending significant amounts of time away from their significant other or their normal communities. It is also symptomatic of a loss of community that has come about in this day and age.

It is also worth knowing that older and disabled adults are using Alexa or Google Home as a companion in the context of managing lights, or simply asking for the time or a music source. These devices are deliberately designed to look like other pieces of consumer-electronics or IT hardware rather than the typical bland look associated with assistive devices. They also do serve as an aide-memoire for dementia sufferers but only in early stages of this condition before it becomes worse.

But Siri, Alexa, Cortana and co are not perfect replacements for real-life friends, There is the long-term risk of you losing real human interaction if you rely on them as your companions. Here, you simply keep them serving you as a voice-operated “digital concierge” that helps with finding information or setting up your smart home rather than the be-all-and-end-all digital companion.

Amazon chasing the numbers when it comes to Alexa’s Skills

Article

Amazon Echo on kitchen bench press photo courtesy of Amazon USA

Amazon needs to assure quality for the skills they offer to Echo users

Alexa is learning more new skills every day | Engadget

My Comments

At the moment, Amazon is adding many skills to the Alexa voice-activated home assistant ecosystem every day with at least 15,000 skills available for your Echo by the time this article is published. This is in contrast to Google offering 378 apps and Cortana offering 65 apps. Apple yet hasn’t shown up the number of skills or apps that they have added to Siri as part of her role as a voice-driven home assistant.

But the problem with this approach is that Amazon can easily end up “chasing the numbers” where they don’t care about software quality. This is very similar to what has happened with the app stores like Microsoft Store where these stores filled up with many poor-quality and, in some cases, worthless apps. Here it is seen as a quick way for Amazon to dominate the voice-driven home assistant landscape alongside offering the multiple devices and extra capabilities.

Amazon yet haven’t had much experience in building up a platform app store with a goal towards achieving a significant number of quality apps. This is compared to Google, Microsoft and Apple who have learnt by experience when it came to building up their platform app stores which Google Home, Cortana and Siri will be based on. In most cases, it was about leaving the gates wide open and admitting too much trash or “dribbling in” very little software and putting across an image of very little choice. It is symptomatic of a technology being at an immature state where much hasn’t been worked on to have the right mix of features and software.

As regards with the software quality of skills or apps for a voice-driven home assistant platform, there will be issues about preserving proper software behaviour, assuring proper taste and decency in a family environment, along with assuring end-users’ data-security and privacy. It is more so with the fact that these skills will be relating to smart-home devices and these devices can be used to represent a household’s lifestyle. This will need to be achieved through software and consumer-protection policies and a feedback loop between end-users and the platform developer.

Of course, there needs to be the ability for Amazon and co to highlight high-quality skills and apps to users such as through an “editor’s choice” or “product spotlight”, along with a user review and rating system.

Other issues yet to be raised include how a developer can monetise a skill, whether through having customers buy the skill through Amazon’s storefront or through an advertising platform. In the case of advertising, there will be issues regarding user privacy, the kind of advertising that appears along with when the ads appear in your interaction with that skill.

I would see the sign of maturity for the voice-driven home assistant technology as higher-quality skills or apps being available along with the platforms being offered in more territories on more devices with the expected feature sets.

A four-horse race for voice-driven home assistants

Articles

Apple Homepod smart speaker press picture courtesy of Apple Inc.

Apple Homepod smart speaker – a competitor to Amazon, Google and Microsoft

Apple readying Siri-powered home assistant: report | Yaho 7 News

From the horse’s mouth

Apple

Press Release

My Comments

The voice-driven home assistant has approached a point of competition where there are four different actors involved.

This class of computing device is based around a speakerphone-type device that can respond to your voice by answering questions you put to it cause certain actions to occur at your command. It was initially brought on by Amazon with their Echo speaker and Alexa voice assistant, but was subsequently answered by Google with their Home speaker based on their Google Now platform.

Amazon Echo on kitchen bench press photo courtesy of Amazon USA

The Amazon Alexa platform now faces some healthy competition from Apple as well

Very recently Microsoft touted one of these speakers that is based on the Cortana voice-driven personal assistant platform. Not to be outdone, Apple just announced a smart speaker and voice-driven home assistant based on their Siri voice-driven personal assistant.

All of these companies have positioned themselves in a highly-competitive manner by using the same approach to how they present their devices. Here, they allow independent hardware vendors to license these technologies to use in their own “smart-speaker” or similar products. In the case of Amazon Alexa and Microsoft Cortana, these systems can even show information in a visual manner on screen-equipped devices, whether that be in the form of a listing or a graphical “at-a-glance” display.

Harman Invoke Cortana-driven smart speaker press picture courtesy of Harman International

Harman Invoke Cortana-driven smart speaker

Similarly, they have extended their voice-driven assistant platforms by allowing third parties to add “skills” to them whether in the near term or later. These are additional abilities that users can add to their voice-driven assistant to make it perform additional tasks or interface with other devices. It also underscores the activity that these platform vendors are undertaking to integrated their voice-driven home assistant with home-automation and allied devices, allowing for things like dimming the lights or adjusting the heating at your command.

Let’s not forget that Amazon, Microsoft and Apple have over-the-top communications platforms equipped with videocall and messaging abilities that either are or will be integrated to their voice-driven home-assistant platforms. Amazon created their Alexa-based IP-telephony platform from scratch, adding it to the crowded sea of IP-communications platforms so it can tie in with their Alexa home-assistant platform. It could allow for you to ask Alexa, Cortana or Siri to immediately “drop a line” to someone using Alexa Messaging, Skype or iMessage / Facetime respectively. You could even use this to instantiate a videocall between yourself and your correspondent if both of you are using suitable equipment.

What do I see of this? Personally, I would find that hardware manufacturers such as the respected audio-equipment names may offer smart speakers and similar equipment that works across multiple platforms, requiring the user to determine which platform they want to use during setup or at a later time. Similar software developers who write interfaces for online service may be required to write “skills” for each of the platforms.

I also see it as being very similar to 1989 when there were multiple graphic-user-interfaces on the market with each computer platform having its own mouse-driven interface. Hello to “Hey Siri”, “Hi Cortana”, “OK Google” or “Alexa” to dim those lights, close that garage, start Spotify or whatever as you talk to that speaker.

The Nickname field is now of use for mobile assistant platforms

Article

Samsung Galaxy Note 2 smartphone

Android and iOS can support contacts’ nicknames with Google Now and Siri

Use Nicknames With Siri And Google Now To Reach Contacts Faster | Gizmodo

My Comments

Most smartphone operating systems have in their contact list a field called “Nickname”. This is typically of use when you have a personal nickname, relative-shortcut name like “Mum” or similar name for a contact. But in most cases, this field isn’t shown up on call logs or contact lists.

Now Siri and Google Now make use of the Nickname field to interpret instructions to call particular people. Google Now does provide inherent support for relationship-shortcut names but you can use the Nickname field for manually determining a contact’s nickname. Both voice assistants can query which person a nickname pertains to which can come in handy if you are calling one of many siblings or someone with an obscure nickname or a nickname that is spelt a certain way but pronounced another way.

How could this be improved upon?

Nicknames appearing in the contact-display context

At the moment, the nickname functionality only works in the contact-search context but I would like to see it also work in the contact-display context especailly when a call or text comes in from the contact or you browse through your contact list or recent / missed call logs. This could be facilitated through the use of a “Display As” field which shows a user-chosen field or combination of concatenated fields for a particular contact.

Support for a phonetic representation of a nickname

These systems could support the ability to store a phonetic representation of a nickname which can come in handy when you say that nickname one way but have it written another way. The phonetic representation would be used for voice-based search and voice-based call announcements.

Security issues with nicknames

Nicknames may expose security issues when they fall in to the wrong hands. It is because people use these nicknames as a “password” or “word of trust” within their community.  But confidence tricksters using familiar nicknames as a way to “get in to someone’s mind” and have them acquiesce to their inappropriate scheme. In some cases, a nickname that is a symbol of endearment may be used as a weapon against one or both of the participants.

Having nicknames as a “secure” field which is only shown to trusted users is important to preserve this kind of security. For example, if a phone shows a list of missed calls or text messages on the notification screen, it could show a standard “first-name last-name” or “company-name” while locked but show the nickname while unlocked. Similarly, voice-level biometrics can be used to authenticate a user who is “searching by nickname” using a voice-based personal assistant.

Further improvements needed for phone contact lists

Handling of common phone numbers

Another area where a lot of contact list programs miss out on is handling phone calls or other communication that comes in from pbone numbers, emails or other contact addresses common to two or more contacts.

The most common example is a landline phone number that serves as a “catch-all” number for a household, workgroup or business. In this case, you may instruct the voice assistant to call a person on that landline by saying “person-name Home” or “person-name Work” or something similar. This will place the call to that landline. The same thing will happen if you contact someone else who lives or works behind that common phone number.

The problem rears its ugly head when a call comes in from that phone number or you review your call logs and you see the first alphabetically-listed contact related to that “catch-all” number even though other contacts in your contact list are behind that number. Here you don’t know whom it was who called you or whom you placed that call to.

This could be facilitated using a dynamically-concatenated display field for phone numbers with something like [<company-name>(caller-name-1. caller-name-2, or caller-name-n] for callers with a populated company-name field; or [caller-name-1, caller-name-2 or caller-name-n] for callers missing a company-name field i.e. households. Or you may create a dedicated contact entry for the “catch-all” phone number such as a distinct “name-address-number” entry for a company or household. Then you add “common fields” like work number, home number or company name to the entries associated with the people with that same “roof” in common. The name associated with the dedicated contact entry shows up in the call log when you call that number or on your phone’s screen when they ring you from that “catch-all” telephone.

Conclusion

At least something is being done to make sure that the contact management software and voice-activated personal assistant software  is tied in to how we view our contacts so we see our contacts our way.

Personal-assistant software turns from a trickle to a flood

Siri - the first of the mobile personal-assistant software

Hi Siri! Siri – the first of the mobile personal-assistant software

First there was Apple with Siri, then Google with Google Now, then Microsoft with Cortana (not that Ford car of the 1970s). Now Facebook has jumped in on the act with M. What is this about?

We are talking of “personal-assistant” software that uses artificial intelligence and natural-language processing along with access to locally-stored and Web-hosted resources to answer questions.They also implement machine learning to fine-tune themselves to how you operate in life. Depending on the software, you may pose these questions by talking to the device or typing in the question. They will reply either by text or, if they implement speech technology, by voice. In some cases, you could ask the “personal-assistant” software to get the ball rolling for a hotel, restaurant or journey booking or product purchase.

Some of these programs provide API hooks to other programs and Web services either to learn from or pass commands to them so you could, for example, ask Google Now or Cortana to get Shazam to identify a particular song playing on the radio. These APIs may be passed to select programs as determined by the personal-assistant software vendor or may be widely available to every third-party app developer.

OK Google - Google Now as an Android widget

OK Google – Google Now as an Android widget

Initially this class of software was bound to a particular operating system but it is less becoming the case especially with Google Now, Cortana and Facebook M. Rather you can use these assistants at least on the major mobile platforms. Let’s not forget that these assistants are showing up on regular desktop and laptop computers with Microsoft rolling out Cortana for Windows 10 desktop use and Apple working on having Siri in an upcoming version of MacOS X.

Hey Cortana - Cortana which is the first of these intelligent personal assistants for regular-computer use

Hey Cortana – Cortana which is the first of these intelligent personal assistants for regular-computer use

What do I see of this competition? Personally, the proliferation may be focused on tying a natural-language personal-assistant experience to be centric to particular platforms and aps even if your computing life is multi-platform. But it could then lead to different personal-assistant programs that are focused on particular experiences, beliefs and ideals so that the experience is more in tune with who you are, what you believe and what you like. For example, a media company could create a personal-assistant program based on their media properties like ESPN creating a personal-assistant program centered around their sports channels but learning who your favourite leagues, teams and competitors are.

But I would rather that these platforms focus on a level of modularity where you can interlink them with particular information sources and apps and give them the kind of functionality that you desire yet keeping your data private. As well, this will assure that users can use a single interface point rather than switching between interface points according to what they are after.