Tag: user interfaces

Cloudflare to work on simplified CAPTCHA

Article

CAPTCHA text

Cloudflare is intending to replace CAPTCHA authentication on Web forms with …

CAPTCHAs May Soon Go Extinct (gizmodo.com)

From the horse’s mouth

Cloudflare

Humanity wastes about 500 years per day on CAPTCHAs. It’s time to end this madness (cloudflare.com)

My Comments

The CAPTCHA is being used as a means to prevent spam emails or comments on Websites or to assure that people who register in an online context are real people.

But these measures, typically ranging from transcribing letters or identifying objects, can be very frustrating for many people. This is caused by hard-to-read or small letters or instructions relating to object identification being difficult to understand on a language or cultural context. As well, some of these CAPTCHAs don’t work well for mobile setups like smartphones which is increasingly the common way to use the Internet. That leads to abandoned registrations or online-shopping carts or people not joining in to online services for example.

HP Elitebook 2560p business notebook fingerprint reader

you scanning your fingerprint on your flaptop’s fingerprint scanner or you entering your device’s PIN code to prove that a person is entering the data

CloudFlare are working on a different approach to authenticating the personhood of a device user without resorting to letters to transcribe or objects to identify. Initially they are using USB security keys for this purpose but are moving towards full WebAuthN implementation for this purpose.

This approach will work with WebAuthN-capable browser and operating-system setups and work in a similar vein to password-free authentication for online services using that technology. This will require you to enter your device PIN, use face recognition or use the fingerprint reader, operate a USB security key or an authenticator app on your smartphone to prove your personhood, as if you are enrolling in to an online service that implements WebAuthN technology.

The success or failure of the WebAuthN test will simply allow you to submit that form or not on the Website. The logic won’t cause any extra identifying factors to be stored on the online service’s server under default setups. But it may store a device-local cookie to record success so as to treat the session as authenticated, catering towards data revision approaches in wizard-based forms or long data-entry sessions.

A question I would have with this CloudFlare approach is how it can work with computing setups that don’t support WebAuthN. This will also include shared computing setups and public-access computers where the use of this kind of authentication may not be practicable for a single session.

But Cloudflare’s effort is taking WebAuthN further as a way to prove that a real person rather than a robot is actually operating an online account in a manner that is universal to abilities, languages and cultures.

Newer Windows updates will have relevant information about what’s new

Article

Acer Switch Alpha 12 tablet press image courtesy of Acer

Windows 10 major updates will see an improvement to how new functionality is discovered

Windows 10 Insider build 20190 hits Dev channel with new post-update experience | Windows Central

My Comments

When Microsoft officially releases a major Windows 10 feature update, it may be daunting to know what changes have existed to your computing environment as a result of that update.

Here, you may want to know what changes took effect including any new functionality that came about. It may also be about any significant changes to Windows 10’s user experience that you may have to get used to. For some people, finding that a significant change to the user experience may be daunting and that a feature may be delivered but they don’t know how to take advantage of it. This may cause some Windows 10 computer users to delay or avoid major-update cycles all together.

As well, it is more important for people who aren’t sure of any significant changes to how their technology operates, something that can be of concern for the older generations who haven’t had much computer experience. For them, it may be about relearning a skill they already have in order to adapt it to a newly-revised user interface.

Microsoft will be answering this problem with its “Tips” app in Windows 10 from the next feature update onwards. Here it will have a “What’s New” focus that appears after the update is rolled out to highlight any new features or changes to the user experience. This will be updated with every feature update so users are aware of the newly-added functionality.

But I would like to see added to this information relating to improved peripheral and network device support especially where it is relevant to the kind of connections your computer has and devices it is connected to.

For example, it may be about whether a peripheral or network device is gaining class-driver support within Windows or whether the current class drivers that are part of Windows and relevant to the device are gaining any significant improvement. This includes any newer settings that are available to the end-user so they have it working their way.

This can allow a user to rationalise the software that is running on their computer without worrying that they will lose the functions they are dependent on because they remove vendor-supplied software for that device. Similarly, they may want to know whether the installation of a device on a newer computer is going to be a true plug-and-play experience without the need to download and install any extra software. As well, users are then sure they won’t lose device functionality if the device vendor declares end-of-support on that device.

Microsoft is at least taking some steps towards improving the update experience for major updates within Windows in order to make them discoverable and user-friendly.

A call to attention now exists regarding videoconferencing platform security

Article

Zoom (MacOS) multi-party video conference screenshot

A call to action is now taking place regarding the data security and user privacy of video conferencing platforms

Privacy watchdogs urge videoconferencing services to boost privacy protections | We Live Security

From the horse’s mouth

Officer Of The Privacy Commissioner Of Canada

Joint statement on global privacy expectations of Video Teleconferencing companies (English / Français)

Press Release (English, Français)

Office Of The Australian Information Commissioner

Global privacy expectations of video teleconference providers – with open letter

Federal Data Protection And Information Commissioner (Switzerland)

Audio And Video Conferencing Systems – Privacy Resource factsheet (English, Français, Deutsch, Italiano)

Open Letter (PDF)

Information Commissioner’s Office (United Kingdom)

Global privacy expectations of video teleconference providers

Open Letter (PDF)

My Comments

Thanks to the COVID-19 coronavirus plague, we are making increased use of various videoconferencing platforms for our work, education, healthcare, religious and social reasons.

This has been facilitated through the use of applications like Zoom, Skype, Microsoft Teams and HouseParty. It also includes “over-the-top” text-chat and Internet-telephony apps like Apple’s Facetime, Facebook’s Messenger, WhatsApp and Viber for this kind of communication, thanks to them opening up or having established multi-party audio/video conferencing or “party-line” communications facilities.

Security issues have been raised by various experts in the field about these platforms with some finding that there are platforms that aren’t fit for purpose in today’s use cases thanks to gaping holes in the platform’s security and privacy setup. In some cases, the software hasn’t been maintained in a manner as to prevent security risks taking place.

As well, there have been some high-profile “Zoombombing” attacks on video conferences in recent times. This is where inappropriate, usually pornographic, images have been thrown up in to these video conferences to embarrass the participants with one of these occurring during a court hearing and one disrupting an Australian open forum about reenergising tourism.

This has led to the public data-protection and privacy authorities in Australia, Canada, Gibraltar, Hong Kong, Switzerland and the United Kingdom writing an open letter to Microsoft, Cisco, Zoom, HouseParty and Google addressing these issues. I also see this relevant to any company who is running a text-based “chat” or similar service that offers group-chatting or party-line functionality or adapts their IP-based one-to-one audio/video telephony platform for multi-party calls.

Some of these issues are very similar to what has been raised over the last 10 years thanks to an increase in our use of online services and cloud computing in our daily lives.This included data security under a highly-mobile computing environment with a heterogeny of computing devices and online services; along with the issue of data sovereignty in a globalised business world.

One of the key issues is data security. This is about having proper data-security safeguards in place such as end-to-end encryption for communications traffic; improved access control like strong passwords, two-factor authentication or modern device-based authentication approaches like device PINs and biometrics.

There will also be the requirement to factor in handling of sensitive data like telehealth appointments between medical/allied-health specialists and their patients. Similarly data security in the context of videoconferencing will also encompass the management of a platform’s abilities to share files, Weblinks, secondary screens and other media beyond the video-audio feed.

As well, a “secure by design and default” approach should prohibit the ability to share resources including screenviews unless the person managing the videoconference gives the go-ahead for the person offering the resource. If there is a resource-preview mechanism, the previews should only be available to the person in charge of the video conference.

Another key issue is user privacy including business confidentiality. There will be a requirement for a videoconferencing platform to have “privacy by design and default”. It is similar to the core data-security operating principle of least privilege. It encompasses strong default access controls along with features like announcing new participants when they join a multi-party video conference; use of waiting rooms, muting the microphone and camera when you join a video conference with you having to deliberately enable them to have your voice and video part of the conference; an option to blur out backgrounds or use substitute backgrounds; use of substitute still images like account avatars in lieu of a video feed when the camera is muted; and the like.

There will also be a requirement to allow businesses to comply with user-privacy obligations like enabling them to seek users’ express consent before participating. It also includes a requirement for the platform to minimise the capture of data to what is necessary to provide the service. That may include things like limiting unnecessary synchronsing of contact lists for example.

Another issue is for the platforms to to “know their audience” or know what kind of users are using their platform. This is for them to properly provide these services in a privacy-focused way. It applies especially to use of the platform by children and vulnerable user groups; or where the platform is being used in a sensitive use setting like education, health or religion.

As well it encompasses where a videoconferencing platform is used or has its data handled within a jurisdiction that doesn’t respect fundamental human rights and civil liberties. This risk will increase more as countries succumb to populist rule and strongman politics and they forget the idea of these rights. In this case, participants face an increased exposure to various risks associated with these jurisdictions especially if the conversation is about a controversial topic or activity or they are a member of a people group targeted by the oppressive regime.

Another issue being raised is transparency and fairness. Here this is about what data is being collected by the platform, how it is being used, whom it is shared with including the jurisdictions they are based in along with why it is being collected. It doesn’t matter whether it is important or not. The transparency about data use within the platform also affects what happens whenever the platform is evolved and the kind of impact any change would have.

The last point is to provide each of the end-users effective control over their experience with the videoconferencing platforms. Here, an organisation or user group may determine that a particular videoconferencing platform like Zoom or Skype is the order of the day for their needs. But the users need to be able to know whether location data is being collected or whether the videoconference is tracking their engagement, or whether it is being recorded or transcribed.

I would add to this letter the issue of the platform’s user-friendliness from provisioning new users through all stages of establishing and managing a videoconference. This is of concern with videoconference platforms being used by young children or older-generation people who have had limited exposure to newer technologies. It also includes efforts to make the platform accessible to all abilities.

This is relevant to the security and user privacy of a videoconferencing platform due to simplifying the ability for the videoconference hosts and participants to maintain effective control of their experience. Here, if a platform’s user interface is difficult to use safely. videoconference hosts and participants will end up opting for insecure setups this making themselves vulnerable.

For example, consistent and less-confusing function icons or colours would be required for the software’s controls; along with proper standardised  “mapping” of controls on hardware devices to particular functions. Or there could be a user-interface option that always exposes the essential call-management controls at the bottom of the user’s screen during a videocall.

This issue has come to my mind due to regularly participating in a Skype videoconference session with my church’s Bible-study group. Most of the members of that group were of older generations who weren’t necessarily technology-literate. Here, I have had to explain what icons to click or tap on to enable the camera or microphone during the videoconference and even was starting it earlier to “walk” participants through using Skype. Here, it would be about calling out buttons on the screen that have particular icons for particular functions like enabling the camera or microphone or selecting the front or back camera on their device.

At least the public-service efforts have come about to raise the consistent security and privacy problems associated with the increased use of videoconferencing software.

How to bring back the Up Next function on your Apple TV box

tvOS Apple TV with Up Next list

Personalised Up Next view shows what TV shows you are working through

Before Apple upgraded the tvOS operating system in your Apple TV set-top box to version 13, you used to see at the top row a photo-gallery view of shows you were working through from some of the content providers you set up with your Apple TV. This function, known as “Up Next” mainly happens with most broadcaster-operated video-on-demand services who have Apple TV client apps but doesn’t work with all other video-on-demand services like Netflix.

Here, you would see which episodes of these shows you were up to, including whether you were working through a particular episode of a show. That would be highlighted with a bar that indicates how much of the episode you have seen. This arrangement would actually represent your tastes properly.

The tvOS 13 upgrade replaced this with the ability for Apple to promote its own content or those it has strong business relationships with and promote it in a Hollywood fashion. Here, it didn’t really sit with some viewers who saw it as a form of TV advertising, especially if it is about content that really doesn’t reflect their tastes. It then led towards most of us who know what we are after heading to the video-on-demand services’ apps to find the content we are after or continue watching our favourite series.

tvOS 13.3 confirmed in Software Updates Screen

Your Apple TV must be running tvOS 13.3 for this to work

Thanks to user feedback, Apple has answered this problem properly by restoring the “Up Next” functionality as a user-selectable option for tvOS-based Apple TV devices when upgraded to tvOS 13.3. By default, this will happen when you are not using your Apple TV box with it downloading the upgrade from Apple’s servers, installing it and restarting.

How to set this up

Software update

tvOS Settings - System - Software Updates optionConfirm that the Apple TV is on tvOS 13.3 by selecting “Settings”, then “System” then “Software Updates”. Under the Apple TV logo, you will see the operating system version for your device. If it’s not up-to-date, select the “Update Software” item on that screen to commence updating to the latest version of tvOS.

Selecting the right option

tvOS Settings - Apps - TV screen

In the TV App settings menu (found in the Settings app under TV) is the Top Shelf option which you need to change to Up Next

Head back to the Settings menu on your Apple TV device, then select “Apps”. This will show a list of apps installed on your Apple TV device whose settings can be managed through the Settings menu. Highlight the TV app, which will show an Apple TV logo in a black rectangle, then select this app to adjust its settings.

tvOS 13.3 Top Shelf options description

On-screen description for the Top Shelf display options

Highlight the “Top Shelf” option, which will determine what appears at the top of your Apple TV’s main screen menu if you highlight the Apple TV icon. Select this option to toggle between the “What To Watch” option which shows the trailers and other Apple-driven recommendations, and the “Up Next” option which are the shows you are working through. In this case, make sure you are selecting “Up Next” to have what you had before the tvOS 13 update.

You may find that the “Up Next” view is out of sync with what you are viewing on the compatible video-on-demand services. But, as you use the regular apps for these services to continue watching your content, this view will update itself to what you watch now.

Why I support multiple accounts with online media endpoints at home?

Apple TV 4th Generation press picture courtesy of Apple

The Apple TV set-top box – an example of a popular online-media platform

It is so easy to think of the idea of one person associated with an account-based online media service that is run on a commonly-used online media device. The classic example of this is a smart TV or set-top box that is installed in the main living room. It also extends to smart speakers, Internet radios and network-capable audio setups that work with various online audio content services.

There is a reality that many adults will end up using the same device like the aforementioned smart TV. But a lot of online-media services like Netflix, the broadcast video-on-demand services run by the free-to-air TV broadcasters or online audio services implement user-account-driven operation so customers benefit from their subscription or user-experience personalisation like “favourite shows” lists. With these smart TVs or similar devices, you can only associate the device with one user account for each of these services. This assumes that one person owns and operates the device.

Dish Joey 4K set-top box press picture courtesy of Dish Networks America

Set-top boxes connected to TVs in common areas are used by many people

It is although Apple has started work with having one Apple TV device work with multiple Apple ID user accounts, leading towards concurrent operation of these accounts in tvOS 13. But, at the moment, this only works with Apple-provided online services that are bound to end-users’ Apple IDs.

This reality is driven by the rise in multi-generational households with adult children living under the same roof as their parents. That has come about due to strong financial pressures on young people driven by costly housing in major cities, whether owned or rented. It goes along with that long-time adult reality of maintaining personal relationships under the same roof, while other adults end up staying at the home of another person they are friendly with as a temporary measure. As well, younger adults are increasingly living in share-houses in order to split their living costs easily amongst each other.

Dell Inspiron 14 5000 2-in-1 - viewer arrangement at Rydges Melbourne (Locanda)

An online media account set up on a laptop, tablet or smartphone is typically set up for one user having exclusive use of that device

But a significant number of the accounts for the various online-media services are established on computing devices that are primarily or exclusively used by a single adult. Then a person may decide to register their online-media service account on a commonly-used online-media device to use their subscription or customisations there.

The problem that easily happens is that other people cannot operate their accounts for the same service on that same device thus losing the benefit of their customisations being valid at that device. Or if they do so, they have to complete a rigmarole of logging others out before they log in, with some services having a login procedure requiring you to enter usernames and passwords on the media device using that dreaded “pick-and-choose” method even if the service was set up using social sign-in.

What does the single account problem affect?

Netflix menu screen - favourites

Shows you have marked as “favourite” for your profile in your Netflix account

The situation can also affect the account that is associated with the commonly-used device in a number of ways. This is more so with the content recommendation engines that most online media services implement which help in the discovery of new content that may be of interest. The behaviour of these engines manifests in the form of a “recommended content” playlist that appears on the service’s homepage, the customer email that is sent out to each of the service’s customers with a list of recommended content or a content suggestion that appears at the end of content you were engaging with.

SBS On Demand - favourites screenshot

Another example of shows you have marked as favourite – this time on SBS On Demand

Here, you may have “steered” SBS On Demand’s content recommendation engine to bring up European thrillers due to you watching these shows. But someone else comes in with a penchant for, perhaps, Indian Bollywood content. They binge on episodes of this content and you end up with the recommended-content list diluted with Indian content.

SBS On Demand - recommendations screenshot

The recommended-content playlist like this one can be diluted when there is one account shared by many with different tastes like with SBS On Demand

Another area where this will affect is the list of favourite shows or currently-viewing series that these services keep. Here, you use these lists to identify where you are up to in a show or series you are viewing. Similarly, your member email may alert you to new seasons of your favourite series or if the show is to be removed from the service. But if you started working through a show or series on a computing device you exclusively use but want to continue it on the large-screen TV bound to someone else’s account, you won’t be able to do so unless you log in with your account to continue your viewing there.

In the same context, it doesn’t permit a user who is enjoying the content on the account associated with the commonly-used device to another device associated with their own account. This may be of concern if, for example, you commenced viewing of an episode of a binge-worthy series on the main TV in the house’s main living area but had to continue it on your 2-in-1 laptop in your bedroom because someone else wants to do something else.

Common workarounds

Using a setup like AirPlay, Chromecast or hard-wired connectivity to link your own computing device to the large-screen TV may be seen as a workaround for access to your account even if the set or main set-top device is associated with another account.

But this can yield problems like mobile devices not yielding a best-quality picture with a hard-wired connection or the existence of an Apple TV, Chromecast, Android TV setup or appropriate cable that is connected to the TV you want to use. Let alone it not being feasible to carry that desktop computer of yours around to the main TV to watch that Netflix show there using your account and its customisations. Or your smartphone or tablet going to sleep and interrupting your viewing due to it taking battery-conservation measures or simply running out of battery power.

You may find that connecting multiple set-top boxes or similar devices to the main TV with each one bound to different accounts may exist as another workaround. This is typically demonstrated by the use of a games console bound to its owner’s online media service accounts connected to a Smart TV that is bound to someone else’s online-media-service accounts.

But this can look very ugly, become less useable and you may not have enough HDMI ports on your TV or audio peripherals (soundbar, AV receiver) to cater for each set-top device bound to each individual household member’s accounts. It is made worse by most TVs having up to 3 HDMI inputs and most popularly-priced audio peripherals only having the one HDMI-ARC connection to the TV.

What can be done?

An online media service that works through a particular online media endpoint device could support multiple logins with the number being this side of 10.

Here, you could have an option to add or delete extra accounts to the online media-service interface as if you are managing your own account on that interface. The authentication process for adding accounts would be the same as for your own account, whether through supplying a username and password or transcribing an on-screen number in to the Website or mobile app for that service to enrol a limited-interface device.

A question that will come up is whether to have the accounts concurrently operating with the device exposing the customisations associated with each account on the same interface; or require the end-users to switch accounts for exclusive operation when they want to use their account.

Concurrent operation may be considered of relevance to, for example, a couple who watching their shows with each other whereas exclusive operation may come in to its own with an adult who watches their shows by themselves. This can also help with building out content recommendations or the online-media service keeping track of the popularity of a particular piece of content including how it is enjoyed.

What features can this add to online media consumption?

One feature would be the ability to easily enjoy the same content across different devices associated with your account, no matter whether they are exclusive to your account or not. This would benefit where you are working through the same content in different locations like hearing a playlist from that online music service in the car, or at home on the hi-fi; or watching that series on an iPad while you come home from work on the train then continuing it on the TV in the main lounge area at home.

Concurrent operation could also allow for an amalgamated content-choice experience, perhaps with separate menus or playlists for each person. It can extend to providing a list of common favourites or content recommendations that appeal “across the board”.

You also make sure that the content recommendations offered by the online media service reflect your content-consumption habits rather than be diluted by someone else’s choices. This is more so for music or video content that you enjoy and you want to discover similar content.

In some cases, you could have the ability to have the content-recommendation engine come up with content that appeals to the tastes represented by a group of accounts like a household rather than just one account. Such recommendations could be listed alongside account-specific recommendations lists.

Conclusion

What needs to be considered as the rise of online multimedia consumption occurs is the ability for multiple online media-service accounts to be used for the same service on the same device. This means that these services can work well with the reality of multiple-adult households such as couples or multi-generation households.

It then means that the service is personalised to each end-user’s tastes and the content recommendation system in these services reflects what they watch.

Voice-driven assistants at risk of nuisance triggering

Article

Amazon Echo on kitchen bench press photo courtesy of Amazon USA

A problem that showed up with the Amazon Echo’s always-listen behaviour was nuisance triggering for the laughter command

Voice control is no laughing matter | Videonet

My Comments

An issue that has been raised recently is the risk of a voice-driven assistant like Apple’s Siri, Amazon’s Alexa, Google’s Assistant or Microsoft’s Cortana being triggered inadvertently and becoming of nuisance value.

This was discovered with Amazon’s Echo devices where you could say “Alexa, laugh” and Alexa would laugh in response. But if this was said in conversation or through audio or video content you had playing in the background, this could come across very creepy. A similar situation was discovered in 2014 with Microsoft’s XBox when there was a voice-search functionality built in to in and you would wake it by saying “XBox on!”, This was aggravated if, for example, a TV commercial from a consumer electronics outlet was playing and the adman announced a special deal on one of these consoles by saying something like “XBox On Special” or “XBox On Saie” which contain this key phrase.

Similarly, we are starting to see “voice-driven search” become a part of consumer electronics and this could become of an annoyance whenever dialogue in a movie or TV show or an adman’s talking in a TV commercial could instigate a search routine during your TV viewing.

But there are some implementations of these voice assistants that don’t start automatically when they hear your “wake phrase” associated with them like “Alexa” or “Hi Siri”. In these cases, you would press a “call” button to make the device ready to listen to you. This typically happens with smartphones, tablets, computers or smart-TV remote controls.

On the other hand, some of the smart speakers like Google Home use a microphone-mute button which you would activate if there is a risk of nuisance triggering. In this mode, the device’s microphone isn’t active until you manually disable it.

Google Home uses a microphone-mute button to control the mic

Personally, I would still like to see some form of manual control offered as the norm for these devices, preferably in the form of a “call” button with a distinct tactile feel when pressed. Then you would see a different light glow or other visual cue when the device is ready to talk to. Here, the user has some form of control over when the device can listen to them thus assuring their privacy.

Here, the article underscored the role of speech as part of a user interface that integrated one of many different interaction types like touch or vision. This then provides different comfort zones that the user can benefit from when using the device and they then rely on what’s comfortable to them.

You could be using your phone to sign in to Facebook on the big screen

Article

Apple TV 4th Generation press picture courtesy of Apple

You could be able to log in to Facebook on this device using your smartphone’s Facebook client

Facebook Login Updated for tvOS, FireTV, Android | AdWeek SocialTimes

From the horse’s mouth

Facebook

Developer News Press Release

Improving Facebook Login For TV and Android

My Comments

A holy grail that is being achieved for online services is to allow users to authenticate with these services when using a device that has a limited user interface.

TV remote control

A typical smart-TV remote control that can only offer “pick-and-choose” or 12-key data entry

An example of this is a Smart TV or set-top device, where the remote control for these devices has a D-pad and a numeric keypad. Similarly, you have a printer where the only interface is a D-pad or touchscreen, with a numeric keypad only for those machines that have fax capabilities.

Here, it would take a long time to enter one’s credentials for these services due to the nature of the interface. This is down to a very small software keyboard on a touchscreen, using “SMS-style” text entry on the keypad or “pick-and-choose” text entry using the D-pad.

Facebook initially looked at this problem by displaying an authentication code on the device’s user interface or printing this code out when you want to use it from that device. Then you go to a Web-enabled computer or mobile device and log in to facebook.com/device and transcribe that code in to the page to authenticate the device with Facebook.

Here, they are realising that these devices have some role with the Social Web, whether to permit single sign-on, allow you to view photos on your account or use it as part of a comment trail. But they also know that most of us are working our Facebook accounts from our smartphones or tablets very frequently and are doing so with their native mobile client app.

But they are taking a leaf out of DIAL (DIscovery And Launch) which is being used as a way to permit us to throw YouTube or Netflix sessions that we start on our mobile devices to the big screen via our home networks. It avoids a long rigmarole of finding a “pairing screen” on both the large-screen and mobile apps, then transcribing a PIN or association code from the large screen to the mobile client to be able to have it on the TV screen,

This is where you will end up authenticating that big-screen app's Facebook login request

This is where you will end up authenticating that big-screen app’s Facebook login request

What Facebook are now doing for the 4th generation Apple TV (tvOS) and Android-based TV/video peripheral platforms (Android TV / Amazon FireTV) is to use the mobile client app to authenticate.

Here, you use a newer version of the Facebook mobile client, the Facebook Lite client or the Google Chrome Custom Tabs to authenticate with the big screen across the home network. The TV or set-top device, along with the mobile device running the Facebook mobile client both have to be on the same logical network which would represent most small networks. It is irrespective of how each device is physically connected to the network such as a mobile device using Wi-Fi wireless and the Apple TV connected via HomePlug AV500 powerline to the router for reliability.

What will happen is that the TV app that wants to use Facebook will show an authentication code on the screen. Then you go to the “hamburger” icon in your Facebook mobile client and select “Device Requests” under Apps. There will be a description of the app and the device that is wanting you to log in, along with the authentication code you saw an the TV screen. Once you are sure, you would tap “Confirm” to effectively log in from the big screen.

At the moment, this functionality is being rolled out to tvOS and Android-based devices with them being the first two to support the addition and improvement of application programming interfaces. But I would see this being rolled out for more of the Smart TV, set-top box and similar device platforms as Facebook works through them all.

Spotify login screen

This kind of single-sign-on could apply to your Smart TV

One issue that may have to crop up would be to cater for group scenarios, which is a reality with consumer electronics that end up being used by all of the household. Here, software developers may want to allow multiple people to log in on the same device, which may be considered important for games with a multiplayer element, or to allow multiple users to be logged in but with one user having priority over the device at a particular time like during an on-screen poll or with a photo app.

Another question that could be raised is where Facebook is used as the “hub” of a user’s single-sign-on experience. Here, an increasing number of online services including games are implementing Facebook as one of the “social sign-on” options and the improved sign-on experience for devices could be implemented as a way to permit this form of social sign-on across the apps and services offered on a Smart TV for example. It could subsequently be feasible to persist current login / logout / active-user status across one device with all the apps following that status.

Other social-media, messaging or similar platforms can use this technology as a way to simplify the login process for client-side devices that use very limited user interfaces. This is especially where the smartphone becomes the core device where the user base interacts with these platforms frequently.

Blu-Ray, HBBTV and app-based NAS systems can take documentary content further

Increasingly the Internet has been used as a “cyber-library” of information that is being used to create many interesting feature-length documentary films.

Wikipedia - could augment many of these documentaries

Wikipedia – could augment many of these documentaries

But most of these shows have been augmented by a micro-Website dedicated to the film, which may just contain some public-relations material like press releases. But some of these sites contain more detailed information on the topics covered in these films and/or provide a pathway to a “call-to-action” like engaging other entities that relate to the documentary’s subject. The classic example may be to have viewers contact a particular advocacy organisation for assistance if the subject relates to them personally; or to engage local, regional or national politicians to have the issue covered in the film raised by their government.

In some cases, the Website is the only resource used to keep the film’s viewers updated on the topic. This may be augmented with a site-based newsfeed or email list so viewers can keep “in the loop” with what is going on.

Similarly, there are other resources like the “reference sites” like IMDB, Wikipedia, Bible Gateway and the like which provide useful reference tools for viewers to use. Let’s not forget YouTube or Vimeo being used simply as a video repository for supporting video material.

But how can these resources be brought to the large screen?

The Blu-Ray Disc family of optical discs

Sony BDP-S390 Blu-Ray Disc Player

Blu-Ray players can provide pathways to online content

The DVD had opened up some ways content can be taken further thanks to providing a standardised way to add interactive content like a graphical menu tree along with the ability to package supporting video and image content. There is even the ability to provide supplementary audio tracks that have extra narration that can be played alongside the main audio track.

But the Blu-Ray disc family has taken this concept further with a few features that earn their keep with the documentary film.

Sony BDP-S390 Blu-Ray player remote control

A remote control that comes with a Blu-Ray player – a pathway to interactivity

One of these is BD-J which is a variant of Java written for Blu-Ray applications and can be run an all Blu-Ray players currently in use. This can allow for interactive content that is more than just a fancy menu, a photo gallery or some extra video material. For example, the “coloured” function buttons on every Blu-Ray player’s remote control could be exploited to allow the viewer to pull up “explain more” screens or movies if they need to understand concepts. A skilful Java programmer who is good at creating full-screen graphics could even create an experience not dissimilar to a computer game to highlight various concepts in a graphically-rich manner.

Another feature available to the Blu-Ray format is BD-Live which connects the Blu-Ray player to online resources. Here, this could range from a Web-hosted resource list through “download-to-view” movies and trailers that take it further. A BD-J script could exploit the RSS Webfeed associated with Webpages or blogs relevant to the film or show up the Wikipedia page about the topics of relevance. These same scripts can even provide pathways to advocacy Websites in a localised form or even provide that link to an online petition.

HBBTV and similar “broadcast + broadband” technologies

Panasonic VIERA AX900 Series 4K UHDTV press picture courtesy of Panasonic

HBBTV-capable TVs can provide the same level of rich interactivity with broadcast content

Another path for a lot of these shows to be exhibited is through broadcast TV, often with public-service broadcasters being associated with showing documentary and other allied content to inform the populace.

But in Germany and a large part of Continental Europe, along with Australia, Hybrid Broadcast Broadband TV is in full flight. This works with TVs or set-top devices that are connected to the broadcast-TV infrastructure (aerial, cable-TV or satellite dish) along with a broadband Internet connection. This standards-based setup allows broadcasters to transmit information that leads to access to interactive-TV content via the Internet with a focus on “lean-back” presentation.

These systems could make it feasible that a user can have access to the online resources while the content is being broadcast. This could be facilitated by using the so-called “red button” concept being implemented with interactive TV where users can bring up this content by pressing a red button on the remote control. But there will be a requirement to provide access to a simplified user experience such as using the coloured function buttons for direct access to the “calls to action” for example.

File-based media distribution

Thecus N5810PRO Small Business NAS press photo courtesy of Thecus

App-based NAS units that exploit RVU and HTML5 remote user interface can provide a high level of interactivity for these movies

If the content is to be delivered as file-based video, it may be about implementing an RVU-compliant media server and using a “file-of-files” like an ISO file or BitTorrent Bundle file to deliver video material along with a “lean-back-friendly” Web page that can be presented with this media server. An example of a server that could tick these boxes is the Plex advanced media server being made available to a few current-issue NAS units but this doesn’t implement RVU and HTML5 remote-user-interface technology nor does it allow for “file-of-files” delivery. Here, this issue will crop up if Vidity is being considered as a “sell-through” format for delivering file-based video content or if BitTorrent Bundles, part of the BitTorrent Now platform, are being valued as a way to deliver indie documentary content.

Where HTML5 is used skilfully, it could he feasible to create a highly-interactive media interface in the same guise as either a well-designed Website or Blu-Ray BD-J user interface. Again this leads to tapping in to external resources like the “reference hub” sites (Wikipedia, IMDB & co), the film’s Website or blog, “call-to-actions” and the like. There can also be the ability to use animations and other graphics to “tell more”, as well as ways to control playback of the film like “diving in” to particular portions or adding narration tracks.

What are the issues to be faced?

Handling the 10-foot lean-back user experience

The main problem with Webfeeds, Wikipedia and the like is that these resources are typically formatted in a “lean-forward” manner associated with working with a tablet, laptop or desktop computer. But these resources may not appeal to the 10-foot “lean-back” viewing experience associated with watching TV and video content on the household TV set.

The traditional “lean-forward” layout for computer use involves a “dark-on-light” colour scheme that doesn’t really work well for the large screen, the use of serif typefaces in the copy text that can be hard to read from a distance along with a navigation experience that is focused towards a touchscreen or a keyboard and mouse rather than a D-pad on a remote control.

It is compared to the “lean-back” experience where larger bright sans-serif text is set against a dark background and any highlighting is made more distinct. There is the expectation that the user interface has to be navigated with one hand using the D-pad on a remote control. The same experience can also be achieved if one used a projector to show a Website or similar interface to a group of people such as in a boardroom.

But most of these attributes are being shared by mobile-compatible user interfaces as viewed on a smartphone due to the requirement for reduced clutter and the ability to be operated by one hand.

The problem could be answered through the use of “application-specific” interfaces dedicated to presenting the interactive content in a 10-foot experience. Here, a resource like a blog or a Wikipedia article would need to be presented in a market-up text form. Then a BD-J interface for a BD-Live Blu-Ray Disc, or an HTML5 or RVU interface Website that accompanies a file-delivered film package would be used to “set” these external resources to a 10-foot user interface.

Similarly, the definition for “responsive” or “adaptive” Website design or user interfaces could encompass a variation for 10-foot lean-back applications. This is where a Website could be required to work on a regular computer’s screen, a smartphone, a tablet or a TV screen with the variation being described as “large-screen” or “lean-back”,

Conclusion

As independent and other filmmakers build out documentary content especially with the help of the Internet, it could become feasible to use the Internet and interactive-content technologies as a way to provide more detailed information with these shows that the viewer can summon. It can also allow the filmmakers to build up a call-to-action for their viewers while the film is fresh in their minds.

A way to improve mobile-device lock-screen management

Samsung Galaxy Note 2 smartphone

Basic “essential-data” lockscreen (provided by ICE)

All mobile devices like smartphones and tablets will maintain a lock-screen which you interact with to unlock the device in order to use it. This is a security measure and also to avoid accidentally making calls or sending messages which can lead to embarrassment or a dint in you pocket due to long phone calls.

But there are situations where you need to maintain a lock-screen as a display or “instant-access” screen where you don’t necessarily have to unlock your phone. This can be either to display certain incoming messages, provide quick access to adjustments like operating modes (sound modes, flight mode, etc) or even provide access to emergency information. Even something like being “wired for sound” and listening to music from your smartphone may require you to have access to the controls for your music-player software to start and stop the music.

Android main interactive lock screen

Main interactive lock screen on Android where you enter the PIN

Some Android applications like ICE create another lock-screen for direct access to their functionality, with a widget or slider that drops through to the main interactive lock-screen where you enter your PIN. These app-created lock-screens can interfere with your phone’s normal behaviour, especially if you are starting to use your phone or putting it through a shut-down and restart cycle.

What could be implemented would be a two-level lock-screen. Here, when you “wake up” your phone, you see a “first-level” screen with widgets and display information that you need to be able to interact with at all times such as emergency contact information, notifications, operating-mode selection, and music player or torch control. Then a slide gesture or a slider widget leads to the “main” lock-screen where you enter your PIN to gain access to the phone’s main screen. This level could also have one or more widgets or information panels alongside the PIN keypad.

Most mobile operating systems could implement this through a multiple-page lock-screen as well as a notification screen which shows up when the device isn’t interacted with for a long time. The apps would then show icons or publish detailed information on the notification screen and provide widgets for the lock-screen as well as the home screen if the platform supports it. These widgets and their existence can be configured through a lock-screen configuration option similar to a home-screen configuration option.

This can also open up the option of creating environment-specific lock-screens such as a music-focused lock-screen when you have your headphones or another audio device plugged in to your phone or have it paired with a Bluetooth audio device. Or a “smart-home” app could be made available when you are connected to your home network.

I see this ideal as a way to extend what a smartphone is about – something that you can customise for your own needs/

Windows 10 Start Menu–not your father’s old station wagon

Windows 10 Start Menu

Start Menu in Windows 10 – the pop-up look from Windows 7 with the tiles from Windows 8

Windows 7 and its predecessors had a traditional pop-up start menu with an option to see all the programs or the frequently-used programs on your computer. This was presented in a list rather than a cluster of icons or tiles.

But Windows 8 headed down a totally different path with a dashboard-style layout hat has all of the programs or a user-defined set of programs represented as tiles. This had thrown many computer users off the operating system and caused some unnecessary worry.

The Start Menu

Windows 10 brought back the pop-up Start Menu that looks like a combination of the traditional Start menu and Windows 8’s tile-based look. This includes the famed “Live Tiles” that are always updated with new content thus working like a dashboard.

In the early days of your experience with Windows 10, you can mess around getting that tile-based Start Menu area looking how you want. If you run Windows 10 on a touchscreen laptop or a computer with a touchscreen monitor, this menu style can work just as well for you.

Getting it right!

You can organise your tiles in to groups by dragging them in to the space between two groups to create a group or dragging them in to a group to have them part of that group. This can be done in both the traditional pop-up view and the Tablet Mode view mentioned later on at the end.

Then you can name each group by right-clicking or “dwelling” your finger on the group name then typing in the name you want to give it.

Browsing for that program

Windows 10 Start Menu - All Apps highlighted

Looking for that program – click All Apps on the Start Menu

This will be a situation for those of you who have held out with Windows 7 or its predecessors, where you will be wanting to know where all of your programs have gone even though they aren’t on the Start Menu or Taskbar.

Browsing for that particular program? Click on “All Apps” to see a list of all programs on your computer. Then, click on any of the letters to bring up a list of alphabetical letters. Subsequently, you just need to click on the first letter of the program’s title to be sent straight to a list of the programs beginning with that letter.

You then have two options to have your program readily accessible. One is to “pin” your program to the Taskbar so it is always accessible and this setup may remind you of the station-preset buttons on your car radio. On the other hand, you could “pin” your program to the Start Menu where it will appear as a tile which you shift around until it is in the right place for you.

Tablet Mode

Windows 10 Tablet Mode

How Windows 10 looks when you use Tablet Mode

The Tablet Mode gives you a view that is not dissimilar to how you have operated your Windows 8 or Windows 8.1 computer. It is automatically selected if you detach a keyboard from your detachable-style “2-in-1” tablet or fold over a convertible notebook so the screen becomes a tablet. But you can manually select this mode on any Windows 10 computer.

Windows 10 Notification Menu buttons wiht Tablet Mode highlighted

How to select Tablet Mode manually

As I have said just before, this doesn’t just those of you who work with tablet computers or 2-in-1 devices. You can use it with a laptop or desktop computer and it doesn’t need a touchscreen to benefit from this function. Rather you would use your mouse or trackpad to navigate around the screen and a scroll-enabled mouse earns its keep by allowing you to scroll downwards. In the Notification Menu, you have a button labelled Tablet Mode which you can use to toggle between this mod and the regular Desktop Mode.

I would recommending having your screen in the Tablet mode if you are trying to sort out the Start Menu groups after an upgrade because you can use the whole of your screen’s real estate to do this.

Search Bar

There is an always-visible Search Bar on the Taskbar which you can fill in your search requests for local or Web-hosted resources. This works with Cortana which is the personal digital assistant in the same vein as Siri or Google Now.

Here, ordering a search is as simple as clicking or tapping on the search area and typing in what you are after.

Conclusion

Anyone who has worked with any of Windows’ incarnations will find the Windows 10 Start Menu as something that doesn’t daunt you but allows you to get more out of the operating system.