Category: Content Creation

Questions are being raised about generative artificial intelligence

What is AI

Artificial intelligence is about use of machine learning and algorithms to analyse data in order to make decisions on that data. It is more so about recognising and identifying patterns in the data presented to the algorithm based on what it has been taught.

This is primarily used with speech-to-text, machine translation, content recommendation engines and similar use cases. As well, it is being used to recognise objects in a range of fields like medicine, photography, content management, defence, and security.

You may find that your phone’s camera uses this as a means of improving photo quality or that Google Photos uses this for facial recognition as part of indexing your photos. Or Netflix and other online video services use this to build up a “recommended viewing” list based on what you previously watched. As well, the likes of Amazon Alexa, Apple Siri or Google Assistant use this technology to understand what you say and create a conversation.

What is generative AI

Generative artificial intelligence applies artificial intelligence including machine learning towards creating content. Here, it is about use of machine learning, typically from different data collections, and one or more algorithms to create this content. It is best described as programmatically synthesising material from other material sources.

This is underscored by ChatGPT and similar chatbots that use conversational responses to create textual, audio or visual material.  This is seen as a killer app for generative AI. But using a “voice typeface” or “voice font” that represents a particular person’s voice for text-to-speech applications could be a similar application.

Sometimes generative AI is used as a means to parse statistical information in to an easy-to-understand form. For example, it could be about an image collection of particular cities that is shaped by data that has geographic relevance.

The issues that are being raised

Plagiarism

Here, one could use a chatbot to create what apparently looks like new original work with material from other sources without attributing the content creators for the material that existed in these sources.

Nor does it require the end-user to make a critical judgement call about the sources or the content created or allow the user to apply their own personality to the content.

This affects academia, journalism, research, creative industries and other use cases. For example, education institutions are seeing this as something that impacts on how students are assessed, such as whether the classic written-preferred approach is to be maintained as the preferred approach or to be interleaved with interview-style oral assessment methods.

Provenance and attribution

It can also extend to identifying whether a piece of work was created by a human or by generative artificial intelligence and identifying and attributing the original content used in the work. It also encompasses the privacy of individuals that appear in work like photos or videos; or where personal material from one’s own image collection is being properly used.

This would be about, for example, having us “watermark” content we create in or export to the digital domain and having to identify how much AI was used in the process of creating the content.

Creation of convincing disinformation content

We are becoming more aware of disinformation and its effect on social, political and economic stability. It is something we have become sensitised to since 2016 with the Brexit referendum and Donald Trump’s election victory in the USA.

Here, generative artificial intelligence could be used to create “deepfake” image, audio and video content. An example of this being a recent image of an explosion at the Pentagon, that was sent around the Social Web and had rattled Wall Street.

These algorithms could be used to create the vocal equivalent of a typeface based on audio recordings of a particular speaker. Here, this vocal “typeface” equivalent could then be used with text-to-speech to make it as though the speaker said something in particular. This can be used as a way to make it as though a politician had contradicted himself on a sensitive issue or given authority for something critical to occur.

Or a combination of images or videos are used to create another image or video that depicts an event that never happened. This can involve the use of stock imagery or B-roll video mixed in with other material.

Displacement of jobs in knowledge and creative industries

Another key issue regarding generative artificial intelligence is what kind of jobs this technology will impact.

There is a strong risk that a significant number of jobs in the knowledge and creative industries could be lost thanks to generative AI. This is because the algorithms could be used to turn out material, rather than having people create the necessary work.

But there will be a want in some creative fields to preserve the human touch when it comes to creating a work. Such work is often viewed as “training work” for artificial-intelligence and machine-learning algorithms.

It may also be found that some processes involved in the creation of a work could be expedited using this technology while there is room to allow for the human touch. Often this comes about during editing processes like cleaning-up and balancing audio tracks or adjusting colour, brightness or contrast in image and video material with such processes working as an “assistant”. It can also be about accurately translating content between languages, whether as part of content discovery or as part of localisation.

There could be the ability for people in the knowledge and creative industries to differentiate work between so-called “cookie-cutter” output and artistic output created by humans. This would also include the ability to identify the artistic calibre that went in to that work.

The want to slow down and regulate AI

There is a want, even withing established “Big Tech” circles, to slow down and regulate artificial intelligence, especially generative AI.

This encompasses slowing down the pace of AI technology development, especially generative AI development. It is to allow for the possible impact that AI could have on society to be critically assessed and, perhaps, install “guardrails” around its implementation.

It also encompasses an “arms race” between generative-AI algorithms and algorithms that detect or identify the use of generative AI in the creation of work. It will also include how to identify source material, or the role generative AI had in the work’s creation. This is because generative AI may have a particular beneficial role in the creation of a piece of work such as to expedite routine tasks.

There is also the emphasis on what kind of source material the generative AI algorithms are being fed with to generate particular content. It is to remind ourselves of the GIGO (garbage in, garbage out) concept that has been associated with computer programming where you can’t make a silk purse out of a sow’s ear.

What can be done

There has to be more effort towards improving social trustworthiness of generative AI when it comes to content creation. It could be about where generative AI is appropriate to use in the creative workflow and where it is not. This includes making it feasible for us to know whether the content is created by artificial intelligence and the attribution of any source content being used.

Similarly, there could be a strong code of ethics for handling AI-generated content especially where it is used in journalism or academia. This is more so where a significant part of the workload involved in creating the work is contributed by generative AI rather than it being used as part of the editing or finishing process.

Emiko is an example of how you can deal with online trolls

Article

Why Emiko is forgetting the trolls and passing on her love of food to her daughters instead – ABC Everyday

Previous coverage on HomeNetworking01.info

Constance Hall puts trolling and bullying in the TV spotlight on Dancing With The Stars

What can you do about people who use the Social Web to menace

Dealing with Internet trolls

How can social media keep itself socially sane?

My Comments

I had come across another personality who had to do battle with online bullies and trolls and she and her fan base turned it around for good.

Emiko Davies is a food writer of Japanese heritage who writes for newspaper lifestyle supplements as well as running an online presence about food. She has two daughters that are part of her food culture with one that has a large body frame.

There was an instance that she documented as part of an interview with Everyday, the ABC’s online lifestyle site. This was where Emiko’s large-bodied daughter was fat-shamed by online trolls, with Emiko being accused of not doing things right as a parent even though she is encouraging an enjoyment-of-food culture.

But, what I liked here was that an army of her online followers jumped in to defend Emiko, her daughters and her food culture. This took Emiko’s mind away from dealing with the perils of online life and led to most of these trolls deleting the comments they had posted.

It also led to Emiko changing her online-presence policy by limiting comment-writing privileges to followers and not sharing content about her children in the online space. Here she was able to rely on her followers as an army of defenders and to use the content-management tools and policies wisely to limit bad behaviour online.

But it also showed up an issue amongst the trolls as not having a healthy relationship with their food or bodies. This was drawing on an unhealthy culture where people who have a large body frame are frequently denigrated while their isn’t much positive content about these people, especially large-bodied children, engaging in joyful activities relating to food like cooking.

It is also driven by the diet culture and a vanity culture amongst women where the “hourglass figure” is considered the ideal look. As well, large-framed people aren’t really portrayed as significant heroes in popular fiction, especially juvenile fiction. There is a reality that some men and women who look large aren’t necessarily fat with this coming about because of ethnic origins or other factors or how one’s body shape changes over our lives.

Some of these accounts are showing up how a group of loyal followers for an online creator can act as their army especially when dealing with online bullying and harassment. It takes the heat off the online creator’s mind and allows them to continue to create good content. In some cases, it can also expose particular hurts that are taking place within our society.

Google to provide privacy-focused object blurring as an open-source tool

Article

Google is making its internal video-blurring privacy tool open source | Engadget

My Comments

There are objects you have to be careful of when you photograph them for the public Web. What I mean by that is public-facing social media accounts, blogs or similar use cases where the general public would see the content; or images being offered as stock photos for anyone to illustrate material with.

Such objects are things like vehicles with their registration (license) plates or documents that lie in the scope of a picture and they can easily be considered personally-identifiable information. Even tattoos on a person could be considered identifiable unless they are a common design.

What Google has done and is publishing as open-source is a software algorithm that follows an object like a vehicle’s number plate and blurs that object. This could happen not just in photos but in videos where that object is moving. Here, it avoids the risk of that kind of information being indexed by a search engine with optical-character-recognition abilities.

This can also come in to its own where an email address, Web link or QR code is part of an image and there is the desire to control the use of this data by people who see the image on the Internet or on TV.

It is being pitched towards creators or journalists who want to blur out personal-identifying information whether that be of themselves, their premises or people they know for content destined for the public Web. Typically this workflow will be in the form of creating and editing a “public copy” of the image they took and using that on the Website or social-media account.

But there may be some use cases where an identifier is required to be visible in the published photo. For example, when a vehicle is put on the market, having a visible registration number in the accompanying images of that vehicle in the online ad is an asset for buyers when it comes to checking that vehicle’s provenance.

What I would like to see with this software is for it to be repackaged as a free plugin for photo and video editing software. Or, better still, more photo/video editing software developer being encouraged to “bake” the privacy-blurring code in to a major version of that software.

USB microphones or traditional mics for content creation?

Blue Yeti Nano USB microphone product image courtesy of Logitech

Blue HYeti Nano – an example of a USB microphone pitched at podcasters

Increasingly as we create and post content online, we are realising that microphones are becoming a valuable computer accessory for recording or broadcasting our voices or other live sound. This is more so where we are making podcasts or videos or even streaming video games with our own commentary, with this kind of content creation becoming a viable cottage industry in its own right.

Even videoconferencing with Zoom and similar software has had us want to use better microphones so we can be heard clearly during these videocalls. This was important while stringent public health measures were in place to limit the spread of the COVID coronavirus plague but is now coming in to play with hybrid (online and face-to-face) work and education settings that we are taking advantage of.

What we are realising is that the integrated condenser microphone in your laptop computer or Webcam isn’t really all that up-to-scratch for this kind of content creation. This is similar to the days of the cassette recorder where people who aspired to make better live recordings stopped using their tape recorder’s built-in microphone and used a better quality external microphone.

But there are two ways of connecting an external microphone to your computer – USB port or a traditional microphone input.

USB microphone

Lenovo Yoga 2 Pro convertible notebook Right-hand side - Power switch, Volume buttons, 3.5mm audio jack, USB 2.0 port

The USB port on most regular computers is what you would plug a USB microphone into for plug-and-play recording

The USB microphone has at least one microphone element directly connected to an integrated audio interface. This converts the sound picked up by the microphone into a digital form useable by the host computer.

Some of these microphones have an audio-output function which feeds a headphone jack so you can monitor what you are recording or broadcasting with a set of headphones. You may even find that some USB microphones have a microphone-level analogue audio output so you can connect them to a traditional audio device rather than just a computer.

All of the USB microphones present to the host computing device as a standard USB Audio input device with those with headphone outputs also presenting the headphone jack as a standard USB Audio output device. This means that the USB Audio class drivers supplied with your computer’s operating system are used to enable these microphones without the need for extra software to be installed on the computer.

An increasing number of manufacturers will often supply audio-processing software that performs equalisation, level control or dynamic-range control on the host computer. Or the digital-audio recording software that you use on your computer will be able to do this function for you. All of this audio processing happens in the digital domain using your computer’s CPU or GPU.

The integrated audio interface allows designers of these USB microphones to set up a sophisticated array of multiple microphone elements in these microphones. This would allow for them to work as one-point stereo microphones or use microphone-array techniques to determine their sensitivity or pickup pattern. You may find that you determine how these sophisticated microphones operate through manufacturer-supplied software or perhaps a hardware switch on the microphone.

Traditional microphone

Behringer UlltraVoice XM8500 microphone product image courtesy of Behringer

The Behringer UltraVoice XM8500 microphone – an example of a traditional microphone

The common traditional microphone makes the sound that it picks up available as a low-level analogue signal. They are designed to be connected to an amplifier, recording device, mixing desk or other audio device that has an integrated microphone amplifier circuit.

This would be either a balanced or unbalanced signal depending on whether the microphone is for professional or consumer use. It is although most value-priced professional-grade mono dynamic microphones typically pitched for PA and basic recording use can work as balanced or unbalanced mics. That is thanks to the mic’s cable connected to the mic itself via an XLR plug even though the cable would plug in to the equipment using a 6.35mm mono phone plug.

There are electret-condenser microphones that work in a different way to the common dynamic microphone but these are dependent on a power source. This is typically provided by a battery that is installed in the microphone or through the associated equipment offering “phantom power” or “plug-in power” to these microphones via their cable.

If you use a traditional microphone with your computer, you would need to use an audio interface of some sort. The traditional sound card installed in a desktop computer or some basic USB audio interfaces that you use with your laptop computer would offer a 3.5mm phone-jack microphone input which would be mono (2-conductor) at least or may be stereo (3-conductor) so you can use a one-point stereo mic. These could work well with a wide range of microphones that have this connection type, typically those pitched at portable-recorder or home-video use.

Then the better USB audio interfaces would offer either at least one microphone input in either a 6.35mm phone jack or three-pin XLR socket, most likely offering a balanced wiring approach. You can still use a mic that has a 3.5mm phone plug if you use an adaptor that you can buy from an electronics store.

Shure X2U USB audio interface product image courtesy of Shure

Shure X2U USB audio interface that plugs in to the XLR socket on a common traditional microphone

Let’s not forget that a significant number of microphone manufacturers offer USB audio interfaces that plug in to their microphone’s XLR socket. These adaptors such as the Shure X2U are powered by the host computer USB interface and, in a lot of cases, provide the “phantom power” needed by electret-condenser microphones.

It is also worth noting that the better quality USB audio interfaces will do a better job at the sound-handling process and will yield a high-quality signal. This is compared to the audio interface in your laptop computer or Webcam, or baseline soundcards and USB audio modules which may not make the mark for sound quality.

For a long time there have been traditional one-point stereo microphones but most of them have been pitched at hobbyist or consumer use with stereo tape recorders. Most such microphones use a hardwired cable with a 3.5mm stereo phone plug or a 5-pin standard DIN plug if the recorder has a stereo microphone socket, or two 6.35mm or 3.5mm mono phone plugs if it has a pair of mono microphone sockets. But some professional stereo microphones have a 5-pin XLR or Neutrik connection and come with a breakout cable that has two XLR plugs to connect to a pair of microphone inputs.

What microphone type suits your application better

A USB microphone is valuable for laptops or small desktop computers and is only intended where you are using the software on your computing device to record or broadcast.

You may end up getting more “bang for your buck” out of a USB microphone purchase due to the integrated audio-interface design that they have. This may be of value to people starting out in podcasting or similar audio-recording and broadcasting tasks and want a low-risk approach. As well, you may find them easy to set up and use with your computer especially where the microphone relies on class drivers supplied by the operating system rather than proprietary driver software.

USB microphones are considered to be more portable because you don’t need to carry a USB audio interface with you when you intend to record “on the road” with your computer.

Another advantage is that you have a very short low-level unbalanced analogue audio link between the microphone elements and the signal-processing electronics, This means that you end up without the risk of AC hum or other undesirable noise getting in to your recording due to a long unbalanced low=level audio link.

You may find it difficult to use a USB microphone with a digital camera or camcorder. This is because not many of them provide USB Audio device support for microphones and similar devices and they may not eve have a host-level USB connection for any peripherals. Similarly, you may find it difficult to use them with most mobile-platform devices because of the way some versions of iOS or Android handle them.

A traditional microphone with a common connection type excels when it comes to versatility. This is more important where you intend to use them with a wide range of audio devices like recording equipment or mixing consoles. Similarly they excel when it comes to microphones that have particular sensitivity and audio characteristics out of the box.

It also comes in to its own when you want to record with a tape recorder or other standalone recording device to assure recording reliability. This use case includes the use of external microphones with your video equipment to have better sound on your video recordings.

Some users may find that connecting traditional mics to their computer via a mixing console of some sort may give them better hands-on control over how their recordings or broadcasts will sound. Here, you may find that some of the newer mixing consoles are likely to have their own USB audio interface to connect to a computer especially if they are more sophisticated. As well, some users who have used mixing desks or standalone recording devices frequently will find themselves at ease with this kind of setup. This is because these devices offer the ability to adjust the sound “on the fly” or mix multiple microphones and audio sources for a polished recording or broadcast.

Conclusion

A cardinal rule to remember is that you will end up having to spend a good amount of money on a good-quality microphone if you are wanting to make good-quality recordings or online broadcasts. No digital processing can make a silk purse out of a sow’s ear when it comes to audio recording.

Here, the USB microphone will come in to its own if you are just using a computer. On the other hand, a good-quality traditional microphone used with a USB audio interface could answer your needs better if you want pure flexibility.