AMKTG 454 ADVERTISING Belch_13e_PPT_Ch18

Frank Tian Xie ่ฌ็ฐ
1.1K followers
15 Video ViewsยทSep 18, 2024
AMKTG 454 Belch_13e_PPT_Ch18
Hello everyone.
Welcome to Marketing 454, Advertising and Promotion.
This is chapter 18, chapter 18.
In this chapter, let's talk about how
to measure the effectiveness of promotional program,
measuring the effectiveness of promotional program.
These are the learning objectives.
I want you to read that.
And there are arguments for and against
measuring the effectiveness of promotional programs.
The reasons to measure that include
you can measure that to avoid costly mistakes.
You can evaluate alternative strategies.
You can increase advertising efficiency.
And you can determine if objectives are achieved.
But there are also reasons not to measure,
not to measure effectiveness because of costs involved,
the research problems, and disagreement on what to test.
And also objections of the creative department,
the creative people, for lack of time.
So there are arguments for and against
measuring the effectiveness.
And this figure shows the effectiveness
creative does contribute to campaign effectiveness.
This one shows that the ad quality is believed,
the survey to be believed to be contributing to sales changes,
52% people believe that.
The media plan, 13%.
Others, like 35%.
So this study shows that.
To conduct research on measuring advertising effectiveness,
you know what to test.
What do you want to test the effectiveness of advertising?
You can test the source factors, the source factors,
the spokesperson.
You can test the message variables,
message variables, different type of messages,
different messages.
You can test your media strategies,
how you use media, the media option, vehicle option,
source effect, which media vehicle you use.
There's a differential impact of advertising exposure
on the same audience, depending on media option used.
Or you can test on the budgeting decisions, budgets.
Second is, when do you do the test?
When do you want to do the test?
Test measures the effectiveness of advertising.
All test measures classified according
to when they are conducted.
We can do pre-test and post-test.
Pre-test and post-test.
Pre-tests are that the measures taken
before campaign is implemented.
Post-tests occur after ads or commercial
has been in the field.
There is a variety of pre-tests and post-tests available,
and each has its own methodology.
Here's some examples of classifications
of testing methods.
You can do pre-tests.
You can do lab methods, lab tests.
And you can do field tests.
Pre-tests in lab methods include consumer juries.
You can gather consumer juries to do the test.
You can use a theater test.
You can use a readability test, readability of the ad copy.
Portfolio tests, you can do a rough test,
test on the draft.
Comprehension and reaction tests, comprehension test.
You can use physiological test measures.
And you can do concept tests.
You can use the field methods to do that,
like a dummy advertising vehicle.
Use a dummy advertising vehicle to do tests.
You can use on-air tests, on-air tests,
or online theater tests, field tests.
In post-tests, they're mostly done in the field,
using field methods.
You can do recall tests, how much you can recall,
things you can recall.
Single-source system tests, recommendation tests,
if they can recognize that, association measures,
inquiry tests, and tracking studies.
A lot of methods available and being used.
Where to test, where to test.
Basically, you can do the test in the lab or in the field.
Lab tests, people brought to location
where they are shown in the ad or the commercial,
but there's a lack of realism results in testing bias.
People may scrutinize the ads much more closely
than they would at home,
because they're in the lab.
They think of themselves as experts on that.
Field tests, tests under natural viewing situations.
It's carried out with realism, noise, distractions,
and conforms of home.
And account for reflect effects,
account for effects of repetition, program content,
presence of competitive messages.
Because the repetition, program content,
and competitive messages,
those effects are accounted for by field tests.
And how to do the test, how to do the test.
Yeah, you can use a positioning,
advertising, copy, testing tool.
It's called a PACT, positioning, advertising, copy tool.
Improves the research used in preparing and testing ads
by providing a better creative product for clients
by controlling the cost of TV commercials.
Making measurement makes sense.
It's a joint effort to make digital media measurements
comparable to those of traditional media,
while still evaluating the unique value of interactivity.
That's how you do the test.
Here is the positioning, advertising, copy test,
or PACT is about.
One, provide measurements that are relevant
to the objective of advertising.
Two, second, it requires agreement
about how the results will be used
in advance of each specific test.
Three, it provides multiple measurements
because the single measurements are not adequate
to assess ad performance.
And four, it be based on a model
of human response to communications.
The reception of a stimulus,
the comprehension of the stimulus,
and the response to the stimulus.
Five, allow for consideration
of whether the advertising stimulus
should be exposed more than once.
Six, require that the more finished a piece of copy is,
the more soundly it can be evaluated
and require as a minimum
that alternative executions be tested
in the same degree of finish.
Number seven of PACT, it provides controls
to avoid the biasing effects of the exposure contacts.
Number eight, it take into account
basic considerations of sample definition.
And number nine, PACT demonstrates
the reliability and validity.
So this is what is used by the industry people, okay?
There are some guiding principles of digital measurement.
The digital measurement of effectiveness, right?
Principle number one,
move to a viewable impression standard
and count real exposure online, okay?
There's a movement to viewable impressions.
Principle number two,
online advertising must migrate to currency
based on audience impressions,
not gross impressions, okay?
Principle number three,
because all ad units are not created equal,
we must create a transparent classification system.
Principle number four,
determine interactivity metrics that matter
for brand marketers so that marketers
can better evaluate the online's contribution
to brand building, okay?
And principle number five,
digital media measurement must become
increasingly comparable and integrated with other media.
That was just some guiding principles
for digital measurements, right?
Digital measurement.
Let's talk about the testing process,
concept testing, concept generation testing.
Concept testing is conducted by very early
in the campaign development to explore
consumers' response to a potential ad or campaign.
When you have some initial concept,
you can test to see which one is better, okay?
It may just be a headline or a rough sketch.
You can use folks groups and mall intercepts, okay?
Online folks groups are becoming more common
form of concept testing like this one is doing, all right?
And for concept testing,
the objective here is to explore consumers' response
to various ad concepts,
as expressing words, pictures, or symbols.
The method that you want to use is,
you can use alternative concepts,
and they're being exposed to consumers
who match the characteristic of the target audience.
Reactions and evaluations of each are solved
through a variety of methods,
including folks groups, direct questioning,
and survey completion.
Sample sizes vary depending on the number of concepts
to be presented and the consensus of the responses.
The output of concept testing is qualitative
or quantitative data,
evaluating and comparing alternative concepts, okay?
And there are some weaknesses
associated with the folks group research, okay?
The results are not quantifiable,
sometimes, most times.
Sample sizes are too small
to generalize to larger populations.
Group influences may bias participants' responses, okay?
One or two members of the group
may steer the conversation or dominate the discussion.
That's what you do now.
You want to avoid that, avoid that, okay?
Consumers become instant experts, so-called experts.
Members may now represent the target market.
A folks group participant, a certain type of person, okay?
Results may be taken to be more representative
and or definitive than they really are,
so they may not be representative, okay?
That's weakness associated with the folks group, okay?
Rough test, rough test, copy test, and commercial testing.
You can do comprehension and reaction tests
that assess if ad conveys intended meaning.
Does your ad really convey
what you intended to say, to mean?
Assess the reaction an ad generates
to ensure it is not offensive, okay?
You use consumer jury.
That consumer jury uses consumers
to represent the target market
to evaluate the probable success of the ad.
Here's some rough testing terminology here, right?
An animatic rough, it's like a succession
of drawings, cartoons, it's rendered artwork
with still frames, stimulated movement,
panning, zooming of frame, rapid sequence, okay?
You can use a photomatic rough,
like a succession of photographs,
real people, scenery, still frame, stimulated movements,
panning, zooming of frame, rapid sequence there.
Or you can use a live action rough.
You can use live motion, okay?
Stand-in, non-union talent, non-union crew,
limited props, minimal obstacles, location settings.
Okay, or you can use finished commercial use,
like live motion animation, highly paid union talent,
full union crew, exalted props,
studio sets, special effects, et cetera.
Yes, in terminology, it's a rough testing, okay?
Consumer juries.
The objective of consumer juries
is to potentially where the consumers are asked
to evaluate ads and give their reactions to an evaluation.
Of the ads.
When two or more ads are tested,
viewers are usually asked to rate or rank other ads
according to their preferences, okay?
The message is that the respondents are asked
to view an ad and rate them
according to either the order of merit method
or the pair, the comparison method.
In the former, in the order of merit method,
the respondents decide to view the ad
and then rank them from one to five to N
according to their perceived merit.
In the paired comparison ad,
ads are compared only two at a time, right?
Each ad is compared to every other ad in the group
and the winner is listed.
The best ad is that which wins the most times.
Consumer juries typically employ 50 to 100 participants,
and jury members.
The output of consumer juries
and the overall reaction to each ad and the construction
as well as the rank ordering of ads
based on the viewer's perceptions.
Then you can use that based on the making decisions.
Limitations of consumer jury.
Yeah, limitations of consumer jury method.
Consumer may become self-appointed experts.
They may become self-appointed experts.
The number of ads that can be evaluated is limited.
Excuse me.
There could be a halo effect.
Halo effect.
What's a halo effect?
The overall rating is influenced by the judgment
on one or a few characteristics of the ad.
Just a hairball, a hairball.
Here, therefore, a halo effect may take place.
Preferences for specific types of advertising
may overshadow objectivity because people may prefer
a specific type of advertising and not others.
That may overshadow their objectivity.
You can also do A-B testing.
A slash B testing.
That's testing two versions of the ad or a homepage
to see which one is more effective.
Become A-B testing, okay?
Portfolio test, okay?
Pre-testing, yeah, portfolio test.
Pre-testing the finished print message,
you can use a portfolio test.
Expose the group of respondents to a portfolio
consisting of control and test ads, okay?
I said there is a control ad, there is also a test ad.
Ads that yield the highest recall
considered more effective.
Whatever ad, whichever ad that has the highest recall
is considered the most effective.
But the limitation of portfolio tests
that include factors other than advertising creativity
and or presentation may affect recall.
Remember the presentation.
The sequence, right?
Ability to recognize the ad when shown
may be better measures than recall, okay?
Here, conjointly count outcome print ad pre-testing.
There's their workflow, okay?
The objective for them, for print ad pre-testing,
the objective is to determine the best print ad
by comparing the respondents' attitude toward that,
by benchmarking ad against other good performing ads,
and then by garnering feedbacks
regarding likes and dislikes about the ad.
The measures they have,
the number of measures are taken for print ads,
including the clarity and trustworthiness
of relevant and likable ad is,
how easy it will be to spot an ad,
originality and authenticity
when the respondents will follow the call to action
or discuss the ad further
where they would expect to see the ad.
The output is in addition to comparing the ads that tested,
additional measures of association
and likes and dislikes about ads are provided, okay?
Again, those will do a flat readability test, yeah?
Communications, efficiency of the copy in print
and ad tested without reader interviews, okay?
And you can use a flash formula,
flash formula assess readability of copy
by determining the average number of syllables
per 100 words, okay?
But the copy may become too mechanical,
direct input from receiver may not be available, okay?
New print pre-testing measures.
New methodologies involve hybrid measures
that measure effectiveness in different ways
or in different channels,
like this APSOS ASI NextConnect, okay?
Also the PTG, the pre-testing group measures time
a respondent spends with print or a table,
a tablet using a hidden camera to track eye movement, okay?
And also Link uses a comprehensive set
of diagnostic questions to evoke viewer reactions to ads,
okay, using new measures, new measures that's being used.
This is APSOS ASI Comprehensive Online Copy Testing Measure.
For APSOS ASI NextConnect,
their objective is to assist advertisers in copy testing
of rough or finished advertisements
in traditional or digital form
to determine the individual's executions
or multiple campaign elements across any platforms.
The method is the consumers are recruited
to complete an online survey
where they're exposed to a variety of messages
and results are compared against those from a control group,
not exposed to any ads.
And the output of this test
is that you have standard scores related to recall,
persuasion and comprehensive diagnostics,
potential ad-driven in-market sales.
Pre-testing finished ads.
You can use finished ads by using theater testing.
Participants are invited to view pilots
of proposed TV programs.
You can measure the brand preference changes, okay?
And like this, GFK employees using these techniques
to gather market knowledge.
Theater testing, okay, theater testing.
An advantage of theater testing,
you can establish norms,
you can get how ad will fare against others,
test in the same product class.
Brand preference measure is supported
by actual sales results.
But the disadvantage of theater testing
is the environment is artificial, okay?
Contract measures of brand preference change
is easily recognizable, okay?
And group efforts, group effect
may influence viewers' reaction
because of presence of other people in the theater.
On-air test, on-air test you can use commercials
inserted into actual TV programs in certain test market.
And you can use well-known providers
like a decision analyst, Epsos, MSW, Nielsen.
The most common metric is recall.
Recall, yeah, what is recall?
The number of persons able to recall an ad and or its message.
There are also the physiological measures
like pupil dilation, pupil meters, right?
Measures dilation and constriction of pupils
in response to certain stimuli.
You can use galvanic skin response, GSR.
Basically, the skin conductivity is measured
because the electrodermal response, EDR,
measures skin's resistance or conductance
to a small amount of current, okay?
Using skin, galvanic skin response
or pupil dilation to measure.
These are the physiological measures, okay?
Eye tracking, view and add while sensor aims to,
aims to beam of infrared light at eye.
Pretty scary, huh?
Brain waves, brain waves, right?
Using electroencephalographic, or EEH, EEG,
to determine the electrical frequencies in the brain.
And you can detect alpha activity,
the degrees of brain activation,
hemispheric lateralization,
distinguishes between alpha activity in the left
and the right side of your brain.
Or use a brain scan, brain scan imaging,
examine the physiological reaction to add and rinse.
Because your brain waves to measure, okay?
Eye movement research, okay?
Eye movement research, right?
Track your, the viewer's eye movements
to determine what viewers read or view
in the print ad and where their attention is
focused in the TV commercial,
in a website or view boards, okay?
Use the fiber optics, digital data processing,
and advanced electronics to follow the eye movement
of viewers, okay?
Little scary, huh?
Also, you have a relationship
on what we just see, recall, and comprehend, okay?
Scan movement paths in print ads,
on view boards, in commercials, in print,
and on website, okay?
Eye movement tests.
This one here is Toby, yeah,
is a leading developer and provider
of eye tracking software.
And you always can watch an ad
where the sensor aims a beam of infrared light at the eye.
The beam follow your eye's movement
and tracks the exact spot on which the viewer focuses
and for how long.
So, quite interesting, huh?
Post-test print ads, post-test print ads.
Inquiry test, how much inquiry you get.
You also do a split run test.
The variations of ads appear in different copies
of the same print media, right?
And different copies use that.
You can run the same ad in different media to see, right?
So, inquiry, and how many inquiries you got, right,
from the ad, generated from the ad.
And post-test of print ads,
the advantage of print inquiry test
is that the implementation is inexpensive.
It provides good feedback.
But disadvantage of inquiry test,
inquiry may not be a true measure
of attention-getting information
and providing aspect of the ad.
For other reasons, ineffective for comparing
different versions or specific creative aspects in that.
So, keep that in mind, okay?
This is for ads distributed through local,
direct mail pieces, catalogs, or flyers.
The number of inquiries can be used
as a measure of ads effectiveness.
Recognition method, recognition method.
It determines recognition of print ads
and provides involvement readers have with a specific ad.
Most common types of post-test of print ads, right?
It's closely associated with the GFK-STARCH
and STARCH ad readership report.
Now, this is STARCH reading scale, reading scores.
Okay, you see that?
Post-test of print ads.
There's some advantages, you know,
the pulling power aspect of the ad
can be assessed through control.
In fact, even some competitive ads can be compared.
Alternative ad execution can be tested, okay?
But disadvantage of recognition method
is that there could be false claiming,
you need fewer sensitivities,
and reliable recognition scores.
Recall test, attempt to measure recall of specific ad.
The advantage of recall test,
it gives you the ability to assess ads impact on memory,
business memory.
The disadvantage of recall test,
the reader's degree of involvement with product
or with appeals and measures
may lead to higher than accurate recall scores, okay?
Higher than accurate recall scores.
This is GNR Magazine Impact Research Service,
you know, MRIS,
their objective method in the notebook,
and I'm gonna let you read that.
Day after recall test.
Basically measure recall of ad a day after viewing it,
the next day,
known as the birthday after recall test, okay?
The advantage of day after recall test
is natural setting provides more realistic response profile.
It provides norms against which
the ad performance can be measured.
Persuasiveness and diagnostics measures are also available.
Day after recall test,
or post-test of broadcast commercials, okay?
The disadvantages of the day after recall test,
you know, it could favor unemotional appeals,
emotional ads may be processed differently
than thinking ads.
Program content may influence recall.
Respondents are aware of tests and will be more attentive.
So recall is not a measure of acceptance
or predictive of sales.
Just because they can recall,
doesn't mean they can, they will buy the product.
There are persuasive measures,
and like evaluate commercials,
persuasiveness effect of this, okay?
Can use a diagnostic,
garner viewers' evaluation of ad,
how clearly the creative idea is understood,
how well the preposition is communicated.
You can use comprehensive measures,
different measures obtained through one testing program.
Test marketing.
Test marketing, measure advertising effect
in specific test markets
before releasing them internationally in a certain market.
Advantage of that, realism and high degree of control.
Disadvantage, time-consuming and expensive.
Competitors may discover and intervene in the process.
That would be bad, okay, that would be bad.
Tracking studies.
Tracking studies, post-test, broadcast commercials.
You can do a tracking study,
measures effects of advertising on awareness,
recall, interest, and attitude toward ad,
or brand, and purchase intentions.
You can use standard set of questions,
ask in regular intervals.
The advantage of that can be that it can be tailored
to each specific campaign or situation.
These are the factors that make or break
your tracking studies, like you read them.
Problem, there are problems with current research methods.
Accomplishing some factors important
to good copy testing requires more effort.
More current methods do little more
than provide recall scores.
Lab measures artificial and vulnerable to testing effects.
Field measures result in loss of control.
And concern for reliability and validity
must also be carried over to online measures.
So, yeah, these are the problems
with current research methods.
There's something essential of effective testing.
You need to establish communication objectives,
use a consumer response model,
use both pre-test and post-test,
use multiple measures,
understand and implement the proper research.
Both pre-test and post-test should be used.
Also, to measure the effectiveness of sales promotion,
you can scan the data captured
to establish weekly transactions.
We use scanner data.
Give retailers information about effectiveness,
gaining awareness of tracking studies,
tracking sales during promotional
and non-promotional periods,
using heat map sensors in-store
to track customers and gauge traffic patterns
of sales promotion.
The effectiveness of non-traditional media,
very non-traditional media.
Print versus online measures the effects
on memory and purchase behavior of each medium.
Parking lot-based media measures the ad impressions,
advertising recall, and combines with sales tracking data.
In-store radio and television software
from IMS measures effectiveness.
Other media, you have the resources available
to measure impact on various IMC elements,
the non-traditional media measurement.
And measuring the effectiveness of sponsorship,
how to measure sponsorship.
You can use exposure method.
Monitor quantity and nature of media coverage
obtained for sponsored event.
Estimate direct and indirect audience.
Use tracking measures, evaluate awareness, familiarity,
and preferences produced by sponsorship based on surveys.
Here's an example of showing
the sponsorship performance matrix.
The x-axis is the sponsor appreciation, gratitude index.
The y-axis is the passion, passion index.
The high performance sponsorship ROI.
There are eight steps.
The eight steps in measuring the event sponsorship.
In matter, define the objective of the specifics.
Establish solid strategies against
which programming will be benchmarked.
Set measurable and realistic goals.
Enhance rather than just change
the other marketing variables.
Don't put marketing plan one-on-one off the shelf, okay?
Six, define the scope of your involvement, okay?
And seven, think long-term.
It takes time to build a brand equity.
And eight, build evaluation and a related budget
into your overall sponsoring program, okay?
The other IMC program elements.
There's increased interest in determining
the synergistic effects of old program elements.
Some studies track effects of two or more media.
There are major challenges in determining
the effectiveness and contribution
of various elements of IMC program.
It's not easy to do, okay?
There's a number of factors in effective measurement.
Being able to export my data across my marketing platforms,
cross-channel reach and frequency metrics,
media-specific ROIs, and et cetera.
And what's important, what's not so important.
And you can look at data.
And that's all I have for this chapter, okay?
Thank you.
I will see you next time.
Goodbye.
