Consumer testing of cosmetics: in-use tests and efficacy assessment

Monika

When making claims about moisturization, smoothing, comfort of use, or visible improvement in skin condition, it is important to know how the product is perceived by people in the target group. Consumer cosmetic testing makes it possible to collect structured feedback after a real period of product use and determine whether the claimed benefits are noticed by users.

The value of such research does not result solely from the number of responses collected. It depends primarily on appropriate participant selection, a properly designed application method, control over the course of the test, and questions that distinguish product evaluation from general consumer preferences.

How to design consumer cosmetic testing?

Consumer cosmetic testing consists of product use tests in which participants use a product in conditions similar to everyday life and then evaluate its characteristics and perceived effects. What does such a test involve in practice? It is a planned process of collecting data from people who match the profile of the product’s prospective users, rather than simply a collection of spontaneous opinions.

The first step is to define the research objective. A test for a face cream intended for dry skin requires a different design than a test for shampoo for color-treated hair, and a serum with a specific skincare function requires a different approach again. The objective should indicate the questions that the research is intended to answer. These may concern, among other things, sensations during application, ease of spreading, fragrance, product efficiency, declared skin comfort after use, or a change noticed by the user after a period of regular use.

The research group is then determined. Selection should not be limited to basic demographic characteristics. In cosmetic testing, skin type, hair type, specific skincare needs, previous purchasing habits, frequency of use within the category, and experience with similar products also matter. A person who uses hair masks very rarely may assess the product’s texture and effects differently than a regular user of this category.

At the design stage, it is worth clearly separating inclusion criteria from exclusion criteria. Inclusion criteria indicate who should be included in the sample, for example, people who use skincare products for dry skin. Exclusion criteria reduce the risk that the study will include people whose circumstances prevent them from using the product reliably and according to the instructions. Their scope should result from the research objective and the characteristics of the cosmetic product being tested.

The design should also specify the conditions of use. Participants must know when to use the product, where it fits within their skincare routine, on which area of the body it should be applied, and whether other products from the same category may be used during the test. Without these arrangements, assessing the product’s effects becomes difficult to interpret, as differences in outcomes may result from the way the product is used rather than from the properties of the product itself.

Consumer cosmetic tests are generally used to collect user declarations, so they should not be equated with expert assessment or measurements conducted using equipment. Consumers describe their own experiences: whether their skin feels softer, whether the cosmetic product leaves a pleasant sensation, whether their hair is easier to comb, or whether the product meets their expectations. This perspective is highly valuable if the methodology corresponds to the type of claims to be substantiated.

How to conduct application tests and collect data on cosmetic product performance?

Application tests begin with recruitment and screening, meaning verification that participants meet the established criteria. Screening should confirm the participant’s declared skin or hair type, as well as their habits related to using the category under study. For a hand care product, for example, regular use of creams may be important, while for a hair styling product, it may be important that participants perform specific styling activities themselves.

Participant selection largely determines the reliability of findings in cosmetic testing. A cosmetic product for dry skin tested on a sample that does not correspond to this target group does not allow reliable conclusions to be drawn about how the product is perceived by people with dry skin. A well-designed questionnaire will not correct an error that arises when a product is evaluated by people who do not have the need it was designed to address.

Once participants have been qualified, they are provided with the product and instructions for use. The instructions should be as simple, unambiguous, and consistent with the actual method of product use as possible. If the cosmetic product is to be used in the morning and evening, participants should receive clear information about when the test begins and ends, as well as how to report interruptions in use. It is also worth indicating which situations should be recorded, for example, skipping an application, using another product with a similar function, or being unable to use the cosmetic product for a period of time.

The duration of the test depends on what the evaluation of the cosmetic product’s performance concerns. Immediate characteristics, such as texture, fragrance, ease of dispensing, absorption, or the initial sensation on the skin, can be assessed immediately after the first applications. The assessment of effects that require regular use is different. In this case, a period is needed that allows participants to incorporate the cosmetic product into their routine and compare their impressions with their condition before the test began.

The research questionnaire should guide participants from questions about product use to questions about the evaluation of its characteristics. A division into several thematic blocks works well:

  • the course of product use and compliance with the instructions,
  • impressions related to application, texture, fragrance, and packaging,
  • subjective assessment of the cosmetic product’s performance after regular use,
  • assessment of how well the product meets individual needs,
  • open-ended questions allowing participants to describe perceived advantages, limitations, and usage situations.


Structured response scales are often used in the closed-ended section. A Likert scale allows respondents to indicate their degree of agreement with a statement such as “the product leaves the skin feeling pleasant to the touch” or “after use, the hair appears smoother.” Precise wording of statements is essential. The question “is the product good?” provides little useful information because it combines many different aspects of the experience.

Comparative questions can also be useful, provided that participants have a genuine point of reference. They can be asked whether the product met their expectations for the category or how it compares with the cosmetic product they usually use. However, it should be noted how such a comparison differs from a controlled test of two products. If participants rely on memory and their own routine, their response describes user perception rather than a direct comparison conducted under identical conditions.

It is worthwhile to conduct a measurement before product use begins and another after the test is completed. The first survey collects information about the baseline condition, habits, and expectations. The second concerns experiences with the product. This structure makes it easier to verify whether the respondent actually belonged to the intended group and whether the declared change relates to an issue that was present before the test.

Fieldwork requires ongoing monitoring. It is necessary to check whether participants have begun using the product, understand the instructions, complete surveys at the appropriate time, and whether responses emerge that indicate non-compliance with the criteria. In a home-use study, also referred to as an in-home use test (IHUT), contact with participants and reminders are important for reducing missing data and the risk that the final questionnaire will be completed by people who used the product only occasionally.

The analysis should take into account both quantitative results and open-ended responses. The average score on a scale shows the direction of opinion, but comments help explain what participants mean. If some respondents indicate that a cream “moisturizes well,” it is worth checking whether they are describing the absence of tightness, long-lasting comfort, quick relief after application, or a pleasant finish on the skin. These meanings are not the same.

What can distort cosmetic testing and the assessment of product performance?

Cosmetic testing is useful only when the interpretation takes into account the limitations of declarative data. Consumers can describe their feelings and observations, but their responses depend on their expectations, previous experiences, method of use, and everyday living conditions. The assessment of a cosmetic product’s performance should not be interpreted as an objective measurement of the physical properties of skin or hair.

A common mistake is defining the research group too broadly. If a product is aimed at people with a specific need, but the sample includes users with highly diverse profiles, the findings may be inconsistent. This does not necessarily mean that the product is evaluated negatively. It may mean that some participants did not have the need addressed by the product or evaluated it according to different criteria.

Another pitfall is a period of use that is too short or poorly matched to the product. Participants should have sufficient opportunity to use the product according to the instructions. Conversely, an excessively long test may increase the risk of declining engagement, forgetting earlier impressions, and using the product irregularly. The schedule should therefore be linked to the frequency of application and the type of benefit being assessed.

Combining several characteristics in one question can also be problematic. The statement “the cosmetic product moisturizes well, smooths the skin, and improves its appearance” does not make it possible to determine which aspect the respondent actually confirms. Each characteristic relevant to the research should be evaluated separately. Only then can researchers analyze whether people declaring improvement in one aspect also indicate other sensations.

In consumer cosmetic tests, responses from people who did not use the product as intended should be treated with caution. Such data should not automatically be removed, but they should be flagged in the analysis, and rules for qualifying responses should be established before the results are analyzed. It is important to distinguish between a participant who missed a single application and a person who practically did not use the product.

The way the product is presented also affects data quality. If the test is intended to focus on the formula’s usage characteristics, excessive marketing information may reinforce expectations and influence responses. Participants should receive as much information as they need to use the product safely and correctly, without suggestions about what effects they should expect. This applies particularly to questions about cosmetic claims, meaning statements relating to product properties and benefits.

A positive perception of a cosmetic product should also be distinguished from the ability to make a specific claim. The statement “most participants liked the fragrance” relates to preference. A statement about a perceived effect should result from a question precisely linked to that effect, a defined participant group, and a described method of use. Claims require appropriate substantiation, and consumer research may form part of the evidence base if its design corresponds to the content of the statement being assessed.

How to document cosmetic testing results for cosmetic claims?

The study result should be traceable from the objective, through sample selection, to the question on which the conclusion was based. In practice, this means preparing documentation that describes the methodology, participant profile, instructions for use, contact schedule, research instrument, and analysis rules. This makes it clear what each reported measure represents and to which group it can be applied.

For cosmetic claims, consistency between the wording of the statement and the construction of the question is particularly important. If the message concerns the feeling of moisturization, the survey should not be limited to a question about overall satisfaction. If the claim relates to ease of application, the questions should concern application rather than only the assessment of the product as a whole.

A cosmetic testing report should present results without overinterpretation. It is worth describing the distribution of responses, the most frequently cited reasons, differences between participant segments, and the conditions in which the product was used. Open-ended responses are best quoted in anonymized form and treated as explanatory material rather than evidence replacing data from the full sample.

Data consistency checks are also useful. Researchers can verify whether a person declaring regular use of the product responds logically to questions about application frequency, whether the final evaluation contradicts the description of their experience, and whether any responses appear to have been given mechanically. Such activities are not intended to “improve” the result, but to identify data that may not reflect actual participation in the test.

In projects comparing more than one product, it is important to control the order of contact with products and the way they are labeled. How does this approach differ from a standard assessment of a single cosmetic product? In comparative testing, the influence of usage order, memory of the previous product, and information identifying the brand must be minimized. Methods for choosing between a home-use test, a central location test, and a monadic approach are also described in “Product testing in practice.”

Frequently asked questions

How should a consumer cosmetic test be conducted?

A consumer cosmetic test begins by defining the objective, the user group, and recruitment criteria. Participants are then provided with the product and clear instructions for use, and data are collected in a structured questionnaire after an appropriate period of time. Cosmetic testing should include monitoring of the test process and verification that participants actually used the product as intended.

How many people should take part in an application test?

Sample size depends on the objective of the application test, the diversity of the target group, the planned reporting approach, and the type of conclusions to be drawn. A different sample will be needed to describe the opinions of one clearly defined group than to compare several user segments. In cosmetic testing, sample size should be determined before recruitment, together with the rules for handling incomplete or unreliable responses.

How long should a cosmetic product be tested before its performance is assessed?

The duration of the test depends on the frequency of product use and the type of effect being assessed. Application characteristics can be evaluated quickly, whereas assessment of the performance of a cosmetic product requiring regular use should take place after a period that allows participants to genuinely become familiar with the product. The schedule must be included in the instructions and reflected in the questionnaire questions.

Ask about a consumer test for your cosmetic product

Hume’s Institute helps design consumer cosmetic tests, select participants, prepare research tools, and organize the data needed to assess user experiences and substantiate cosmetic claims.