Topic 7: Evaluation (6 hours)

7.1 Evaluation and designing

2 hours

	Assessment statement	Obj	Notes	References
7.1.1	Outline the general criteria used to evaluate products.	2	Consider performance, reliability, ease of use, safety, aesthetics, materials, construction and cost.
7.1.2	Explain how the criteria used to evaluate products will vary depending on the purpose of the evaluation.	3	For example, crash-testing cars is done in relation to safety only.
7.1.3	Apply the general criteria to evaluate products.	2		Evaluation
7.1.4	Explain the use of qualitative and/or quantitative tests, models and experiments used to evaluate ideas at the design development stage (developing chosen solution) of the design cycle.	3	Consider the use of scale models to evaluate shape, form and proportion; materials tests; construction technique tests, and so on.
7.1.5	Define literature search.	1
7.1.6	Describe one advantage and one disadvantage of literature search for data collection.	2	Many sources of information are available, but there may be an abundance of data, which can be too time-consuming.
7.1.7	Evaluate the importance of ICT in aiding literature searching.	3	Consider access to information, speed, costs, storage and security.
7.1.8	Define user trial.	1
7.1.9	Describe one advantage and one disadvantage of a user trial to collect data.	2	The “user” is a non-specialist, which makes trials easier and cost-effective. However, users may carry out tasks in different ways from those expected and be inexperienced.
7.1.10	Define user research.	1
7.1.11	Describe one advantage and one disadvantage of user research to collect data.	2	Data is relatively easy and cheap to obtain but is largely qualitative.
7.1.12	Compare user research with user trial.	3	With user research, data is collected by obtaining users’ responses to questions. User trial data is collected by observing users’ behaviour.
7.1.13	Define expert appraisal.	1
7.1.14	Describe one advantage and one disadvantage of using expert appraisal to collect data.	2	For example, expert knowledge and advice are gained (compared to a user trial), but the expert may be biased. It may also be difficult to locate an expert. Data is usually qualitative.

7.2 Evaluation and manufacturing

2 hours

	Assessment statement	Obj	Notes	References
7.2.1	Identify the nature of evaluation at different stages of the product cycle.	2	Different types of market research, for example, evaluating competitive products, evaluating the success of a new product and evaluating for redesign.
7.2.2	Define cost-effectiveness.	1
7.2.3	Explain the importance of cost effectiveness to manufacturers.	3	In order to maximize profit, manufacturers require the most cost-effective production system. This is often the major aim of the brief for designers.
7.2.4	Define quality control and quality assurance.	1
7.2.5	Compare quality control with quality assurance for manufactured products.	3
7.2.6	Define performance test.	1
7.2.7	Describe one advantage and one disadvantage of using a performance test to collect data.	2	It is possible to collect quantitative data, but the test may be time-consuming and costly. It can be used where a user trial is not feasible, for example, crash-testing cars.
7.2.8	Define field trial.	1
7.2.9	Describe one advantage and one disadvantage of using a field trial to collect data.	2	Field trials are usually quite extensive exercises, so can be expensive, but the product is tested in the marketplace, which provides data that is different from laboratory-based evaluations.

7.3 Evaluation and the consumer

2 hours

	Assessment statement	Obj	Notes	References
7.3.1	Define value for money.	1
7.3.2	Compare price with value when assessing a product for value for money.	3	If the price is too high, there may not be enough potential purchasers who can afford it or think the product is value for money. If the price is too low, consumers may think the product is too cheap to have much value. Demand for a product will generally establish the maximum price that can be charged, and the costs of production will determine the minimum price that is acceptable. However, a company may choose to set its price in relation to its competitors, or it may choose to set the price in accordance with the perceived value of the product.
7.3.3	Explain how consumers apply criteria to evaluate a product for value for money, referring to before purchase, purchase, initial use and long-term use.	3	Before purchase: advertising, manufacturer’s specification, list price, product image, and evaluation by experts and consumer groups. Purchase: aesthetics, performance, build quality and purchase price. Initial use: actual performance, safety and ease of use. Long-term use: reliability, ease of maintenance, durability and running costs.
7.3.4	Discuss how the criteria in 7.3.3 are assigned different weightings depending on the design context.	3	Value judgments play a part in product analysis, and they vary according to the individual, the time (era) and the circumstances. Consumers often value utility, security, availability, rarity and aesthetics, while designers may consider function, reliability and ease of maintenance more important.
7.3.5	Explain the relevance of quality assurance to consumers.	3	Quality assurance means that consumers do not have to carry out their own research when considering purchasing products, and they have a means of redress if a product fails to match expected standards, for example, via a guarantee.
7.3.6	Discuss the role of consumer associations for product evaluation.	3	Consumer associations are independent organizations. They carry out tests on products to see if manufacturers’ claims are justified, and they provide published data for consumers. They compare similar products within a target market and recommend the best value-for-money products.
7.3.7	Explain the contribution of the media and education to product evaluation.	3	Consider the contribution of consumer and lifestyle programmes, the weekend sections of newspapers and consumer journals, and their focus on new products. Also curriculum development and design education in schools.