Systematic Approach to Performance Evaluation

State goals; define the system
List services and outcomes
What does the system do, and what are the system's responses?
(Example: In Web caching study, which HTTP response codes do we ignore, and which should contribute to our performance measure?)
Select metrics
List parameters
Select factors to study
(A factor is a parameter that will be varied.)
Select evaluation technique (e.g., simulation, analysis, measurement)
Select workload
Design experiments
Analyze and interpret data
Present results