How to evaluate a simulation: a quick guide for non-modellers

It’s not easy to assess other people’s research. And it is double difficult if they use a technique, theoretical framework or vocab one is not familiar with. Usually, the more our work depends on one of the ‘auxiliary disciplines to archaeology’ (geology, ethnography, genetics etc)  the more knowledgable we are but, in general, we know ‘just enough’ about everything that is not absolutely key to our research. For the nitty gritty we trust the domain specialists to keep an eye on each other and let only the ‘vetted’ research filter through to us. It largely works fine, except when a new thing shows up and it is difficult to find time and learn ‘just enough’ to evaluate its merits.

It seems that that’s the case with modelling techniques. Since simulation is not commonly taught at the undergrad level (yet!) it largely falls in the ‘not a clue what they’re on about’ category. This leads to a (not-that-)funny situation where the only people who can evaluate the quality of a model (i.e. other modellers) don’t care about the actual results, while those who should care play safe and ignore them. Simulation is not rocket science (except when it is actually used in rocket science), but it is an unbelievably useful tool and it looks like it is here to stay so I prepared this short guide for non-modellers showing how simulations are created step by step, with a special focus on the most common problems in models. As it will, most likely, backfire straight in my face the very next time I present my work and someone from the audience points out a fatal flaw in my research, I would like to ensure everyone that most of the mistakes and blunders we produce are really not intentional, really.

[click on the right-pointing arrows to advance the presentation]

If the prezi doesn’t work, follow this link:


One thought on “How to evaluate a simulation: a quick guide for non-modellers”

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s