You have to be able to recognize when there simply is not enough data, and in our WA context, this happens a lot. There are things like conditional logistic regressions that you can apply to tease out some insights. It is hard.

I have personally learned to SWITCH to "What ELSE can I do?" So for EXAMPLE, if the site has a very small sample, I could switch to a simple one question on-exit survey to get some VOC to get more HINTS as to what's up. Or maybe just dump the whole data from visitors and switch to expert analysis (conceptfeedback.com type analysis). Or maybe simple usability research. Or, worst of all when the gun is to my head, "best practices."

You have to be able to recognize when there simply is not enough data, and in our WA context, this happens a lot. There are things like conditional logistic regressions that you can apply to tease out some insights. It is hard.

I have personally learned to switch to "What else can I do?" So for example, if the site has a very small sample, I could switch to a simple one question on-exit survey to get some VOC to get more hints as to what's up. Or maybe just dump the whole data from visitors and switch to expert analysis (conceptfeedback.com type analysis). Or maybe simple usability research. Or, worst of all when the gun is to my head, "best practices."