niccol:
I am not sure how I can demonstate without saying what I think is a good approach. In my opinion:
I would set up two sub-domains
Easy done, but only 2? Is that a big enough sample base to be able to draw any valid conclusions? Wouldn't that be like trying to test the 4/8 cylinder car speeds with only one car of each type?
niccol:
I choose to name them as similarly as I can
I would password lock them so they can't be indexed
I would install zen on both sub-domains simultaneously ( yes I know that is impossible)
Are you serious? In order to get a valid result we need to do the impossible?
Besides, if we could do the impossible, would any of the test results be valid? After all, didn't you recently state that the age of the domains are a factor that we need to consider. Doesn't this mean we'll need to repeat all the tests with domains of different ages before we can make any valid conclusions?
niccol:
at this point I have pretty nearly identical installs which logically should perform identically in google.
Then I would change one single thing on one of the installs. So, if you are interested in 'keywords' in the URL just change that. Nothing else.
I'm confused. It wasn't very long ago that feznizzle serendipiously found himself in a position where he had a single store where the product content variable could have been eliminated, leaving the 'perfect' test scenario where **everything would have been 100% identical in every possible way, except the format of the URL. **
I was lambasted that this test wouldn't prove anything because of all the other variables. I fail to see the difference between your proposal and mine. Exactly what is it I'm missing here?
niccol:
I would not publish where I am doing this publicly because people clicking around can effect the results.
This wouldn't have been an issue with the feznizzle single site test, because any clicks would affect the site as a whole, with no bearing on the product/URL's.
niccol:
Sorry, by the way, I clicked around your sites without thinking about it!
No big deal, it wouldn't affect any of my tests. Also, out of curiosity, was it also you that initiated the 'SEO check' on our site from chme.com? If it wasn't, you may be interested to know we only scored 87% (they recommend 90% or better as being good result). All in all not a bad score considering we do nothing in regards to SEO... its all pure native Zencart. It would have done even better if I gave a little more consideration to the text formating of the Wuldbitzer product.
niccol:
Then remove the password lock and let the games begin.
This way I have isolated the single change that I have made. Logically if there is a difference in performance then it must be due to that single change I have made.
But wait up, this doesn't take all of the variables into account. What about the speed of the server? The speed of the network? What if google crawls one of the sites at a busy time of the day and the other during the quiet period? Surely these factors have to be accounted for in some way or another, otherwise the results will be invalid.
niccol:
Of course, some idjit like me will come along and say that just doing it on a single pair of sites then the results are dubious.
<grin> I said that before reading this. :)
niccol:
But can you really be bothered to set up a hundred pairs of subdomains?
We can't rely on any results unless we do this (or, we could make a reasonable assumption that the domain names really aren't that important after all, and simply recruit more volunteer sites, which is what I chose to do).
Even though it is reasonable to assume that the results from more sites with different domain names is going to tell us far more than any results from just two domains, this is/was apparenlty another flaw in my testing/logic.
What does that tell us about your logic?
niccol:
I might also say that any result you get in the first period is going to be noise rather than signal so that you need to wait a bit longer than you have.
- I really have no idea what you mean by this.
- Since 'time' is another of the variables that we need to consider, then in order for the result to have any meaning, don't we need to monitor and record the results over a period of time? You seem to have missed this in your proposed tests. On the other hand, my 'flawed' tests had this well in hand (look back at the speadsheet I'd created very early when I was 1st devising the tests).
niccol:
That is how you might, if you chose to, set up a slightly more rigorous 'test'. I genuinely do not mean this negatively. It is a positive suggestion about how you can proceed and improve your results.
I appreciate your efforts, but seriously, it has just as many 'flaws' as my tests. It doesn't take all the variables into consideration (by a long shot), not to mention that in your own words the test scenario is impossible to set up.
niccol:
Having said that I kind of appreciate the pissing competition approach because it does make people think about stuff and does raise questions that may not have been considered before. I agree that it can be kind of fun and can highlight interesting areas.
The bottom line though is that we both have flawed test methods and flawed logic, and the concensus is that no matter what we do, or try to do, any results or observations we make are totally and completly worthless because there are far to many variables that weve not (or are unable) to take into consideration.
As of this day I now know that I can't find out whether 4 cylinder cars are faster than 8 cylinder cars or not by racing them, unless I am sure none of them are being driven by a professional driver, oh, and of course, they all have to be the same colour.
This was a hard lesson for me to learn, and I have you to thank for teaching it to me.
niccol:
Listen, Rod, I genuinely apologise if at any point I have over-stepped the bounds of politeness.
Listen Nick, you should know by now that I don't give a flying duck about politeness. It serves no purpose in regards to solving technical puzzles, and this topic has been,and always will be a technical issue.
niccol:
Which I know I have. I am going to quietly leave this thread now.
You choose to leave now? I think you should clear up some of the mess and misinformation that you've been sprouting before walking out on us.
niccol:
I really wish you the best of luck with it and hope you get useful and interesting information.
But Nick.... You've convinced me, and no doubt many others that all of our testing is pointless and will never prove to be useful because we aren't taking all the variables into account.
niccol:
PS. I think that if we go back and look at the first post of this thread we are all going to have to admit that we are all very much 'off topic' :-)
On the other hand, if you look at the topic of this thread, it is very much on topic. It just isn't the direction any of us were heading.... and why? Because you and you mate DivaVocals decided you had nothing better to do than to try prove that arrogant ########## RodG wrong in any and every way possible, with no regard to any of the other participants in this forum.
You have constantly and repeatedly twisted almost every word I've written to make it appear I've stated things and made claims I've never made. Any useful information that could have been gleaned from the tests have been lost in the noise. In short, you have succesfully destroyed anything good to come from this thread, which is now a lost cause.
Well done. I hope you are really proud of yourself. You too Diva!
I'm out of here. As far as I'm concerned this thread is now closed.
Rod