A few weeks ago the traffic coming to the new usv.com dropped off by 20 or 30% week over week. Brian and Nick were wondering if it was related to the new design we rolled out at the end of January. They decided to take a deep dive into our analytics to see what was going on.
I told them it had to be some sort of plumbing issue. Something that was hooked up to usv.com must have gotten unhooked. Because I have rarely seen the behavior of an entire user base change drastically overnight because of something like a redesign. Change can come pretty quickly, but in my experience it is months not weeks or days for something to drastically change in your user base resulting from a subtle product change/tweak.
They noticed in the analytics that front page views were steady but traffic to the article pages was off by a lot. I suggested that something in our twitter plumbing was off. And sure enough, we figured out that the autoposting of popular articles on usv.com to this twitter handle was broken (it is actually an RSS issue that is being fixed today).
I tell this story because we all encounter this sort of thing along the way of building and launching and growing a product. We make tweaks and something changes right away. That immediate change is usually related to something that brought traffic (google, twitter, rss, email, appstore) and not a design change. More gradual changes (up or down) are usually because of design changes.
There’s a difference between these two kinds of effects and it is important to understand that.
