This post has actual graphs with numbers and data so I kind feel like Tony Hirst right now, I just won’t be as smart. Zach Davis did kernel updates on the ds106 student server as well as on the main ds106 site server, and one of the reasons we’ve been having so many issues with that site is not necessarily traffic, because ds106.us is not a highly trafficed site by any means, rather it’s a resource intensive site because of how many blogs it is syndicating in on a regular basis. Fact is, the syndication bus using FeedWordPress is a resource intensive affair.
Exhibit A, this first graph is the server that hosts all ds106 students (maybe 75-100 low traffic blogs) that have gotten hosting with Cast Iron Coding:
As Zach notes: “The CPU consumption on this server is what you’d expect. The spikes probably represent backups, but otherwise it just kinda hums along, never getting above 50% of CPU usage.”
Now, look at the DS106 server that we just moved to:
To quote Zach again:
Woah! See how this server is repeatedly using up 100% of CPU? This is why we had to move you to a dedicated server, because the site is a crazy resource hog. I don’t think it’s a resource hog because of traffic. I think that the problem is probably your feed import script….needs some kind of throttling built into it so that it works better.
And that is exactly right, what I am gonna try and do with any of the extra funds, assuming their still are some, is see if the developer of FeedWordPress—amongst other things we need from him—might consider integrating a few ways to make the syndication less resource-intensive so we can scale this kind of aggregation hub up a bit without peaking out on resources. Anyway, I found it interesting when Zach shared it with me, and given he doesn’t blog because he is in Portland and that city is basically one, big organic blog in the new flesh, I figured I’d just share it out here 😉