A personal blog transitioning into an exploration of the intersection of design, technology and ethics
Just a few quick shots from last night. I’d arrived late for the first afternoon thanks to a failed gearbox mount (thanks for that, VW Warrington) but at least did get there thanks to a courtesy car (also thanks, VW Warrington!) that got me here just a couple of hours late…
Anyway, to the pics. I’ll add more later, I’m sure.
I’d started to notice that my site could often be slow to load – other sites on the same server weren’t suffering the same way, so I wanted to document a simple way in which one can identify performance issues on the site. This is one of them.
A little while ago I reported that my site, since some WordPress upgrades, had started to slow down. I’d wondered whether it was WP becoming increasingly bloated, or some other problem.
Well, it took me a while to get back to the issue (babies and a booming business don’t help!) it’s continued to get worse and worse, until a recent change has improved things… but only marginally, as shown by the Pingdom chart below:
This is dreadful, really – daily average of 4,000ms responses just aren’t acceptable where, two years ago, I was getting 800ms.
So, now the process starts. The recent small improvement came after installing our Spectacu.la Advanced Search Plugin, which runs a regular database optimisation to help keep things nippy, but it was still dreadful.
My first suspicion is always that of plugins (and sometimes themes, if they’re complex). In our office we have a term called ‘pluginitis’ which refers to the problem of a site having too many plugins installed, many of which are poorly written. I hate to say it, but when clients call to ask for a plugin to be installed that we’ve never tested we go through it and, 90% of the time, discover serious performance or security flaws that will cause long-term issues.
And this site here is old – I’ve been running a WP install for four and a half years with nothing more than upgrades and, like an old PC that’s been upgraded too many times, that causes issues with old drivers and code. Same can apply to WordPress. So let’s see what we can do to improve things.
First stage is to disable as many plugins as possible so as to isolate the issue. I’m using a division based approach – ie, I’m going to disable half of my plugins to see what happens. If I get full performance back, then the problem lies in that half. I can then reactivate half the plugins and see what happens. If the performance is still good, the problem is in the other half. I think you can see where I’m going here.
I’m also going to go for plugins that aren’t written by us. Not because I’m biased (ok, maybe a little) but because I know all of ours are carefully tested for performance – many are run on major sites such as the Telegraphs blogs site. Speed is of the essence.
I’m also going to skip plugins like Akismet, because anything that’s essentially ‘core’ is usually going to be reasonably performant – at least on a small site like this one.
It’s worth noting that I could easily delve into SQL statements and code efficiency – but that’s only interesting to developers – if you’re simply a WordPress user, performance is interesting but what you can do to find problems is somewhat more limiting.
Add to feed – a simple plugin, but sometimes simple plugins miss simple tricks.
Headspace2 – I have my suspicions about this plugin as it’s massive. Could be fine, may not be. Only way definite way to know – measure it.
Search Meter – a nice plugin to see what people are searching for, but is it adding load somewhere?
Social Bookmarks – it shouldn’t cause issues, but you can never be sure.
wp-typography – I love what it does for the typography on the site, but it’s also running a lot of javascript.
I do use YSlow to test the site, but one of the problems is that it’s hard to get a large enough series of data to be statistically relevant. It’s good for seeing the extra load (and why I knew the amount of javascript was an issue) but for longer term analysis it’s flawed.
So, we go back to Pingdom and look at the one day chart. As I type this it’s now an hour since disabling the plugins above – so let’s see what’s happened:
As you can see, in this afternoon alone there’s been a dramatic improvement – from around 2500ms per visit to 1230ms per visit. In one single step I’ve halved the load time of the page.
What we don’t know so far is whether that’s because the page got smaller to load or whether it’s down to a reduction in database load – but that’s really for another article. What this is all about is trying to document how I’m improving the responsiveness of the site in a way which relatively non-technical folk can follow.
What I’ll do in the next feature is to turn off some more plugins to measure the impact they had. I’ll also be interested to see if the spikeyness of the response times has varied much – are they caused by simple server load, or is there something else at play?
I will then start to switch plugins on again in a structured way in order to measure which was causing the heaviest loads on the site.
Keep watching!
There’s enough in the video to convince anybody, but I’ve decided to add my own few thoughts.
As long as the military culture exists that allows this to happen, then the West can never consider themselves superior in any sense, nor can we ever expect peace in the Middle East or the cessation of Islamic terrorism. What happened was murder, pure and simple. The airmen acted as judges, jury and executioners.
I felt sick. You probably will too. I know that this post won’t reach the eyes of anyone in a significant position of power, but if I show it to you, and you show it to some more people, then we can be a tiny part of what will put pressure on the US military authorities to properly investigate this video and explain fully what happened.
It would appear that, perhaps through a state of heightened tension and military paranoia, that any grouping of individuals in Baghdad could become targets. With nobody taking real care to check what was actually happening the killing of innocents, including two children, was inevitable.
But what really really made me angry was the way the airmen talked like teenagers playing a video-game. They described the scene as ‘nice.’ They were please with their blasting apart of a van that had been trying to help rescue the wounded. Their descriptions of the people they were watching didn’t for one moment suggest they were dealing with people or individuals. People with children, parents, lovers, dreams and ambitions.
There are, I’m sure, a great many in the military who’ll be appalled by this video. Let’s hope they can encourage Thinking amongst those who appear to have detached themselves from any sense of empathy.
Over at Interconnect IT, where I work, we’ve found that demand for our WordPress Training Courses has shot up over the past year or so. And it’s certainly interesting to see where the work comes from.
Curiously, it’s very polarised – we either work with smaller one man band companies like Jason Nevin who runs a house removals company site who are looking to switch technologies, or big corporates and government agencies such as Shop Direct, The US Mission to the UN and the Department for Business, Innovation and Skills.
I’ve been thinking about why there’s such a big dip in the middle of our client base – 90% of our business is groups with over 500 staff or with fewer than three.
Small, one man companies tend to involve highly motivated individuals. They understand the important of their skills, and they know that in the tech sector they have to always stay up to date. Large corporates tend to understand this too, and have allocated training budgets to make sure they keep up to date. Government departments are often a little slower with new technology, but they too need to keep efficient or tax payers will kick up a stink.
And WordPress is a very efficient platform for running many informational websites.
But why are medium sized companies not coming to us in nearly such large numbers as micro enterprises and large corporates? Let’s see…
I’ve noticed that medium companies often have people who are extremely good at what they do, but I do find that there are often significant skills gaps. I’ve dealt with someone from a school (medium) who didn’t realise that you don’t have to close an application in Windows in order to see another application. Each time she cut and paste she’d open one document, select the text, close the document, then open the receiving application and paste the text there. Productivity, as you can imagine, was pretty poor.
I think a lot comes from budgets – many firms around the 50 people size aren’t always able to make good money. They have to be careful where they spend it – they’re not big enough to have training departments who make sure everyone is up to date, and they’re usually busy.
Another thing with smaller firms, I believe, is that they’re often started by individuals with a lot of skills – these are flexible folk who can teach themselves and learn quickly from books and the internet. As they grow they try and hire similar people, but eventually there comes a point where a lot of staff are there for the job. They need training because they aren’t going to go to the trouble of autodidactism. They have a job to do, and they’re going to do that and no more or less.
At best, they’ll get on-the-job training.
We don’t do a lot of it, to be quite frank. But perhaps our website, approach and costs simply don’t ring true with people in medium sized companies looking for WordPress training? Do we need to get advertising in business magazines, such as those sent out by the FSB?
I suspect that the truth is that a company always needs to look at the skills of staff, but as they reach a certain size they have too much going on to give it much thought. Once they break through that difficult 50 man barrier things seem to start to change again.
But how do we change this? I’m not sure we can, easily. Governments often give generous grants, and around here we have Skillworks which helps a little, and we do get local approaches – however, the person paying still has to pay a significant contribution and specialist training is never all that cheap.
Do you have any ideas of how skills can be improved in small to medium sized enterprises? Should we be marketing our courses more proactively? What about scheduled classroom courses that keep things at a lower cost, albeit needing more time from the attendees? I’d love to hear your thoughts – especially in the field of WordPress.
I noticed on my pingdom stats recently that this site has been slowing down recently. But why? Is it WordPress? Some plugins? Time for research!
I don’t really look at server response times too much, because generally it’s a bit dull, really. If our server is really sick then the automatic alerts and text messages from Pingdom tell me to get fixing.
Anyway, tonight I just thought I’d have a look at some graphs. And hey, there’s a bit of a shock… my own site, this one here, is getting slower. Here’s the graph:
Now, what you’ll notice is that generally everything looked nice and brisk until early August 2009 when there was a marked deterioration in performance. Then it plodded along just fine until December 2009 when it got worse again.
I wondered what had happened to cause this – I’m especially shocked that a page load is now so slow. I haven’t changed the theme in use for at least a year, and the plugins are generally ones I use elsewhere. So I did a bit of thinking, and then it dawned on me when I found this list of release dates at WordPress.org:
The dates correlate exactly with the worsening performance of this site.
Now, correlation absolutely does not relate to causality. At upgrade time I usually take a moment to review plugins, upgrade the theme, etc. It could be that an upgrade or change to one of the many plugins in use here that has caused the slowdown. I know it’s not traffic to my site – that’s been flat for ages, with only the occasional blip. The server is a dedicated machine running about fourty sites that we manage, but the load is generally quite consistent and impact on different websites is fairly well managed.
But I’m a speed freak. I like it when a website zings into view. I love fast cars. I love computers that don’t dither. I love telephones that respond instantly. So I hate that response times are now below 1s. That’s not on!
So I’m going to try to find the cause of this slowdown – I’ll be running some experiments on this site, profiling queries, checking the database over and so on. And I’ll document it all as a way of showing you how we at Interconnect IT do our performance tuning. Whether I document it here or there I haven’t decided yet – I think it would make a good case study for the site. We’ll see! Watch both sites…
note 1 – deactivated Twitme on 03/02/2010
A wee picture from Liverpool.
I just happen to like this technically dreadful picture I just found from last month. So I’m going to share it anyway. Taken from the company office.
First outing with the polarising filter given to me for Xmas by my friend and colleague James and decided to wander up to Southport for the afternoon. We were rewarded with a beautiful sunset that the filter really helped add punch to the skies. Downsides of the day? I think I’ve lost the use of two fingers and a toe, it was that cold!
This is the view from our new office in Liverpool, right now. Well, a few minutes ago.
I consider myself very lucky to have this just behind my desk and it has to rate as the best view of any office I’ve worked in. You’d think the office would be very expensive, but it’s not, thanks to the way the Liverpool Science Park has been set up and funded.
I can think of worse places to work….
I expected more ice, it has to be said. I also packed my thermals and it turned out to be warmer than home. But, I also know how bitterly cold it can get in countries like this in Winter even if the thermometer doesn’t show it as looking so bad – driving rain, strong winds and pervasive dampness can chill you to the bone where the same temperature on a sunny day in the Alps could feel positively balmy.
This was my 40th birthday present from Romana. The hope had been to see the Northern Lights, something I always wanted to witness. Sadly the weather and conditions meant it wasn’t to be. But I still appreciated the trip and the unique experiences – it was a great gift!
I’m not going to extol the virtues of Iceland too much here – it’s a small country, with a rich culture and heritage. It’s definitely one of those places worth visiting if you get the chance.
One note, though – I expected to be hungry, but it turns out there’s six vegetarian restaurants, and most (but not all, by any means) restaurants offered fairly decent vegetarian options.
PS – some pictures are rather grainy as I had to push the camera somewhat. This is one dark country!
Sean’s 40. But he’ll always be two months younger than me. Dammit. Well, here’s some photos from his party. Enjoy…
OK, it’s taken me four months to actually pull these images from the memory card, get them on my computer, select them, resize them for the web, and upload them.
And mainly because tomorrow I go to see Sean & Em to celebrate the 1st birthday of their young son Matthew.
I’ll try and be quicker next time, but in the meantime, enjoy the pics:
