The productivity paradox

I came across this chart recently and it gave me pause for thought as someone whose life work is designed to improve productivity. It shows that from 2008, although we know technologies have been growing in power, productivity growth suddenly dropped away from the trendline following the global financial crisis. Why?

This is where I fall back on an old story as a developer trying to make things more efficient. I worked with my colleagues to bring a client company the equivalent of about ten hours a day of labour saving due to using a well structured database for better data integrity over their previous ‘loose’ system. As they expanded, each branch would save at least an hour of time, and they were no longer capacity bound at each branch where more customers would linearly increase administrative work in a difficult recruiting environment. This would provide a return on investment (ROI) of less than a year.

It worked exceptionally well and the person we’d worked with said their staff were even worried redundancies might be on the way! This was never going to be the case in a growing company, because there’s an infinite amount of work to do.

All was good.

Then for some reason, our contact’s role was diminished and they eventually left the company. And the knowledge of the improvement left as well. The board’s innate distrust of anyone and their perception of us as no more than a cost base resulted in a great difficulty for us to help them without dramatically increasing costs by gold-plating every spec and decision.

This left the client unable to gain for advantage by exploiting our skills. It was difficult for us to see, and we could do little for them other to look for cost savings when, in reality, they needed to implement cost savings by using us more. Instead they opted for a recruitment based strategy to feed their growth and we parted ways as they shifted the system to a maintenance partner.

In all my thirty years of development experience I’ve seen this again and again. Instead of sticking with a solid set of developers who have learned your business details, chop and change to save money. Treat developers as a cost base and you lose so much knowledge that you’ll fail to gain productivity nearly as quickly as you could treating it as a partnership.

I don’t feel this is unique. I see lots of projects following an arc of big development then a cost reduction period which ends up losing the momentum of ongoing improvement.

Solving the productivity paradox

A strategy I now suggest when selling is to spend 60% of what you thought of on your project in year 1, then 40% in year two, 30% in year three, and then 20% a year throughout the product lifecycle. Software isn’t like building a bridge where things stabilise then stay them same for thirty years, sadly.

Fundamentally, I think corporate culture around custom software became both cautious and speculative following the global financial crash of 2008 and only invested in technology if it felt like it would create some impressive unicorn of an offering. We saw lots of developers tied up with venture capital chasing big things like blockchain and AI whilst ignoring the importance of daily incremental improvement that adds up to a huge return over time.

The answer then, is that if you have access to capital, you should stop chasing unicorns and start thinking about continuous pragmatic development aimed at dealing with all the little productivity blocks in your firm. Look to Kaizen style methodologies to help with structuring your processes around this.

What do you think? Feel free to comment!

Interesting times in the world of software

About a decade ago, I was at a conference and talking to a fellow developer (I still call myself one, even though I don’t code so much these days) when he giddily told me about the funding he’d got for building a new piece of software he was hoping would make it big. It was a two year project and he’d got £100k funding. I asked if it was just him… and no, he had a colleague. So £100k, for two people, for two years? £100k didn’t sound a lot… £25k/yr each, basically. Or what you can earn in a much simpler tech support role. I decided not to say anything and leave the poor guy in peace, although this sort of work seemed a lot like gambling to me.

Today, things are different although there’s still a sniff of gamble about it overall. If you’re a developer it’s relatively easy to find a highly capitalised employer that’s positively dripping with money who will pay you £60k-£90k a year. Potentially quite a bit more. This reminds me of the late nineties dotcom boom. In 1997 I myself quit my safe but somewhat dull job at a multinational to become a freelancer, doubling my income almost immediately, and quadrupling it another year later. The new work was, in some ways, more interesting. It was also a lot more stressful, bad for my health, and definitely wasn’t the most exciting coding work. But it paid. I honestly don’t blame developers who decide to do what I did 25 years ago. It set me up. I think it was also a large part of why I had a heart attack in 2019… living out of hotels for a decade wasn’t healthy, and cheese became far too much a food staple for me as a vegetarian. However, the money was very good and it helped set me up. When you’re poor, it’s very hard to catch up and a good income was necessary for a while.

I bring this up because today I’m not ‘just a developer’ but actually run a web development company that specialises in websites and custom software for clients. And things are happening today that are reminiscent of the dotcom boom on the late nineties. 25 years have passed, but people don’t really change nearly as much as you may think.

The dotcom & Millennium Bug era

The late nineties were a period of post-recession growth and capital release. Banks had been deregulated, money was being created in the way it can be, and we were riding high on increasing productivity. Life felt good. And when money is created it can be invested.

There’s only one little problem in that. Sometimes, people get giddy and start splashing the money out too readily. The boom of the late nineties and early noughties, and the deregulation that encouraged it around the world, eventually led to the financial crisis of 2008. I’m a bit of a cautious soul, so even though I had plenty of income, I resisted borrowing too much to get a bigger house. In some ways I was foolish, because I could now be living mortgage free in the house I have now. But I figured that not having a big mortgage would afford me some other freedoms and I could use my money elsewhere. Mostly I just invested my money in solid companies. Friends, however, were telling me to invest in dotcoms. But I looked at the fundamentals. One example was a firm called Vocalis. They did, basically, telephone voice services software. Small team, and had some crazy valuation that was effectively equivalent of £20m per member of the staff. I rightly reckoned that was mad. My friend went ahead and pumped money in, and I mocked him. For a while I looked a fool. The value of the shares rose and rose.

Right now, there are loads of speculation bubbles. At the café at work I was trying to explain Bitcoin’s fundamental problems to our barista, when our receptionist came over excitedly wanting to know more. Both seemed interested in getting involved. That means the crash is likely imminent. They’re both lovely people, but in the economic chain, they’re nowhere near the top, which means that the speculation bubble is reaching it’s limits.

“If shoe shine boys are giving stock tips, then it’s time to get out of the market.” – Joe Kennedy, 1929 as the stock market was about to crash and lead to the Great Depression

So the dotcom boom and Millennium Bug led to a boom in demand for developers. New software was being created to replace supposedly outdated software that couldn’t be fixed (narrator: “It could”) and salaries were rocketing. I took advantage of that boom. I also knew it wouldn’t last. And it didn’t. My day rate as a PeopleSoft developer went from £200 a day in 1997 to £600 in 2002. It could have been higher. Cisco did an amazing job of raising funds in that era and I remember they kept offering me more and more to go to work for them in the Netherlands. But I didn’t really want to go to work there. I never really chased the money, so that’s about where I peaked. But I remember people with the right skills, experience and self confidence were on as much as £1k a day. That’s getting towards £2k a day at today’s prices. Some skills seen as super hard and rare could command double that. Most people didn’t, of course, make nearly that much, and some people preferred a job with reasonable hours and close to their families – a very valid and decent decision. But I was single with no ties.

There are a lot more developers around today – good incomes have brought many people into the trade. I meet people who called me a nerd in the eighties and now they’re working in IT. It’s a bit weird.

Today’s situation

Now it’s a bit weird. Rates still aren’t at the dotcom level, once adjusted for inflation, but they’re close. You can do very well in tech. But in my little firm we pay typically around £40k for a developer, plus various benefits, kit, resources etc, meaning you’d need to make around £70k as a freelancer to equal it. At least the way I calculate things and always did. I nearly swapped my £600 a day for £60k a year and kind of regret not doing that.

But why have the rates risen? Well, there are a few hot areas, and they can be summarised as AI, analytics, mass market apps, and blockchain. I’ll discuss each briefly:

AI

This is a hot one – the idea we can replace rooms full of people doing dull and not very high value work (from the perspective of the company) such as service desks with AI bots is very attractive. It won’t work though. Most “supposedly AI” bots are just following decision trees and the only bit of AI is in parsing the meaning out of a sentence in a very tightly defined context. AI is useful today for categorisation problems – e.g. looking at a picture and deciding “this is a cat” or “this is a threatening comment”. It’s not brilliant at the job, but I like that an AI can work out which pictures are of my Mum, for example, even if it misses about a third of them… it still makes my life easier. A bit. But what an AI can’t do is right a decent blog post. Sorry, it can’t. They’re awful at it. There’s loads of AI generated content out there and it feels obviously fake. The main job of these AI generated blog posts is to trick other AIs (Google, Bing etc) into categorising a website as useful. And because AI’s make toddlers look worldly wise, they can be easily fooled… and that means you can’t trust them with anything of real importance. Like your business decisions.

But, it’s a hot keyword, and naive venture capitalists like the idea. So in comes the money.

Analytics

Tracking and stalking customers across the internet is very attractive for advertisers believing that doing so makes them seem more interesting to consumers. I’m not convinced. People often find it creepy. They feel like they’re constantly stalked. They visit the website of, say, a printer supplier and they receive ads for a month for printers… but not only for that supplier, but for other printers because the tracking provider is cheerfully using your data as a supplier against you and selling that information to your rivals! I think advertisers are starting to cotton on, but are unsure of what to do… but I know there’s a lot more direct selling of adverts between publishers and advertisers than there used to be.

But, the siren call of analytics is strong, and people love a nice chart on which to justify a decision, so the more nice charts your system can create, the more people will pay to use it and try to gain an advantage over competitors. And advertising is huge, so in pumps the money. For now.

Mass market apps

Can you build the next Facebook, Instagram, or Slack? What’s the potential for an app that lets people read books from any publisher for a fixed monthly fee? How about an app that revolutionises food delivery? Interestingly, some apps are about replacing old and inefficient intermediaries and putting new ones in place. Uber is a nice way of hiring a minicab with flexible pricing that rewards drivers for being available at the right time. They don’t disintermediate, however. The customer is both the driver and the passenger. The new intermediary takes their share.

If you can replace old intermediaries you can make a lot of money. Imagine taking 0.5% of every single financial transaction, like Visa do? That’s a lot of money. Then you have intermediaries between the card firms, providers, and networks, such as Stripe… and then there are those replacing old ones, like Wise, for money transfers across borders.

What other things can be improved? Well, literally anything.

But most attempts to build these apps and the supporting infrastructure are doomed to never turn a profit.

Blockchain

Blockchain is a really interesting concept for a public ledger, using an interesting concept called proof of work to make it hard for any one person to try to dominate the network and win the consensus mechanism on new transactions. There are theoretical ideas out there to improve on this, but at the moment they remain just that and haven’t been proven.

And it’s a scam. Pure and simple. But it’s a hot topic. Bitcoin, Ethereum, Dogecoin and many others are actively speculated upon, as well as being used for the exchange of value – often in a hope to evade regulators. It appeals to the natural rebels amongst us because it’s outside of government control… and given that governments aren’t always a force for good, I get that.

Problem is, Blockchain breaks the rules of good software development… if you look at the big O notation for software, it has to follow certain rules or it will fail at some point and need to be re-engineered. Big O matters. I don’t have academic access to papers, and the internet is full of vested interests pretending that Blockchain scales just fine. I used to see the same in WordPress land, where people said the software scaled fine… but it doesn’t. In WordPress we get scale by putting a layer between WordPress and the internet to balance things out – the work the software itself does goes up in line with the number of people talking to WordPress. We can define that as O(n) so long as you know what you’re doing – that’s OK. We can live with that. But the consensus mechanism required for multi node agreement of transactions as required to track transactions will, by its nature, follow a curve that is likely to be somewhat greater than O(n^2) (each node does O(n) work in a linear fashion but the total work done on the network as each node is added therefore grows as O(n^2) plus a bit for network latency and overheads. Yet bitcoin transaction cost isn’t following that curve in spite of huge interest because, I reckon, most Bitcoin trades aren’t real.

Yes, that’s right. And what does that mean? It’s because wideboys, crooks and the overly-optimistic are involved. Given it is, by design, a pyramid scheme, it will have to fail at some point. But people are motivated to hide that, so there are Bitcoin tracker schemes, rather like gold purchase schemes, that never hold the asset in question. They will pump and pump values as hard as you like. And as long as there are new people coming in, like our receptionists wishes to, all is good.

And there are enormous amounts of money to be made. As in a goldrush, the people making real money are the shovel makers and traders. And they need developers. So for as long as there’s money to be made, coked up wide boys will be gurning their way through stressful meetings, fidgeting and anxious to cash in before it crashes out. You can earn a lot there. For a while.

OK, so thanks for the very long essay. What does it mean then?

Well, it means developers are really expensive right now. Small firms that do actual useful work and aren’t highly capitalised (like mine) can’t grow because we can’t suddenly charge our customers double for the work so that we can compete against these booms. It’s as if a very rich person has moved into your town and hired all the builders possible to create a huge mansion. They even approached builders working for firms and offered them double to come build that mansion. Soon builders are all swanning around town in Teslas and feeling pleased with themselves for being so cunning as to be in the building industry.

Same in software. Locally there’s a Tesla with a crypto referencing private number plate and a young, bearded and muscular techbro driving it. Fine, I’m not going to judge. He’s happy and making good money.

But if builders are all hired by the rich, the rest of us get priced out. Same in software. Small firms are going to find they can’t afford websites unless they just use some cheap web builder platform – it’ll give a less good solution, but it’ll do the job. Ish. And the firms that can afford will do that bit better. And better. And the gap will grow.

At my firm I’ve had to raise salaries, but we still struggle to clear a profit with the raised salaries. I’m fiscally conservative, so we’ve always had decent cash reserves. This lets us ride out the storm. From 1997 to 2002 dev rates went crazy. By 2005 they were back to normal again. We as a firm can’t handle eight years of this. But it’s not quite the same as back then – you can now hire developers globally and have them work remotely, if you really wish to, which can save some money and also help those countries out with extra foreign revenue. I, however, really like quality and good communications and I find that a geographically tight team works the best. It also makes it easier to hire new people into the trade. So, for now, I’m sitting tight. I won’t seek venture capital, or borrow. And if the worst comes to the worst, we’ll add AI to something that does basic statistical analysis, and blockchain to something with two computers in the network and hope someone out there fancies throwing us some money so we join the party. In the meantime, however, there’s still a healthy living to be made as a business doing useful things and avoiding the hot trends. I never set out to be rich, merely secure – I’ll ignore the rich mansions and do my own thing, creating good code for good people.

n.b. about the above – the above isn’t a paper. It’s a set of opinions designed to inform and illuminate about what’s happened. It relies on anecdotes. Don’t take it too seriously and don’t use it as the basis for what you want to do with software and investing in software. Or crypto. Do your own thing with the information you gather from multiple sources. Also remember that a lot of people say misleading things because it’s in their interests to do so, and that you shouldn’t trust a random blog or news source on the internet. Mine included.

Of WordPress Training and Learning

Over at Interconnect IT, where I work, we’ve found that demand for our WordPress Training Courses has shot up over the past year or so.  And it’s certainly interesting to see where the work comes from.

Curiously, it’s very polarised – we either work with smaller one man band companies like Jason Nevin who runs a house removals company site who are looking to switch technologies, or big corporates and government agencies such as Shop Direct, The US Mission to the UN and the Department for Business, Innovation and Skills.

I’ve been thinking about why there’s such a big dip in the middle of our client base – 90% of our business is groups with over 500 staff or with fewer than three.

The Gap

Small, one man companies tend to involve highly motivated individuals.  They understand the important of their skills, and they know that in the tech sector they have to always stay up to date.  Large corporates tend to understand this too, and have allocated training budgets to make sure they keep up to date.  Government departments are often a little slower with new technology, but they too need to keep efficient or tax payers will kick up a stink.

And WordPress is a very efficient platform for running many informational websites.

But why are medium sized companies not coming to us in nearly such large numbers as micro enterprises and large corporates?  Let’s see…

Budgets

I’ve noticed that medium companies often have people who are extremely good at what they do, but I do find that there are often significant skills gaps.  I’ve dealt with someone from a school (medium) who didn’t realise that you don’t have to close an application in Windows in order to see another application.  Each time she cut and paste she’d open one document, select the text, close the document, then open the receiving application and paste the text there.  Productivity, as you can imagine, was pretty poor.

I think a lot comes from budgets – many firms around the 50 people size aren’t always able to make good money.  They have to be careful where they spend it – they’re not big enough to have training departments who make sure everyone is up to date, and they’re usually busy.

Culture

Another thing with smaller firms, I believe, is that they’re often started by individuals with a lot of skills – these are flexible folk who can teach themselves and learn quickly from books and the internet.  As they grow they try and hire similar people, but eventually there comes a point where a lot of staff are there for the job.  They need training because they aren’t going to go to the trouble of autodidactism.  They have a job to do, and they’re going to do that and no more or less.

At best, they’ll get on-the-job training.

Our Marketing

We don’t do a lot of it, to be quite frank.  But perhaps our website, approach and costs simply don’t ring true with people in medium sized companies looking for WordPress training?  Do we need to get advertising in business magazines, such as those sent out by the FSB?

Summary

I suspect that the truth is that a company always needs to look at the skills of staff, but as they reach a certain size they have too much going on to give it much thought.  Once they break through that difficult 50 man barrier things seem to start to change again.

But how do we change this?  I’m not sure we can, easily.  Governments often give generous grants, and around here we have Skillworks which helps a little, and we do get local approaches – however, the person paying still has to pay a significant contribution and specialist training is never all that cheap.

Do you have any ideas of how skills can be improved in small to medium sized enterprises?  Should we be marketing our courses more proactively?  What about scheduled classroom courses that keep things at a lower cost, albeit needing more time from the attendees?  I’d love to hear your thoughts – especially in the field of WordPress.

Five Things Bing Does Better than Google

MS have, at last, come up with what appears to be a competent rival to Google. Here’s five ways in which it beats Google.

Microsoft (MS), quite frankly, gets a lot of grief in the internet world.  Sometimes it’s fair (I never like MSN, for example, from way back in the mid nineties) and often a little unfair.

But Live Search simply wasn’t up to the job.  It didn’t work well.  And I know that people that found IE defaulting to it would either work out how to change it, or simply type Google.com into the address bar.  In other words, many tried it, but it didn’t find the answers they wanted.  The algorithm has been slowly improved with time, but the damage was done.  MS knew they had to relaunch.

Bing, they felt, was the answer.  And in some ways, it’s a better and more productive tool than Google:

Bing - pretty pictures to cheer you up
Bing - pretty pictures to cheer you up

1. It’s Prettier

While I’ve heard many question the function of the landing page photo, I personally really like it.  It’s attractive, well designed, and brings a little bit of beauty into the day.  You can’t sit and surf pretty images at work, so if they’re there as part of the ‘wallpaper’ of a daily tool then that’s a lift we all need.

2. Infinite Image Search

The infinite scroll facility of the image search makes it a quicker tool to use.  Chunking of text related searches makes sense, because we can scan a page relatively slowly, but with images the human eye can scan a huge amount of visual information incredibly quickly which means that Bing’s constantly scrolling visual tool is way ahead of Google’s image search.

3. Video Previewing on Video Search

bingvideo
Bing Video - content owner's nightmare or benefit?

Searching for video content can often be a slow and painful process.  In Bing, when you get a series of videos up on screen you can simply hover your mouse pointer over a video to preview the first 30s and get a feel for the video, rather than visiting the site and waiting for a slow load.  The previews are poor quality, in order to get quick loading, but they’re good enough.  I feel this is one of Bing’s most effective innovations.

One thing where they may struggle is that if you click the video and that video has an embed option, you get it on the Bing site, rather than going through to the source site.  So a YouTube video search result doesn’t send you off to YouTube.  Content owners may not like this.

4. Site Preview

When you hover over a search result, you’ll see a small orange marker appear over to the right.  Hover over that and up pops a preview of the content you’re looking for.  Again, saves a wasted visit as it lets you scan a little bit of content for relevance – something that’s quicker this way than clicking on yet another unnecessary site.

5. It’s Not Google

Bing is, purportedly, a recursive acronym that means Bing Is Not Google.  But there’s something important in that – Microsoft is a highly profitable, focussed company that has the resources to provide an alternative to Google.  This is important – without solid competition Google will cease to innovate appropriately.  MS suffered a similar fate on the desktop – they were too dominant and rivals couldn’t compete.  Apple’s OS9 was dreadfully dated when sat next to a Windows machine of the same era, yet Windows had significant flaws.  It’s only lately with Windows 7 that MS have really started to get their act together properly – because OSX finally gave it some decent competition in certain sectors.

When you start seeing articles on how to change from Google to Bing on Firefox, you know something’s happened.

It Can Get Better

Microsoft Seadragon, with it’s deep zoom and mobile capabilities, and Photosynth technologies could be tied into the image search, for example.  As cheap processing power expands and more and more images are geotagged, this could form an astonishing visual search capability.  A shame it won’t be coupled with Google Street View – imagine what that could be like?

Search is going to become more relevant and more powerful with time.  Developers (our own Interconnect IT included) are busy creating a lot of powerful geocoded databases which will allow for some amazing mashups.  If Google and MS start fighting for dominance in this space the opportunities for users and information suppliers are vast.  Are you looking into it?

New Year’s Resolutions for Greater Productivity

I don’t talk much about business on this blog, but I’ve decided to share what I’m doing to increase my productivity at work. So far these changes are making a great deal of difference.

An infinite blogger.
An infinite blogger.

I don’t talk much about business on this blog, but I’ve decided to share what I’m doing to increase my productivity at work.  So far these changes are making a great deal of difference.

  1. Dump timewasters like the StumbleUpon or Digg toolbars from Firefox for any work related PC.  I love it, but it’s there for entertainment.  This is my work PC and I can’t afford the easy distraction.
  2. Use Twitter more.  I know it sounds like a potential distraction, but by being selective about who I follow I find it adds to my community connection – and that can make me more productive, rather than less.  Don’t be offended if I don’t follow you back – it’s just that what you’re twittering about isn’t connected to what I do, even if it’s very interesting.
  3. Declutter my online life.  That means unsubscribing from mail-lists that I’m not really that interested in, and filtering the rest for reading when I’m not busy.
  4. Declutter business.  All companies have to deal with them – the small clients that constantly ask you lots of niggling questions which never actually lead to a sale or any real income.  Work out a way of politely dumping them.  You could consider referring them on to someone who’s just starting up and who needs the small clients.
  5. Implement proper time-tracking.  Use a simple grid sheet where you can quickly mark units of time against clients and jobs.  That way you can establish where you’re wasting time and money.
  6. Turn off IM except for a short period each day – especially if you have chatty friends.
  7. Use larger monitors.  I now use a 24″ screen at the office and a smaller 22″ at the home office.  Both are dramatically more productive than smaller screens.  And they’re not even especially expensive these days.
  8. Use your laptop like a desktop computer.  By that, I mean get to your desk and connect it a full size monitor (see point 7!), keyboard and mouse.  Use the laptop screen as a secondary screen if you like, but that’s all.  I don’t care what anybody says, but a laptop alone is always less productive unless you’re single-tasking most of the time – and in today’s connected world that’s rare.
  9. Learn to use Outlook.  There’s a lot of great productivity features in there.  Outlook 2007 is especially neat and brings the game on.  Office for the Home or for Small Businesses is pretty cheap these days and well worth it.
  10. Actually, learn to use MS Office properly.  It’s got some amazing tricks available to you.  Excel can gather data from websites and keep it refreshed, so you can use it in your spreadsheets.  Access can make up the basics of a decent CRM system in no time at all.  And if you get a decent MS Word template your documents can be clearly structured and indexed in no time at all.  In fact, if you join at Spectacu.la their WordPress User Guide has all the styles in it that you could ever need for a comprehensive document.

That’s enough for now, but needless to say that a little investment can reap incredible benefits to your work life.  Yes, you’ll need to devote a little time and/or money, but if you gain more of both within a short while then everyone’s happy, no?