Paul Wallbank – Brilliant Communications

Author: Paul Wallbank

How much server space do Internet companies need to run their sites?
“How much server space do companies like Google, Amazon, or YouTube, or for that matter Hotmail and Facebook need to run their sites?” is the question I’ve been asked to answer on ABC Radio National Drive this evening.

This isn’t a simple question to answer as the details of data storage are kept secret by most online services.

Figuring out how much data is saved in computer systems is a daunting task in itself and in 2011 scientists estimated there were 295 exabytes stored on the Internet, desktop hard drives, tape backup and other systems in 2007.

An exabyte is the equivalent of 50,000 years worth of DVD video, a typical new computer comes with a terabyte hard drive so one exabyte is the equivalent of a million new computers.

The numbers when looking at this topic are so great that petabytes are probably the best way of measuring data, a thousand of these make up an exabyte. A petabyte is the equivalent to filling up the hard drives of a thousand new computers.

Given cloud computing and data centres have grown exponentially since 2007, it’s possible that number has doubled in the last five years.

In 2009 it was reported Google was planning to have ten million servers and an exabyte of information. It’s almost certain that point has been passed, particularly given the volume of data being uploaded to YouTube which alone has 72 hours worth of video uploaded every minute.

Facebook is struggling with similar growth and it’s reported that the social media service is having to rewrite its database. Last year it was reported Facebook users were uploading six billion photos a month and at the time of the float on the US stock market the company claimed to have over a 100 petabytes of photos and video.

According to one of Microsoft’s blogs, Hotmail has over a billion mailboxes and “hundreds of petabytes of data”.

For Amazon details are harder to find, in June 2012 Amazon’s founder Jeff Bezos announced their S3 cloud storage service was now hosting a billion ‘objects’. If we assume the ‘objects’ – which could be anything from a picture to a database running on Amazon’s service – have an average size of a megabyte then that’s a exabyte of storage.

The amount of storage is only one part of the equation, we have to be able to do something with the data we’ve collected so we also have to look at processing power. This comes down to the number of computer chips or CPUs – Central Processing Units – being used to crunch the information.

Probably the most impressive data cruncher of all is the Google search engine that processes phenomenal amounts of data every time somebody does a search on the web. Google have put together an infographic that illustrates how they manage to answer over a billion queries a day in an average time of less than quarter of a second.

Google is reported to own 2% of the world’s servers and they are very secretive about the numbers, estimates based on power usage in 2011 put the number of servers the company uses at around 900,000. Given Google invests about 2.5 billion US dollars a year on new data centres, it’s safe to say they have probably passed the one million mark.

How much electricity all of this equipment uses is a valid question. According to Jonathan Koomey of Stanford University, US data centres use around 2% of the nation’s power supply and globally these facilities use around 1.5%.

The numbers involved in answering the question of how much data is stored by web services are mind boggling and they are growing exponentially. One of the problems with researching a topic like this is how quickly the source data becomes outdated.

It’s easy to overlook the complexity and size of the technologies that run social media, cloud computing or web searches. Asking questions on how these services work is essential to understanding the things we now take for granted.

Similar posts:
August 23, 2012
Selling old rope
“Big Data is a fad” announced a speaker at a technology conference. “We’ve had Big Data for years. We used to call it business analytics.”

He’s right. The IT industry is very good at rebadging technology and the term ‘Big Data’ is just the latest of many examples — the best of which is how ‘cloud computing’ which is largely a rebadging of SaaS, Application Service Providers or client-server.

While it’s easy to be cynical about this IT industry habit, there is a valid underlying point to this repainting old rope — that the refurbished old string is cheaper and more useful than what came before it.

The problem for innovators creating accessible, cheaper and faster ways to do things is they risk that their product will be likened to the old, expensive and inaccessible methods. No cloud computing provider wants to be associated with IBM’s expensive client-server products or the flaky Application Service Provider of the dot com era.

Most innovations aren’t revolutionary, they have evolved out of an older way of doing things. So saying “it’s being done before” when seeing an innovative product may be missing the point.

In the case of Big Data the principles aren’t new but we’re collecting more data than ever before and the old tools — even if they could manage with the volume of information— are far more expensive than the new services.

So repainting old rope isn’t always done for purely marketing purposes, sometimes there’s a real benefit to the customers.

Similar posts:
August 22, 2012
Fleeing the group buying market
As Apple becomes the highest capitalised stock in US market history, former daily deals site and market darling Groupon continues to sink into misery.

Groupon led the group buying mania of 2011 and its stock market float in November of that year valued the business at 13 billion dollars, ten months later the business has a capitalisation of three billion, wiping out three quarters of its IPO shareholders’ investment.

To make matters worse for the daily deals site the New York Times features a story looking at deal fatigue, where customers tire of the daily emails offering discounted cafe meals or personal training while businesses find the deals just aren’t worth the trouble.

“I pretty much had to take a loan out to cover the loss, or we would have probably had to close,” the Times quotes Dyer Price, owner of Muddy’s Coffehouse in Portland, Oregon. “We will never, ever do it again”

In a straw poll, the Times correspondent visited neighbouring businesses who had similar stories.

The common factor with all the business horror stories surrounding group buying or deal of the day sites is high pressure sales tactics that blind the merchant to the downsides of these offers.

For these services, it’s essential to move through as many deals as possible so salespeople are driven to sign up as many merchants as possible. When you put pressure on sales teams, they tend to behave in ways that aren’t always good for customers.

Most of the customers Groupon attracts – or those of other deal of the day sites – are price sensitive and fussy. Having demanded their deal, most of these customers are not coming back so it may well be that daily deals are the most expensive, disruptive and pointless marketing channel ever invented.

The results of the high pressure tactics are shown in a Venture Beat story which claims Groupon is now threatening to sue unhappy merchants as payments slow and the daily deals struggle to attract customers.

What was always misunderstood during the group buying mania was that Deal Of The Day sites weren’t really technology plays – they were reliant on good sales teams driving deals. The technology being used was incidental to the core business concept.

In this respect, services like Groupon had more in common with the Yellow Pages or multi-level marketing schemes. It was about salespeople delivering orders and taking a percentage off the top. To compare Groupon with Google, Facebook or any tech start up was really missing the point.

This isn’t to say that group buying or deals of the day services don’t have a role in business. For retailers clearing inventory, hotels working around quiet periods or new businesses wanting to get attention in a crowded marketplace, there’s an argument for offering a deal on one of these sites.

For most though it was an expensive and pointless exercise that attracted the picky, price sensitive customers that most business would avoid rather than encourage. That’s the harsh lesson learned by many of the businesses who fell Groupon’s fast talking salesteams.

Similar posts:
August 21, 2012
Is Australia’s blue sky future making way for a red sunset?
Australia’s political and business leaders are convinced the nation will ride on the back of a fast growing China for the foreseeable future.

Having climbed off the sheep’s back during the 1980s and moved from being an economy dependent on agricultural exports to a ‘clever country’ exporting high value services and products, in the late 1990s Australia turned its back on building a modern economy and decided to stake the future on a never ending coal and iron ore boom driven by Chinese industrialisation.

Smarter than Bill Gates

Australia’s success in riding China’s coattails allowed the Reserve Bank Governor Glenn Stevens in 2010 to boast how he and the nation’s politicians were smarter than Bill Gates who nine years earlier warned Australia about being over reliant on commodities.

Despite the hubris, there are real risks in the Chinese economy that the blue sky mining school of Australian economic management needs to plan for.

China warnings

The warning to US Presidential candidates on trade with China by Professor Patrick Chovanec of Beijing’s Tsinghua University’s School of Economics and Management is a good starting point.

In his warning Professor Chovanec points out that Chinese growth in recent years has been driven by the construction sector, even if building activity were to stay constant this would shave off half of China’s growth rate. The options for stimulating the economy in manner similar to 2008 have narrowed.

China’s economy is not just slowing, it is entering a serious correction. The investment bubble that has been driving Chinese growth has popped, and there are no quick “stimulus” fixes left. There is the very real possibility of some form of financial crisis in China before year’s end.

China’s stimulus package was the world’s biggest response to the 2008 Global Financial Crisis, followed by the South Koreans (another Australian commodities customers) and Australia itself.

While the Chinese commodities boom drove most of Australia’s trade, it was domestic spending driven by the Rudd government’s stimulus package that saved Australia from entering recession.

Squandering a century’s boom

One of the notable things about Australia’s commodity success in the 2000s is just how little a dent the booming coal and iron ore exports put in the trade deficit. Despite record terms of trade, Australians still manage to spend as much on imports as they make on exported goods.

Not that this worries Australia’s leaders who seem to spend all of their time worrying about pandering to a tiny number of marginal seat voters who listen to fear mongering talkback radio hosts which is what has driven the last two weeks’ obsession with a few hundred asylum seekers.

Professor Chovanec points out the Chinese leadership is distracted as well with their struggles over a messy change of Politburo leadership, risking that the policy makers might miss any opportunity they have to engineer a ‘soft’ landing for their economy.

The biggest risk is that of a crisis engineered to distract a discontented population warns Chovanec;

in a worst case scenario, China may be tempted to provoke a conflict in the South China Sea to redirect popular discontent onto an external enemy.

Already such things are happening, as anti-Japanese demonstrations step up around China over an island dispute.

There are no shortage of island disputes in the South China Sea and almost all scenarios involve allies of the United States – the only one feasible dispute that doesn’t is Vietnam and China’s leadership has had their nose blooded in such disputes with their southern neighbour before.

Even if we don’t see military tensions between the US and China, we certainly are going to see trade and political disputes in the next few years as both countries adapt to their places in a changed world.

For Australia’s business and political leaders, it means being prepared for a world more complex than one where a country can get by just lazily skimming a few dollars of easy iron ore exports to China.

We have to hope Australia’s leaders are capable of dealing with the challenges of a much more dynamic and difficult world where huge growth of one friendly trading partner is not assured. The stakes are too high to be distracted by suburban apparatchiks scoring meaningless political points off each other.

Similar posts:
August 20, 2012
Is Small Business Whingeing its way to irrelevance
“Is small business whingeing its way to irrelevance?” first appeared in Smart Company on August 16, 2012.

Last week, TripAdvisor announced the results of a worldwide hospitality survey. One of the things that leapt out of the survey was how large hotel chains are using social media while smaller Australian establishments are languishing.

Following on TripAdvisor’s survey was the release of accounting software company MYOB’s regular index that showed businesses are retreating from the online world with reduced usage rates of social media, eCommerce and online payments.

At an Australian Israel Chamber of Commerce lunch in Sydney on Tuesday, MYOB’s CEO Tim Reed and Google Australia’s Tim Leeder discussed small business and the web with their Getting Australian Business Online program missing its target of 50,000 sign ups since its launch in March last year.

The fact more than half of Australian businesses don’t have a website despite free services from Google, WordPress, Weebly and a host of others indicates a deeper apathy among small businesses towards a whole range of issues.

Earlier this year the New South Wales state government abolished the popular Small Business September program with barely a squeak from the SME sector, with some small business groups actually welcoming what was a dramatic cut to support programs.

Compare this to the Olympic athletes, not only do we see the AOC coming out swinging with demands for more funding but the yachting team are staging an effective campaign to reinstate NSW government programs to support their sport: The total opposite to the small business community.

Small business, on the other hand, rolls over and accepts cuts to programs, poorly thought out regulations and government procurement policies that favour multinationals over local companies which are capable of the job.

When small business is given a chance to have a voice, the community blows it with whingeing. At the NSW Small Business Commissioner’s roadshows earlier this year it was notable how much time was spent whingeing about group buying services, traffic clearways and council permits for coffee tables rather than sensible and achievable wins for the SME sector.

So it wasn’t a surprise that the result of that roadshow was the cutting of useful programs and little effective change.

The best example of this whingeing rather than action is the current campaign to increase the GST threshold and abolish penalty rates.

Instead of focusing on the real problems facing businesses such as high rents, profit gouging from distributors and poorly thought out state and federal regulations imposed by both sides of politics – the small business and retail sectors manage to demonise their staff and customers and increase the suspicions of consumers and workers that they’re being ripped off by big, bad employers.

In reality, the shopkeepers and other small businesses are struggling to adapt to a rapidly changing economy. They are feeling those changes earlier than the rest of the economy because they don’t have the cushions of fat margins, political connections or guaranteed incomes of the corporate, public or political sectors.

Those struggles will give the small business sector an advantage over the bigger and slower groups – having adapted to the changed economy, those smaller businesses will be stronger and fitter than their bigger competitors.

Chris Ridd, of cloud computing accounting service Xero, one of MYOB’s biggest competitors, puts this best.

“Technology is an enabler and can actually help small businesses gain efficiencies, reach new customers and generate new revenue streams. Why turn your back on the one thing that can turn your business around.”

It’s the proactive business people adopting new technologies who are going to thrive over the next decade. Whingeing about TripAdvisor, the GST or dumb government policies isn’t going to save an enterprise that’s become irrelevant.

So make sure your website’s up to date, check what customers are saying about you on social media or review sites and have a look at those cloud computing services that can improve your business’ profitability and efficiency.

The time to do it is now, before your business becomes irrelevant.

Similar posts:
August 19, 2012