Category: Big Data

  • How Green is the Internet?

    How Green is the Internet?

    Earlier this month Google hosted “How Green is the Internet?“, a summit which looked at the environmental costs of the connected society and technologies like cloud computing and Big Data.

    The environmental impact of the internet and related technologies is a subject worth exploring, like all industries there are real costs to the planet which usually aren’t bourne by those who make the profits or reap the benefits.

    In complex modern supply chains which often span the globe, the costs are not often apparent either. What appears to be a relatively clean, innocuous product to city consumers could have terrible environmental consequences for others.

    Google’s summit is a good example of overlooking many external costs in that most of the conversations looked at reducing energy usage, understandable given the company’s dependence on power hungry data centres which drive their cloud computing services.

    move-to-cloud-cost-savings-on-the-internet

    Energy usage is important in the discussion about digital technologies – the businesses of bits and bytes almost wholly relies upon having constant and reliable electricity supplies and power generation is one of the most environmentally damaging activities we engage in.

    Focusing on energy consumption though is not the only aspect we need to look at when examining how green the internet is, there’s many other costs in building the supply chain that enables us to watch funny cat videos in our homes or offices.

    The entire supply chain is complex and the session on infrastructure costs by Jon Koomey of Stanford University touched on this; there’s the environmental costs of building data centres, of manufacturing routers, of laying cables and – probably the most difficult question of all – what do we do with the e-waste generated by obsolete equipment.

    Little of this was touched on in the Google conference and it’s interesting that the tech industry is focusing on the energy costs while overlooking other effects of a global, complex industry.

    That isn’t to say the energy story isn’t valid. A number of the Google speakers emphasized the indirect energy saving costs as cloud computing and Big Data allows more intelligent business decisions that make industries and daily life more efficient.

    A favourite example is the use of car parking apps where drivers save energy and reduce pollution because they aren’t driving around looking for the parking spaces. This puts Google’s acquisition of traffic app Waze into perspective.

    Reducing driving times is just one area of where the internet is improving energy efficiency and these are important factors when considering the ‘greenness’ of the web.

    However without considering the full impact of building, maintaining and disposing the equipment that we need to operate the internet, we aren’t really looking at the entire impact the internet is having on the planet.

    Google’s conference though is a good starting point for that discussion which is one that every industry should be having.

    Similar posts:

  • Smart cities and the sensors in your pocket

    Smart cities and the sensors in your pocket

    National Public Radio’s Parallels program has story on how the Spanish city of Santander is wiring itself as a ‘smart city’ with a network of sensors wiring everything from garbage bins to parking spots.

    The hope with the sensors is they’ll will improve local government’s services, allowing things like more efficient garbage collection and better pricing of parking meters.

    What’s notable about the story is that smartphones are included as ‘sensors’ with Santander residents being able to submit data from their handsets.

    The idea of smartphones as sensors isn’t new — pothole reporting apps were early to the iPhone — the increased sophistication of handsets and improved tracking technology is making them more powerful.

    So we have another Big Data problem with local councils being flooded with information.

    Processing all this information is going to require the community pitching in so the data is going to have to open.

    Once governments make the data open it also creates opportunities for smart entrepreneurs to create new services and technologies.

    Creating new opportunities is a hope of government sensor programs around the world, including Tasmania’s Sense-T project .

    With factors like water quality and weather being monitored, existing sectors become more efficient and new industries are being created.

    Hopefully the urge to hoard this rich, community data will be resisted by governments.

    Similar posts:

  • Big data’s big truths

    Big data’s big truths

    One thing former Obama 2012 campaign CTO Harper Reed cannot be accused of is subtlety so his statement at the Sydney CeBIT conference last week that Big Data is Bullshit wasn’t wholly surprising.

    Reed has a good point – like all IT industry buzzwords there is a fair degree of hype and BS around Big Data although his referring to it as a storage problem misses the point.

    Data storage is a problem largely solved; when we’re talking about Big Data today, we’re talking more about analysing the information and managing the life cycle of an organisation’s data.

    Not that these issues are new, the tech industry has been dealing with the challenges of storing, managing and analysing data since computers first appeared. In fact, that’s the reason computers were invented.

    An excellent NY Times Bits blog post expands on Harper’s views and rebuts many of the myths and hype around big data.

    Most important is the point that big data is not the truth, we can torture those bits and bytes to tell us anything we like.

    Claims that Big Data can tell us everything or that it will conquer discrimination and make cities smarter are fanciful. It all depends on how we choose to use the data.

    There are downsides with Big Data too — we live in an age where it’s easier to let the algorithm do the work and if the computer says ‘no’, then we can shrug and say “sorry it’s beyond our control.”

    Letting the algorithms run our lives is one of many risks, but it doesn’t change the opportunities for businesses, governments and communities Big Data presents. If we can understand our world better, we can do smarter things.

    That’s the real opportunity with Big Data and we don’t need the hype to tell us that.

    Similar posts:

  • ABC 702 mornings – Storage and your computer

    ABC 702 mornings – Storage and your computer

    This morning on 702 Sydney I’m talking to Linda Mottram on the decidedly unsexy topic of storage – hard drives, cloud computing and the struggle to keep up with ever expanding file sizes of documents, photos and downloads.

    It’s an opportunity to revisit the How Much Data Does The Internet Need topic which I covered for Radio National last year, although almost certainly that needs updating.

    Earlier this year networking vendor Cisco released its 2013 Virtual Networking Index which forecast global data traffic growing fourteen fold over the next five years.

    Those bytes slopping around the internet have to come to rest on someone’s hard drive and this is what’s driving the storage crisis.

    Yesterday US business site Venture Beat had an op-ed by an executive from Seagate, the world’s biggest hard drive manufacturer where he discussed the storage challenges with a claim from industry consultants IDC that worldwide computer storage is 2.7 zettabytes.

    A zettabyte is a trillion gigabytes, or ten followed by twenty zeros – it’s the equivalent of a billion one terabyte hard drives that are standard on most cheap desktop computers.

    Where those hard drives are located is the big challenge, is it on your laptop, smartphone or on a somewhere on a cloud service?

    The other big challenge is what do you do with all this information – which is where the Big Data discussion comes in.

    While data storage is a mundane topic, it’s a big one that matters. I hope you can tune in.

    We’d love to hear your views so join the conversation with your on-air questions, ideas or comments; phone in on 1300 222 702 or post a question on ABC702 Sydney’s Facebook page.

    If you’re a social media users, you can also follow the show through twitter to @paulwallbank and @702Sydney.

    Similar posts:

  • Skills, data scientists and the decade’s big IT trends

    Skills, data scientists and the decade’s big IT trends

    As we all get buried under a tsunami of data, the challenge is managing it. The MIT Technology Review this week looks at the rise of the data scientist, a job title unknown a few years ago.

    The problem for industry is the skill sets required to become a data scientist are fairly esoteric.

    Data scientist has become a popular job title partly because it has helped pull together a growing number of haphazardly defined and overlapping job roles, says Jake Klamka, who runs a six-week fellowship to place PhDs from fields like math, astrophysics, and even neuroscience in such jobs. “We have anyone who works with a lot of data in their research,” Klamka says. “They need to know how to program, but they also have to have strong communications skills and curiosity.”

    Over the last twenty years we’ve done a pretty poor job teaching maths and statistics which is going to create a skills shortage as industry struggles to find people qualified to figure out what all of this data means.

    While Big Data might be to this decade what plastics were to the 1960s, it’s not the only technology change that’s affecting business as the McKinsey Quarterly describes the ten IT trends for the decade ahead.

    The thing that really stands out with McKinsey’s predictions is the degree of reskilling the workforce is going to need, today’s workers are going to need an understanding of programming, logic and statistics as much the kids currently at school.

    If you’re planning on being in the workforce at the end of this decade right now may be the time to consider getting some of these skills.

    Just as businesses will be separated by how they use Big Data, workers may too find those skills divide the winners from the losers.

    As the amount of data flooding into our lives explodes, we’ll all need to think about how we can get the skills to manage and understand data.

    Similar posts: