big data | Paul Wallbank - Communications Professional

The real thing behind the internet of things

We need to think beyond technology to get value the real value from the internet of things says Alicia Asin, the CEO and co-founder of Spanish sensor company Libelium.

Libelium and its CEO Alicia Asin has been covered previously on this blog and we had the opportunity to record an interview with Alicia at the 2013 Dreamforce conference.

Alicia told us about her vision for how she sees cities and governments evolving in an era of real time accessible information, in many ways it’s similar to where the Deputy Lord Mayor of Barcelona sees his city being at the end of this decade.

“I would say the biggest legacy the internet of things can bring is transparency,” says Alicia. “In the smart cities movement the IoT gives an opportunity for have a dashboard for cities.”

“You can see the investment made for reducing traffic investment downtown, the carbon footprint reduced and the return on investment,” says Alicia. “You can have very objective facts to supply to the citizens and they can make better decisions.”

For this vision to become true, it means government data has to open to the community which is something that challenges many administrations, however Alicia also told the story of how her company supplied Geiger counters to volunteers monitoring the radiation fallout around the damaged Fukushima nuclear reactor in Japan.

“We made a project in Fukushima when the nuclear accident happened where we sent some Geiger counters to the hacker space,” says Alicia. “Suddenly all the people with the Geiger counters started to publish the data onto the internet.”

“They were keeping a totally independent radiation map made by the activist citizens.”

Alicia raises an important point of how citizens can be using technology independently of governments. This was most notable in the Occupy movements across the United States that sprung up in late 2011 where hackers set up independent communications networks and recorded events outside the control of mainstream media and government agencies.

While citizens can use these tools to get around official restrictions, governments play an important role in developing new industries around these technologies, Alicia sees the smart city investments made by Spanish cities as creating the start of a Spanish Silicon Valley.

“Despite the economy, we are seeing a number of projects in Spain around smart cities,” Alicia observes. “In fact, I’m saying Spain is becoming the Silicon Valley for smart cities.”

“In terms of attracting big companies to look at what’s going on in Spain and to build a bigger brand around the Internet of Things, I think that really helps.”

With government and citizens working together, Alicia sees the Internet of Things delivering great changes to society as it enables citizens and makes governments more accountable.

“It’s the real thing, it’s beyond technology.”

Finding the data editors

Data journalism is the future of news media, but who will check and edit the data?

Data journalism is one of the buzz words of the media industry as it deals with its own issues of extracting information from the flood of data swamping business and society.

One of the media organisations leading the move to data journalism is The Guardian who have an excellent video on what a data journalist does.

The question though is where are the data editors? Like traditional journalism and writing, a good sub-editor is essential to clean up copy and check that the story makes sense.

With data, it’s even more important for other pairs of eyes to look at the numbers.

Last week I was asked by an editor to check a story that lots of number – and those numbers didn’t make sense. In fact, the numbers as they were presented argued against the writer’s point. Had the story run, both the writer’s and the publication’s would have been damaged.

Many news organisations are cutting back on their sub editing teams and the resulting drop in quality is hurting their publications.

Poor checking of data is even more risky and it’s going to be interesting to see if media organisations start devoting scarce resources to editing their data driven stories.

Do business awards help companies?

Winning business awards are great for helping a company focus on its operations, but they aren’t necessarily great for growing an organisation.

The latest clip on The Decoding the New Economy YouTube channel is an interview of Cameron Wall of Melbourne’s C3 Business Solutions about business intelligence, data analytics and whether winning awards helps a company.

Cameron’s business has been a successful enterprise having grown to over a hundred employees since being founded seven years ago.

As a high growth business, the company was listed in the 2010 BRW Fast Starters list, interestingly though Cameron didn’t see a great deal of benefit from winning the accolade.

“I look at it as being a credential, just because you get the credentials it doesn’t necessarily mean you can charge a premium in the marketplace,” Cameron says. “It all helps in terms of recognition, but we haven’t been thrown anything as a result of the award.”

On the other hand the company has won the BRW Best Australian workplace three years in a row and Cameron has found this improved the business’ recruitment.

“Being in a service company you often hear ‘people are our greatest asset’, basically they are our only asset.” Cameron says, “Having a great place to work is really important for us.”

Cameron found that after winning the great place to work that the flow of resumes increased. “Some of the benefits of that were a lot of people applied to join C3 and it makes the recruitment process a lot easier.”

How business awards do help companies is in reviewing their operations and practices as Cameron explained, “using the great place to work process is a great way to understand if we’re trending upward, downward and where we’re going.”

“It was a difficult award to win, as you get probed by every angle.”

With the growth in data science, business analytics and Big Data companies like C3 are going to need good employees in the global race for talent. Having a reputation as fine place to work is a good way of winning the global race for talent.

Trophy image by RoyM through sxc.hu

Big Data needs big databases

Investors are making big bets on the databases that underpin Big Data

While the tech industry’s startup hype this week has been focused on the impending Twitter Initial Public Offering, a much more fascinating company quietly completed a major capital raising.

MongoDB provides an open-source, document database program and last week raised another $150 million from investors that values the company at $1.2 billion dollars.

Databases lie at the heart of Big Data and businesses need better computer programs to manage the overwhelming amount of information that’s pouring in every day.

As every business is unique, larger corporations find they spend huge amounts of money on their databases. The enterprise that buys an Oracle, IBM or SAP system usually spends tens, if not hundreds, of millions of dollars in adapting the system to work for them, often with less than spectacular results.

While implementing MongoDB or any other open source program doesn’t eliminate implementation costs, it is often easier to setup and maintain as most of the information about the system is shared and freely available rather than locked inside the vendor’s proprietary knowledgebases.

Probably most important of all, the data structures themselves are open so customers don’t find themselves locked into a relationship with one vendor because all their information is in a format that can only be read by one system.

Open source is where Big Data, social media and cloud computing intersect – without the data itself being open and accessible, most cloud computing and social media services will almost certainly fail.

So MongoDB and the other open source products are the quiet, back of house technologies that keep the internet as we know it ticking along.

Bloomberg Businessweek reports there’s some very serious investors in MongoDB.

The deal attracted new investors such as EMC Corp. (EMC:US) and Salesforce.com Inc. (CRM:US), along with previous backers Red Hat Inc. (RHT:US), Intel Corp. (INTC:US), New Enterprise Associates and Sequoia Capital, according to MongoDB.

Sequoia Capital are one of the longest lasting Silicon Valley venture capital firms whose greatest success was being one of the first investors in Apple Computers and New Enterprise Ventures have a similar pedigree with companies like 3Com, Juniper Networks and Vonage. Investment by industry leaders like Intel, Red Hat, Salesforce and EMC in the company also shows MongoDB isn’t the standard Silicon Valley Greater Fool play.

When there’s a gold rush, it’s those selling the shovels who make the big money and the investors in MongoDB and similar services are hoping they’ve found some of the modern day shovels.

That may well turn out to be the case and while the smart folk make more money from the technologies that drive social media and cloud computing services, the rest of us are distracted by the latest shiny thing.

On the internet, the Feds know what breed of dog you are

The downfall of Silk Road’s alleged founder is a lesson on how fragile our privacy and online security are

The arrest of alleged Silk Road founder Ross Ulbricht – also known as the Dread Pirate Roberts – has attracted plenty of media attention.

What’s particularly notable is the FBI is claiming Ulbricht made a basic mistake in posting to a website under his real name that gave his identity away.

If true, Ulbricht’s trivial mistake illustrates how easy it is for any determined investigator to find someone’s identity online from the trillion points of data we all create in the connected world.

Anyone who wants to be truly anonymous on the web has to work extremely hard to protect their identity. Most of us aren’t prepared to trade convenience for security, particularly given the massive effort required.

Even if we could protect our online habits, the use of credit cards, loyalty plans and even driving our cars still it almost impossible to escape the watch of a determined investigator.

In the early days of the web, it was said “on the internet, no-one knows you’re a dog.” Today the feds can figure out not only what breed of dog you are, but what your name is and your favourite brand of dog food.

The modern panopticon we live in is a very efficient machine and it’s difficult to hide from society’s gaze. It’s why we need to rethink privacy and information security.

Image of Presidio Modelo by Friman through Wikimedia.

The truth is in the data

One of the big challenges facing all organisation is using Big Data to understand their customers better, Emma LoRusso and Digivizer are part of the new wage of businesses and entrepreneurs providing the tools to help managers make better decisions.

Emma LoRusso founder of Sydney based social analytics service Digivizer believes the truth in a company’s data will challenge many managment and marketing beliefs.

In a somewhat poorly recorded interview as part of the Decoding the New Economy YouTube channel, Emma described how analysing social media trends and tying them into an organisation’s Customer Relationship Management (CRM) platform can help improve a business’ marketing and customer satisfaction.

The Truth is in the data

“A lot of marketing in the past has not been data driven,” says Emma. “There’s still this gap between people saying ‘this is what we think’, ‘this is what we’ve always done’ and ‘this is what they’ve found’ – we’ll come behind that and say ‘let’s let the data tell the truth.'”

That data is powerful due to the context Emma believes Digivizer adds, “because we can map people to the social web based on their profiles – who are they, what they talk about, who they are engaged with and what’s important to them.”

“We let data become the truth and we push back on the hypothesis that might have been unsubstantiated previously in the organisation,” Emma says.

Fighting the average

For some organisations, this truth can be challenging. “The ones who resist it are those with a fixed position who have built a career of playing to the averages,” states Emma. “We get massive returns, say 39 to one, whereas they were getting maybe seven to one or twelve to one.”

“Again, data can be the truth in this story.”

One advantage of real time social media monitoring is marketers can now track how consumers changing lives unfold are affecting their buying habits and desires as people get married, become single, have children, move houses or just simply change tastes.

Hearing the consumer

A key part of modern marketing is letting customers know their voices have been heard, as modern consumers know they have a voice and expect companies to acknowledge what they’re saying.

Emma sees a lot of lip service has been paid in companies to the ‘single customer view’ where businesses need to know their customers better.

“I actually think it’s customers that are driving that,” says Emma. “Their expectation is ‘I’ve interacted with you a lot of times, you’re asking me to engage with you digitally and now I expect you to serve me better.'”

“Now if you plug that data into organisations you can start to offer more meaningful – the right message at the right time.”

Emma believes that makes customers happier as they now feel they’ve been heard and understood. “That’s the beauty in the data,” she says.

While there’s some risks with paying close attention to customers’ online behaviour – as we saw with the famous Target pregnant girl mailout – the benefits for businesses listening to their clients is obvious. It’s another example of how the slow to adapt businesses will be crushed in the changing economy.

Privacy’s still beating heart and the social media challenge

The changing habits of younger web surfers are challenging the assumptions underlying social media services.

“I’m not a very public person,” twenty-two year old Walter Woodman tells the New Yorker in How A Relationship Dies on Facebook.

One of the assumptions of the social media industry is that digital natives, those born after 1990, have little if any expectations of privacy. The New Yorker story challenges that idea.

Much of the New Yorker’s background is taken from the Pew Centre’s May 2013 report Teens, Social Media and Privacy which interviewed 802 US teens and their parents to identify young adults’ attitudes towards privacy.

As the Pew Centre’s Mary Madden wrote in a follow up post to that report, US teenagers aren’t about to about to abandon Facebook yet but they are concerned about privacy and the work involved in managing an online persona.

While some of our teen focus group participants reported positive feelings about their use of Facebook, many spoke negatively about an increasing adult presence, the high stakes of managing self-presentation on the site, the burden of negative social interactions (“drama”), or feeling overwhelmed by friends who share too much.

This suggests a far more mature, and complex, understanding of privacy by teenagers than many of the social media boosters assumed when declaring that privacy is irrelevant in the Facebook era.

Like their parents, teenagers and young adults know there are consequences for sharing too much online which challenges the social media platforms that have built their businesses around users spilling everything about themselves into the big data pot.

It turns out digital natives are just as conscious of the risks as their parents, although how they handle it may manifest in different ways, and the assumptions of many social media businesses aren’t quite as robust as they appeared not so long ago.

A trillion points of data

As shopping centres, social media services and police forces collect greater amounts of information about us, we need to understand and manage the risks involved.

Last night, current Affairs program Four Corners had a look of the risks to families in the age of Big Data.

Earlier in the day I had the opportunity to speak on ABC 702 Sydney with the program’s reporter, Geoff Thompson, to discuss some of the issues and take listeners’ calls about Big Data and security.

What stood out from the audience’s comments is how most people don’t understand the extent of how data is being shared. The frightening thing is the Four Corners program itself understated the extent of how information is being distributed around the internet.

Looking beyond social media

Social media sites like Facebook are an obvious and legitimate area of concern with most people not understanding the ramifications of the terms and conditions of these services, however Big Data is a far more that what you share on LinkedIn or Instagram.

A major point of the program was how the New South Wales police force’s Automatic Number Plate Recognition (ANPR) equipment stores photographs of car license plates.

One of the applications of ANPR shown during the program was how an officer can be warned that a vehicle has owned by someone potentially dangerous or used in a suspicious situation, allowing them to be more cautious if they decide to pull a car over. Probably the greatest application is getting unregistered, uninsured or unlicensed drivers off the road.

Those sorts of usage is the positive side of Big Data and its role in reducing the road toll, the example also illustrates how data points are coming together with the internet of machines as traffic lights, road signs and cars themselves are communicating with each other and those police databases.

When that information is put together there’s a lot valuable intelligence and that’s why people are concerned that the NSW Police are storing millions of apparently useless images of car number plates with the time and location of the photographs.

These technologies aren’t just being used in shopping centres; instore mobile phone tracking combined with the same numberplate recognition the police use watching who is entering the carparks makes it possible to predict buying patterns and target offers to shoppers.

Couple that information with store loyalty cards and add in rapidly developing facial recognition, retailers have a very powerful way of monitoring how their customers behave.

“What instore analytics does is it takes the same kind of capablities that e-commerce sites have had for more than a decade and apply them to brick and mortar stores,” says Retail Next’s Tim Callen. Using the store’s CCTV system the company applies facial recognition software to track shoppers’ behaviour.

Securing the data feeds

The immediate concern is the security of this data, we’ve covered the hackable baby monitor and the Four Corners program examined Troy Hunt’s exposure of security flaws in Westfield Shopping Centres’ Find My Car App. Similar security concerns surround government databases like the NSW Police’s numberplate store.

As we’ve seen with the repeated data breaches of 2011, the management of big and small organisations like Sony or Stratfor don’t take security seriously. It’s hard to recall any senior public servant being held accountable for a security breach by their department.

A billion points of data

On their own, each of these data points means little but for a motivated marketer, tenacious police officer or determined stalker pulling those separate information sources together can pull together an accurate picture of a person’s private information, habits and beliefs.

Almost all the collectors of this data claim this information is anonymised or isn’t personal information, unfortunately there’s mismatch between the definition of private data and reality as number plates and mobile phone MAC addresses are not considered private, however they provide enough insight for an individual to be identified.

That aspect isn’t understood by most people, the final caller to the ABC Radio spot asked why she should be bothered worrying about privacy – it doesn’t matter.

As French politician Cardinal Richelau said in the Seventeenth Century, If you give me six lines written by the hand of the most honest of men, I will find something in them which will hang him

Today we each have six million points of data that can hang us, in a decade it could easily be a billion. We need to understand and manage the risks this presents while enjoying the benefits.

Coping with Generation LuXurY

Starwood Hotel’s Phil McAveety describes how tech will help hotel understand a new generation of customers.

Speaking at the recent ADMA Global Summit in Sydney, Starwood Hotel’s Phil McAveety described Generation LuXury – the changing hospitality expectations of Gen X and Ys.

McAveety sees the new generation of travellers as being more diverse, younger, female and increasingly from emerging economies making them very different from the middle aged Caucasian male from Europe or North America which seems to be the focus of most of the hospitality industry.

The lessons from McAveety’s presentation weren’t just for hotels, much of his message applies as to almost every other business sector.

3D printing featured heavily, with McAveetry seeing the technology as delivering the personalised experiences demanded by Generation LuXurY, as an example he cited a concierge being able to create a pair of running shoes for a guest in exactly the size and style required for a guest.

Big Data played a role too with McAveety illustrating how hotel managers used to watch for important, valued guests with hidden windows letting them see who was checking into their establishment, a role that’s now carried out by Big Data and social media.

McAveety though had a warning about social media in the risks of giving away business intelligence and intellectual property to the services.

The big risk though is in technology itself – that hotels treat it as an end in itself instead of tools to deliver better experiences to guests.

“It’s not about tech,” warns McAveety. “If so, we are going to lose.”

That’s a lesson all industries need to heed, that technology is a means to the end of delivering better products to customers. Understanding what Generation LuXurY perceive as a better product is one of those uses for tech.

Five actions for disrupted marketers

Brands and marketers can cut through the noise of the modern marketplace with smart story telling.

It’s necessary to tell compelling stories with the aid of big data and smart algorithms McKinsey’s Joshua Goff told a conference in Sydney two weeks ago.

As part of the recent ADMA Global Forum, the head of McKinsey’s Asia Pacific Consumer Marketing Analytics Center spoke of importance of story telling, big data and personalisation for marketers meeting the challenges of today’s connected marketplace.

Goff sees three disruptions to the current marketing industry – a proliferation of channels, a mountain of raw data to deal with and a hyper-informed consumer. These are challenges which businesses and marketers didn’t have to face in previous years.

To counter these disruptions Goff proposes five actions; develop a four screen strategy, build a content supply chain, broaden personalisation, understand big data isn’t just about data and forget your current marketing mix.

Forget your current marketing mix

“Spending on digital media and non-traditional media is soaring,” says Goff. “We’re recommend to some of our clients to double or triple their spending on these channels.”

Goff showed ASICS’ Support Your Marathoner campaign as an example of how innovative marketers can create digital campaigns that look beyond banner ads and popups. Campaigns like this are critical to building advocacy around a brand.

Develop a four screen strategy

The four screen strategy is essential as consumers are changing how consumers behave, something that is going to accelerate as more screens like Google Glass appear on the market.

“If we have multiple screens is it not reasonable to think when you turn on your TV – and I count the TV as a screen – that they see the same information?” asks Goff. “But recognise that different screens offer different experiences.”

Build a content supply chain

One of the key problems for marketers is feeding content to these screens, which means world class editorial teams will be essential to getting customers’ attention.

“Content is going to be king going forward,” says Goff. “Content is going to be a source of competitive advantage.”

In this mix, user generated content is a key factor as well. One of the examples Goff gave was Disguised Lighting, surprisingly a business to business operation which proves that getting fans as advocates is not just restricted to consumer brands.

Personalisation needs to be broadened

“If you give the customer in return, they will give you the information you want,” Goff states. “Start solving your customer’s problem.”

Personalisation is more than just email, it now means delivering personalised goods and configurable services. The physical experience, such as a Japanese vending machines that tailors the drinks available based on the demographic segment the system identifies the customer as being in.

Big data isn’t just about data

Data is worthless without the algorithms and the APIs required to understand and distribute the information. To do this well, Goff sees data scientists and software engineers as critical which means the global race for talent is going to be particularly acute in these areas.

As an example of big data, and cloud computing, Goff showed Sberbank’s lie detecting ATM machine that issues personal loans based up the applicant’s voice patterns. The device brings together a number of technologies to deliver a personalised experience for customers.

“We can’t afford to wait wait,” warns Goff. “There’s a lot of change and it’s complicated but there are successes and we need to start our own stories.”

At the heart of Goff’s presentation is the fact we live in a noiser world and for brands wanting to cut through that noise they have to offer something more than what has worked in the past.

Understanding the social media whispers

The evolution of Roamz into Local Measure tells us a lot about how businesses can use social media and online local services.

What do you do when paying customers tell you they would rather your product be different to what you were offering? This is the predicament that faced Jonathan Barouch when he discovered the real market for his Roamz service was in social media business intelligence.

How Jonathan dealt with this was the classic business pivot, where the original idea of Roamz evolved into Local Measure.

Originally Roamz was set up to consolidate social services like Twitter, Foursquare and Facebook. If you wanted to find a restaurant, bar or hotel in your neighbourhood, Roamz would pick the most relevant reviews from the various services to show you what was in your neighbourhood.

The idea for Roamz came from when Jonathan was looking for places to take his new baby, jugging several different location services to find local cafes, shops or playground is hard work when you have a little one to deal with.

A notable feature of Roamz was the use of geotags to determine relevance. Even if the social media user doesn’t mention the business, Roamz would use the attached location information to determine what outlet was being discussed.

Enter Local Measure

While Roamz was doing well it wasn’t making money and, in Jonathan’s words, it was a “slower burn, longer term play”. On the other hand businesses were telling him and his sales team that they would pay immediately to use the service to monitor what people were saying about them on social media.

“People said, ‘hey this is cool, we want to pay for this.” Jonathan said of the decision to pivot Roamz into Local Measure.

“I want to say it was a really difficult decision but it wasn’t because we had people saying ‘we want to pay you if you continue with this product.’”

Local Measure is built on the Roamz platform but instead of helping consumers find local venues, the service now gives businesses a tool to monitor what people are saying about them on social media services.

The difference with the larger social media monitoring tools like Radian6 is Local Measure gives an intimate view of individual posts and users. The idea being a business can directly monitor what people are saying are saying about a store or a product.

For dispersed companies, particularly franchise chains and service businesses, it gives local managers and franchisees the ability to know what’s happening with their outlet rather than having to rely on a social media team at head office.

The most immediate benefit of Local Measure is in identifying loyal users and influencers. Managers can see who is tweeting, checking in or updating their status in their store.

Armed with that intelligence, the local store owner, franchisee or manager can engage with the shop’s most enthusiastic customers.

Customer service is one of the big undervalued areas of social media and Jonathan believes Local Measure can help businesses improve how they help customers.

“It makes invisible customers visibile to management,” says Jonathan.

An example Jonathan gives is of a cinema where the concession’s frozen drink machine wasn’t set currently. While the staff were oblivious to the issue, customers were complaining on various social media channels. Once the theatre manager saw the feedback he was able to quickly fix the problem.

Employee behaviour online is also an important concern for modern managers, if employees are posting inappropriate material on social media then the risks to a business are substantial.

“From an operational point perspective we’ve picked up really weird and wonderful things that the business doesn’t know,” says Jonathon. “Staff putting things in the public domain that is really damaging to brands.”

“We’ve had two or three cases of behaviour that you shudder at. I’ve been presenting and it has popped up and the clients have said ‘delete that, we don’t want that up’ and I say ‘that’s the whole point – it’s out there.’”

That’s a lesson that Domino’s Pizza learned in the US when staff posted YouTube videos of each other putting toppings up their noses. Once unruly employees post these things, it’s hard work undoing the brand damage and for smaller businesses or franchise outlets the bad publicity could be fatal.

Local Measure is a good example of a business pivot, it’s also shows how concepts like Big Data, social media and geolocation come together to help businesses.

Being able to listen to customers also shows how marketing and customer service are merging in an age where the punters are no longer happy to be seen and not heard.

It’s the business who grab tools like Local Measure who are going to be the success stories of the next decade, the older businesses who ignore the changes in customer service, marketing and communications are going to be a memory.

Coming to your city – the internet of machines

A chart by sensor manufacturer Libelium illustrates how the internet of machines is growing

An intriguing infographic from Spanish sensor manufacturer Libelium – which to Australian ears sounds like a new age defamation law firm – illustrates how the internet of things is being used in all walks of life from shipping containers to park benches.

The notable thing about the diagram is pretty well all of the sensor applications have been available for years – in some cases decades – and its only with the arrival of cheap sensors and pervasive internet access that widespread monitoring has becoming possible.

With affordable, even disposible, sensors coupled with internet projects like Google Loon and Australia’s National Broadband Network, these networks are now possible at a price that won’t sink a government’s budget.

In fact these sensor networks will probably improve councils’ and governments’ budgets as they promise to improve the efficiency of services like rubbish collection and street repairs.

The real challenge is managing all the data this equipment gathers, that’s going to be one of the big jobs of the next decade.