Tag: big data

Big Data needs big databases

Investors are making big bets on the databases that underpin Big Data

While the tech industry’s startup hype this week has been focused on the impending Twitter Initial Public Offering, a much more fascinating company quietly completed a major capital raising.

MongoDB provides an open-source, document database program and last week raised another $150 million from investors that values the company at $1.2 billion dollars.

Databases lie at the heart of Big Data and businesses need better computer programs to manage the overwhelming amount of information that’s pouring in every day.

As every business is unique, larger corporations find they spend huge amounts of money on their databases. The enterprise that buys an Oracle, IBM or SAP system usually spends tens, if not hundreds, of millions of dollars in adapting the system to work for them, often with less than spectacular results.

While implementing MongoDB or any other open source program doesn’t eliminate implementation costs, it is often easier to setup and maintain as most of the information about the system is shared and freely available rather than locked inside the vendor’s proprietary knowledgebases.

Probably most important of all, the data structures themselves are open so customers don’t find themselves locked into a relationship with one vendor because all their information is in a format that can only be read by one system.

Open source is where Big Data, social media and cloud computing intersect – without the data itself being open and accessible, most cloud computing and social media services will almost certainly fail.

So MongoDB and the other open source products are the quiet, back of house technologies that keep the internet as we know it ticking along.

Bloomberg Businessweek reports there’s some very serious investors in MongoDB.

The deal attracted new investors such as EMC Corp. (EMC:US) and Salesforce.com Inc. (CRM:US), along with previous backers Red Hat Inc. (RHT:US), Intel Corp. (INTC:US), New Enterprise Associates and Sequoia Capital, according to MongoDB.

Sequoia Capital are one of the longest lasting Silicon Valley venture capital firms whose greatest success was being one of the first investors in Apple Computers and New Enterprise Ventures have a similar pedigree with companies like 3Com, Juniper Networks and Vonage. Investment by industry leaders like Intel, Red Hat, Salesforce and EMC in the company also shows MongoDB isn’t the standard Silicon Valley Greater Fool play.

When there’s a gold rush, it’s those selling the shovels who make the big money and the investors in MongoDB and similar services are hoping they’ve found some of the modern day shovels.

That may well turn out to be the case and while the smart folk make more money from the technologies that drive social media and cloud computing services, the rest of us are distracted by the latest shiny thing.

Similar posts:

  • No Related Posts

On the internet, the Feds know what breed of dog you are

The downfall of Silk Road’s alleged founder is a lesson on how fragile our privacy and online security are

The arrest of alleged Silk Road founder Ross Ulbricht – also known as the Dread Pirate Roberts – has attracted plenty of media attention.

What’s particularly notable is the FBI is claiming Ulbricht made a basic mistake in posting to a website under his real name that gave his identity away.

If true, Ulbricht’s trivial mistake illustrates how easy it is for any determined investigator to find someone’s identity online from the trillion points of data we all create in the connected world.

Anyone who wants to be truly anonymous on the web has to work extremely hard to protect their identity. Most of us aren’t prepared to trade convenience for security, particularly given the massive effort required.

Even if we could protect our online habits, the use of credit cards, loyalty plans and even driving our cars still it almost impossible to escape the watch of a determined investigator.

In the early days of the web, it was said “on the internet, no-one knows you’re a dog.” Today the feds can figure out not only what breed of dog you are, but what your name is and your favourite brand of dog food.

The modern panopticon we live in is a very efficient machine and it’s difficult to hide from society’s gaze. It’s why we need to rethink privacy and information security.

Image of Presidio Modelo by Friman through Wikimedia.

Similar posts:

  • No Related Posts

The truth is in the data

One of the big challenges facing all organisation is using Big Data to understand their customers better, Emma LoRusso and Digivizer are part of the new wage of businesses and entrepreneurs providing the tools to help managers make better decisions.

Emma LoRusso founder of Sydney based social analytics service Digivizer believes the truth in a company’s data will challenge many managment and marketing beliefs.

In a somewhat poorly recorded interview as part of the Decoding the New Economy YouTube channel, Emma described how analysing social media trends and tying them into an organisation’s Customer Relationship Management (CRM) platform can help improve a business’ marketing and customer satisfaction.

The Truth is in the data

“A lot of marketing in the past has not been data driven,” says Emma. “There’s still this gap between people saying ‘this is what we think’, ‘this is what we’ve always done’ and ‘this is what they’ve found’ – we’ll come behind that and say ‘let’s let the data tell the truth.'”

That data is powerful due to the context Emma believes Digivizer adds, “because we can map people to the social web based on their profiles – who are they, what they talk about, who they are engaged with and what’s important to them.”

“We let data become the truth and we push back on the hypothesis that might have been unsubstantiated previously in the organisation,” Emma says.

Fighting the average

For some organisations, this truth can be challenging. “The ones who resist it are those with a fixed position who have built a career of playing to the averages,” states Emma. “We get massive returns, say 39 to one, whereas they were getting maybe seven to one or twelve to one.”

“Again, data can be the truth in this story.”

One advantage of real time social media monitoring is marketers can now track how consumers changing lives unfold are affecting their buying habits and desires as people get married, become single, have children, move houses or just simply change tastes.

Hearing the consumer

A key part of modern marketing is letting customers know their voices have been heard, as modern consumers know they have a voice and expect companies to acknowledge what they’re saying.

Emma sees a lot of lip service has been paid in companies to the ‘single customer view’ where businesses need to know their customers better.

“I actually think it’s customers that are driving that,” says Emma. “Their expectation is ‘I’ve interacted with you a lot of times, you’re asking me to engage with you digitally and now I expect you to serve me better.'”

“Now if you plug that data into organisations you can start to offer more meaningful – the right message at the right time.”

Emma believes that makes customers happier as they now feel they’ve been heard and understood. “That’s the beauty in the data,” she says.

One of the big challenges facing all organisation is using Big Data to understand their customers better, Emma LoRusso and Digivizer are part of the new wage of businesses and entrepreneurs providing the tools to help managers make better decisions.

While there’s some risks with paying close attention to customers’ online behaviour – as we saw with the famous Target pregnant girl mailout – the benefits for businesses listening to their clients is obvious. It’s another example of how the slow to adapt businesses will be crushed in the changing economy.

Similar posts:

  • No Related Posts

Privacy’s still beating heart and the social media challenge

The changing habits of younger web surfers are challenging the assumptions underlying social media services.

“I’m not a very public person,” twenty-two year old Walter Woodman tells the New Yorker in How A Relationship Dies on Facebook.

One of the assumptions of the social media industry is that digital natives, those born after 1990, have little if any expectations of privacy. The New Yorker story challenges that idea.

Much of the New Yorker’s background is taken from the Pew Centre’s May 2013 report Teens, Social Media and Privacy which interviewed 802 US teens and their parents to identify young adults’ attitudes towards privacy.

As the Pew Centre’s Mary Madden wrote in a follow up post to that report, US teenagers aren’t about to about to abandon Facebook yet but they are concerned about privacy and the work involved in managing an online persona.

While some of our teen focus group participants reported positive feelings about their use of Facebook, many spoke negatively about an increasing adult presence, the high stakes of managing self-presentation on the site, the burden of negative social interactions (“drama”), or feeling overwhelmed by friends who share too much.

This suggests a far more mature, and complex, understanding of privacy by teenagers than many of the social media boosters assumed when declaring that privacy is irrelevant in the Facebook era.

Like their parents, teenagers and young adults know there are consequences for sharing too much online which challenges the social media platforms that have built their businesses around users spilling everything about themselves into the big data pot.

It turns out digital natives are just as conscious of the risks as their parents, although how they handle it may manifest in different ways, and the assumptions of many social media businesses aren’t quite as robust as they appeared not so long ago.

Similar posts:

  • No Related Posts

A trillion points of data

As shopping centres, social media services and police forces collect greater amounts of information about us, we need to understand and manage the risks involved.

Last night, current Affairs program Four Corners had a look of the risks to families in the age of Big Data.

Earlier in the day I had the opportunity to speak on ABC 702 Sydney with the program’s reporter, Geoff Thompson, to discuss some of the issues and take listeners’ calls about Big Data and security.

What stood out from the audience’s comments is how most people don’t understand the extent of how data is being shared. The frightening thing is the Four Corners program itself understated the extent of how information is being distributed around the internet.

Looking beyond social media

Social media sites like Facebook are an obvious and legitimate area of concern with most people not understanding the ramifications of the terms and conditions of these services, however Big Data is a far more that what you share on LinkedIn or Instagram.

A major point of the program was how the New South Wales police force’s Automatic Number Plate Recognition (ANPR) equipment stores photographs of car license plates.

One of the applications of ANPR shown during the program was how an officer can be warned that a vehicle has owned by someone potentially dangerous or used in a suspicious situation, allowing them to be more cautious if they decide to pull a car over. Probably the greatest application is getting unregistered, uninsured or unlicensed drivers off the road.

Those sorts of usage is the positive side of Big Data and its role in reducing the road toll, the example also illustrates how data points are coming together with the internet of machines as traffic lights, road signs and cars themselves are communicating with each other and those police databases.

When that information is put together there’s a lot valuable intelligence and that’s why people are concerned that the NSW Police are storing millions of apparently useless images of car number plates with the time and location of the photographs.

These technologies aren’t just being used in shopping centres; instore mobile phone tracking combined with the same numberplate recognition the police use watching who is entering the carparks makes it possible to predict buying patterns and target offers to shoppers.

Couple that information with store loyalty cards and add in rapidly developing facial recognition, retailers have a very powerful way of monitoring how their customers behave.

“What instore analytics does is it takes the same kind of capablities that e-commerce sites have had for more than a decade and apply them to brick and mortar stores,” says Retail Next’s Tim Callen. Using the store’s CCTV system the company applies facial recognition software to track shoppers’ behaviour.

Securing the data feeds

The immediate concern is the security of this data, we’ve covered the hackable baby monitor and the Four Corners program examined Troy Hunt’s exposure of security flaws in Westfield Shopping Centres’ Find My Car App. Similar security concerns surround government databases like the NSW Police’s numberplate store.

As we’ve seen with the repeated data breaches of 2011, the management of big and small organisations like Sony or Stratfor don’t take security seriously. It’s hard to recall any senior public servant being held accountable for a security breach by their department.

A billion points of data

On their own, each of these data points means little but for a motivated marketer, tenacious police officer or determined stalker pulling those separate information sources together can pull together an accurate picture of a person’s private information, habits and beliefs.

Almost all the collectors of this data claim this information is anonymised or isn’t personal information, unfortunately there’s mismatch between the definition of private data and reality as number plates and mobile phone MAC addresses are not considered private, however they provide enough insight for an individual to be identified.

That aspect isn’t understood by most people, the final caller to the ABC Radio spot asked why she should be bothered worrying about privacy – it doesn’t matter.

As French politician Cardinal Richelau said in the Seventeenth Century, If you give me six lines written by the hand of the most honest of men, I will find something in them which will hang him

Today we each have six million points of data that can hang us, in a decade it could easily be a billion. We need to understand and manage the risks this presents while enjoying the benefits.

Similar posts:

  • No Related Posts

Coping with Generation LuXurY

Starwood Hotel’s Phil McAveety describes how tech will help hotel understand a new generation of customers.

Speaking at the recent ADMA Global Summit in Sydney, Starwood Hotel’s Phil McAveety described Generation LuXury – the changing hospitality expectations of Gen X and Ys.

McAveety sees the new generation of travellers as being more diverse, younger, female and increasingly from emerging economies making them very different from the middle aged Caucasian male from Europe or North America which seems to be the focus of most of the hospitality industry.

The lessons from McAveety’s presentation weren’t just for hotels, much of his message applies as to almost every other business sector.

3D printing featured heavily, with McAveetry seeing the technology as delivering the personalised experiences demanded by Generation LuXurY, as an example he cited a concierge being able to create a pair of running shoes for a guest in exactly the size and style required for a guest.

Big Data played a role too with McAveety illustrating how hotel managers used to watch for important, valued guests with hidden windows letting them see who was checking into their establishment, a role that’s now carried out by Big Data and social media.

McAveety though had a warning about social media in the risks of giving away business intelligence and intellectual property to the services.

The big risk though is in technology itself – that hotels treat it as an end in itself instead of tools to deliver better experiences to guests.

“It’s not about tech,” warns McAveety. “If so, we are going to lose.”

That’s a lesson all industries need to heed, that technology is a means to the end of delivering better products to customers. Understanding what Generation LuXurY perceive as a better product is one of those uses for tech.

Similar posts:

Five actions for disrupted marketers

Brands and marketers can cut through the noise of the modern marketplace with smart story telling.

It’s necessary to tell compelling stories with the aid of big data and smart algorithms McKinsey’s Joshua Goff told a conference in Sydney two weeks ago.

As part of the recent ADMA Global Forum, the head of McKinsey’s Asia Pacific Consumer Marketing Analytics Center spoke of importance of story telling, big data and personalisation for marketers meeting the challenges of today’s connected marketplace.

Goff sees three disruptions to the current marketing industry – a proliferation of channels, a mountain of raw data to deal with and a hyper-informed consumer. These are challenges which businesses and marketers didn’t have to face in previous years.

To counter these disruptions Goff proposes five actions; develop a four screen strategy, build a content supply chain, broaden personalisation, understand big data isn’t just about data and forget your current marketing mix.

Forget your current marketing mix

“Spending on digital media and non-traditional media is soaring,” says Goff. “We’re recommend to some of our clients to double or triple their spending on these channels.”

Goff showed ASICS’ Support Your Marathoner campaign as an example of how innovative marketers can create digital campaigns that look beyond banner ads and popups. Campaigns like this are critical to building advocacy around a brand.

Develop a four screen strategy

The four screen strategy is essential as consumers are changing how consumers behave, something that is going to accelerate as more screens like Google Glass appear on the market.

“If we have multiple screens is it not reasonable to think when you turn on your TV – and I count the TV as a screen – that they see the same information?” asks Goff. “But recognise that different screens offer different experiences.”

Build a content supply chain

One of the key problems for marketers is feeding content to these screens, which means world class editorial teams will be essential to getting customers’ attention.

“Content is going to be king going forward,” says Goff. “Content is going to be a source of competitive advantage.”

In this mix, user generated content is a key factor as well. One of the examples Goff gave was Disguised Lighting, surprisingly a business to business operation which proves that getting fans as advocates is not just restricted to consumer brands.

Personalisation needs to be broadened

“If you give the customer in return, they will give you the information you want,” Goff states. “Start solving your customer’s problem.”

Personalisation is more than just email, it now means delivering personalised goods and configurable services. The physical experience, such as a Japanese vending machines that tailors the drinks available based on the demographic segment the system identifies the customer as being in.

Big data isn’t just about data

Data is worthless without the algorithms and the APIs required to understand and distribute the information. To do this well, Goff sees data scientists and software engineers as critical which means the global race for talent is going to be particularly acute in these areas.

As an example of big data, and cloud computing, Goff showed Sberbank’s lie detecting ATM machine that issues personal loans based up the applicant’s voice patterns. The device brings together a number of technologies to deliver a personalised experience for customers.

“We can’t afford to wait wait,” warns Goff. “There’s a lot of change and it’s complicated but there are successes and we need to start our own stories.”

At the heart of Goff’s presentation is the fact we live in a noiser world and for brands wanting to cut through that noise they have to offer something more than what has worked in the past.

Similar posts: