Tag: big data

At the mercy of machines

Automation and algorithms are changing business but they are not without risks

Automation is the greatest change we’re going to see in business over the next decade as companies increasingly rely upon computers to make day to day decisions.

Giving control to algorithms however comes with a set of risks which managers and business owners have to prepare for.

Earlier this week the risks in relying on algorithms were shown when car service Uber’s management was slow to react to a situation where its formulas risked a PR disaster.

Uber’s misstep in Sydney shows the weaknesses in the automated business model as its algorithm detected people clamouring for rides out of the city and applied ‘surge pricing’.

Surge pricing is applied when Uber’s system sees high demand – typically around events like New Year’s Eve – although the company has previously been criticised for alleged profiteering during emergencies like Hurricane Sandy in New York.

In the light of previous criticism, it’s surprising that Uber stumbled in Sydney during the hostage crisis. Shortly after criticism of the surge pricing arose on the internet, the company’s Sydney social media manager sent out a standard defence of surge pricing.

That message was consistent with both Uber’s business model and how the algorithm that determines the company’s fares works; however it was a potential disaster for the business’ already battered reputation.

An hour later the company’s management had realised their mistake and announced that rides out of Sydney’s Central Business District would be free.

User’s mistake is a classic example of the dangers of relying solely on an algorithm to determine business decisions; while things will work fine during the normal course of business, there will always be edge cases that create perverse results.

While machines are efficient; they lack context, judgement and compassion which exposes those who rely solely upon them to unforeseen risks.

As the Internet of Things rolls out, systems will be deployed where responses will be based upon the rules of predetermined formulas.

Businesses with overly strict rules and no provision for management intervention in extreme circumstances will find themselves, like Uber, at the mercy of their machines. Staking everything on those machines could turn out to be the riskiest strategy of all.

Similar posts:

SurveyMonkey builds its war chest

SurveyMonkey raises another $250 million to fund future expansion

Earlier this year Decoding The New Economy interviewed SurveyMonkey’s  CEO Dave Goldberg on his vision for the business and how the company’s services are helping people understand the context of the data pouring into their organisations.

Yesterday SurveyMonkey announced it had raised 250 million dollars through an equity round that values the business at $1.3 billion, an amount only a little more than what the company has raised since being founded in 1999.

The additional funds are earmarked for privately held SurveyMonkey to acquire more companies and “provide meaningful liquidity to our employees and investors” with participants in the new funding round including CEO Goldberg and Google Ventures increasing their existing stakes.

In his interview with Decoding The New Economy last February, Goldberg described how he sees mobile technologies changing both SurveyMonkey and business in general along with the challenge for companies in understanding the data pouring into business.

It’s not hard to image many of the acquisitions SurveyMonkey makes with its latest fundraising will be in the mobile and analytics sectors.

Similar posts:

  • No Related Posts

A question of ethics

Uber’s missteps remind us that ethics matter in business

At this week’s Australian Gartner Symposium ethics was one of the key issues flagged for CIOs and IT workers; as technology becomes more pervasive and instrusive, managers are going to have to deal with a myriad of questions about what is the moral course of action.

So far the news isn’t good for the tech industry with many businesses failing to deal with the masses of data they are accumulating on users, suppliers and competitors.

A failure of transparency

One case in point is that of online ride service, Uber. One of Uber’s supposed strengths is its accountability and transparancy; the service can track passengers and drivers through their journey which should, in theory, make the trip safer for everybody.

In reality the tracking doesn’t do a great job of protecting riders and drivers, mainly because Uber has Silicon Valley’s Soviet attitude to customer service. That tracking also creates an ethical issue for the company’s management and one that isn’t being dealt with well.

Compounding Uber’s ethical problem is the attitude of its managers, when a Senior Vice President suggests smearing a journalist who writes critical stories then its clear the company has a problem and the question for users has to be ‘can we trust these people with our personal data?’

With Uber we may be seeing the first company where data management and misuse results in senior management, and possibly the founder, falling on their sword.

Journalists’ ethics

Another aspect of the latest Uber story is the question of journalistic ethics; indeed the apologists for Uber counter that because some journalists are corrupt that justifies underhand tactics from companies subject to critical articles.

That argument is deeply flawed with little merit and tells us more about the people making it than any journalist’s ethical compass, however there is a discussion to be had about the behaviour of many reporters.

As someone who regularly receives corporate largess — I attended the Gartner Symposium as a guest of BlackBerry and will be going to an Acer event tomorrow night — this is something I regularly grapple with; my answer (or rationalisation) is that I disclose that largess and let the reader make up their own mind.

However one thing is clear at these events; everything is on the record unless explicitly stated by the other party. This makes Michael Wolff’s criticism of Ben Smith’s original Uber story in Buzz Feed pretty hollow and gives us many pointers on Wolff’s own moral compass as he invites other writers to ‘privileged’ dinners where the default attitude is that everything is off the record.

Playing an insider game

Ultimately we’re seeing an insider game being played, where journalists like Wolff put their own egos above their job of telling their audience what is happening; Jay Rosen highlighted this problem with political coverage but in many respects it’s worse in tech, business and startup journalism.

It’s not surprising when a game is being played by insiders that they take offense at outsiders criticizing them.

Once the customers become outsiders though, the game is drawing to an end. That’s the fate Uber, and much of the tech industry, desperately want to avoid.

Uber in particular has many powerful enemies around the world and clumsy management mis-steps only play into the hands of those who see the company as a threat to their cosy cartels. It would be a shame if Uber’s disruption of the many dysfunctional taxi markets was derailed due to the company’s paranoia and arrogance.

Eventually ethics matter. It’s something that both the insular tech industry and those who write on it should remind themselves.

Similar posts:

Democratising the internet of things

A primary school science project shows how communities can start using open data to monitor their neighbourhood’s environment

Last year Alicia Asin of Spanish sensor vendor Libelium spoke to this site about her vision of the internet of things improving transparency in society and government.

A good example of this democratisation of data was at the New South Wales Pearcey Awards last week where the state’s winners of the Young ICT Explorers competition were profiled.

Coming in equal first were a group of students from Neutral Bay’s state primary school with their Bin I.T project that monitors garbage levels in rubbish bins.

The kids built their project on an Arduino microcontroller that connects to a Google spreadsheet which displays the status of the bin in the school’s classrooms. For $80 they’ve created a small version of what the City of Barcelona is spending millions of Euro on.

With the accessibility of cheap sensors and cloud computing its possible for students, community groups and activists to take the monitoring of their environment into their own hands; no longer do people have to rely on government agencies or private companies to release information when they can collect it themselves.

Probably the best example of activists taking action themselves is the Safecast project which was born out of community suspicion of official radiation data following the Fukushima.

We can expect to see more communities following the Safecast model as concerns about the effects of mining, industrial and fracking operations on neighbourhoods grow.

The Bin I.T project and the kids of Neutral Bay Public School could be showing us where communities will be taking data into their own hands in the near future.

Similar posts:

Salesforce faces the end of the database era

Cloud CRM giant Salesforce faces a challenge as searching unstructured data and analytics companies like Splunk change the business model.

Last week we looked at the way we organise information is changing in the face of exploding data volumes.

One of the consequences of the data explosion is that structured databases are beginning to struggle as information sources and business needs are becoming more diverse.

Yesterday, cloud Customer Relationship Management company Salesforce announced their Wave analytics product which the company says “with its schema-free architecture, data no longer has to be pre-sorted or organized in some narrowly defined manner before it can be analyzed.”

The end of the database era

Salesforce’s move is interesting for a company whose success has been based upon structured databases to run its CRM and other services.

What the company’s move could be interpreted that the age of the database is over; that organising data is a fool’s errand as it becomes harder to sort and categorise the information pouring into businesses.

This was the theme at the previous week’s Splunk conference in Las Vegas where the company’s CTO, Todd Papaioannou, told Decoding The New Economy how the world is moving away from structured databases.

“We’re going through a sea change in the analytics space,” Papaioannou said. “What characterised the last thirty years was what I call the ‘schema write’ era; big databases that have a schema where you have to load the data into that schema then transform before you can ask questions of it.”

Breaking the structure

The key with programs like Salesforce and other database driven products like SAP and Oracle is that both the data structures — the schema — and the questions are largely pre-configured. With the unstructured model it’s Google-like queries on the stored data that matters.

For companies like Salesforce this means a fundamental change to their underlying product and possibly their business models as well.

It may well be that Salesforce, a company that defined itself by the ‘No Software’ slogan is now being challenged by the No Database era.

Paul travelled to San Francisco and Las Vegas as a guest of Salesforce and Splunk respectively

Similar posts:

  • No Related Posts

You’re being scanned

Recognition technology is advancing rapidly, creating opportunities for marketers and privacy concerns for consumers.

A  cute little story appeared on the BBC website today about the Teatreneu club, a comedy venue in Barcelona using facial recognition technology to charge for laughs.

In a related story, the Wall Street Journal reports on how marketers are scanning online pictures to identify the people engaging with their brands and the context they’re being used.

With the advances in recognition technology and deeper, faster analytics it’s now becoming feasible that anything you do that’s posted online or being monitored by things like CCTV is now quite possibly recognise you, the products your using and the place you’re using them in.

Throw all of the data gathered by these technologies into the stew of information that marketers, companies and governments are already collecting and there a myriad of  good and bad applications which could be used.

What both stories show is that technology is moving fast, certainly faster than regulatory agencies and the bulk of the public realise. This is going to present challenges in the near future, not least with privacy issues.

For the Teatreneu club, the experiment should be interesting given rich people tend to laugh less; they may find the folk who laugh the most are the people least able to pay 3o Euro cents a giggle.

Similar posts:

  • No Related Posts

Adrift in the data lake

We’re awash with data and businesses have to figure out how not to drown in it

Last week Yahoo! closed down their directory pages ending one of the defining services of the 1990s internet and showing how the internet has changed since the first dot com boom.

The Yahoo! Directory was victim of a fundamental change in how we manage data as Google showed it wasn’t necessary to tag and label every piece of information before it could be used.

Yahoo!’s Directory was a classic case of applying old methods to new technologies – in this case carrying out a librarian’s function of cataloguing and categorising every web page.

One problem with that way of saving information is you need to know part of the answer before you can start searching; you need to have some idea of what category your query comes under or the name of the business or person you’re looking for.

That pan was exploited by the Yellow Pages where licensees around the world harvested a healthy cash flow from businesses forced to list under a dozen different categories to make sure prospective customers found them.

With the arrival of Google that way of structuring information came to an end as Sergey Brin and Larry Page’s smart algorithm showed it wasn’t necessary to pigeonhole information into highly structured databases.

Unstructured data

Rather than being structured, data is now becoming ‘unstructured’ and instead of employing an army of clerks to categorise information it’s now the job of computers to analyse that raw information and pick out what we need for our businesses and lives.

As information pours into companies from increasingly diverse sources, a flood that’s becoming so great it’s being referred to as the ‘data lake’, it’s become clear the battle to structure data is lost.

At the Splunk Conference in Las Vegas this week, the term ‘data lake’ is being used a lot as the company explains its technology for analysing business information.

Splunk, along with services like IBM’s Watson and Tableau Software, is one the companies capitalising on businesses’ need to manage unstructured data by giving customers the tools to analyse their information without having first to shoehorn it into a database.

“Thanks to Google we got to look at data a different way,” says Splunk’s CEO and Chairman Godfrey Sullivan. “You don’t have to know the question before you start the search.”

Diving into the data lake

It’s always dangerous applying simple labels to computing technologies but some terms, like ‘Cloud Computing’, don’t do a bad job of describing the principles involved and so it is with the ‘data lake’.

Rather than a nice, orderly world where everything can be pigeonholed, we know have a fluid environment where it wouldn’t be possible to label everything even if we wanted to. A lake is a good description of the mass of data pouring into our lives.

The web was an early example of having to manage that data lake and Google showed how it could be done. Now it’s the turn of other companies to apply the principles to business.

Google fatally damaged both Yahoo! and the Yellow Pages, other companies that are stuck in the age of structured data are going to find the future equally dismal. Don’t drown in that data lake.

Paul travelled to Las Vegas as a guest of Splunk

Similar posts:

  • No Related Posts