Decoding the new economy

Splunk and the marathon to make IT sexy again

Can Splunk use data analytics to make IT sexy again?

“We’re early in the marathon but making good progress”, opened Godfrey Sullivan, the CEO of Splunk, as he opened the company’s annual conference in Las Vegas today.

Helping businesses understand their data has proved lucrative for Splunk with the analytics company seeing a 46% increase in year on year revenue to $148 million for the last quarter with the organisation narrowing its losses over the same period.

As with all tech conferences, the focus in the opening keynote is on new product announcements. For Splunk, the main release is its latest enterprise version of Splunk Enterprise 6.3 billed as delivering faster results, better analytics and tying into the masses of machine data being collected from the Internet of Things.

Machine data as a cornerstone

That IoT data is a key part of Sullivan’s strategy of “making machine data more accessible usable and valuable to everyone.” The company also highlights their alliances with IoT data consolidator services such as Xively and Octoblu.

Security is another focus of Splunk with the launch of Splunk User Behavior Analytics (UBA) that analyses usage patterns on networks to identify risky or suspicious activity and a version upgrade of their their Enterprise Security.

The original business of Splunk was to monitor server log files and that IT focus remains with their new IT Service Intelligence (ITSI), an improved IT monitoring and analytics service.

Sullivan’s key message was that IT departments can be offering ‘operational intelligence’ as they gather and analyse data from all aspects of a business. “IT departments have to earn a seat at the table”, as Splunk’s CTO Snehal Antani says and providing rich data analytics, in his view, enable this.

Surprising a bank

Antani cited one of his previous clients, a bank which would ordinarily would deal with ten million dollars of deposits a day so an alarm had been set for when less than half of that had been received by midday.

One day that alarm sounded, and the IT department assumed there was a problem with the bank’s systems. After checking, they found everything was running normally so flagged deposits were unusually low to senior management.

It turned out to be a competitor had launched a successful campaign to open new accounts which had caught the bank by surprise. “The CMO acted as if he’d been hacked,” Antani recalls.

Antani’s anecdote illustrates how business data is no longer just the concern of the IT department and a small group of geeky business analysts, with real time information every part of an organisation can improve its performance.

For Splunk, using data to improve all aspects of business its key message to the market and one it hopes to drive its business forward although it’s highly unlikely they’ll achieve Antani’s hopes of “making IT sexy again.” That would take much more than a marathon.

Paul travelled to the Splunk.conf in Las Vegas as a guest of Splunk

Managing the data stream

Managing the data deluge is where Salesforce is focusing its efforts in a competitive market

One of the world’s biggest tech events – if not the biggest of the vendor shows – is Dreamforce, Salesforce’s annual spectacular that this this year attracted a 150,000 attendees to San Francisco’s Moscone Center.

Every year sees the company – which now holds the title of the world’s fourth biggest software company – and its CEO, Marc Benioff, defining the direction of the company in the face of a rapidly changing market. Despite being a pioneer in cloud computing, the company is as vulnerable to disruption as anyone else in a rapidly changing marketplace.

This year, the focus is on analytics and automation along with a strong leaning towards the Internet of Things and app development on the Lightning platform they announced last year.

With the Thunder platform, Salesforce is offering a service that allows businesses to connect devices onto their platform where users can build up rules based business automation. One notable part of this is the integration with Microsoft Office 365, another example of Microsoft’s reaching out to previously hostile companies.

For Automation, Salesforce is building upon its RelateIQ acquisition from last year, now branded as SalesforceIQ. The company says “Relationship Intelligence technology that utilizes advanced data science to analyze company relationships and drive actions.”

The Wave analytics service, which was also announced at last year’s Dreamforce, is a key part of the the business automation and IoT services in providing the insights into the data being collected. In many respect, Wave is going to be the glue that holds most of the products being announced this year.

Complementing the Wave, Thunder and SalesforceIQ products is the Lightning platform, again announced last year, that allows users to use the company’s AppCloud to quickly build business applications.

For Salesforce, the direction being laid out from this Dreamforce conference is in making helping customers deal with the masses of data coming into the enterprise. As Tod Neilsen, the company’s Executive Vice President of the App Cloud says, “we’re look at making the data usuable for spreadsheet users.”

As businesses struggle to manage and understand the masses of data flowing into their organisations, this may well be a powerful selling point for Salesforce.

Paul travelled to Dreamforce 2015 in San Francisco as a guest of Salesforce

Putting machine learning into wine

Two South Australian students are showing how the wine industry can use machine learning and cloud computing

As we gather more data, the opportunities to apply it become wider. A good example of this is Seer Insights, a South Australian company started by pair of university students that calculates the likely grape yields for vineyards.

Seer Insights’ product Grapebrain is made up of two components, a mobile app that the farmer uses to count the grape clusters on the vines and then a cloud service that analyses the data and produces web based reports for the farmers.

The current methods are notoriously unreliable with Seer Insights estimating mistakes cost the Australian viticulture industry $200 million a year as harvests are miscalculated resulting in either rotting fruit or wasted contractor fees.

Born in an elevator

Seer’s founders, Harry Lucas and Liam Ellul, started the business after a chance meeting on their university campus. “We started off doing this after being stuck in a lift together,” remembers Liam. “Originally we were looking at the hyper-spectrum imaging for broadacre farming but when we started looking at the problems we ended up talking to wine organisations about this.”

“The technology predicts how many grapes will be coming off the vineyards at the end of the season to enable people to sort out their finances,” Harry says. “The growth process grapes go through is difficult to model so we use machine learning to do that.”

For both the founders having an off the shelf product, in this case Microsoft’s machine learning tools, to run the data analysis made it relatively easy to launch the product.

As a winner of Microsoft’s Tech eChallenge, the startup has won a trip to the United States as well as being profiled by the company as a machine learning case study.

Over time as these tools become more accessible to small companies we’ll see more businesses accessing machine learning services to enhance their operations.

As companies face the waves of data flowing into their businesses over the next decade, it will be those who manage it well and gather valuable insights from their information that will be the winners.

Salesforce faces the end of the database era

Cloud CRM giant Salesforce faces a challenge as searching unstructured data and analytics companies like Splunk change the business model.

Last week we looked at the way we organise information is changing in the face of exploding data volumes.

One of the consequences of the data explosion is that structured databases are beginning to struggle as information sources and business needs are becoming more diverse.

Yesterday, cloud Customer Relationship Management company Salesforce announced their Wave analytics product which the company says “with its schema-free architecture, data no longer has to be pre-sorted or organized in some narrowly defined manner before it can be analyzed.”

The end of the database era

Salesforce’s move is interesting for a company whose success has been based upon structured databases to run its CRM and other services.

What the company’s move could be interpreted that the age of the database is over; that organising data is a fool’s errand as it becomes harder to sort and categorise the information pouring into businesses.

This was the theme at the previous week’s Splunk conference in Las Vegas where the company’s CTO, Todd Papaioannou, told Decoding The New Economy how the world is moving away from structured databases.

“We’re going through a sea change in the analytics space,” Papaioannou said. “What characterised the last thirty years was what I call the ‘schema write’ era; big databases that have a schema where you have to load the data into that schema then transform before you can ask questions of it.”

Breaking the structure

The key with programs like Salesforce and other database driven products like SAP and Oracle is that both the data structures — the schema — and the questions are largely pre-configured. With the unstructured model it’s Google-like queries on the stored data that matters.

For companies like Salesforce this means a fundamental change to their underlying product and possibly their business models as well.

It may well be that Salesforce, a company that defined itself by the ‘No Software’ slogan is now being challenged by the No Database era.

Paul travelled to San Francisco and Las Vegas as a guest of Salesforce and Splunk respectively

Adrift in the data lake

We’re awash with data and businesses have to figure out how not to drown in it

Last week Yahoo! closed down their directory pages ending one of the defining services of the 1990s internet and showing how the internet has changed since the first dot com boom.

The Yahoo! Directory was victim of a fundamental change in how we manage data as Google showed it wasn’t necessary to tag and label every piece of information before it could be used.

Yahoo!’s Directory was a classic case of applying old methods to new technologies – in this case carrying out a librarian’s function of cataloguing and categorising every web page.

One problem with that way of saving information is you need to know part of the answer before you can start searching; you need to have some idea of what category your query comes under or the name of the business or person you’re looking for.

That pan was exploited by the Yellow Pages where licensees around the world harvested a healthy cash flow from businesses forced to list under a dozen different categories to make sure prospective customers found them.

With the arrival of Google that way of structuring information came to an end as Sergey Brin and Larry Page’s smart algorithm showed it wasn’t necessary to pigeonhole information into highly structured databases.

Unstructured data

Rather than being structured, data is now becoming ‘unstructured’ and instead of employing an army of clerks to categorise information it’s now the job of computers to analyse that raw information and pick out what we need for our businesses and lives.

As information pours into companies from increasingly diverse sources, a flood that’s becoming so great it’s being referred to as the ‘data lake’, it’s become clear the battle to structure data is lost.

At the Splunk Conference in Las Vegas this week, the term ‘data lake’ is being used a lot as the company explains its technology for analysing business information.

Splunk, along with services like IBM’s Watson and Tableau Software, is one the companies capitalising on businesses’ need to manage unstructured data by giving customers the tools to analyse their information without having first to shoehorn it into a database.

“Thanks to Google we got to look at data a different way,” says Splunk’s CEO and Chairman Godfrey Sullivan. “You don’t have to know the question before you start the search.”

Diving into the data lake

It’s always dangerous applying simple labels to computing technologies but some terms, like ‘Cloud Computing’, don’t do a bad job of describing the principles involved and so it is with the ‘data lake’.

Rather than a nice, orderly world where everything can be pigeonholed, we know have a fluid environment where it wouldn’t be possible to label everything even if we wanted to. A lake is a good description of the mass of data pouring into our lives.

The web was an early example of having to manage that data lake and Google showed how it could be done. Now it’s the turn of other companies to apply the principles to business.

Google fatally damaged both Yahoo! and the Yellow Pages, other companies that are stuck in the age of structured data are going to find the future equally dismal. Don’t drown in that data lake.

Paul travelled to Las Vegas as a guest of Splunk

A unicorn in the wine industry

The wine industry once thought the internet was a cute idea, now companies like Vintank are showing them what it means

“I was a closet tech guy until the 2000s,” says Vintank’s founder Paul Mabray in describing how digital technologies are changing the wine industry to the Decoding The New Economy YouTube channel.

We’d spoken to Paul before about the forces changing the wine industry and visiting him in the Napa Valley gives some perspective on the opportunity the sector has in capturing the enthusiastic US wine market.

Paul’s first venture into wine technology was with Inertia Beverage Group in 2002, “when I started Inertia I said ‘hey, there’s this thing called the internet'”, Mabray recalls. “They said ‘hey Paul you’re so cute, the internet won’t be around in a couple of years.'”

The internet being a fad turned out not to be the case and Vintank evolved out of the rising importance of social media to industries like wineries.

“Vintank is the mission control of social media, the one stop engagement platform for the wine industry,” says Paul of his social media listening service which he and co-founder James Jory established in 2009.

Wine is lagging other industries in adopting social media and other digital technologies because it’s avoided many of the disruptions other sectors have had to deal with.

“The wine industry is the last industry that hasn’t been changed by the internet,” Mabray says. “If you look at hotels with expedia.com or restaurants with Yelp or Open Table, that hasn’t happened yet.”

A key facet of Vintank is its use of the freemium business model in offering a basic service for free; a common practice in the consumer (B2C) market but fairly rare in business (B2C) software services.

“It’s a very different way to do freemium in B2B. Freemium in B2C you do mass adoption — that tiny fraction that pay makes it profitable because so many people have it.”

“In the B2B freemium model what you have to do is distribute it for free and then you measure the usage; who is using it the most is where you send the sales team in.”

For Mabray, we’re in early days of using digital media and the wine industry is one of the sectors that needs to adopt the technologies quickly: “The driver for me is this horribly complex problem that needs to be solved — the wine industry needs digital to survive.”

Tag: analytics

Putting machine learning into wine

Born in an elevator

Similar posts:

Salesforce faces the end of the database era

The end of the database era

Breaking the structure

Similar posts:

Adrift in the data lake

Unstructured data

Diving into the data lake

Similar posts: