Posts Tagged ‘Spark’

Interview: What does a career in Big Data Geo-Analytics look like?

Friday, March 3rd, 2017

Get the scoop from Chandra Sekhar Saripaka, who is a Senior Data Engineer at DataSpark.

Chandra is an experienced software engineer with more than 10 years in the IT field that included stints in major banks.

Chandra is an experienced software engineer with more than 10 years in the IT field that included stints in major banks.

An aspiring Big Data scientist should look no further than Chandra Sekhar Saripaka.

As a Senior Data Engineer with DataSpark, he was one of two speakers from the company who participated in Strata + Hadoop World 2016 in Singapore, a conference which attracted the top minds around the world working on Big Data and analytics.

Chandra spoke on how to go “from telco data to spatial-temporal intelligence APIs”, by “architecting through microservices”.

He explained in detail the production architecture at DataSpark and how it works through terabytes of spatial-temporal telco data each day in PaaS mode.

Chandra also shared with fellow data scientists attending his talk how the platform operates in SaaS mode.

Chandra’s in-depth knowledge of Big Data makes him the best person to give pointers to an aspiring IT engineer in the field.

I’ve asked Chandra to share his valuable insights on carving a career in this intensely competitive arena.

What must today’s IT worker do to get a foothold in Big Data?

Chandra: There is a paradigm shift in the way traditional software is being transformed into data-driven software.

With the rise of many small and medium startups in the market, various cloud-ready tools – in terms of storage, compute, processing and visualisation – have emerged.

(more…)

Riding the Big Data wave: Interview with Ying Shao Wei, COO, DataSpark

Thursday, March 2nd, 2017

Ying Shao Wei – Chief Operating Officer, DataSpark – was one of the distinguished speakers in Strata + Hadoop World Singapore to helm a session attended by fellow data scientists and C-suite leaders as he shared his insights into the analysis of “mobility as a vital sign of people and the economy”.

Strata + Hadoop World Singapore 2016 saw the congregation, in Singapore, of thought leaders in the Big Data analytics and insights arena, enabling practitioners to learn through the sharing of experiences and exchange of ideas. It also provided participants the opportunity to network for future collaboration.

Strata + Hadoop World Singapore 2016 saw the congregation, in Singapore, of thought leaders in the Big Data analytics and insights arena, enabling practitioners to learn through the sharing of experiences and exchange of ideas. It also provided participants the opportunity to network for future collaboration.

To understand more about Big Data and where it is heading, I sat down with Ying to tap his insights into the trends and prospects of Big Data in this fast-paced sector.

Big Data is the buzz word in the world of Enterprise IT. However, to the man in the street, how does Big Data affect them in their daily lives?

Ying Shao Wei: There are significant ways in which Big Data is already benefiting the man in the street.

Big Data enables the huge amount of customer feedback – through online reviews and social media – to be processed so that companies have a better chance of responding to and acting quickly upon such feedback.

So with Big Data, customers are more likely to have their preferences addressed.

When you visit an e-commerce website, you will be provided more relevant recommended products and services, thanks to recommendation systems enabled by Big Data.

Because of Big Data, I am able to see and sense my surrounding environment with better clarity than ever before.

When I use online maps to navigate or plan for a journey, I am using Big Data to save tremendous time and effort in getting from one place to another.

With Big Data, mobile subscribers are also now getting better network experiences when they use their mobile broadband connections.

(more…)

DataSpark: Setting the stage for Big Data Analytics

Wednesday, March 1st, 2017

DataSpark is a Big Data company that is part of Singtel, Asia’s leading communications group. The company participated in Strata + Hadoop World 2016 in Singapore with two speakers and an exhibition booth.

Strata + Hadoop World is one of the world’s leading conference on big data, featuring some of the most progressive leaders in the industry, delving into areas that include Big Data in telecommunications and finance; smart cities and urban automation; IoT and intelligent real-time applications; data science and advanced analytics; chat, machine learning, and AI; security, governance and ethics; as well as the issues involved in becoming a data-centric company. Other topics include design, visualisation, and VR, Hadoop use cases, Hadoop internals and development, production-ready Hadoop, Spark and beyond.

Strata + Hadoop World is one of the world’s leading conferences on big data, featuring some of the most progressive leaders in the industry.

Strata + Hadoop World first came to Singapore in 2015 with DataSpark participating as an exhibitor.

The sold-out conference also featured two speakers from DataSpark covering how the telco landscape could be invigorated by using data assets to create new applications, as well as the use of telco data to monitor traffic in Singapore.

With the resounding response during the inaugural conference in Singapore, DataSpark participated again in this year’s Strata + Hadoop World 2016, as an exhibitor with a booth in the Sponsor Pavilion.

As a thought leader in its mobility intelligence, two speakers from DataSpark were also showcased in the conference.

Mobility as a vital sign of people and the economy

Ying Shao Wei, Chief Operating Officer, spoke on “mobility as a vital sign of people and the economy”.

The audience learnt how telco-enabled insights could provide deep, refreshing and actionable perspectives on the health of urban infrastructure such as road and train systems; the economy, in terms of trade activities and major tourism events; as well as the general well-being of the populace.

Ying Shao Wei, Chief Operating Officer, DataSpark, spoke on how real-time insights from DataSpark’s software help the organisers and public authorities better understand how crowds build up and disperse and detect anomalies in the flow of people, enabling a better marshalling of ground resources to ensure public safety.

Ying Shao Wei, Chief Operating Officer, DataSpark, spoke on how real-time insights from DataSpark’s software help the organisers and public authorities better understand how crowds build up and disperse and detect anomalies in the flow of people, enabling a better marshalling of ground resources to ensure public safety.

These telco-enabled insights were gleaned from the software platforms and data science engines that DataSpark has built to make sense of the interconnected world of digital devices and more than two hundred million users across Singapore, Australia, Indonesia, and Thailand.

The company has successfully applied data science methodologies and techniques, such as data mining and machine learning, to make discoveries about the interactions between users and their increasing number of devices, from mobile phones and tablets to TV set-top boxes and broadband devices.

With their expertise and developments in Big Data and analytics, DataSpark is well-positioned to ride the wave of Big Data adoption that the industry and governments are looking to embrace.

(more…)