IBM commits to Apache Spark open source project

Monday 15 June 2015 | 09:48 CET | News

IBM said it has made a major commitment to ApacheSpark open source project.

IBM plans to embed Spark into its Analytics and Commerce platforms, and to offer Spark as a service on IBM Cloud. IBM will also put more than 3,500 IBM researchers and developers to work on Spark-related projects, donate its BM SystemML machine learning technology to the Spark open source ecosystem, and educate more than one million data scientists and data engineers on Spark. This will be done through partnerships with AMPLab, DataCamp, MetiStream, Galvanize and Big Data University MOOC.

As part of its commitment, IBM's Watson Health Cloud will leverage Spark as a key underpinning for its insight platform. IBM will also open source its IBM SystemML machine learning technology and collaborate with Databricks to advance Spark’s machine learning capabilities. IBM will offer Spark as a Cloud service on IBM Bluemix to make it possible for app developers to quickly load data, model it, and derive the predictive artifact to use in their app. IBM researchers will work on Spark-related projects at more than a dozen labs worldwide, and open a Spark Technology Center in San Francisco for the Data Science and Developer community to foster design-led innovation in intelligent applications. 

IBM said Spark brings “essential” advances to large-scale data processing, improving the performance of data dependent apps and simplifying the process of developing intelligent apps, which are fueled by data.

Free Headlines in your E-mail

Every day we send out a free e-mail with the most important headlines of the last 24 hours.

Subscribe now

::: add a comment