When Zaharia started work on Spark around 2010, analyzing "big data" generally meant using MapReduce, the Java-based ...

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources. Agent workflows make transport a first-order ...

Apache Spark creator and Databricks CTO Matei Zaharia wins the 2026 ACM Prize in Computing and argues that AGI has already ...

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources. Agent workflows make transport a first-order ...

Editor’s Note: Vaibhav Nivargi is the founder and chief architect of ClearStory Data, a data analytics service provider. This week the fast-growing Apache Spark community is gathering in New York City ...

eSpeaks’ Corey Noles talks with Rob Israch, President of Tipalti, about what it means to lead with Global-First Finance and how companies can build scalable, compliant operations in an increasingly ...

ACM, the Association for Computing Machinery, today named Matei Zaharia as the recipient of the ACM Prize in Computing for ...

Recent surveys and forecasts of technology adoption have consistently suggested that Apache Spark is being embraced at a rate that outperforms other big data frameworks Initially open-sourced in 2012 ...

Apache Spark is a hugely popular execution framework for running data engineering and machine learning workloads. It powers the Databricks platform and is available in both on-premises and cloud-based ...

Yahoo, model Apache Spark citizen and developer of CaffeOnSpark, which made it easier for developers building deep learning models in Caffe to scale with parallel processing, is open sourcing a new ...