Skip to main contentSkip to Xpert Chatbot

UCSanDiegoX: Big Data Analytics Using Spark

4.3 stars
14 ratings

Learn how to analyze large datasets using Jupyter notebooks, MapReduce and Spark as a platform.

Big Data Analytics Using Spark
10 weeks
9–12 hours per week
Instructor-paced
Instructor-led on a course schedule
Free
Optional upgrade available

There is one session available:

59,849 already enrolled! After a course session ends, it will be archivedOpens in a new tab.
Starts Dec 15
Ends Apr 4, 2025
Enroll
Big Data Analytics Using Spark

About this course

Skip About this course

In data science, data is called "big" if it cannot fit into the memory of a single standard laptop or workstation.

The analysis of big datasets requires using a cluster of tens, hundreds or thousands of computers. Effectively using such clusters requires the use of distributed files systems, such as the Hadoop Distributed File System (HDFS) and corresponding computational models, such as Hadoop, MapReduce and Spark.

In this course, part of the Data Science MicroMasters program, you will learn what the bottlenecks are in massive parallel computation and how to use spark to minimize these bottlenecks.

You will learn how to perform supervised an unsupervised machine learning on massive datasets using the Machine Learning Library (MLlib).

In this course, as in the other ones in this MicroMasters program, you will gain hands-on experience using PySpark within the Jupyter notebooks environment.

At a glance

  • Language: English
  • Video Transcript: English
  • Associated programs:
  • Associated skills:Machine Learning, Data Science, Distributed File Systems, MapReduce, Apache Spark, Jupyter, Apache Hadoop, Hadoop Distributed File System (HDFS), Pyspark, Big Data Analytics, Big Data

What you'll learn

Skip What you'll learn
  • Programming Spark using Pyspark
  • Identifying the computational tradeoffs in a Spark application
  • Performing data loading and cleaning using Spark and Parquet
  • Modeling data through statistical and machine learning methods

Who can take this course?

Unfortunately, learners residing in one or more of the following countries or regions will not be able to register for this course: Iran, Cuba and the Crimea region of Ukraine. While edX has sought licenses from the U.S. Office of Foreign Assets Control (OFAC) to offer our courses to learners in these countries and regions, the licenses we have received are not broad enough to allow us to offer this course in all locations. edX truly regrets that U.S. sanctions prevent us from offering all of our courses to everyone, no matter where they live.

This course is part of Data Science MicroMasters Program

Learn more 
Expert instruction
4 graduate-level courses
10 months
9 - 11 hours per week

Ways to take this course

Choose your path when you enroll.

Certificate

Free

Price

$350 USD

-

Access to course materials

Unlimited

Limited

Expires on Feb 23, 2025

World-class institutions and universities

edX support

Shareable certificate upon completion

Graded assignments and exams

Read our FAQsin a new tab about frequently asked questions on these tracks.

Interested in this course for your business or team?

Train your employees in the most in-demand topics, with edX For Business.