Dive into the world of big datasets using SQL, Python, and AWS. Our Data Engineering course guides you through managing vast amounts of data, from understanding storage requirements to building end-to-end pipelines and efficiently handling distributed data systems.
βYou deal with vast amounts of data, navigating their complexities to store and process them efficiently.
β
βYou design and implement solid data architectures, laying the foundation for analytics and operations.
β
βYou set up processes for a smooth transformation of data from its raw form to an analysis-ready state.
β
βConsistency is key. You maintain both relational and non-relational databases, offering efficient and reliable access.
β
βAs the volume of data grows, you adapt, scaling systems to always meet new data challenges.
This course will provide students with the knowledge, skills, and experience to get a job as a data engineer.
Explore101 introduces you to the world of data science. You'll set up your learning environment, understand the ExploreAI Teaching Philosophy, and dive into the basics of modern data science. You'll also learn problem-solving with design thinking and the scientific method. We'll touch on the ExploreAI data product framework and effective project management, making sure you know how to work well in a data-driven workplace.
With the Python module, you'll dive into one of the go-to languages for data science. You'll learn about the Notebook environment, work with different data types, and get hands-on with writing functions and data analysis. It's everything you need to start working confidently with Python.
In the SQL (Structured Query Language) module, you'll learn how to work with databases, which are the backbone of most big data projects. From the basics of how databases work to designing and running your own, you'll get a clear overview of what SQL is all about and why it's so important.
In Cloud Computing, you'll be introduced to the basics of doing computer work online. You'll understand what cloud computing is, its pros and cons, and get to know big companies like Amazon Web Services (AWS) that provide these services. From storing data online to keeping everything running smoothly and securely, this module gives you a clear look into how modern online projects work.
The Storing Big Data module is all about understanding where and how to keep large datasets. You'll learn about different types of databases, from the common relational ones to the big data-specialised data lakes. You'll also dive into how data can be static, like when it comes from APIs and devices, or be streaming in real-time. Whether it's files, streams, or data lakes, by the end of this module, you'll know how to choose the best storage solution for your needs.
In Moving Big Data, it's all about transferring and managing your data. You'll explore how to set up pipelines to move data from one place to another, and how to start these pipelines with specific events or triggers. To make sure everything is working correctly, you'll also dive into logging to keep track of data movement and set up alerts to notify you of any hiccups in the system.
β
The Processing Big Data module takes you into the world of big data frameworks like Spark, Hive, and Hadoop. You'll learn how they help store and access large amounts of data efficiently. The focus will be on transforming data to make it useful and managing its quality and security. From setting up a big data-ready cluster to ensuring the data is always available and safe, this module covers the key steps in processing big data.
An educational entrepreneur, Maddy has 15 years of experience teaching maths and statistics. With a BSc in the same field, she also graduated at the top of our Data Science class of 2020.
A computer science master's graduate turned data scientist, Nthikeng offers a deep expertise in supervised and unsupervised learning, elevating the quality and depth of our Academy courses.
Vince is a technical lead in the enterprise division of ExploreAI. Busy with his PhD in engineering and with a deep knowledge of big data, Vince ensures our data engineering content is of the highest quality.
Andries holds an MSc in bioinformatics. He joined ExploreAI as a data scientist and is an alumnus of our data science qualification. He is now a Senior Data Engineer in ExploreAIβs enterprise division.
Chelsea leads creative media production at ExploreAI. Holding a BA(Hons) in Film and Media, she melds storytelling with e-learning, achieving a balance of entertainment and education.
Pay in a way that matches your budget. Pay up front, monthly or with a loan.
Get paid to study, by applying for a scholarship or having your employer fund your qualification.