Data Engineering Nanodegree v2.0.0

Nanodegree key: nd027

Version: 2.0.0

Locale: en-us

Learn to design data models, build data warehouses and data lakes, automate data pipelines, and work with massive datasets.

Content

Part 01 : Welcome to the Nanodegree Program

Module 01: Welcome
- Lesson 01: Welcome to the Data Engineering Nanodegree Program
  Learn to design data models, build data warehouses and data lakes, automate data pipelines, and work with massive datasets.
- Lesson 02: Knowledge, Community, and Careers
  You are starting a challenging but rewarding journey! Take 5 minutes to read how to get help with projects and content.
- Lesson 03: Get Help with Your Account
  What to do if you have questions about your account or general questions about the program.
  - Concept 01: FAQ
  - Concept 02: Support
- Lesson 04: Introduction to Data Engineering
  What does it mean to be a Data Engineer?
Module 02: Careers Services Orientation
- Lesson 01: Nanodegree Career Services
  The Careers team at Udacity is here to help you move forward in your career - whether it's finding a new job, exploring a new career path, or applying new skills to your current job.
  - Concept 01: Meet the Careers Team
  - Concept 02: Access the Career Portal

Part 02 : Data Modeling

Learn to create relational and NoSQL data models to fit the diverse needs of data consumers. Use ETL to build databases in PostgreSQL and Apache Cassandra.

Module 01: Data Modeling Lessons and Projects
- Lesson 01: Introduction to Data Modeling
  In this lesson, students will learn the basic difference between relational and non-relational databases, and how each type of database fits the diverse needs of data consumers.
- Lesson 02: Relational Data Models
  In this lesson, students understand the purpose of data modeling, the strengths and weaknesses of relational databases, and create schemas and tables in Postgres
- Lesson 03: Project: Data Modeling with Postgres
  Students will model user activity data to create a database and ETL pipeline in Postgres for a music streaming app. They will define Fact and Dimension tables and insert data into new tables.
  
  Project Description - Data Modeling with Postgres
  
  Project Rubric - Data Modeling with Postgres
- Lesson 04: NoSQL Data Models
  Students will understand when to use non-relational databases based on the data business needs, their strengths and weaknesses, and how to creates tables in Apache Cassandra.
- Lesson 05: Project: Data Modeling with Apache Cassandra
  Students will model event data to create a non-relational database and ETL pipeline for a music streaming app. They will define queries and tables for a database built using Apache Cassandra.
  
  Project Description - Data Modeling with Apache Cassandra
  
  Project Rubric - Data Modeling with Apache Cassandra

**Part 07 (Elective):** Intro to Python

Learn Python programming fundamentals such as data types and structures, variables, loops, and functions.

Module 01: Lessons
- Lesson 01: Why Python Programming
  Welcome to Introduction to Python! Here's an overview of the course.
  - Concept 01: Welcome to the Course!
  - Concept 02: Programming in Python
- Lesson 02: Data Types and Operators
  Familiarize yourself with the building blocks of Python! Learn about data types and operators, built-in functions, type conversion, whitespace, and style guidelines.
- Lesson 03: Data Structures
  Use data structures to order and group different data types together! Learn about the types of data structures in Python, along with more useful built-in functions and operators.
- Lesson 04: Control Flow
  Build logic into your code with control flow tools! Learn about conditional statements, repeating code with loops and useful built-in functions, and list comprehensions.
- Lesson 05: Functions
  Learn how to use functions to improve and reuse your code! Learn about functions, variable scope, documentation, lambda expressions, iterators, and generators.
- Lesson 06: Scripting
  Setup your own programming environment to write and run Python scripts locally! Learn good scripting practices, interact with different inputs, and discover awesome tools.
- Lesson 07: NumPy
  Learn the basics of NumPy and how to use it to create and manipulate arrays.
- Lesson 08: Pandas
  Learn the basics of Pandas Series and DataFrames and how to use them to load and process data.
- Lesson 09: Advanced Topics
  In this lesson we cover some advanced topics of iterators and generators. You are not required to complete this but we have provided these to give you a taste of these.

**Part 08 (Elective):** SQL for Data Analysis

Learn SQL language fundamentals such as building basic queries and advanced functions like Window Functions, Subqueries and Common Table Expressions.

Module 01: Lessons
- Lesson 01: Basic SQL
  In this section, you will gain knowledge about SQL basics for working with a single table. You will learn the key commands to filter a table in many different ways.
- Lesson 02: SQL Joins
  In this lesson, you will learn how to combine data from multiple tables together.
- Lesson 03: SQL Aggregations
  In this lesson, you will learn how to aggregate data using SQL functions like SUM, AVG, and COUNT. Additionally, CASE, HAVING, and DATE functions provide you an incredible problem solving toolkit.
- Lesson 04: SQL Subqueries & Temporary Tables
  In this lesson, you will be learning to answer much more complex business questions using nested querying methods - also known as subqueries.
- Lesson 05: SQL Data Cleaning
  Cleaning data is an important part of the data analysis process. You will be learning how to perform data cleaning using SQL in this lesson.
- Lesson 06: SQL Window Functions
  Compare one row to another without doing any joins using one of the most powerful concepts in SQL data analysis: window functions.
- Lesson 07: SQL Advanced JOINS & Performance Tuning
  Learn advanced joins and how to make queries that run quickly across giant datasets. Most of the examples in the lesson involve edge cases, some of which come up in interviews.

**Part 09 (Elective):** Command Line Essentials

The Unix shell is a powerful tool for developers of all sorts. In this lesson, you'll get a quick introduction to the very basics of using it on your own computer.

Module 01: Command Line Essentials
- Lesson 01: Shell Workshop
  The Unix shell is a powerful tool for developers of all sorts. In this lesson, you'll get a quick introduction to the very basics of using it on your own computer.

**Part 10 (Elective):** Git and Github

Learn how to use version control to save and share your projects with others.

Module 01: Git and GitHub
- Lesson 01: What is Version Control?
  Version control is an incredibly important part of a professional programmer's life. In this lesson, you'll learn about the benefits of version control and install the version control tool Git!
- Lesson 02: Create a Git Repo
  Now that you've learned the benefits of Version Control and gotten Git installed, it's time you learn how to create a repository.
- Lesson 03: Review A Repo's History
  Knowing how to review an existing Git repository's history of commits is extremely important. You'll learn how to do just that in this lesson.
- Lesson 04: Add Commits to A Repo
  A repository is nothing without commits. In this lesson, you'll learn how to make commits, write descriptive commit messages, and verify the changes you're about to save to the repository.
- Lesson 05: Tagging, Branching, and Merging
  Being able to work on your project in isolation from other changes will multiply your productivity. You'll learn how to do this isolated development with Git's branches.
- Lesson 06: Undoing Changes
  Help! Disaster has struck! You don't have to worry, though, because your project is tracked in version control! You'll learn how to undo and modify changes that have been saved to the repository.
- Lesson 07: Working With Remotes
  You'll learn how to create remote repositories on GitHub and how to get and send changes to the remote repository.
- Lesson 08: Working On Another Developer's Repository
  In this lesson, you'll learn how to fork another developer's project. Collaborating with other developers can be a tricky process, so you'll learn how to contribute to a public project.
- Lesson 09: Staying In Sync With A Remote Repository
  You'll learn how to send suggested changes to another developer by using pull requests. You'll also learn how to use the powerful git rebase command to squash commits together.

Content

Part 01 : Welcome to the Nanodegree Program

Part 02 : Data Modeling

Part 03 : Cloud Data Warehouses

Part 04 : Data Lakes with Spark

Part 05 : Data Pipelines with Airflow

Part 06 : Capstone Project

Part 07 (Elective): Intro to Python

Part 08 (Elective): SQL for Data Analysis

Part 09 (Elective): Command Line Essentials

Part 10 (Elective): Git and Github

**Part 07 (Elective):** Intro to Python

**Part 08 (Elective):** SQL for Data Analysis

**Part 09 (Elective):** Command Line Essentials

**Part 10 (Elective):** Git and Github