Data Engineering Bootcamp

Prepare For A Data Engineering Career

What You Will Learn

• The Data Engineering Lifecycle

  You will learn the steps involved in making raw data a valuable, usable resource for organizations. From getting data, to storing data, to transforming data, and delivering data to your end users you will become familiar with design decisions and using software tools that enable this work. You will also begin to learn about how the work of a data engineer intersects with security and privacy concerns, data management, architecture, devops/dataops, and orchestration.

• Python and SQL

  You will become adept at writing Python code to get data, transform data, and create data pipelines that move data through the lifecycle workflow. You will also become very practiced with writing SQL to work with data. You will learn about how things happen under the hood of the SQL engine so you can write queries that are better optimized. SQL and Python are the most common languages used by data engineers and form a foundation for more modern tooling.

• Ingesting Data

  From csv and parquet files to APIs, databases, and cloud storage, you will learn to pull data from various sources. You will also learn concepts like change data capture, webhooks, SFTP, database connections, and streaming versus batch while getting practice with obtaining raw data that can be transformed to valuable business assets.

• Data Storage

  You will learn about database design, SQL and NoSQL databases, data warehouses, data lakes, and data lakehouses. You will learn different use cases for making storage selections to support how data is going to be used.

• Data Transformations

  You will learn about combining and aggregating data, cleaning data and converting it from one datatype to another. You will learn to apply business rules and business logic to add value to data for your organization.

• Data Delivery

  You will gain an understanding of how data analysts and data scientists use data to answer questions. You will learn about how data is prepared for machine learning and other AI applications. You will practice different methods for making data available to users in different disciplines and you will practice updating the data you use as a data engineer through reverse ETL.

• Tools and Techniques

  You will be working with the command line, VSCode, git and Github. You will practice working on a team, building your communication skills, and using agile methodologies. You will gain experience talking about your work and the decisions made in designing your design, pipeline, or workflow. You will get an introduction to modern tools such as Docker, dbt, Databricks, Apache Airflow, Snowflake, and Dremio. You will interact with the 3 major cloud platforms, AWS, Microsoft Azure, and Google Cloud, and learn about some of the tools they have to offer.

• Generative AI

  Generative AI has led to new tools that can improve the productivity of data engineers, developers, and analysts. They can help you learn new technologies, provide a valuable reference resource, and help generate code or tests for an application. But these tools must be carefully managed, given detailed requirements, and the results carefully scrutinized by a trained data engineer. You will learn valuable skills in prompting within conversational AI platforms and coding agents, and how to use generative AI safely and effectively.

• Real-World Projects

  You will be able to apply the skills you are learning to real-world datasets and problems from various domains, such as healthcare, financial services, entertainment, consumer marketing/retail, and government. Projects will be executed primarily in a team environment so you’ll get experience working with others in a multi-disciplinary project team.
  
  Your capstone project will be an individual effort that demonstrates your ability to take a data engineering project through the entire data engineering lifecycle. This project will demonstrate to potential employers your ability to apply the skills learned in this class to a real-world problem and present your findings.

• Career Preparation

  Throughout the bootcamp you will also be preparing to move into a data engineering job. You’ll meet working data engineers from several industries. We’ll hold workshops on resume preparation/marketing yourself, interview preparation, negotiating, and more. And we’ll introduce you to prospective employers at your class Demo Day and support you after graduation during your job search.