| 001 Building Streaming Pipeline using Kinesis.en.srt | 4.4 KB | ||
| 001 Building Streaming Pipeline using Kinesis.mp4 | 15.5 MB | ||
| 001 Customizing s3 folder using Kinesis Delivery Stream.en.srt | 8.5 KB | ||
| 001 Customizing s3 folder using Kinesis Delivery Stream.mp4 | 42 MB | ||
| 001 Getting Started with Cloud9.en.srt | 5 KB | ||
| 001 Getting Started with Cloud9.mp4 | 19.6 MB | ||
| 001 Hello World using AWS Lambda.en.srt | 7.4 KB | ||
| 001 Hello World using AWS Lambda.mp4 | 24.5 MB | ||
| 001 Install required libraries.en.srt | 3.1 KB | ||
| 001 Install required libraries.mp4 | 20.4 MB | ||
| 001 Introduction - AWS Getting Started.en.srt | 6 KB | ||
| 001 Introduction - AWS Getting Started.mp4 | 25.3 MB | ||
| 001 Introduction - Overview of Glue Components.en.srt | 4.6 KB | ||
| 001 Introduction - Overview of Glue Components.mp4 | 15.1 MB | ||
| 001 Introduction - Spark History Server for Glue.en.srt | 2.7 KB | ||
| 001 Introduction - Spark History Server for Glue.mp4 | 11.5 MB | ||
| 001 Introduction to Data Engineering using AWS Analytics Services.en.srt | 8.7 KB | ||
| 001 Introduction to Data Engineering using AWS Analytics Services.mp4 | 32.1 MB | ||
| 001 Introduction to Glue Job Boomarks.en.srt | 1.8 KB | ||
| 001 Introduction to Glue Job Boomarks.mp4 | 7.3 MB | ||
| 001 Prerequisites for Glue Catalog Tables.en.srt | 1.8 KB | ||
| 001 Prerequisites for Glue Catalog Tables.mp4 | 4.4 MB | ||
| 001 Setup Jupyter Lab using Docker.en.srt | 9.3 KB | ||
| 001 Setup Jupyter Lab using Docker.mp4 | 15.6 MB | ||
| 001 Setup Virtual Environment and Install Pyspark.en.srt | 7.7 KB | ||
| 001 Setup Virtual Environment and Install Pyspark.mp4 | 37.8 MB | ||
| 001 Update IAM Role for Glue Job.en.srt | 3.5 KB | ||
| 001 Update IAM Role for Glue Job.mp4 | 13.6 MB | ||
| 002 Cleaning up the data.en.srt | 3 KB | ||
| 002 Cleaning up the data.mp4 | 10.8 MB | ||
| 002 Create Crawler and Catalog Table.en.srt | 11 KB | ||
| 002 Create Crawler and Catalog Table.mp4 | 40.1 MB | ||
| 002 Create Policy to read from s3 Bucket.en.srt | 6.6 KB | ||
| 002 Create Policy to read from s3 Bucket.mp4 | 33.2 MB | ||
| 002 Creating Cloud9 Environment.en.srt | 7.9 KB | ||
| 002 Creating Cloud9 Environment.mp4 | 27.7 MB | ||
| 002 Generate baseline Glue Job.en.srt | 8.2 KB | ||
| 002 Generate baseline Glue Job.mp4 | 27.7 MB | ||
| 002 Getting Started with Pycharm.en.srt | 7.8 KB | ||
| 002 Getting Started with Pycharm.mp4 | 29.7 MB | ||
| 002 Rotating Logs.en.srt | 16.3 KB | ||
| 002 Rotating Logs.mp4 | 86.5 MB | ||
| 002 Setup Project for local development.en.srt | 9.5 KB | ||
| 002 Setup Project for local development.mp4 | 47 MB | ||
| 002 Setup Spark History Server on AWS.en.srt | 12.3 KB | ||
| 002 Setup Spark History Server on AWS.mp4 | 53.4 MB | ||
| 002 Steps for Creating Catalog Tables.en.srt | 2.4 KB | ||
| 002 Steps for Creating Catalog Tables.mp4 | 10.1 MB | ||
| 002 Understanding GitHub APIs.en.srt | 7.9 KB | ||
| 002 Understanding GitHub APIs.mp4 | 43 MB | ||
| 002 [Instructions and Code] Setup Jupyter Lab using Docker.html | 1.9 KB | ||
| 002 [Instructions] Introduction - AWS Getting Started.html | 1.6 KB | ||
| 003 Analyze Data using Athena.en.srt | 6.5 KB | ||
| 003 Analyze Data using Athena.mp4 | 9.8 MB | ||
| 003 Clone AWS Glue Samples repository.en.srt | 2.9 KB | ||
| 003 Clone AWS Glue Samples repository.mp4 | 14.5 MB | ||
| 003 Create s3 Bucket.en.srt | 6 KB | ||
| 003 Create s3 Bucket.mp4 | 25.3 MB | ||
| 003 Deploy Project to AWS Lambda console.en.srt | 6.1 KB | ||
| 003 Deploy Project to AWS Lambda console.mp4 | 26.2 MB | ||
| 003 Download Data Set.en.srt | 6.9 KB | ||
| 003 Download Data Set.mp4 | 38.1 MB | ||
| 003 Overview of AWS Glue CLI.en.srt | 5.6 KB | ||
| 003 Overview of AWS Glue CLI.mp4 | 24.4 MB | ||
| 003 Passing Run Time Arguments.en.srt | 8.8 KB | ||
| 003 Passing Run Time Arguments.mp4 | 29.9 MB | ||
| 003 Running baseline Glue Job.en.srt | 15.8 KB | ||
| 003 Running baseline Glue Job.mp4 | 76.1 MB | ||
| 003 Setting up GitHub API Token.en.srt | 5.3 KB | ||
| 003 Setting up GitHub API Token.mp4 | 29.5 MB | ||
| 003 Setup Kinesis Firehose Agent.en.srt | 9 KB | ||
| 003 Setup Kinesis Firehose Agent.mp4 | 53 MB | ||
| 003 Understanding Jupyter Lab Environment.en.srt | 2.5 KB | ||
| 003 Understanding Jupyter Lab Environment.mp4 | 7.9 MB | ||
| 003 Validate s3 access using AWS CLI.en.srt | 6.6 KB | ||
| 003 Validate s3 access using AWS CLI.mp4 | 29.6 MB | ||
| 003 Warming up with Cloud9 IDE.en.srt | 5.9 KB | ||
| 003 Warming up with Cloud9 IDE.mp4 | 17.3 MB | ||
| 004 Accessing OS Environment Variables.en.srt | 6.8 KB | ||
| 004 Accessing OS Environment Variables.mp4 | 23.9 MB | ||
| 004 Build Glue Spark UI Container.en.srt | 1.6 KB | ||
| 004 Build Glue Spark UI Container.mp4 | 8.5 MB | ||
| 004 Create Kinesis Firehose Delivery Stream.en.srt | 12.1 KB | ||
| 004 Create Kinesis Firehose Delivery Stream.mp4 | 47.6 MB | ||
| 004 Creating S3 Bucket and Role.en.srt | 6.7 KB | ||
| 004 Creating S3 Bucket and Role.mp4 | 28.5 MB | ||
| 004 Develop download functionality using requests.en.srt | 11.3 KB | ||
| 004 Develop download functionality using requests.mp4 | 49.8 MB | ||
| 004 Glue Script for Partitioning Data.en.srt | 6.7 KB | ||
| 004 Glue Script for Partitioning Data.mp4 | 31.5 MB | ||
| 004 Overview of EC2 related to Cloud9.en.srt | 2.6 KB | ||
| 004 Overview of EC2 related to Cloud9.mp4 | 9.4 MB | ||
| 004 Run Job using Bookmark.en.srt | 4 KB | ||
| 004 Run Job using Bookmark.mp4 | 22.4 MB | ||
| 004 Setup Python Virtual Environment to explore boto3.en.srt | 5.2 KB | ||
| 004 Setup Python Virtual Environment to explore boto3.mp4 | 17.4 MB | ||
| 004 Understanding GitHub Rate Limit.en.srt | 2.6 KB | ||
| 004 Understanding GitHub Rate Limit.mp4 | 13.1 MB | ||
| 004 Upload data to s3.en.srt | 9.7 KB | ||
| 004 Upload data to s3.mp4 | 58.8 MB | ||
| 004 [Instructions] Create s3 Bucket.html | 1.8 KB | ||
| 004 [Instructions] Understanding Jupyter Lab Environment.html | 1.6 KB | ||
| 005 Create Glue Catalog Database - itvghlandingdb.en.srt | 1.8 KB | ||
| 005 Create Glue Catalog Database - itvghlandingdb.mp4 | 7.3 MB | ||
| 005 Create IAM Group and User.en.srt | 7.8 KB | ||
| 005 Create IAM Group and User.mp4 | 27.2 MB | ||
| 005 Create New Repository for since.en.srt | 3.5 KB | ||
| 005 Create New Repository for since.mp4 | 19.8 MB | ||
| 005 Create and Run the Glue Job.en.srt | 14.2 KB | ||
| 005 Create and Run the Glue Job.mp4 | 73.2 MB | ||
| 005 Getting Started with Spark.en.srt | 4 KB | ||
| 005 Getting Started with Spark.mp4 | 18.7 MB | ||
| 005 Install Python boto3.en.srt | 2.6 KB | ||
| 005 Install Python boto3.mp4 | 9.8 MB | ||
| 005 Opening ports for Cloud9 Instance.en.srt | 5.3 KB | ||
| 005 Opening ports for Cloud9 Instance.mp4 | 18.3 MB | ||
| 005 Planning the Pipeline.en.srt | 5.3 KB | ||
| 005 Planning the Pipeline.mp4 | 23.1 MB | ||
| 005 Update IAM Policy Permissions.en.srt | 7 KB | ||
| 005 Update IAM Policy Permissions.mp4 | 28.8 MB | ||
| 005 Using 3rd party libraries in AWS Lambda.en.srt | 9.3 KB | ||
| 005 Using 3rd party libraries in AWS Lambda.mp4 | 44.6 MB | ||
| 005 Validate Bookmark using AWS CLI.en.srt | 8.5 KB | ||
| 005 Validate Bookmark using AWS CLI.mp4 | 40.3 MB | ||
| 005 Validating access to s3 using Python boto3.en.srt | 7.3 KB | ||
| 005 Validating access to s3 using Python boto3.mp4 | 35.9 MB | ||
| 005 [Instructions and Code] Glue Script for Partitioning Data.html | 3.4 KB | ||
| 006 Add new data to landing.en.srt | 3.8 KB | ||
| 006 Add new data to landing.mp4 | 20 MB | ||
| 006 Associating Elastic IPs to Cloud9 Instance.en.srt | 6.8 KB | ||
| 006 Associating Elastic IPs to Cloud9 Instance.mp4 | 28.8 MB | ||
| 006 Create Function for Spark Session.en.srt | 8.2 KB | ||
| 006 Create Function for Spark Session.mp4 | 41.3 MB | ||
| 006 Create Glue Catalog Table - ghactivity.en.srt | 8.3 KB | ||
| 006 Create Glue Catalog Table - ghactivity.mp4 | 29.4 MB | ||
| 006 Create IAM Group and User.en.srt | 11.6 KB | ||
| 006 Create IAM Group and User.mp4 | 49.3 MB | ||
| 006 Extracting Required Information.en.srt | 9.8 KB | ||
| 006 Extracting Required Information.mp4 | 44.6 MB | ||
| 006 Overview of Roles.en.srt | 3.8 KB | ||
| 006 Overview of Roles.mp4 | 15 MB | ||
| 006 Read Content from s3 object.en.srt | 12.5 KB | ||
| 006 Read Content from s3 object.mp4 | 66.6 MB | ||
| 006 Start Glue Spark UI Container.en.srt | 9.5 KB | ||
| 006 Start Glue Spark UI Container.mp4 | 41.8 MB | ||
| 006 Validate using Glue CatalogTable and Athena.en.srt | 11 KB | ||
| 006 Validate using Glue CatalogTable and Athena.mp4 | 46.3 MB | ||
| 006 Validating s3 access for local development.en.srt | 14.1 KB | ||
| 006 Validating s3 access for local development.mp4 | 63.3 MB | ||
| 006 Validating using Athena.en.srt | 9.6 KB | ||
| 006 Validating using Athena.mp4 | 45.8 MB | ||
| 006 [Instructions and Code] Install Python boto3.html | 1.4 KB | ||
| 007 Create and Attach Custom Policy.en.srt | 7.5 KB | ||
| 007 Create and Attach Custom Policy.mp4 | 29.6 MB | ||
| 007 Create and Run Glue Trigger.en.srt | 6.5 KB | ||
| 007 Create and Run Glue Trigger.mp4 | 24.6 MB | ||
| 007 Develop upload functionality to s3.en.srt | 13.8 KB | ||
| 007 Develop upload functionality to s3.mp4 | 63.7 MB | ||
| 007 Granting Permissions to IAM User using Policy.en.srt | 8 KB | ||
| 007 Granting Permissions to IAM User using Policy.mp4 | 34.3 MB | ||
| 007 Increase EBS Volume Size of Cloud9 Instance.en.srt | 5.6 KB | ||
| 007 Increase EBS Volume Size of Cloud9 Instance.mp4 | 18.2 MB | ||
| 007 Processing Data.en.srt | 15.1 KB | ||
| 007 Processing Data.mp4 | 68.4 MB | ||
| 007 Read multiple s3 Objects.en.srt | 10 KB | ||
| 007 Read multiple s3 Objects.mp4 | 42.9 MB | ||
| 007 Rerun Glue Job using Bookmark.en.srt | 5.2 KB | ||
| 007 Rerun Glue Job using Bookmark.mp4 | 25.1 MB | ||
| 007 Running Queries using Athena - ghactivity.en.srt | 6.5 KB | ||
| 007 Running Queries using Athena - ghactivity.mp4 | 33.5 MB | ||
| 007 Running Shell Commands.en.srt | 2.6 KB | ||
| 007 Running Shell Commands.mp4 | 10.2 MB | ||
| 007 Setup Sample Data.en.srt | 3.8 KB | ||
| 007 Setup Sample Data.mp4 | 18.5 MB | ||
| 008 Configure Kinesis Firehose Agent.en.srt | 8.8 KB | ||
| 008 Configure Kinesis Firehose Agent.mp4 | 36.1 MB | ||
| 008 Crawling Multiple Folders.en.srt | 10.6 KB | ||
| 008 Crawling Multiple Folders.mp4 | 44.9 MB | ||
| 008 Create Glue Workflow.en.srt | 10.2 KB | ||
| 008 Create Glue Workflow.mp4 | 45.1 MB | ||
| 008 Get number of s3 Objects using Marker.en.srt | 9.9 KB | ||
| 008 Get number of s3 Objects using Marker.mp4 | 40.6 MB | ||
| 008 Grant Permissions to create dynamodb tables using boto3.en.srt | 4.7 KB | ||
| 008 Grant Permissions to create dynamodb tables using boto3.mp4 | 18.7 MB | ||
| 008 Read data from files.en.srt | 12.8 KB | ||
| 008 Read data from files.mp4 | 63.6 MB | ||
| 008 Setup Jupyter lab on Cloud9 Instance.en.srt | 11.6 KB | ||
| 008 Setup Jupyter lab on Cloud9 Instance.mp4 | 42.2 MB | ||
| 008 Validate Job Bookmark and Files for Incremental run.en.srt | 3.3 KB | ||
| 008 Validate Job Bookmark and Files for Incremental run.mp4 | 20.6 MB | ||
| 008 Validating using AWS Lambda Console.en.srt | 4.1 KB | ||
| 008 Validating using AWS Lambda Console.mp4 | 23.8 MB | ||
| 008 [Instructions and Code] Create and Attach Custom Policy.html | 2.2 KB | ||
| 008 [Instructions] Running Shell Commands.html | 1.1 KB | ||
| 009 Configure and Validate AWS CLI.en.srt | 7.7 KB | ||
| 009 Configure and Validate AWS CLI.mp4 | 30.1 MB | ||
| 009 Create Dynamodb Tables.en.srt | 11.1 KB | ||
| 009 Create Dynamodb Tables.mp4 | 45.8 MB | ||
| 009 Get size of s3 Objects using Marker.en.srt | 6.7 KB | ||
| 009 Get size of s3 Objects using Marker.mp4 | 29.7 MB | ||
| 009 Install AWS CLI.en.srt | 6.5 KB | ||
| 009 Install AWS CLI.mp4 | 24.8 MB | ||
| 009 Managing Glue Catalog using Python Boto3.en.srt | 19.1 KB | ||
| 009 Managing Glue Catalog using Python Boto3.mp4 | 91.8 MB | ||
| 009 Process data using Spark APIs.en.srt | 9.5 KB | ||
| 009 Process data using Spark APIs.mp4 | 43.6 MB | ||
| 009 Recrawl the Clue Catalog Table using CLI.en.srt | 8.2 KB | ||
| 009 Recrawl the Clue Catalog Table using CLI.mp4 | 37.6 MB | ||
| 009 Run Glue Workflow and Validate.en.srt | 9.2 KB | ||
| 009 Run Glue Workflow and Validate.mp4 | 43.4 MB | ||
| 009 Run using AWS Lambda Console.en.srt | 6.6 KB | ||
| 009 Run using AWS Lambda Console.mp4 | 35.5 MB | ||
| 009 Start and Validate Agent.en.srt | 15.9 KB | ||
| 009 Start and Validate Agent.mp4 | 98.4 MB | ||
| 010 Conclusion - Building Simple Steaming Pipeline.en.srt | 1.7 KB | ||
| 010 Conclusion - Building Simple Steaming Pipeline.mp4 | 13.3 MB | ||
| 010 Dynamodb CRUD Operations.en.srt | 13.1 KB | ||
| 010 Dynamodb CRUD Operations.mp4 | 54.1 MB | ||
| 010 Run Athena Queries for Data Validation.en.srt | 6.4 KB | ||
| 010 Run Athena Queries for Data Validation.mp4 | 33.9 MB | ||
| 010 Validating files incrementally.en.srt | 13.3 KB | ||
| 010 Validating files incrementally.mp4 | 67.4 MB | ||
| 010 Write data to files.en.srt | 11.2 KB | ||
| 010 Write data to files.mp4 | 44.7 MB | ||
| 010 [Instructions and Code] Configure and Validate AWS CLI.html | 1.7 KB | ||
| 010 [Instructions and Code] Install AWS CLI.html | 1.4 KB | ||
| 011 Populate Dynamodb Table.en.srt | 8.4 KB | ||
| 011 Populate Dynamodb Table.mp4 | 45.8 MB | ||
| 011 Reading and Writing Bookmark using s3.en.srt | 11.5 KB | ||
| 011 Reading and Writing Bookmark using s3.mp4 | 61.8 MB | ||
| 011 Validating Writing Data to Files.en.srt | 10.8 KB | ||
| 011 Validating Writing Data to Files.mp4 | 50.6 MB | ||
| 012 Dynamodb Batch Operations.en.srt | 10.4 KB | ||
| 012 Dynamodb Batch Operations.mp4 | 45.8 MB | ||
| 012 Maintaining Bookmark using s3.en.srt | 12.8 KB | ||
| 012 Maintaining Bookmark using s3.mp4 | 57 MB | ||
| 012 Productionizing the Code.en.srt | 7.4 KB | ||
| 012 Productionizing the Code.mp4 | 25.5 MB | ||
| 013 Review the incremental upload logic.en.srt | 9.9 KB | ||
| 013 Review the incremental upload logic.mp4 | 48.1 MB | ||
| 014 Deploying lambda function.en.srt | 18.1 KB | ||
| 014 Deploying lambda function.mp4 | 98.5 MB | ||
| 015 Schedule Lambda Function using AWS Event Bridge.en.srt | 8.3 KB | ||
| 015 Schedule Lambda Function using AWS Event Bridge.mp4 | 36.3 MB | ||
| Bonus Resources.txt | 307.2 B | ||
| Get Bonus Downloads Here.url | 204.8 B | ||
| ▲ 246 total files | |||
Data Engineering using AWS Analytics Services
MP4 | Video: h264, 1280x720 | Audio: AAC, 44.1 KHz, 2 Ch
Genre: eLearning | Language: English + srt | Duration: 124 lectures (9h 35m) | Size: 3.61 GB
Build Data Engineering Pipelines using AWS Analytics Services such as Glue, EMR, Athena, Kinesis, Quick Sight, etc
What you'll learn:
Data Engineering leveraging AWS Analytics features
Managing Tables using Glue Catalog
Engineering Batch Data Pipelines using Glue Jobs
Orchestrating Batch Data Pipelines using Glue Workflows
Running Queries using Athena - Server less query engine service
Using AWS Elastic Map Reduce (EMR) Clusters for building Data Pipelines
Using AWS Elastic Map Reduce (EMR) Clusters for reports and dashboards
Data Ingestion using Lambda Functions
Scheduling using Events Bridge
Engineering Streaming Pipelines using Kinesis
Streaming Web Server logs using Kinesis Firehose
Requirements
Programming experience using Python
Data Engineering experience using Spark
Ability to write and interpret SQL Queries
This course is ideal for experienced data engineers to add AWS Analytics Services as key skills to their profile
Description
Data Engineering is all about building Data Pipelines to get data from multiple sources into Data Lake or Data Warehouse and then from Data Lake or Data Warehouse to downstream systems. As part of this course, I will walk you through how to build Data Engineering Pipelines using AWS Analytics Stack. It includes services such as Glue, Elastic Map Reduce (EMR), Lambda Functions, Athena, QuickSight, and many more.
Here are the high-level steps which you will follow as part of the course.
| torrent name | size | uploader | age | seed | leech |
|---|---|---|---|---|---|
| 274.1 MB | freecoursewb | 1 week | 17 | 1 | |
| 1.1 GB | freecoursewb | 1 week | 5 | 7 | |
| 2.9 GB | freecoursewb | 1 week | 2 | 19 | |
|
Udemy - Revit Ideate - BIM Automation, Data Management and Documents Posted by
freecoursewb in Other
|
2.4 GB | freecoursewb | 1 week | 11 | 10 |
| 952.8 MB | freecoursewb | 2 weeks | 45 | 16 |
All Comments