Tools Data Engineers need to know in 2024
There are so many tools out there, but I found this video on YouTube. It did a good job of breaking down the essentials.
Here's a quick list of the tools mentioned:
  • Basics: SQL, Python, Linux, bash scripting, network understanding
  • Technical Basics: Git, SFTP, PGP
  • Databases: PostgreSQL, MySQL, MongoDB
  • Data Platforms: Snowflake, Databricks, BigQuery, Redshift, Azure Synapse Analytics
  • Orchestration, ETL & Data Pipelines: Airflow, Dagster, SSAS, Azure Data Factory
  • Cloud: AWS, Azure, GCP
  • Others: Docker, Kubernetes, Terraform
If you had to give advice on where to start, what would that be? What are your favored tools?
6
5 comments
Lina Sibbel
4
Tools Data Engineers need to know in 2024
Data Innovators Exchange
skool.com/data-innovators-exchange
Your source for Data Management Professionals in the age of AI and Big Data. Comprehensive Data Engineering reviews, resources, frameworks & news.
Leaderboard (30-day)
powered by