|
Answer» To BECOME a data engineer you have to: - Learn computer-science fundamentals
- Master a programming language
- Understand concepts of SOFTWARE testing
- Learn database concepts, try to learn both RELATIONAL and nonrelational database concepts.
- Learn how to design and construct a data warehouse as it is crucial.
- Understand the basics of cloud computing
- Learn about frameworks for batch, hybrid, and streaming data processing. Apache Pig, Apache Spark, and Apache Kafka are just a few examples.
- Scheduling your workflow- you can use TOOLS like Apache Airflow for this
- Understand the basics of networking
- Learn how to use machine-readable CONFIGURATION files to manage and provision your data centre. Learn how to use containers with tools like Docker, Kubernetes, and AWS CloudFormation.
- The final step of learning– learn about cybersecurity to protect your data.
|