aureliowozhiak/awesome-data-engineering-br

This repository is a curated Portuguese language guide to data engineering, aimed at people in Brazil who want to learn the field or grow their career in it. Rather than being a piece of software, it is a large collection of organized links, explanations, and reference material, following the common awesome list format used across GitHub. It opens by explaining what data engineering actually is: the discipline of building and maintaining the pipelines and infrastructure that collect, transform, store, and deliver reliable data for analysis, machine learning, and other products. It contrasts this role with a data analyst, who consumes data to produce insights, and a data scientist, who builds predictive models, using a comparison table to show how their tools and day to day work differ. It also describes typical daily tasks such as writing batch and streaming pipelines, modeling analytical tables, integrating data sources, and documenting data catalogs, alongside the common tools used for each. For the Brazilian market specifically, it lists which industries commonly hire data engineers, such as fintechs, e-commerce, banking, and consulting firms, and gives approximate salary ranges by seniority level in Brazilian reais. It also explains market trends driving demand, including cloud adoption, the shift from ETL to ELT workflows, lakehouse architectures, and Brazil's data protection law. The core of the repository is a five phase learning roadmap, shown as a diagram, that moves from foundational skills like SQL, Python, Git, Linux, and Docker, through pipeline tools like Airflow and dbt, into large scale processing with Spark and cloud platforms, then real time streaming with Kafka, and finally career preparation covering portfolio projects, interviews, and certifications. Beyond the roadmap, the repository links out to recommended books, YouTube channels, podcasts, newsletters, communities, cheat sheets, and other GitHub repositories relevant to the field. This resource is aimed at Portuguese speaking beginners and career changers interested in data engineering, as well as working analysts or scientists considering a shift into the role, and requires no coding to browse since it is primarily a reference document.