Content deleted Content added
No edit summary Tags: Mobile edit Mobile web edit |
Wrote a section about Data Engineering Job roles: Data Architect, Data Reliability Engineer, Data Product Manager Tags: Reverted Visual edit |
||
Line 53:
== Roles ==
=== Data engineer ===
A ''' [https://kanger.dev/career/data-engineer data engineer]''' (DE) is a type of software engineer who creates [[big data]] [[Extract, transform, load|ETL]] pipelines to manage the flow of data through the organization. This makes it possible to take huge amounts of data and translate it into [[business intelligence|insights]].<ref>{{Cite journal|last1=Tamir|first1=Mike|last2=Miller|first2=Steven|last3=Gagliardi|first3=Alessandro|date=2015-12-11|title=The Data Engineer|url=https://papers.ssrn.com/abstract=2762013|language=en|___location=Rochester, NY|doi=10.2139/ssrn.2762013|ssrn=2762013|s2cid=113342650}}</ref> They are focused on the production readiness of data and things like formats, resilience, scaling, and security. Data engineers usually hail from a software engineering background and are proficient in programming languages like [[Java (programming language)|Java]], [[Python (programming language)|Python]], [[Scala (programming language)|Scala]], and [[Rust (programming language)|Rust]].<ref>{{Cite web|date=2019-02-07|title=Data Engineer vs. Data Scientist|url=https://www.springboard.com/blog/data-engineer-vs-data-scientist/|access-date=2021-03-14|website=Springboard Blog|language=en-US}}</ref><ref name="hist1" /> They will be more familiar with databases, architecture, cloud computing, and [[Agile software development]].<ref name="hist1" />
=== Data Architect ===
A [https://kanger.dev/career/data-architect Data Architect] is an IT professional who designs, creates, manages, and optimizes an organization's data architecture to support data analysis, storage, and processing systems. They ensure data accessibility and integrity for efficient and accurate decision-making. Data Architects play a critical role in helping organizations to get the most out of their data. They work with stakeholders to understand the organization's business goals and data needs, and then design and implement a data architecture that will meet those needs. Data Architects also work to ensure that the organization's data is secure, compliant with regulations, and scalable to meet future growth.
=== Data Reliability Engineer ===
A [https://kanger.dev/career/data-reliability-engineer Data Reliability Engineer] (DRE) is a software engineer who specializes in ensuring the reliability, performance, and scalability of data systems. DREs work closely with data engineers, data scientists, and other stakeholders to ensure that data is available, accurate, and timely. They play a vital role in ensuring that organizations can rely on their data to make informed decisions. They are in high demand as companies increasingly recognize the importance of data reliability.
=== Data Product Manager ===
A [https://kanger.dev/career/data-product-manager Data Product Manager] (DPM) is responsible for the development and implementation of data-driven products. This includes identifying data-driven opportunities, defining product requirements, working with cross-functional teams to build and launch products, and measuring and analyzing the success of those products. DPMs need to have a deep understanding of both data and product management. They need to be able to identify and understand data-driven opportunities, and they need to be able to translate those opportunities into product requirements that can be understood and implemented by engineering teams. DPMs also need to be able to work effectively with cross-functional teams to ensure that products are aligned with business goals and user needs.
=== Data scientist ===
{{ main article | Data science}}
'''[https://kanger.dev/career/data-scientist Data scientists]''' are more focused on the analysis of the data, they will be more familiar with [[mathematics]], [[algorithms]], [[statistics]], and [[machine learning]].<ref name="hist1" />
==See also==
Line 64 ⟶ 73:
* [[Software engineering]]
* [[Computer science]]
* [https://kanger.dev/article/data-engineering-jobs Types of Data Engineering Jobs]
==References==
| |||