{"id":224,"date":"2024-08-07T13:39:45","date_gmt":"2024-08-07T20:39:45","guid":{"rendered":"https:\/\/gabe-romero.com\/?p=224"},"modified":"2024-08-07T13:59:01","modified_gmt":"2024-08-07T20:59:01","slug":"building-a-succesfull-data-engineering-team","status":"publish","type":"post","link":"https:\/\/gabe-romero.com\/?p=224","title":{"rendered":"Building a Succesfull Data Engineering Team"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"224\" class=\"elementor elementor-224\" data-elementor-post-type=\"post\">\n\t\t\t\t<div class=\"elementor-element elementor-element-4770b08 e-flex e-con-boxed e-con e-parent\" data-id=\"4770b08\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t<div class=\"elementor-element elementor-element-7902fcc e-con-full e-flex e-con e-child\" data-id=\"7902fcc\" data-element_type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-babc1fa elementor-widget elementor-widget-text-editor\" data-id=\"babc1fa\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style>\/*! elementor - v3.23.0 - 25-07-2024 *\/\n.elementor-widget-text-editor.elementor-drop-cap-view-stacked .elementor-drop-cap{background-color:#69727d;color:#fff}.elementor-widget-text-editor.elementor-drop-cap-view-framed .elementor-drop-cap{color:#69727d;border:3px solid;background-color:transparent}.elementor-widget-text-editor:not(.elementor-drop-cap-view-default) .elementor-drop-cap{margin-top:8px}.elementor-widget-text-editor:not(.elementor-drop-cap-view-default) .elementor-drop-cap-letter{width:1em;height:1em}.elementor-widget-text-editor .elementor-drop-cap{float:left;text-align:center;line-height:1;font-size:50px}.elementor-widget-text-editor .elementor-drop-cap-letter{display:inline-block}<\/style>\t\t\t\t<p>When it comes to building a successful data engineering team its important to understand and structure the team as if the data provided to the business were a product itself (a product in which only customer is the internal stakeholders of the company).<br \/>This team structure proposes to create three main roles in a data team, a backend engineering team that builds and maintains the data models used for the business.<br \/>A Frontend data team of analysts that build the reports and dashboards that will be consumed by the business.\u00a0<br \/>And a Data infrastructure architect that maintains the data pipeline operational and at scale to ensure the data build and pipeline is operating at the optimal cost and rate.\u00a0<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-48a66fe elementor-widget elementor-widget-image\" data-id=\"48a66fe\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style>\/*! elementor - v3.23.0 - 25-07-2024 *\/\n.elementor-widget-image{text-align:center}.elementor-widget-image a{display:inline-block}.elementor-widget-image a img[src$=\".svg\"]{width:48px}.elementor-widget-image img{vertical-align:middle;display:inline-block}<\/style>\t\t\t\t\t\t\t\t\t\t<img fetchpriority=\"high\" decoding=\"async\" width=\"800\" height=\"450\" src=\"https:\/\/gabe-romero.com\/wp-content\/uploads\/2024\/07\/TeamDevelopment-1024x576.jpg\" class=\"attachment-large size-large wp-image-128\" alt=\"\" srcset=\"https:\/\/gabe-romero.com\/wp-content\/uploads\/2024\/07\/TeamDevelopment-1024x576.jpg 1024w, https:\/\/gabe-romero.com\/wp-content\/uploads\/2024\/07\/TeamDevelopment-300x169.jpg 300w, https:\/\/gabe-romero.com\/wp-content\/uploads\/2024\/07\/TeamDevelopment-768x432.jpg 768w, https:\/\/gabe-romero.com\/wp-content\/uploads\/2024\/07\/TeamDevelopment-1536x864.jpg 1536w\" sizes=\"(max-width: 800px) 100vw, 800px\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-16f1fd5 elementor-widget elementor-widget-text-editor\" data-id=\"16f1fd5\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>Company goals and objectives are translated into work items and tasks through the data development funnel, by doing regular sprint deployments the data team can continuously deliver progress and maintain the business analytics processes running.<\/p><p>Important here to include the ability of members of the business to provide user stories based on the initiatives of the company and goals, this is where the rubber meets the road, the team builds what the stakeholders ask based on what the company aims to achieve.\u00a0<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-69e1528 elementor-widget elementor-widget-image\" data-id=\"69e1528\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" width=\"800\" height=\"448\" src=\"https:\/\/gabe-romero.com\/wp-content\/uploads\/2024\/07\/ProcessManagment-1024x574.jpg\" class=\"attachment-large size-large wp-image-126\" alt=\"\" srcset=\"https:\/\/gabe-romero.com\/wp-content\/uploads\/2024\/07\/ProcessManagment-1024x574.jpg 1024w, https:\/\/gabe-romero.com\/wp-content\/uploads\/2024\/07\/ProcessManagment-300x168.jpg 300w, https:\/\/gabe-romero.com\/wp-content\/uploads\/2024\/07\/ProcessManagment-768x430.jpg 768w, https:\/\/gabe-romero.com\/wp-content\/uploads\/2024\/07\/ProcessManagment-1536x861.jpg 1536w\" sizes=\"(max-width: 800px) 100vw, 800px\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-abae3fb elementor-widget elementor-widget-text-editor\" data-id=\"abae3fb\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>Continuous collaboration across all departments in the business is critical. And implementing a system to track requests, questions, bugs and feedback in an organized, trackable and open view is crucial.\u00a0<br \/>Ticketing systems like Jira, Zendesk etc are great for this purpose to ensure no requests are getting left behind and allow the ability for users \/ (internal) customers be kept updated of their questions and requests.<\/p><p>As well as organize the work that is allocated to each team member.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-a000b98 elementor-widget elementor-widget-image\" data-id=\"a000b98\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" width=\"800\" height=\"450\" src=\"https:\/\/gabe-romero.com\/wp-content\/uploads\/2024\/07\/Team-Collaboration-1024x576.jpg\" class=\"attachment-large size-large wp-image-127\" alt=\"\" srcset=\"https:\/\/gabe-romero.com\/wp-content\/uploads\/2024\/07\/Team-Collaboration-1024x576.jpg 1024w, https:\/\/gabe-romero.com\/wp-content\/uploads\/2024\/07\/Team-Collaboration-300x169.jpg 300w, https:\/\/gabe-romero.com\/wp-content\/uploads\/2024\/07\/Team-Collaboration-768x432.jpg 768w, https:\/\/gabe-romero.com\/wp-content\/uploads\/2024\/07\/Team-Collaboration-1536x863.jpg 1536w\" sizes=\"(max-width: 800px) 100vw, 800px\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-e5602c4 elementor-widget elementor-widget-text-editor\" data-id=\"e5602c4\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>As data grows in a business its important to have a detailed and updated data governance model.<br \/>To implement a data governance model the business a Data governance council is the best course of action, this council is composed of different business unit heads and stakeholders that consume and use data on a regular basis.\u00a0<br \/>Defining the data policies and data archival procedures ensures the business is always functioning with a clean data model at the latest results.\u00a0<\/p><p>Data Stewards are key elements as they act as the representatives of their unique teams into the data council and ensure that the policies set up by the council are followed up on their respective systems of management.\u00a0<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-e5b72a1 elementor-widget elementor-widget-image\" data-id=\"e5b72a1\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"800\" height=\"451\" src=\"https:\/\/gabe-romero.com\/wp-content\/uploads\/2024\/08\/DataGovernance-1024x577.jpg\" class=\"attachment-large size-large wp-image-226\" alt=\"\" srcset=\"https:\/\/gabe-romero.com\/wp-content\/uploads\/2024\/08\/DataGovernance-1024x577.jpg 1024w, https:\/\/gabe-romero.com\/wp-content\/uploads\/2024\/08\/DataGovernance-300x169.jpg 300w, https:\/\/gabe-romero.com\/wp-content\/uploads\/2024\/08\/DataGovernance-768x433.jpg 768w, https:\/\/gabe-romero.com\/wp-content\/uploads\/2024\/08\/DataGovernance-1536x866.jpg 1536w\" sizes=\"(max-width: 800px) 100vw, 800px\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>When it comes to building a successful data engineering team its important to understand and structure the team as if the data provided to the business were a product itself (a product in which only customer is the internal stakeholders of the company).This team structure proposes to create three main roles in a data team, [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":128,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[98],"tags":[],"class_list":["post-224","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-data-engineering"],"aioseo_notices":[],"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"https:\/\/gabe-romero.com\/wp-content\/uploads\/2024\/07\/TeamDevelopment.jpg","_links":{"self":[{"href":"https:\/\/gabe-romero.com\/index.php?rest_route=\/wp\/v2\/posts\/224"}],"collection":[{"href":"https:\/\/gabe-romero.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/gabe-romero.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/gabe-romero.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/gabe-romero.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=224"}],"version-history":[{"count":4,"href":"https:\/\/gabe-romero.com\/index.php?rest_route=\/wp\/v2\/posts\/224\/revisions"}],"predecessor-version":[{"id":232,"href":"https:\/\/gabe-romero.com\/index.php?rest_route=\/wp\/v2\/posts\/224\/revisions\/232"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/gabe-romero.com\/index.php?rest_route=\/wp\/v2\/media\/128"}],"wp:attachment":[{"href":"https:\/\/gabe-romero.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=224"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/gabe-romero.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=224"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/gabe-romero.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=224"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}