Big Data Engineer

<p>To help maintain our existing data lake and further scale our Business Intelligence practice, we are seeking a<strong>&nbsp;Big Data Engineer</strong> to join our team. You will take the lead in all the data engineering of the BI team, which includes managing the existing Azure Databricks environment and creating new ETL pipelines.</p>

Toronto, ON

CBC Digital Products

If you share our passion for Canadian storytelling and you wish to help us engage with individuals and communities across our various digital platforms, this is where you&rsquo;ll want to be!&nbsp;You will have an opportunity to shape the way in which Canadians see themselves reflected in our digital services. Your work will have a direct impact on how millions of Canadians from various communities&nbsp;connect with our products, with one another, and with the diverse voices that make our country so unique.&nbsp;<br />You'll have the opportunity to play a part in enlightening and entertaining Canadians through our innovative work in building the mediums that deliver our content. We are an innovative hub, where the talented professionals we work with are respected and valued for their contributions. Our product teams are vibrant and our work culture strives to achieve the highest standards of diversity and inclusion. http://www.cbc.ca

keywords: work at cbc,why is this role important?,why we should work together,assist,maintain data integrity,be the expert,primary liaison,be a part of cbc’s digital footprint,the experience,technical skills,the drive,communication skills,bonus skills,the education

Experienced

Overview: <p><strong>Working at CBC:</strong></p> <p>At the CBC, we all have a story to tell. What&rsquo;s yours?</p> <p>If you share our passion for Canadian storytelling and you wish to help us engage with individuals and communities across our various digital platforms, this is where you&rsquo;ll want to be!&nbsp;</p> <p>Every day, you will have an opportunity to shape the way in which Canadians see themselves reflected in our digital services. Your work will have a direct impact on how millions of Canadians from various communities connect with our products, with one another, and with the diverse voices that make our country so unique.&nbsp;</p> <p>You will have the opportunity to play a part in enlightening and entertaining Canadians through our innovative work in building the mediums that deliver our content. We are an innovative hub, where the talented professionals we work with are respected and valued for their contributions. Our product teams are vibrant and our work culture strives to achieve the highest standards of diversity and inclusion. We believe that hiring people with different career paths and backgrounds is fundamental in our shared success and in building healthy and highly performant teams. When you join our mission, you are not only shaping the vision of the CBC, but the future of our country.&nbsp;</p> <p><strong>Why is this role important?</strong></p> <p>To help maintain our existing data lake and further scale our Business Intelligence practice, we are seeking a Big Data Engineer to join our team. You will take the lead in all the data engineering of the BI team, which includes managing the existing Azure Databricks environment and creating new ETL pipelines.</p> <p>We are open to qualified candidates within Canada, but the CBC&rsquo;s BI team is based in Toronto, with much of the big data engineering team in Montreal.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</p> <p>The Business Intelligence team is connected to every facet of the organization as a strategic partner, data solutions provider, and catalyst supporting the CBC&rsquo;s product, content, and operational decision-making with data.&nbsp;</p> <p>Cross-functional and collaborative by nature, we work to ensure that objectives, strategies, and tactics across all departments in the organization are aligned and delivering value to Canadians. As a result, we work closely with various front and backend product teams; Content Units including News and Local Services; Customer Success; Marketing and Media Solutions; as well as our BI counterparts at Radio-Canada.</p> <p>As our Big Data Engineer, you will be part of a major shift towards data-driven decision-making at an organization that&rsquo;s eager to use data to drive the growth of audience-facing products such as Digital Publishing (<a href="https://www.cbc.ca/news">CBC News</a>,&nbsp;<a href="https://www.cbc.ca/sports">CBC Sports</a>, etc.),&nbsp;<a href="https://gem.cbc.ca/">CBC Gem</a>&nbsp;(Live and On-Demand Video) and&nbsp;<a href="https://www.cbc.ca/listen/live-radio?radio_one=toronto&amp;cbc_music=toronto">CBC Listen</a>&nbsp;(Digital Audio) as well as the crucial work of our business-facing teams.&nbsp;</p> <p>Our data engineering stack consists of a data lake in the Azure cloud (namely Azure Databricks and Delta Lake) as well as Airflow with a smaller footprint in the Google Cloud Platform. Our primary languages are SQL and Python.&nbsp;</p> <p><strong>Here&rsquo;s why we should work together:</strong></p> <p>Our digital teams&rsquo; values - collaboration, learning, and continuous improvement - embody who we are as a people-focused, digital-forward employer. We follow lean startup principles and use an Agile approach. Our dedicated people managers work closely with every individual to ensure we are leveraging their strengths, championing their ideas and supporting their pursuit of new skills and their desired career progression.</p> <p>Here at CBC Digital Strategy &amp; Products, we want you to be happy and feel good at work.&nbsp; It is essential that work be a safe space where our employees are able to share their authentic selves with one another and to push each other to challenge conventions.&nbsp;</p> <p><strong>Perks you can look forward to:</strong></p> <ul> <li>Hybrid work environment with flexible work schedules, allowing you to prioritize yourself, your family and your work (Note: we are fully remote until masks are no longer required to be worn indoors);</li> <li>Enrollment in a generous defined benefits pension plan;&nbsp;</li> <li>Competitive total rewards package;&nbsp;</li> <li>20% of time for innovation, learning and development; wherever your interests lie</li> <li>Opportunities to work with cutting edge technology;&nbsp;</li> <li>Opportunities for continued learning and professional development;&nbsp;</li> <li>Opportunities to become a member of our Employee Resource Groups; ● Pair programming and mentorship opportunities, where you can learn from the best in the industry and help coach new talent;&nbsp;</li> <li>A creative and dynamic work environment, where your ideas and contributions can be heard, valued and respected;&nbsp;</li> <li>A supportive management team committed to upholding the highest standards of diversity and inclusivity;</li> <li>An environment that favours experimentation and an iterative approach in order to achieve the highest form of technical innovation.</li> </ul>
Responsibilities: <p><strong>How you will make an impact:</strong></p> <ul> <li>Work with one of the largest datasets in Canada. You will have the opportunity to be part of the CBC&rsquo;s digital footprint is one of the largest in Canada, third only to Facebook and YouTube.</li> <li>Assist in building a sustainable big-data platform. You will implement the architecture, new tools, processes, and models. You will direct quality control operations for incoming and outgoing data and propose test strategies to develop optimum solutions.</li> <li>Maintain data integrity. You will plan and execute the extraction, standardization, and transformation of our reliable data sources.</li> <li>Be the expert. You will provide practical and technical advice and support to the business intelligence team. You will assist in setting up a data governance plan in compliance with our privacy policy. You will manage risks and resolve issues or escalate them to a higher level, as necessary.</li> <li>Act as the primary liaison between the Montreal and Toronto teams, working closely with BI Analysts and communicating findings to product managers and web developers. You will synthesize and explain technological innovations to non-experts to make them understandable and accessible across the Corporation.</li> </ul>
Requirements: <p><strong>What you could bring to our team:&nbsp;</strong></p> <ul> <li><em>The expertise.</em> You have a data engineering certification in at least one cloud environment, preferably Azure. You have some familiarity with PySpark and have built at least one end-to-end data engineering solution such as an ETL pipeline.</li> <li><em>The technical skills.</em> You have deep hands-on experience with: <ul> <li>The Azure and Google cloud environments, especially Azure Databricks, BigQuery, Azure Data Lake Storage, Azure DevOps</li> <li>Big data / distributed computing platforms and practices, specifically Spark</li> <li>Workflow automation &amp; management tools, especially Apache Airflow&nbsp;</li> <li>Creating clean code in SQL and Python</li> <li>Very large datasets (millions or billions of rows)&nbsp;</li> <li>Creating data pipelines using APIs as well as flat files&nbsp;</li> <li>Structured, unstructured, and semi-structured data</li> <li>Batch-processed data as well as streaming data</li> </ul> </li> <li><em>The drive.</em> You thrive in an autonomous and ambiguous environment that rejects &ldquo;business as usual.&rdquo; You enjoy working with people and sharing your knowledge with them in a collaborative way. You are constantly curious and continuously learning.&nbsp;&nbsp;</li> <li><em>The communication skills.</em> You are skilled at presenting ideas to non-technical stakeholders. You know how to listen and empathize with others. You have excellent verbal and written skills in English and a willingness to join the BI team in learning/advancing communication skills in French to further facilitate collaboration.</li> <li><em>The bonus skills.</em> You may have experience with data architecture, building robust and clean data models, and working with Continuous Integration / Development pipelines (CI/CD). Additional data engineering certification in all three major cloud platforms and knowledge of Scala are also beneficial.</li> <li><em>The education.</em> We are less interested in formal degrees, but you may be a good fit if you have a certification in big data engineering in the Azure and Google stacks. You might also have an academic background in Computer Science, but we value know-how over theory.</li> </ul> <p>Qualified candidates may be subject to a practical assessment of the above requirements.<br /><br /><strong>Additional Requirement:<br /><br /></strong><em>All employees of CBC/Radio-Canada are required to be fully vaccinated against COVID-19 as of December 1st, 2021 unless exempted based on a medical/religious ground. As per this requirement, employees must attest to their vaccination status. The requirement for employees to be fully vaccinated applies whether they are teleworking, working remotely or working on-site. This is a condition of employment and it applies to all employees. Should you reach the point in the selection process where it is necessary to verify if you meet the conditions of employment, you will be asked to provide an attestation confirming your COVID-19 vaccination status.</em></p> <p><strong>To Apply:</strong></p> <p>At the CBC, we recognize that not everyone takes the same path when it comes to building their skills. We value diversity of thought and of experience, and we are excited to hear from you! Hands-on experience, intelligence, innovation, a passion for learning, and a team-focused approach can combine to form the best set of qualifications. If you feel you meet most of the qualifications and you are excited by the possibility of adding to the rich culture of the CBC, take a chance and express your interest by applying now!</p> <p>If you&rsquo;re interested in reading more about the various backgrounds of the talented people that make up our teams, our exciting new projects, and what we&rsquo;re currently working on, check out our&nbsp;<a href="https://medium.com/cbc-digital-labs">Digital Labs</a>&nbsp;blog on Medium!&nbsp;</p> <p>CBC/Radio-Canada is committed to being a leader in reflecting our country&rsquo;s diversity. That&rsquo;s because we can only create and tell the stories that connect Canadians, by having a workforce that mirrors the ever-changing makeup of our country. That&rsquo;s why we, as an employer, value equal opportunity and nurture an inclusive workplace where our individual differences are not only recognized and valued, but also extend to and pervade all the services we provide as Canada&rsquo;s public broadcaster. For more information, visit the&nbsp;<a href="http://www.cbc.radio-canada.ca/en/explore/jobs/diversity-and-inclusion-at-cbc-radio-canada/">Diversity and Inclusion</a>&nbsp;section of our website. If you have accommodation needs at this stage of the recruitment process, please inform us as soon as possible by sending an e-mail to recruitment@cbc.ca.</p> <p>You are invited to consult and familiarize yourself with our Code of Conduct, which can be found on our&nbsp;<a href="http://www.cbc.radio-canada.ca/en/reporting-to-canadians/acts-and-policies/management/human-resources/code-conduct/">corporate website</a>. All employees must adhere to the Code as a condition of employment. We also invite you to take a look at our policy on&nbsp;<a href="http://www.cbc.radio-canada.ca/en/reporting-to-canadians/acts-and-policies/programming/journalism/conflicts/">conflicts of interest</a>. In the event that you become an employee, it will be important to inform us, as quickly as possible, of any situation that, because of your hiring, constitutes or could appear to constitute a conflict of interest.</p> <p>Wherever in the wording of the job description either gender is used, it shall be understood to include all genders.</p>