Data Engineering Lead
City : TORONTO, Ontario, Canada
Category : Technology | Analytics | Research
Industry : Financial/Banking
Employer : RBC
Come Work with Us!
At RBC, our culture is deeply supportive and rich in opportunity and reward. You will help our clients thrive and our communities prosper, empowered by a spirit of shared purpose.
Whether you’re helping clients find new opportunities, developing new technology, or providing expert advice to internal partners, you will be doing work that matters in the world, in an environment built on teamwork, service, responsibility, diversity, and integrity.
Job Title
Job Description
Data Lead/Architect
Excited by Data? This is your opportunity to join the RBC data transformation. . We are a team that believes being agile a way of thinking, and not a process to follow. We believe in going big, pushing the boundaries and daring to fail and that the community is greater than any hero and that competency is greater than any corporate title.
Job Profile
Collaborate across a variety of teams to enable our Data Platform and MLOps needs and consult, design, implement, and maintain a EDL Data platform.
Provide guidelines to Design and build petabyte scale systems for high availability, high throughput, and data consistency.
Mentor other engineers/application and promote software engineering best practices across the organization designing systems with monitoring, auditing, reliability, and security at their core.
Come up with solutions for scaling data systems for various business needs and collaborate in a dynamic and consultative environment
Use Infrastructure as Code and provide guidelines to containerization to create immutable reproducible deployments and establish best practices to scale that Infrastructure as Code (IaC) project in a maintainable way
Create tools for automating monitoring, alerting and operations of the overall platform and establish best practices for CI/CD environments and methodologies such as GitOps
Work with different application teams Analyze Resource usage to optimize for a balance of performance vs cost
Must-have
Experience in big data technologies like Hadoop, Presto/Trino, Spark & Flink, Airflow & Prefect, RedPanda & Kafka, Iceberg & Delta Lake, Cassandra & Scylla, PlanetScale Vitess & CockroachDB, Snowflake & Databricks,
professional software development experience with Scala, Spark, Hadoop, Java, Linux, and SQL
5+ years of experience in the big data ecosystem, with Hadoop (Pig, Hive, HDFS), Apache Spark, and NoSQL/SQL databases
Experience using Git and Maven while collaborating on a software development team
Experience using ETL big data pipelines (Apache Airflow), knowledge of CI workflows and build
Nice-to-have
Bachelors in Computer Science, Software Engineering, Mathematics, or other STEM majors. Masters/PhD considered an asset.
Experience with other analytics programming languages (Python and R)
Experience with other data analytics and visualization tools such as Tableau
Experience with Agile software development
Experience with DevOps concerns, including CI/CD
Experience AWS, GCP , Azure
What’s in it for you?
We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.
A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable
Leaders who support your development through coaching and managing opportunities
Ability to make a difference and lasting impact
Work in a dynamic, collaborative, progressive, and high-performing team
Opportunities to do challenging work
Opportunities to take on progressively greater accountabilities
Job Summary
Address:
City:
Country:
Work hours/week:
Employment Type:
Platform:
Job Type:
Pay Type:
Posted Date:
Application Deadline:
Inclusion and Equal Opportunity Employment
At RBC, we embrace diversity and inclusion for innovation and growth. We are committed to building inclusive teams and an equitable workplace for our employees to bring their true selves to work. We are taking actions to tackle issues of inequity and systemic bias to support our diverse talent, clients and communities.
We also strive to provide an accessible candidate experience for our prospective employees with different abilities. Please let us know if you need any accommodations during the recruitment process.
Join our Talent Community
Stay in-the-know about great career opportunities at RBC. Sign up and get customized info on our latest jobs, career tips and Recruitment events that matter to you.
Expand your limits and create a new future together at RBC. Find out how we use our passion and drive to enhance the well-being of our clients and communities at rbc.com/careers.