Senior Product Engineer

Job Title Big Data Developer Work Location Mississauga, Ontario, Canada Responsibilities Design, develop and maintain data pipelines using PySpark for large-scale data processing Perform data transformations, aggregations and validations using Spark SQL DataFrames Write and optimize SQL queries for data extraction, reconciliation and reporting Perform data quality checks, profiling and consistency validations Support existing data pipelines by troubleshooting failures and performing root cause …