Data Engineer
On behalf of our client, an IT company working on complex digital transformation, greenfield and enterprise-level projects for top clients in the industry, we are hiring an experienced Data Engineer. The company is based in New York with a global workforce of 14,500+, and 43 offices in 18 countries within key global markets.
Responsibilities:
- Architecting, designing, implementing, and operationalizing large-scale data and analytics solutions on Snowflake Cloud Data Warehouse or Databricks
- Providing production support for Data Warehouse issues such as data load problems and transformation translation problems
- Translating mapping specifications into data transformation design and development strategies, incorporating standards and best practices
- Developing data pipelines and automating data pipeline testing in cloud-based environments, with clear documentation
- Conducting code reviews to ensure alignment with requirements and adherence to optimal execution patterns and established standards
- Building ETL pipelines in and out of the data warehouse using a combination of Databricks/Snowflake, Python, and SQL
- Establishing and monitoring Operational Level Agreements for warehouse health and performance/cost (Loads, queries, data quality)
Requirements:
- A minimum of 5 years of relevant experience in data engineering
- Hands-on experience with Python, PySpark, and SQL
- In-depth knowledge of Data Warehousing
- Demonstrable experience with Databricks and/or Snowflake platforms
- Experience in Data Integration Solutions and familiarity with Azure Data Factory or AWS Glue is a plus
- Experience with Python libraries like Pandas, Numpy, etc is a plus
- Preferred experience in the finance or banking sector, with an understanding of securities and banking products
Benefits:
- Global mobility program: Experience our international culture and way of doing things
- Opportunity to move into new projects, roles, and between departments
- Specialized training, accredited certification, and unlimited Udemy courses
- Opportunity to grow your career through our customized leadership program
- Private medical insurance
- FitPass membership
- Attractive salary package and the chance to earn performance-based bonuses
- Comprehensive Referral Rewards Program