DATA ENGINEER @ CONVEX TECH INC.
Convex Tech Inc. is seeking a skilled Data Engineer for a hybrid role based in New York. This position requires the candidate to work onsite three days a week and participate in an onsite interview process. The successful candidate will focus on designing and implementing scalable data pipelines within the Azure ecosystem, specifically utilizing Azure Databricks and Azure Data Factory. The role involves developing robust ETL/ELT workflows using Apache Spark and PySpark DataFrames to process large datasets efficiently while ensuring optimal performance and scalability.
Beyond core pipeline development, the Data Engineer will be responsible for maintaining data governance, security, and compliance. Key tasks include implementing data quality frameworks, managing data lineage, and supporting modern Lakehouse architectures. Candidates must possess a deep understanding of SQL-based transformations and Master Data Management (MDM) concepts to ensure data consistency and integrity across the organization. This is a contract-based opportunity for 6 months or more, specifically looking for USC or GC holders ready to work in a hybrid environment.
Beyond core pipeline development, the Data Engineer will be responsible for maintaining data governance, security, and compliance. Key tasks include implementing data quality frameworks, managing data lineage, and supporting modern Lakehouse architectures. Candidates must possess a deep understanding of SQL-based transformations and Master Data Management (MDM) concepts to ensure data consistency and integrity across the organization. This is a contract-based opportunity for 6 months or more, specifically looking for USC or GC holders ready to work in a hybrid environment.
Key Requirements
Design and implement scalable data pipelines using Azure Databricks and Azure Data Factory.
Develop and maintain robust ETL/ELT workflows using Apache Spark and PySpark DataFrames.
Build and optimize data pipelines for efficient data ingestion and processing of large datasets.
Utilize data governance tools to manage data access, security, compliance, and data lifecycle.
Implement data quality frameworks and maintain data lineage across enterprise data platforms.
Design and support modern data architecture using Lakehouse and distributed data processing.
Develop high-performance Spark and SQL-based data transformation procedures.
Apply Master Data Management (MDM) concepts to ensure data consistency and standardization.
Must be a US Citizen or Green Card holder (USC/GC only).
Willingness to work onsite in New York 3 days a week and attend an onsite interview.