DATA ENGINEERING – E2E AI SYSTEMS @ NITCO TECH
We are seeking a skilled Data Engineer to join our team in Tokyo, focusing on End-to-End AI Systems for the automotive sector. This role involves designing sophisticated data pipelines for sensor ingestion, fusion, and management using ROS bags, Parquet, and HDF5 formats. You will be responsible for data preprocessing tasks such as image normalization, calibration, and multi-sensor alignment to ensure high-quality inputs for our AI models.
In addition to pipeline design, you will manage cloud and data platforms including AWS S3, Azure Blob, and Databricks. Working with tools like Airflow, Kafka, Spark, Kubernetes, MLflow, and Kubeflow, you will support the development of cutting-edge automotive technology. Candidates must possess N1 or native Japanese language proficiency and a strong technical background in data engineering within complex AI environments.
In addition to pipeline design, you will manage cloud and data platforms including AWS S3, Azure Blob, and Databricks. Working with tools like Airflow, Kafka, Spark, Kubernetes, MLflow, and Kubeflow, you will support the development of cutting-edge automotive technology. Candidates must possess N1 or native Japanese language proficiency and a strong technical background in data engineering within complex AI environments.
Key Requirements
Expertise in data pipeline design for sensor ingestion and fusion.
Proficiency with data formats like ROS bags, Parquet, and HDF5.
Experience in data preprocessing, specifically image normalization and calibration.
Hands-on experience with multi-sensor alignment techniques.
Proficiency in cloud platforms including AWS S3, Azure Blob, or Databricks.
Technical skills in Airflow, Kafka, and Spark for data processing.
Familiarity with containerization and orchestration using Kubernetes.
Experience with ML lifecycle tools such as MLflow and Kubeflow.
Native or JLPT N1 Japanese language proficiency.
Strong background in automotive technology or AI/ML systems.