📍 Алматы (Казахстан)Помощь с переездом
Специализация
Data Engineer
Stack
PythonSQLSparkPySparkETLAirflowKubernetes
We are currently actively building a Data Warehouse, a key part of the product. We work with cutting edge technologies (GCP, AWS, Airflow, Kafka, K8s) and make infrastructure and architectural decisions based on data. We are building a large scale data infrastructure for analytics, machine learning, and realtime recommendations.
Responsibilities
- Develop the data-driven culture within the company.
- Develop processes for data processing, storage, cleaning, and enrichment.
- Design and maintain data pipelines from collection to consumption.
- Develop APIs (REST, gRPC) for highload services.
- Create infrastructure for storing and processing large datasets on K8s, Terraform automate testing, validation, and monitoring of data.
- Participate in system design and architectural decision making.
Qualifications
- Expert in Python 3.7+.
- Experience with PySpark.
- Deep knowledge of SQL.
- Extensive experience building ETLs with Airflow 2.
- Industrial experience with Kubernetes.
- Understanding of data processing principles and algorithms.
- Excellent knowledge of OOP, design patterns, clean architecture.
- Productivity, responsibility, and the ability to take ownership.
Would be a plus
- Experience with highload services DevOps skills and CI/CD automation experience If you’re interested in working with big data, complex challenges, and cutting edge technologies, we’d love to meet you.
Our tech stack
- Languages: Python, SQL.
- Frameworks: Spark, Apache Beam.
- Storage and analytics: BigQuery, GCS, S3, Trio, other GCP and AWS stack.
- Components Integration: Apache Kafka, Google Pub/Sub, Debezium.
- ETL: Airflow 2.
- Infrastructure: Kubernetes, Terraform.
- Development: GitHub, GitHub Actions, Jira.
Conditions and benefits
- Stable salary, official employment.
- Health insurance.
- Hybrid work mode and flexible schedule.
- Relocation package offered for candidates from other regions (only for Kazakhstan and Cyprus).
- Access to professional counseling services including psychological, financial, and legal support.
- Discount club membership.
- Diverse internal training programs.
- Partially or fully paid additional training courses.
- All necessary work equipment.
Дарья Лебедева IT-рекрутер