Data Engineer

Responsibilities

• Create ETL processes and data marts.
• Design linearly scalable client wrappers for interacting with exchange APIs, brokers, data aggregators, vendors, and blockchains.
• Work with FIX, HTTP, WebSocket, and gRPC protocols.
• Configure monitoring systems to ensure the reliability of ETL processes.
• Develop BI dashboards/reports using data visualization tools such as Grafana, Tableau, Lightweight Charts, and Google Sheets.
• Analyze and compare diverse data sources, their costs, and the amount of effort required to obtain them.
• Search for data from non-normalized sources, such as news, social media, or websites.

Requirements

• Strong proficiency in SQL: aggregations, joins, subqueries, window functions (first, last, candle, histogram), indexes, query planning, and optimization.
• Proficiency in Python.
• Experience in designing database schemas: normalization/denormalization within the scope of OLAP/OLTP.
• Understanding of different data storage architectures (Data Warehouse, Data Lake).
• Experience working with databases such as PostgreSQL + TimescaleDB or ClickHouse.
• Experience with raw data, including cleaning, normalization, and enrichment (CSV, JSON, PCAP, FIXML, etc.).
• Experience with large datasets (1TB+) and understanding of data architecture for high-load systems.
• Ability to work in a rapidly changing, dynamic environment.

Nice to have

• Proficiency in Docker, Airflow, and Kafka tools.
• Experience and/or willingness to transition to Go, Rust.
• Experience with the Hadoop ecosystem (HDFS, Hive, Spark).
• Understanding high-level business tasks and independently determining the data needed to solve them.
• Knowledge of basic trading statistics such as PnL, trading volumes, funding and interest rates, profitability, variation margin, spreads, convert rates, weighted average prices, etc.
• Knowledge of financial markets and high-frequency trading systems.
• Experience with real-time data processing and streaming data technologies.

Conditions

• Work in a modern international technology company without bureaucracy, legacy systems, or technical debt.
• Excellent opportunities for professional growth and self-realization.
• We work remotely from anywhere in the world, with a flexible schedule.
• We offer compensation for health insurance, sports activities, and non-professional training.