Data Engineer

в PulsePoint

7 000 —‍ 9 000 $/мес на руки

📍 ЕС, Великобритания, СШАПолная удалёнкаПомощь с переездом

Специализация

Data Engineering

Уровень

Senior

PulsePoint is a fast-growing healthcare technology company (with adtech roots) using real-time data to transform healthcare. We help brands and agencies interpret the hard-to-read signals across the health journey and unify these digital determinants of health with real-world data to produce the most dimensional view of the customer. Our award-winning advertising platforms use machine learning and programmatic automation to seamlessly activate this data, making marketing, predictive analytics, and decision support easy and instantaneous.

Our Data Engineering team plays a key role in our technology company that's experiencing exponential growth. Our data pipeline processes over 80 billion impressions a day (> 20TB of data, 220 TB uncompressed). This data is used to generate reports, update budgets, and drive our optimization engines. We do all this while running against extremely tight SLAs and providing stats and reports as close to real-time as possible.

You should be able to sign a contract and legally receive payment from our US entity.

Remote work. Relocation to EU/UK/US is negotiable (depends on your current location and legal status).

Stack

PythonHiveSparkSpark StreamingKubernetesAirflow

You will

Design, build and maintain reliable and scalable enterprise-level distributed transactional data processing systems for scaling existing businesses and supporting new business initiatives.
Optimize jobs to utilize Hadoop, Spark Streaming, Kubernetes and other resources in the most efficient way.
Monitor and provide transparency into data quality across systems (accuracy, consistency, completeness, etc.).
Increase accessibility and effectiveness of data (work with Analysts, Data Scientists, and Developers to build/deploy tools and datasets that fit their use cases).
Ingest, validate and process internal and third-party data.
Create, maintain and monitor data flows.
Maintain and enhance the framework for jobs (primarily aggregate jobs in Hive).
Create different consumers for data in Kafka using Spark Streaming for near-time aggregation.
Review and approval: DDL for databases, Hive Framework jobs and Spark Streaming to make sure they meet our standards.

Required skills

Spoken English.
5+ years of software engineering experience.
Knowledge and exposure to distributed production systems i.e. Hadoop is a huge plus.
Proficiency in Linux.
Fluency in Python, experience in Scala/Java is a plus.
Strong understanding of RDBMS, SQL.
Passion for engineering and computer science around data.

We offer

Remote work. Relocation to EU/UK/US is negotiable (depends on your current location and legal status).
Salary: 7-9k USD / month, higher figures may be negotiated.
US holiday schedule.
21 days of vacation.

Петр Кузин Tech Recruiter

О компании PulsePoint

Сфера

Медиа

Инвестиции

$25-50М

Размер

201 - 500

PulsePoint — глобальная программная рекламная платформа со специализированным опытом в области здравоохранения, объединяет науку программного таргетинга, распространения и оптимизации с искусством взаимодействия с брендом.