Big Data Ops Engineer

You will

• Participate in the implementation and support of data platform services.
• Manage Spark cluster environments on bare-metal and container infrastructure, including service allocation and configuration for the cluster, capacity planning, performance tuning, and ongoing monitoring.
• Implement and operate our data lake (S3/Hadoop and Spark).
• Deploy and maintain Spark on k8s.
• Carry out data protection according to company security policies.
• Provide monitoring and alerting of the services.
• Participate in data platform architecture development.

Expectations

• Relevant experience in deployment and maintaining of the Hadoop Ecosystem including the Spark framework.
• Deep understanding of Hadoop and Spark cluster security, networking connectivity, and IO throughput, along with other factors that affect distributed system performance.
• Working knowledge of containers, such as docker and containerd, and major orchestrators, such as Kubernetes and, Rancher.
• Understanding of object storage solutions based on S3.
• Excellent knowledge of Linux.
• Working knowledge of automation tools, such as Puppet, Chef, or Ansible.
• General knowledge of Java, Python, and SQL.
• Good communication and problem-solving skills.
• Spoken and written English at an intermediate level or higher.
• Detail-oriented and critical thinking.
• Decision-making and flexibility in adapting to new changes.
• Ability to write concise and clear documentation.
• Capacity to deal with constructive critics and the know-how to develop relationships with the team to achieve common goals.
• Solid work ethic.

Nice to have:

• Understanding of base principles of CI/CD in the data processing area.
• Experience with big data processing and data lake building.
• Strong working knowledge of disaster recovery, incident management, and security best practices.

Conditions

• Competitive and attractive compensation.
• Extensive learning opportunities, such as professional training and certifications, soft skills development, free English courses, and trading workshops.
• Flight tickets, hotel or apartment accommodation for your first month, migration support, and legal help for you and your family (if relocating).
• Health and life insurance for employees, spouses, and children, including vaccinations, tests, mental health care, and coverage for vision and dental care.
• Generous time off, including 21 days of annual leave and paid sick leave.
• Education allowance for your children’s school and kindergarten fees.
• Access to our very own sports club with dedicated coaches, free Sanctum Club memberships for you and your spouse, corporate SUPs, jet skis, etc.
• A branded company car (if relocating) with a parking space near the office.
• Outstanding team-building experiences and Exness community gatherings.

Candidate journey

• Intro call (up to 45 minutes).
• Technical interview (1–1.5 hours).
• Final Interview (1 hour).