Senior Site Reliability Engineer

You will

• Ensure the reliability and scalability of our multi-datacenter and hybrid Linux environments.
• Manage the large-scale Linux infrastructure to ensure maximum uptime.
• Conduct performance and reliability testing. This may include reviewing configuration, software choices/versions, hardware specs, etc.
• Advance our technology stack with innovative ideas and new creative solutions.
• Participate in capacity management of core systems and services, application analysis and performance and security tuning. Provide operational support for systems and build automation to remediate and address the root cause; with the goal of automating response to all non-exceptional service conditions.
• Create strategies for long-term permanent fixes to critical production incidents.
• Maintain documentation, build tooling, and create alerts to both identify and address infrastructure reliability.
• Proactively identify system anomalies.

Requirements

• You will be required to work East Coast U.S. hours (9am-6pm EST).
• You should be able to sign a contract and legally receive payment from our US entity.
• Best practices for architecting cross-datacenter Kubernetes clusters running on-premise with automated etcd management using Kubeadm.
• Profound knowledge of Docker (dockershim), Containerd and runc internals at the kernel level.
• Ability to manually troubleshoot and solve certificate issues within Kubernetes with zero downtime.
• In-depth understanding of Kubernetes security ACLs, exhaustive previous exposure to RBAC configuration and complete knowledge of DEX.
• Secret management is essential to succeeding in this role, Vault expertise is also required.
• Ability to manage BGP configuration, mastery in Kube-router and GoBGP, as well as MetalLB.
• Expert-level skills in KubeDNS and CoreDNS.
• Thorough understanding of RPM-based Linux systems.
• Understanding of basic networking concepts (TCP/IP stack, DNS, CDN, load balancing, BGP).
• Ability to resolve complex merge conflicts in Git is an obvious requirement.

Nice-to-have’s:

• Understanding of the most intricate details in Rook/Ceph implementation for Kubernetes.
• Vast experience in development of custom Kubernetes operators and autoscalers, as well as tailored ingress/egress controllers.
• Numerous successful major version upgrades of Elasticsearch and Fluentd in the past are a must, as well as KubeDB operator expertise.
• Fluency in GitOps automation tools (flux v1/v2), comprehensive knowledge of helm customise controller.
• Experience administering SQL/NoSQL databases (MySQL, ES, Redis, Cassandra).
• Experience with scalable infrastructure monitoring solutions such as Icinga, Prometheus, ELK.
• Any scripting language (Python/Ruby/Shell etc).

We offer

• Remote work, full time, EST 9am-6pm (1hr lunch).
• Salary: 7-10k USD / month.
• US holiday schedule.
• 21 days of vacation.

Hiring process

• (Eng) 20-40 min screening with a recruiter to check English and K8s.
• (Eng) 60 min technical interview with a Manager/Senior Engineer.
• (Eng) 180 min of technical interviews. May cover topics like: Linux, Networking, Kubernetes, DB administration, monitoring, migration, automation.
• (Eng) Optionally, someone from management may ask to have an additional call.