Distributed Systems Engineer (L5) - Data Platform

Other Jobs To Apply

No other job posts for this day.

<p><span>Netflix is one of the world's leading entertainment services, with over 300 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time.</span></p><p style="text-align:inherit"></p><p style="text-align:inherit"></p><p style="text-align:inherit"></p><p>The data platform teams at Netflix enable us to leverage data to bring joy to our members in many different ways. We provide centralized data platforms and tools for various business functions at Netflix, so they can utilize our data to make critical data-driven decisions. We do all the heavy lifting to make it easy for our business partners to work with data efficiently, securely, and responsibly. We aspire to lead the industry standard in building a world-class data infrastructure, as Netflix leads the way to be the most popular and pervasive destination for global internet entertainment.<br /><br />We are looking for Distributed Systems Engineers to help evolve and innovate our infrastructure. We are committed to building a diverse and inclusive team to bring new perspectives as we solve the next set of challenges. In addition, we are open to remote candidates. We value what you can do, from anywhere in the U.S.<br /><br /><b>Spotlight on Data Platform Teams:</b></p><p></p><p><b>Data Movement Platform - Realtime Data Engines</b></p><p><span>Offers low level building blocks for the transport and processing of realtime data. For data transport we offer </span><a href="https://kafka.apache.org/intro" target="_blank"><u>Kafka</u></a><span>; for data processing we offer </span><a href="https://flink.apache.org/" target="_blank"><u>Flink</u></a><span> and </span><a href="https://github.com/Netflix/mantis" target="_blank"><u>Mantis</u></a><span>. Responsibilities include development of the control plane, compute resource management, reliability and availability of the data. Realtime data is critical across many business units of Netflix including Streaming, Gaming, Finance and Machine Learning platforms. This team also owns the Schema Registry to enable schema driven development for all real-time applications across Netflix.</span></p><p></p><p><b>Data Movement Platform - Abstractions</b></p><p><span>Offers an abstracted self-service paved path product to enable varied user personas across Netflix to meet their Data Movement and Processing requirements; enables abstraction over complex real-time frameworks such as Kafka and Flink and batch frameworks such as Spark; offers a Schema driven processing experience; invests in operational automation, reliability and tools for predictable data quality. </span></p><p><br /><b>Data Discovery and Governance </b></p><p><span>Data Discovery and Governance are strategic bets at Netflix that underpin our ability to leverage data as a valuable asset. The Netflix data discovery and governance team owns the foundational building blocks necessary for ensuring all our data is used effectively, efficiently, securely, and in compliance with regulations. Specifically, this allows Netflix to organize its data better, take informed actions with increased precision in security, privacy, and efficiency, improve our risk management capabilities, increase confidence in the quality of the data, and enable the discovery & auditing of high-value datasets.  </span></p><p></p><p><span>While Netflix has built a strong data platform foundation, we are still in the very early stages of setting up a scalable and extensible data discovery platform to help the company derive higher-level insights and values of data across new businesses like Games, Live, Ads, on top of our streaming service. </span></p><p><br /><span>Specifically, this team owns the </span>Netflix-wide data catalog <span>to capture and infer business metadata across all datasets at Netflix, </span>distributed search and lineage infrastructure<span> to effectively discover data and track lineage across different systems; and an extensible </span>policy engine framework <span>that allows our stakeholders to customize data policy rules for all datasets.</span></p><p></p><p><b>Online DataStores - </b><b><b>KeyValue Team</b></b></p><p><span>The KeyValue team (part of the Online Data Stores portfolio) offers a managed key value store to meet Netflix's operational data requirements across all lines of business. Our focus is on developing and maintaining a high-performance, reliable, and efficient key-value store. Additionally, we enhance developer productivity by providing secure, intuitive and opinionated access layer for our backing storage engines including Cassandra.</span></p><p></p><p><span>This team is passionate about building innovative, efficient, performant, and scalable offerings for our customers. Our team also engages with the Cassandra open source community, actively contributing to and responsibly stewarding the development and use of open source software.</span></p><p></p><p><b><span>Online DataStores - Caching</span></b></p><p>Our focus is on developing and maintaining highly performant, reliable, and cost-efficient data storage solutions at Netflix’s extreme scale. These data stores are built from a combination of world-class in-house solutions that are open-sourced and used by top technology firms, as well as state-of-the-art data solutions from public cloud offerings. Additionally, we enhance developer productivity by providing opinionated and intuitive, secure abstraction layers on top of the base storage systems.<br /><br />The Online Data Stores team is a customer-obsessed infrastructure team that strives to accelerate the growth and diversification of Netflix’s business verticals through world-class data storage technologies. Our team also seeks to impact the greater technology landscape by engaging with open source communities, actively contributing to, and responsibly stewarding the development and use of open source software.<br /><br />The Netflix Online Data Stores Caching Team provides extremely low-latency yet high-throughput in-memory and distributed data storage solutions across the company. Our services power mission-critical Tier-0 Netflix services such as the streaming Catalog and Content Delivery Network (CDN) metadata. We are looking for passionate and innovative software engineers to join our team to build novel caching architectures that push the limits of performance, cost efficiency, utility, and usability.</p><p></p><p><b><span>Analytics Infrastructure and Enablement</span></b></p><p><span>Our Analytics Infrastructure and Enablement team offers a platform that enables data practitioners to develop and manage data models for broad analytical use and to produce analytic products with efficiency and ease. The ultimate goal of the team is to enable broader self-service of high-fidelity analytics by developing robust APIs, user-friendly  interfaces, and semi-automated data management and governance systems. Our team offers abstractions on Netflix's expansive data warehouse, and other data platform components, to provide easy access to semantic data models and easier development of analytical reporting and visualizations.</span></p><p></p><p><b><span>Big Data Compute Engines</span></b></p><p>This team is responsible for providing the cloud-native platform for distributed data processing at Netflix. This team is central to analytics and data processing in Data Platform. It provides the platform to get insights from the Exabytes-scale data in our data warehouse using Presto/TrinoDB and Snowflake. It also provides sub-second latency for real time analytics use cases as well as supports key insight dashboards using Druid. This platform enables new business initiatives such as ads and live.</p><p><br />A new addition to this team is the LanceDB offering that supports offline vector search and multimodal processing to enable MLP and GenAI use cases, an exciting emerging area.</p><p></p><p>We are looking for exceptional talent with experience in Spark, Presto / Trino, Druid, Iceberg, and distributed database systems in general. Roles in this team involve solving super interesting and challenging problems related to working with data at scale, building features and performance enhancements, and working closely with open source communities to shape the projects and make contributions.</p><p></p><p><b>GenAI Platform</b></p><p>The mission of the GenAI Platform team is to boost the productivity of the data science and engineering community at Netflix. This means enabling users to spend more time solving business problems and less time engineering lower-level systems. We are seeking a Software Engineer to help build a developer platform that will provide the building blocks for Netflix to efficiently create GenAI applications. The platform will enable our teams to leverage LLM models and internally fine-tuned models. It will provide tools to support the LLM development lifecycle, high-level abstraction APIs for RAG, and tools for prompt engineering, management, and LLM operations.</p><p></p><p><b>Data Security & Infrastructure</b></p><p><span>The </span>Data Security and Infrastructure (DSI)<span> team acts as a platform for our own data platforms, providing foundational infrastructure and tooling that empower Netflix to innovate rapidly in delivering cutting-edge data and analytics systems. Instead of building custom scaffolding for every new system, we focus on creating scalable, high-leverage infrastructure tailored to the demands of running data systems at Netflix's scale.</span></p><p></p><p><span>Our work spans infrastructure, security, deployment systems, and more, ensuring the reliability, security, and performance of our platform. A unique aspect of our team is our diverse tech stack, with many of our tools and systems developed in </span>Go<span>, </span>Python and Java<span>. If you thrive on solving complex problems, enjoy working with multiple programming languages, and want to make an impact at scale, this team could be a perfect fit for you!</span></p><p></p><p><b><span>Big Data Orchestration</span></b></p><p><span>The Big Data Orchestration team at Netflix empowers data engineers, data scientists, and ML researchers to create and manage computing workflows that leverage the full power of the Netflix Data Platform. This team is central to data processing at Netflix, hosting all ETL and batch ML data workloads running across domains as diverse as homepage personalization, studio & content application, and critical company reporting tasks.  We provide both self-service and managed offerings in ETL and DAG workflow creation and execution, along with a variety of supporting services for failure robustness, data validation, and featureful user interfaces. We solve challenging problems working with data at scale, providing world-class uptime and efficiency features, and supporting Netflix engineers to delight our members, advance research frontiers and achieve ambitious business goals.</span></p><p><br /><b>This would be your dream job if you enjoy:</b></p><ul><li><p>Solving real business needs at a large scale by applying your software engineering and analytical problem-solving skills.</p></li><li><p>Architecting and building a robust, scalable, and highly available distributed infrastructure.</p></li><li><p>Leading cross-functional initiatives and collaborating with engineers, product managers, and TPM across teams.</p></li><li><p>Sharing our experiences with the open source communities and contributing to Netflix OSS.</p></li></ul><p><br /><b>About you:</b></p><ul><li><p>7+ years experience in crafting complex, scalable distributed data infrastructure</p></li><li><p>Proficiency in Java, C++, Golang, or Python with a solid understanding of multi-threading and memory management</p></li><li><p>Proven track record of developing and maintaining high-impact systems</p></li><li><p>Experience building and operating scalable, fault-tolerant, distributed systems</p></li><li><p>You have a BS in Computer Science or a related field</p></li></ul><p></p><p><br /><b>A few more things about us:</b><br /><br />As a team, we come from many different countries and our fields of education range from the humanities to engineering to computer science. Our team includes product managers, program managers, designers, full-stack developers, distributed systems engineers, and data scientists. Folks have the opportunity to wear different hats, should they choose to. We strongly believe this diversity has helped us build an inclusive and empathetic environment, and we look forward to adding your perspective to the mix!</p><p></p><p>Our compensation structure consists solely of an annual salary; we do not have bonuses. You choose each year how much of your compensation you want in salary versus stock options. To determine your personal top of market compensation, we rely on market indicators and consider your specific job family, background, skills, and experience to determine your compensation in the market range. The range for this role is $170,000 - $720,000.<br /><br />Netflix provides comprehensive benefits including Health Plans, Mental Health support, a 401(k) Retirement Plan with employer match, Stock Option Program, Disability Programs, Health Savings and Flexible Spending Accounts, Family-forming benefits, and Life and Serious Injury Benefits. We also offer paid leave of absence programs. Full-time hourly employees accrue 35 days annually for paid time off to be used for vacation, holidays, and sick paid time off. Full-time salaried employees are immediately entitled to flexible time off.<br /><br />Netflix has a unique culture and environment. Learn more<span> </span><a href="http://jobs.netflix.com/culture" target="_blank">here</a>.</p><p></p><p style="text-align:inherit"></p><p style="text-align:inherit"></p><p><a target="_blank" href="https://about.netflix.com/en/inclusion"><u>Inclusion</u></a> is a Netflix value and we strive to host a meaningful interview experience for all candidates. If you want an accommodation/adjustment for a disability or any other reason during the hiring process, please send a request to your recruiting partner.</p><p></p><p>We are an equal-opportunity employer and celebrate diversity, recognizing that diversity builds stronger teams. We approach diversity and inclusion seriously and thoughtfully. We do not discriminate on the basis of race, religion, color, ancestry, national origin, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service.</p><p style="text-align:inherit"></p><p style="text-align:left"><span>Job is open for no less than 7 days and will be removed when the position is filled.</span></p>

Back to blog

Common Interview Questions And Answers

1. HOW DO YOU PLAN YOUR DAY?

This is what this question poses: When do you focus and start working seriously? What are the hours you work optimally? Are you a night owl? A morning bird? Remote teams can be made up of people working on different shifts and around the world, so you won't necessarily be stuck in the 9-5 schedule if it's not for you...

2. HOW DO YOU USE THE DIFFERENT COMMUNICATION TOOLS IN DIFFERENT SITUATIONS?

When you're working on a remote team, there's no way to chat in the hallway between meetings or catch up on the latest project during an office carpool. Therefore, virtual communication will be absolutely essential to get your work done...

3. WHAT IS "WORKING REMOTE" REALLY FOR YOU?

Many people want to work remotely because of the flexibility it allows. You can work anywhere and at any time of the day...

4. WHAT DO YOU NEED IN YOUR PHYSICAL WORKSPACE TO SUCCEED IN YOUR WORK?

With this question, companies are looking to see what equipment they may need to provide you with and to verify how aware you are of what remote working could mean for you physically and logistically...

5. HOW DO YOU PROCESS INFORMATION?

Several years ago, I was working in a team to plan a big event. My supervisor made us all work as a team before the big day. One of our activities has been to find out how each of us processes information...

6. HOW DO YOU MANAGE THE CALENDAR AND THE PROGRAM? WHICH APPLICATIONS / SYSTEM DO YOU USE?

Or you may receive even more specific questions, such as: What's on your calendar? Do you plan blocks of time to do certain types of work? Do you have an open calendar that everyone can see?...

7. HOW DO YOU ORGANIZE FILES, LINKS, AND TABS ON YOUR COMPUTER?

Just like your schedule, how you track files and other information is very important. After all, everything is digital!...

8. HOW TO PRIORITIZE WORK?

The day I watched Marie Forleo's film separating the important from the urgent, my life changed. Not all remote jobs start fast, but most of them are...

9. HOW DO YOU PREPARE FOR A MEETING AND PREPARE A MEETING? WHAT DO YOU SEE HAPPENING DURING THE MEETING?

Just as communication is essential when working remotely, so is organization. Because you won't have those opportunities in the elevator or a casual conversation in the lunchroom, you should take advantage of the little time you have in a video or phone conference...

10. HOW DO YOU USE TECHNOLOGY ON A DAILY BASIS, IN YOUR WORK AND FOR YOUR PLEASURE?

This is a great question because it shows your comfort level with technology, which is very important for a remote worker because you will be working with technology over time...