Microsoftposted 3 days ago
Full-time • Senior
Redmond, WA

About the position

Security represents the most critical priorities for our customers in a world awash in digital threats, regulatory scrutiny, and estate complexity. Microsoft Security aspires to make the world a safer place for all. We want to reshape security and empower every user, customer, and developer with a security cloud that protects them with end to end, simplified solutions. The Microsoft Security organization accelerates Microsoft’s mission and bold ambitions to ensure that our company and industry is securing digital technology platforms, devices, and clouds in our customers’ heterogeneous environments, as well as ensuring the security of our own internal estate. Our culture is centered on embracing a growth mindset, a theme of inspiring excellence, and encouraging teams and leaders to bring their best each day. In doing so, we create life-changing innovations that impact billions of lives around the world. The Platform Job Service is the core compute orchestration layer for Microsoft Sentinel Graph (MSG), designed to abstract and unify job execution across diverse engines like Spark, KQL, Azure Synapse, Fabric, and Azure Data Explorer. The team is building a highly scalable, reliable, and available infrastructure that supports a wide variety of job types—ranging from enrichment pipelines to behavioral analytics and system-level operations. PJS enables declarative job submission, where users define what they want to achieve (e.g., run a Spark job with specific parameters) without worrying about how it gets executed. The system dynamically selects the appropriate compute backend, manages dependencies, schedules execution, and provides real-time monitoring and historical analytics. As a Senior Software Engineer on the PJS team, you are a technical leader and hands-on contributor responsible for designing, building, and securing the compute orchestration infrastructure that powers job execution across Spark, KQL, and other engines. Your work directly impacts the scalability, reliability, and security posture of Sentinel Graph’s data processing backbone. Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

  • Design, build, and secure the compute orchestration infrastructure for job execution.
  • Work with diverse engines like Spark, KQL, Azure Synapse, Fabric, and Azure Data Explorer.
  • Enable declarative job submission for users.
  • Manage dependencies and schedule execution of jobs.
  • Provide real-time monitoring and historical analytics.

Requirements

  • Experience in software engineering and development.
  • Strong knowledge of compute orchestration and job execution.
  • Familiarity with Spark, KQL, Azure Synapse, Fabric, and Azure Data Explorer.
  • Ability to design scalable and reliable systems.
  • Experience with security best practices in software development.

Nice-to-haves

  • Experience with cloud computing platforms.
  • Knowledge of data processing and analytics.
  • Familiarity with agile development methodologies.

Benefits

  • Growth mindset culture.
  • Opportunities for innovation and collaboration.
  • Commitment to inclusion and diversity.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service