Skip to main content
Technology

Principal System Engineering - DevOps - Spark and Azure

Dallas, Texas

Apply now

Job Description:

This position requires office presence a minimum of 5 days per week and is only located in the location(s) posted. No relocation is offered.

Join AT&T and reimagine the communications and technologies that connect the world. The Chief Information Office is responsible for advancing information technology performance and delivering solutions with a focus on maximizing ROI, increasing efficiency and enhancing the experience of end users. Guided by experienced leaders, Corporate Systems seamlessly integrate with advanced Technology and Operations to drive our enterprise forward. Our Systems Reliability and Software Delivery teams are unwavering in their commitment to excellence, ensuring every solution is robust and efficient. When you step into a career with AT&T, you won’t just imagine the future-you’ll create it.

We are seeking a highly skilled and experienced professional to join our team as an Apache Spark Expert within an Azure Synapse Environment. The ideal candidate will possess deep expertise in Apache Spark and be proficient in working with Databricks. The candidate must have a strong command of Spark job definitions, PySpark, and structured streaming. In addition, the role requires comprehensive knowledge of partitioning, SQL, and Delta Lake capabilities.

The successful candidate will also have hands-on experience with EventHubs, Kafka, and ADLSv2 storage, as well as MongoDB. Familiarity with graph databases, preferably Gremlin, is essential. The candidate will be responsible for leveraging these technologies to drive data processing and analytical solutions within our organization.

Additionally, the ideal candidate should possess strong data science skills, including expertise in time series analysis, graph algorithms, classification, and clustering/NLP. They should also have a deep knowledge of distributed systems, particularly related to Spark, including partitioning for performance and reliability, checkpointing, architecture and provisioning of drivers and executors, sizing of Spark pools, and tuning Spark configurations.

Experience in Azure architecture and developing DevOps pipelines is also required. The candidate should be proficient with Git for version control and collaboration. Moreover, they should have a solid foundation in general computer science skills, including reliability engineering, and be proficient with Kubernetes, Docker, and Helm, including developing and deploying applications on Kubernetes. A strong knowledge of Linux and Linux CLI, as well as programming skills in Java and/or Go, are also necessary.

Furthermore, the candidate should have Open Telemetry developer knowledge, including experience with protobufs, receivers, collectors, and sampling. Familiarity with MLflow internals is also highly desirable.

The successful candidate will bring a combination of advanced technical skills, a strong background in data science and distributed systems, and a solid understanding of DevOps and general computer science principles. This role offers an opportunity to work on cutting-edge technologies and contribute to the development of scalable data solutions within our organization.

Required Skills:

  • 8+ years experience
  • Expert level experience in Apache Spark, PySpark, SQL, and Delta Lake capabilities, EventHubs, Kafka, and ADLSv2 storage, as well as MongoDB,
  • Familiarity with graph databases, preferably Gremlin
  • Azure Synapse Environment, Azure architecture and developing DevOps pipelines
  • strong data science skills, including expertise in time series analysis, graph algorithms, classification, and clustering/NLP
  • Kubernetes, Docker, and Helm, including developing and deploying applications on Kubernetes

Desired Skills:

  • Bachelors Degree in Computer Science, Engineering or Mathematics

Our Principal System Engineering, earns between $158,200.00-$237,400.00 USD Annual, not to mention all the other amazing rewards that working at AT&T offers. Individual starting salary within this range may depend on geography, experience, expertise, and education/training.

Joining our team comes with amazing perks and benefits:

  • Medical/Dental/Vision coverage
  • 401(k) plan
  • Tuition reimbursement program
  • Paid Time Off and Holidays (based on date of hire, at least 23 days of vacation each year and 9 company-designated holidays)
  • Paid Parental Leave
  • Paid Caregiver Leave
  • Additional sick leave beyond what state and local law require may be available but is unprotected
  • Adoption Reimbursement
  • Disability Benefits (short term and long term)
  • Life and Accidental Death Insurance
  • Supplemental benefit programs: critical illness/accident hospital indemnity/group legal
  • Employee Assistance Programs (EAP)
  • Extensive employee wellness programs
  • Employee discounts up to 50% off on eligible AT&T mobility plans and accessories, AT&T internet (and fiber where available) and AT&T phone.

#LI-Onsite – Full-time office role-

 AT&T is leading the way to the future – for customers, businesses, and the industry. We're developing new technologies to make it easier for our customers to stay connected to their world. Together, we’ve built a premier integrated communications and entertainment company and an amazing place to work and grow. Team up with industry innovators every time you walk into work, creating the world you always imagined. Ready to #transformdigital with us?

Apply now!

Weekly Hours:

40

Time Type:

Regular

Location:

USA:TX:Dallas / Two AT&T Plaza (211 S Akard St) - Dat:211 S Akard St

Salary Range:

$158,200.00 - $237,400.00

It is the policy of AT&T to provide equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state or local law. In addition, AT&T will provide reasonable accommodations for qualified individuals with disabilities.

Job ID R-48947 Date posted 12/19/2024
Apply now

Benefits

Your needs? Met. Your wants? Considered. Take a look at our comprehensive benefits.

  • Paid Time Off
  • Tuition Assistance
  • Insurance Options
  • Discounts
  • Training & Development

Learn more about benefits

Our hiring process

Apply Now

Confirm your qualifications align with the job requirements and submit your application.

Assessments

You may be required to complete one or more assessments, depending on the role.

Interview

Get ready to put your best foot forward! More than one interview may be necessary.

Conditional Job Offer

We’ll reach out to discuss a conditional job offer and the next steps to joining the team.

Background Check

Timing is important – complete the necessary actions to proceed with onboarding.

Welcome to the Team!

Congratulations! It’s time to experience #LifeAtATT.

Check your email (and SPAM) throughout the process for important messages and next steps.

Connect today

Didn’t find what you were looking for here? Sign up for our job alerts so we can connect and share the latest.

Welcome to the Talent Network

We’ve always got a ton of awesome things going on – like the latest job openings, events and offerings. But how can you stay on top of it all? That’s easy. Just connect to our Talent Network.

An * indicates a required field.

Interested InSelect a job category from the list of options. Select a location from the list of options. Finally, click “Add” to create your job alert.

AT&T Info and Alerts. Max 12 messages/month Privacy Policy (opens in new tab). You may opt-out at anytime by sending STOP to short code 20013. Msg & data rates may apply.

By submitting your information, you acknowledge that you have read our privacy policy (opens in new tab) and consent to receive email communication from AT&T for our U.S. Talent Network

Don't Miss Out

Join our Talent Network to be the first to know about new job openings, special announcements and behind-the-scenes information.

Skip, I’d rather go straight to the application

AT&T Info and Alerts. Max 12 messages/month Privacy Policy (opens in new window). You may opt-out at anytime by sending STOP to short code 20013. Msg & data rates may apply.

By submitting your information, you acknowledge that you have read our privacy policy (opens in new window) and consent to receive email communication from AT&T for our U.S. Talent Network.