Principal Software Engineer (Azure Data Engineer - Modern BI & Analytics)
Date: May 15, 2022
Location: Fort Worth, TX, US, 76131
Company: BNSF
Apply early as this job may be removed or filled prior to the closing date, which is approximately seven (7) days after the posting date.
Employee Referral Eligible: $500
This position has the potential to be a hybrid position with up to 50% remote work
Job Location: Fort Worth
Other Potential Locations: Fort Worth, TX
Anticipated Start Date: 05/16/2022
Number of Positions: 1
Salary Range: $82,000 - $127,400
Who we are and what we do
Do you want to be a part of something that really matters? Team BNSF includes professionals focused on safety and service that play a vital role in delivering the nation's freight. Together, we help move goods and materials that sustain life and support local, national and global economies. Our rail network is one of the largest freight railroads, spanning 28 western states and serving three Canadian provinces.
What we believe
At BNSF, our Vision and Values drive who we are, not only in our words, but also our actions. BNSF is committed to our foundational values of equality and inclusion. As members of the BNSF community, our employees are entitled to:
- be treated with dignity and respect.
- have equal access to tools, resources, training and development opportunities.
- have equal opportunity to achieve their full potential.
We model the way through our leadership, our BNSF Diversity Councils, our eclectic Business Resource Groups, our deep involvement and investment in the communities we serve and through training programs. Our actions create an inclusive, open and collaborative workplace that encourages diverse perspectives in all interactions.
-BNSF
Summary
This position will work directly with BNSF’s business intelligence and analytic technologies to support Technology Services systems and to collaborate with technology leaders, business partners, solution engineers, and development teams to ensure BNSF technology is well positioned to solve current and future business goals.
The Solutions Engineer leverages a thorough knowledge of existing and planned enterprise analytics capabilities, to create and influence the technical design and architecture of complex, integrated systems comprised of a combination of vendor products and custom developed software. The Solutions Engineer will serve as a proponent of industry best practices including, but not limited to, software development methodologies and toolsets and vendor systems integration to continuously improve the capabilities of the Technology Services organization and business partners. The principle business outcome for this role is to facilitate cross-functional collaboration that leads to the development of sound technology solutions and continuously improving methodologies and toolsets leveraged by Technology Services and business partners to support the analytic needs of BNSF.
Essential Job Duties and Responsibilities
- Participate in design, implementation, and support of a data lake, warehouse and analytics platform utilizing Azure cloud technology
- Design and implement data load processes from disparate data sources into Azure Data Lake and subsequent Azure Synapse and/or Teradata
- Design, develop, test, deploy, maintain, and improve data integration pipeline and loading data from wide variety of source like BLOB Stores, API, Kafka Events, RDBMS, etc.
- Develop pipeline objects using Azure Data Factory, Azure Databricks, Apache Spark / PySpark / Python.
- Load and Performance test data pipelines
- Strive for continuous improvement of code quality and development practices
- Analyze current business practices, processes and procedures and identify future opportunities for leveraging new technologies and services.
- Explore and learn the latest Azure technologies to provide new capabilities and increase efficiency
- Collaborate with data governance; ensure all existing data is created in the right way, and that new data is created according to appropriate standards and with proper documentation
- Read, write, and configure code for end-to-end service telemetry, alerting and self-healing capabilities
- Work closely with other Data Engineers to develop and document solutions for providing data to the enterprise.
- Facilitate collaboration and consensus building between business partners and technology teams to define, deliver, and improve technology solutions that solve business problems while positioning the BNSF technology ecosystem for future success.
- Assist in trouble shooting, root-cause analysis, and solution implementation within multiple technology areas
Qualifications
- Bachelor’s degree in Computer Science, Information Systems, Engineering and / or equivalent formal training or work experience is required
- At least 5 years work experience in Information Technology environment; Preferred experience with large enterprise BI and Analytics environments
- Azure Certification is a plus
- 3+ years of experience with Cloud platforms (Azure preferred, GCP or AWS), and Python programming and frameworks. 2+ years of working with one or more databases like Azure Synapse, AWS Redshift, Snowflake, Oracle, SQL Server, Teradata, Netezza, Hadoop, Mongo DB or Cassandra is required.
- Expert level knowledge of using SQL to write complex, highly-optimized queries across large volumes of data is required.
- 3+ years of hands-on programming experience using Python.
- 1+ year of Structured Streaming Knowledge using Azure Databricks
- 2+ years of professional work experience on ETL pipeline implementation using Azure services such ADF, Functions, and Databricks.
- 2+ years of professional work experience using real-time streaming systems using Kafka topics is required.
- 2+ Experience building CI/CD pipeline using Jenkins/Github or Azure DevOps
- Proficient knowledge of software development methodologies, concepts, and technology
- Demonstrated ability to understand and identify downstream impacts of changes within complex software systems
- Demonstrated ability to continuously improve software development teams processes and capabilities
- Proficient ability to leverage external resources to solve problems
- Proficient written / verbal communication skills, including the ability to explain complex ideas to others with varying levels of expertise throughout the organization and with potential business partners
BENEFITS
BNSF offers competitive benefit programs and services including, but not limited to
- Medical, Dental and Vision Coverage
- 401(k) Plan
- Railroad Retirement
- Life Insurance
- Incentive Compensation Plan (ICP)
- Tuition Reimbursement Program
BACKGROUND INVESTIGATION ELEMENTS
- Criminal history
- Last 7 years of driving history
- Last 5 years of employment history to include military service
- Social Security number
- Education
- Medical evaluation
- Drug Screen
- Other elements as needed
SF: Internal Posting Only; MO | [[mfield5]] | Technology Services | Fort Worth, TX | 76131
Nearest Major Market: Fort Worth
Nearest Secondary Market: Dallas
Job Segment:
Database, Analytics, Business Intelligence, Data Analyst, Developer, Management, Technology, Data