Job Title: Back-End Data Engineer (Python/SQL/AWS)
Job Type: Full-time, with benefits
Job Location: Houston, TX
About the Role:
Skilled Python Data Engineer. Designing, implementing, and maintaining data pipelines. Developing and maintaining APIs using the FASTAPI framework and SQL Alchemy ORM. Experience working with LLMs is a plus! 3+ years of experience in data engineering with a focus on Python. Will work closely with Data Scientists and Business Analysts to ensure that data is properly collected, processed, and analyzed to generate insights and drive business decisions. Good understanding of SQL. Experience with Postgres is a plus, although not a requirement. This position and program will require the candidate to be on-site at our client's office in downtown Houston, TX.
Our client is looking for talented back-end data engineering professionals who are passionate about leveraging technology to provide meaningful impact through their work. As part of the client’s development teams, you will contribute to the development of software solutions that aide in driving efficiencies for drilling, completions, production, and subsurface evaluation activities for a premiere, Fortune 200, Oil & Gas company.
Responsibilities: Data Management & Integration:
- Design and build pipelines to ingest and transport data
- Own data quality and reliability for app-related data pipelines.
- Collaborate with data and product teams to deliver robust, scalable data solutions.
API Development & Management:
- Design and develop secure, robust, user-friendly APIs for applications and users.
- Ensure API performance, fault tolerance, and comprehensive documentation.
Data Storage & Accessibility:
- Build and support databases specific to app usage.
- Work with enterprise database teams to make relevant app data available to stakeholders.
Analytics & Monitoring:
- Generate business rule-based alerts and notifications for stakeholders.
- Develop and support app health monitoring infrastructure to ensure uptime and reliability.
- Enhance and maintain the performance of real-time streaming data processes.
Additional Responsibilities:
- Understand the oil and gas business domain to translate needs into technical solutions.
- Participate in code review processes to ensure code quality and security.
- Provide data quality support and maintenance for assigned applications.
Requirements:
- Minimum 5 years of experience as a Data Engineer or in a similar role.
- Direct exposure to developing scientific or engineering use cases; or degree in a STEM field.
- Strong proficiency in Python preferred.
- Demonstrated experience in stream processing and real-time data calculations, ideally with IoT data.
- Proven ability in working with data caching, relational databases (RDBMS), and API creation/integration.
- Strong problem-solving skills and a proven track record of learning and adapting to new technologies.
- Excellent collaboration and communication skills, with a keen ability to work effectively within dynamic team environments.
- Understanding of Relational Database Management Systems (RDBMS)
- Oracle, SingleStore, MySQL, or Postgres
- Experience with NoSQL Databases
- Redis, MongoDB, and Elasticsearch
- Exposure to Event Log/Message Queuing Systems
- RabbitMQ, Pulsar, or Kafka
- API Development and Integration
- API creation concepts and experience with Python and FastAPI is a benefit
- Stream Processing Expertise
- Experience with large-scale IoT stream processing using Python for real-time data calculations and transformations (on data volumes exceeding MBs per second) is desirable.
- Infrastructure and Deployment Skills
- GitHub Actions, Kubernetes, Docker, Terraform, and Azure for deployment and infrastructure management on Linux (CentOS)
About CODE Staffing:
CODE Staffing exists to provide top of the line technical contingent staff to key clients that we partner with strategically to enable their business. We do this by providing a great environment for our employees, so that we minimize churn for our clients. Our rigorous focus on training and regular meetings with client’s executives ensure that we understand their technological road map and guarantees that we provide the best people for their needs.
Our people are our most valuable asset. That's why we're committed to attracting, retaining, and developing the best talent in the industry.
As a funded startup, working for CODE Staffing in this position will not only give you experience and exposure to one of the largest oil and gas companies in the United States, you’ll have the opportunity to be in at the ground floor of an exciting, forward-thinking organization. We are committed to growing the skills and career paths of our people, and would love the opportunity to have you join our team. We also have great benefits- check out our website for more details: CODE Staffing