Sr. Data Engineer
Job Type: Full- Time
Location: On-Site in Houston (preferred), Remote
About the Role:
The Sr. Data Engineer is responsible for designing, implementing, and supporting full life-cycle data engineering projects, with minimal supervision. These projects should include big data ingestion, ETL, data replication, persistence, transformation, and retrieval. You will develop, maintain, and deploy platform or application code, and database stored procedures into development, staging, and production environments. Performance tuning and optimization. Debug and support production issues and assist with system integration and testing.
Experience
CODE Staffing is looking for someone who can take the project from design to coding without much supervision, though you'll always be part of a team. You should be a self-motivated and responsible person who keeps track of their tasks and delivers.
- Experience with a wide range of databases (Oracle, SQL Server) and big data technologies.
- Must have exceptional coding skills with SQL databases, and have some experience with NoSQL databases such as Elasticsearch and MongoDB.
- Experience with messaging and event streaming technologies including Kafka and RabbitMQ.
- Must have previous experience with git code repositories, and production migration protocols.
- We would ideally like to see a few snippets of your best code to determine your coding style and how you address complex problems and performance improvement strategies you have used in code.
- Experience with data science languages like Perl and Python, developing APIs and deployment in Kubernetes are a plus.
Requirements
We prefer a bachelor's degree in computer science, engineering or other equivalent degree, with 5+ years data engineering experience or a Master's degree in computer science, engineering or other equivalent degree with 2+ years data engineering.
- High school diploma or GED is required.
- 2+ years’ experience in the design, implementation, and support of full lifecycle data engineering projects.
- Experience in event-driven and cloud-based architectures, and working knowledge of containerization and streaming technologies.
- Detailed work experience in Oracle, SingleStore or IBM DB2 database, SQL & PL/SQL, including ANSI SQL.
- Experience in database analysis, development and maintenance of business applications specific to oil & gas back-office operations.
- Expertise in various ETL tools such as SQL*Loader, data replication tools, Python.
- Familiarity with NoSQL databases and pipelines (Elasticsearch, MongoDB).