Data Engineer

We are currently seeking a highly skilled and motivated Data Engineer to join our dynamic team. This is a permanent position, offering an exciting opportunity to work with a diverse array of technologies. The successful candidate will be responsible for designing, developing, and maintaining databases, data systems, and analytic solutions that turn data into knowledge. This position promises an exciting work environment with plenty of opportunities for professional growth and development.

Responsibilities:

1. Develop, construct, test, and maintain architectures such as databases and large-scale data processing systems.
2. Develop database solutions to store and retrieve company information.
3. Install, configure, and maintain data engineering platforms.
4. Perform data analysis to ensure all data systems meet company requirements.
5. Collaborate with data architects, modelers, and IT team members to identify opportunities for data acquisition.
6. Develop data set processes for data modeling, mining, and production.
7. Implement data flow to connect operational systems, data for analytics, and BI systems.
8. Monitor data performance and modify infrastructure as needed.
9. Conduct research for industry and business questions.
10. Use large data sets to address business issues.
11. Deploy sophisticated analytics programs, machine learning, and statistical methods.
12. Prepare data for predictive and prescriptive modeling.
13. Find hidden patterns using data.
14. Use data to discover tasks that can be automated.
15. Deliver updates to stakeholders based on analytics.

Qualifications:

1. Bachelor’s degree in Computer Science, Software Engineering, or a related field.
2. A minimum of 5 years of experience in a data engineer or similar role.
3. Expertise in SQL including coding, optimization, and troubleshooting.
4. Experience with data architecture, data modeling, schema design, and software development.
5. Knowledge of various ETL techniques and frameworks.
6. Experience with big data tools: Hadoop, Spark, Kafka, etc.
7. Experience with relational SQL and NoSQL databases.
8. Experience with data pipeline and workflow management tools.
9. Experience with AWS cloud services.
10. Experience with object-oriented/object function scripting languages: Python, Java, C++, etc.
11. Strong problem-solving skills and attention to detail.
12. Excellent communication and teamwork skills.
13. Ability to work independently and manage multiple tasks simultaneously.
14. Strong understanding of data management fundamentals and data storage principles.
15. Knowledge of distributed systems as it pertains to data storage and computing.
16. Proven ability to work in a fast-paced environment and meet deadlines.