We are seeking a talented and motivated Data Engineer to join our data team. This position will be responsible for designing, developing, and maintaining our data architecture, pipelines, and infrastructure. The ideal candidate is a problem solver who is passionate about data, has a strong technical background, and is capable of working in a dynamic and collaborative environment.
Key Duties and Responsibilities:
- Develop and maintain ETL processes to transform and load data into our data warehouse.
- Design, implement, and manage data storage solutions, including data warehouses and data lakes.
- Develop and maintain data models and schemas to support business requirements.
- Optimize data structures for efficient querying and analytics.
- Identify and resolve bottlenecks and issues in data processing.
- Manage metadata to provide context and lineage information for datasets.
- Implement data security measures to protect sensitive information.
- Ensure data compliance with relevant regulations and policies.
Skills:
- Operating System
- SQL
- Coding
- Machine Learning
- Data Architecture
- Data Warehousing
- Problem-solving
- Apache Hadoop-Based Analytics
Requirements:
- Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
- Proven experience as a Data Engineer or in a similar role.
- Strong proficiency in SQL and experience with database systems (e.g., PostgreSQL, MySQL).
- Hands-on experience with ETL tools and frameworks (e.g., Apache Spark, Apache NiFi).
- Proficiency in at least one programming language (e.g., Python, Java).
- Familiarity with data warehouse solutions (e.g., Amazon Redshift, Google BigQuery).
- Knowledge of data modeling concepts and techniques.
- Experience with version control systems (e.g., Git) and collaboration tools.
- Excellent problem-solving and troubleshooting skills.
- Strong communication and teamwork abilities.
- Experience with cloud computing platforms (e.g., AWS, Azure, Google Cloud Platform).
