KGeN - Data Engineer - AWS
KGEN
Data Science
Bengaluru, Karnataka, India
Posted on Nov 10, 2024
Role Description
Join our dynamic and innovative gaming company, where we are committed to creating immersive experiences for players around the world. As we continue to grow, we are seeking a talented AWS Data Engineer to join our team and help us leverage cutting-edge cloud technologies to drive our data initiatives.
Key Responsibilities
Join our dynamic and innovative gaming company, where we are committed to creating immersive experiences for players around the world. As we continue to grow, we are seeking a talented AWS Data Engineer to join our team and help us leverage cutting-edge cloud technologies to drive our data initiatives.
Key Responsibilities
- Design, develop, and maintain scalable ETL processes using AWS Glue.
- Create and manage data lakes on AWS S3 to store structured and unstructured data.
- Utilize AWS Athena for ad-hoc querying and data analysis.
- Implement and manage AWS Lambda functions for data processing and automation.
- Develop data processing workflows using PySpark.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
- Monitor and optimize data pipelines for performance and cost-efficiency.
- Ensure data quality and integrity through rigorous testing and validation processes.
- Implement data security best practices to protect sensitive information.
- Stay up-to-date with the latest trends and best practices in cloud data engineering and gaming industry.
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 3+ years of experience as a Data Engineer, preferably in a AWS cloud environment.
- Proficiency in AWS services, particularly AWS Glue, Athena, S3, Lambda, and PySpark.
- Strong SQL skills and experience with relational databases.
- Experience with data modeling, ETL processes, and data warehousing concepts.
- Proficiency in programming languages such as Python.
- Familiarity with data visualization tools like AWS QuickSight or Tableau is a plus.
- Strong problem-solving skills and attention to detail.
- Excellent communication and collaboration skills.
- Experience in the gaming industry is a plus but not required.