Data Engineer
Bangalore | In-office
Full-time-Permanent
2 - 5 Years
Software development
Posted on : Sep 22, 2023
Applicants : 78
Vacancies :
Job Description
Function: Software Engineering : Big Data / DWH / ETL
Responsibilities:
- Design a multi-tier data pipeline to feed data into applications for building a full-featured analytics environment.
- Develop high-quality code to support the platform's technical architecture and design.
- Participate and contribute to an effective software development lifecycle using Scrum and Agile.
- Collaborate with global teams and work as one team.
- Work on the design, implementation, and maintenance of data pipelines.
- Design and build database schemas to handle large-scale data migration & transformation.
- Capable of designing a high-performance, scalable, distributed product in the cloud[AWS, GCS].
- Review developmental frameworks, and coding standards, conducts code reviews and walkthroughs, and conduct in-depth design reviews.
- Identify gaps in the existing infrastructure and advocate for the necessary changes to close them.
Requirements:
- 4 to 6 years of industry experience working in Spark and Scala/Python.
- Working experience with big-data tech stacks like Spark, Kafka & Athena.
- Extensive experience in SQL query optimization/tuning and debugging SQL performance issues.
- Experience in ETL/ELT process to move data through the data processing pipeline.
- Be a fearless leader in championing smart design.
- Excellent programming experience in Scala or Python.
- Good experience in SQL queries and optimizations.
- 2 to 3 years of Spark experience.
- Nice to have experience in Airflow.
- Nice to have experience with AWS EMR, Lambda, and S3
Education
B Tech , B E , MCA , M Sc
Work Mode
In-office
Key Skills
About the company
Eloelo
Why Explore a Career at eloelo
- A swanky informal workspace in the heart of Bangalore which defines our open & vibrant work
culture
- Opportunity to work on new and challenging problems being solved for the first time in the sector
- Innovate & Disrupt the entire global Live Streaming gamie ecosystem with us
- Get complete ownership of the product and chance to conceptualize and implement your
solutions
- Exposure to massive scale- we touchover 20M+ registered users on our platform!
- Work with the best talent across the country- folks from core team of startups such as Zomato, Tiktok, Flipkart and Tech giants such as ESPN.
eloelo Interview Process
We assess the candidates on technical and functional parameters on the basis of the roles that they have applied for. We also look at behavioural parameters on the basis of our GAMED competency framework.
G- Getting it Done Fast
A- Adhering to the Highest Standards
M- Mentoring Self and Others
E- End to End Ownership
D- Delighting Customers
We follow a very lean interview process! As soon as your profile is shortlisted you will immediately hear from our HR team in form of an introductory call where you can get to know the opportunity better, followed by usually two round of technical interaction and a direct conversation with the founders followed by Department Head and HR discussions.
Note: The above process may vary depending on the role the candidate is interviewed for.
Benefits at eloelo
Flexible Time-Off • Healthcare Coverage • Learning Assistance • Paid Parental Leave • Flexible Benefit Plan • Employee Wellness Program • Free Food • My Time-off
3rd Floor, SMR Plaza, 360, 19th Main Rd, Sector 4, HSR Layout, Bengaluru, Karnataka 560102, HSR Layout - 560102
Nasreen Khan
Details
Job Description
Function: Software Engineering : Big Data / DWH / ETL
Responsibilities:
- Design a multi-tier data pipeline to feed data into applications for building a full-featured analytics environment.
- Develop high-quality code to support the platform's technical architecture and design.
- Participate and contribute to an effective software development lifecycle using Scrum and Agile.
- Collaborate with global teams and work as one team.
- Work on the design, implementation, and maintenance of data pipelines.
- Design and build database schemas to handle large-scale data migration & transformation.
- Capable of designing a high-performance, scalable, distributed product in the cloud[AWS, GCS].
- Review developmental frameworks, and coding standards, conducts code reviews and walkthroughs, and conduct in-depth design reviews.
- Identify gaps in the existing infrastructure and advocate for the necessary changes to close them.
Requirements:
- 4 to 6 years of industry experience working in Spark and Scala/Python.
- Working experience with big-data tech stacks like Spark, Kafka & Athena.
- Extensive experience in SQL query optimization/tuning and debugging SQL performance issues.
- Experience in ETL/ELT process to move data through the data processing pipeline.
- Be a fearless leader in championing smart design.
- Excellent programming experience in Scala or Python.
- Good experience in SQL queries and optimizations.
- 2 to 3 years of Spark experience.
- Nice to have experience in Airflow.
- Nice to have experience with AWS EMR, Lambda, and S3
Education
B Tech , B E , MCA , M Sc
Work Mode
In-office
Number of Vacancies
Key Skills
About the company
Eloelo
Why Explore a Career at eloelo
- A swanky informal workspace in the heart of Bangalore which defines our open & vibrant work
culture
- Opportunity to work on new and challenging problems being solved for the first time in the sector
- Innovate & Disrupt the entire global Live Streaming gamie ecosystem with us
- Get complete ownership of the product and chance to conceptualize and implement your
solutions
- Exposure to massive scale- we touchover 20M+ registered users on our platform!
- Work with the best talent across the country- folks from core team of startups such as Zomato, Tiktok, Flipkart and Tech giants such as ESPN.
eloelo Interview Process
We assess the candidates on technical and functional parameters on the basis of the roles that they have applied for. We also look at behavioural parameters on the basis of our GAMED competency framework.
G- Getting it Done Fast
A- Adhering to the Highest Standards
M- Mentoring Self and Others
E- End to End Ownership
D- Delighting Customers
We follow a very lean interview process! As soon as your profile is shortlisted you will immediately hear from our HR team in form of an introductory call where you can get to know the opportunity better, followed by usually two round of technical interaction and a direct conversation with the founders followed by Department Head and HR discussions.
Note: The above process may vary depending on the role the candidate is interviewed for.
Benefits at eloelo
Flexible Time-Off • Healthcare Coverage • Learning Assistance • Paid Parental Leave • Flexible Benefit Plan • Employee Wellness Program • Free Food • My Time-off
3rd Floor, SMR Plaza, 360, 19th Main Rd, Sector 4, HSR Layout, Bengaluru, Karnataka 560102, HSR Layout - 560102
Nasreen Khan