Job Title: Data Engineer
Location: Bangalore
Job Type: Full-Time
Job Description:
We are seeking an experienced Data Engineer with expertise in building and maintaining scalable data systems. The ideal candidate will be responsible for designing, implementing, and managing the flow of data from diverse sources to ensure the quality, security, and accessibility of data for analysis. You will work closely with data scientists, analysts, and software engineers to ensure the effective delivery of data-driven insights.
Key Responsibilities:
- Design, develop, and maintain robust, scalable, and high-performance data pipelines.
- Integrate data from various sources (APIs, databases, external data services) and ensure its quality and accessibility.
- Develop and optimize ETL processes to transform raw data into usable formats for analysis.
- Collaborate with cross-functional teams to gather data requirements and support analytics initiatives.
- Build and manage data warehouses and data lakes to enable seamless data access for end-users.
- Implement data governance policies, ensuring data integrity, security, and compliance.
- Monitor and improve data pipeline performance, ensuring minimal downtime and optimal performance.
- Troubleshoot data-related issues and provide solutions in a timely manner.
- Create and maintain documentation of data architecture, pipelines, and processes.
- Work with cloud platforms (AWS, MongoDB, ClickHouse) to design and manage data infrastructure.
Skills and Qualifications:
- Bachelor’s degree in Computer Science, Information Systems, or a related field.
- 3+ years of experience in data engineering or related roles.
- Strong proficiency in SQL and experience with relational databases (e.g., MySQL, PostgreSQL).
- Experience with data pipeline tools (e.g., Apache Airflow, Kafka, AWS Glue).
- Expertise in cloud data solutions (AWS, GCP, or Azure) and cloud-based databases (MongoDB, ClickHouse, Redshift, BigQuery, etc.).
- Strong knowledge of ETL processes and experience with ETL tools.
- Experience with big data technologies like Hadoop, Spark, or similar frameworks.
- Proficiency in scripting and programming languages such as Python, Java, or Scala.
- Familiarity with data modeling, schema design, and optimization techniques.
- Strong understanding of data governance, data quality, and security best practices.
- Ability to work independently and collaboratively in a fast-paced environment.
Nice to Have:
- Experience with machine learning pipelines and integration with data engineering systems.
- Certification in cloud platforms (e.g., AWS Certified Big Data – Specialty, Google Cloud Professional Data Engineer).
- Experience with stream processing technologies (e.g., Apache Flink, Storm).
- Knowledge of containerization and orchestration (Docker, Kubernetes).
Benefits:
- Competitive salary and performance bonuses.
- Health, dental, and vision insurance.
- Flexible working hours and remote work options.
- Opportunities for professional development and certifications.
- Work with a dynamic and collaborative team in an innovative environment.
How to Apply:
Please submit your resume and cover letter to jobs@geospotmedia.com with the subject line "Data Engineer Application – [Your Name]". We look forward to welcoming a new member to our growing team!