Position : Sr Data Engineer.
Location : Bangalore/Hyderabad/Noida.
Immediate joiners preferred.
Required:
- Extensive experience in data engineering with a strong focus on designing and implementing complex and scalable data solutions using AWS services like MWAA and Lambda, RDS (7+ years).
- Proficient in Databricks (5+ years) using pyspark, Delta tables, Unity catalog, SQL Warehouse for optimizing data pipelines, ensuring high performance, managing big data processing tasks in an optimized manner, and writing reusable framework.
- Proficient in Snowflake (4+ years) and Snowpark for optimizing queries, schemas, and implementing security layers.
- Strong architectural knowledge coupled with RBAC concepts
- Strong SQL skills with the ability to write, optimize, and troubleshoot complex queries.
- Demonstrated problem-solving skills with the ability to analyze, diagnose, and resolve technical issues efficiently.
- Experience in developing and maintaining ETL/ELT processes to ensure data is accurately and efficiently loaded into data warehouses and data lakes.
- Knowledge of data quality frameworks, exception handling and adherence to common standards and compliance.
- Experience using CI/CD tools such as CDK, CloudFormation, and Terraform to automate deployments both IaaC and DAGs across environments.