Job Description:

Location: Bangalore / Hyderabad / Noida

Notice: Immediate to 30 days

Roles & Responsibilities:

· 10+ years of experience leading team of data engineers & architects in large scale & complex big data solutions

· Expertise in developing architecture blueprints for various design patterns - batch, real time and micro batches.

· Extensive experience in designing and implementing scalable data solutions using AWS services like MWAA and Lambda, RDS, ECS, EKS (7+ years).

· Proficient in Databricks using pyspark, unity catalog, SQL Warehouse (6+ years) for optimizing data pipelines, ensuring high performance, and managing large-scale data processing.

· Proficient in Snowflake (5+ years) for optimizing queries, schemas, and security layers.

· Deep expertise in FinOps best practices in AWS, Databricks, and Snowflake to build cost effective data products and solution

· Adept at developing and enforcing data governance policies and best practices to ensure data quality and compliance.

· Skilled in deployment patterns and proficient with CI/CD tools, specifically CDK, CloudFormation, and Terraform.

· Knowledge of using AppSecOps tools and best practices

---