Big Data Engineer - Work From Home (Gurgaon) (Exp: 1 to 3 years)

Job description

• Design and develop large scale data architectures, reusable frameworks and components picking best in class technologies • Marry the business requirements with technology, considering best possible performance and doing a thorough gap analysis • Perform PoCs to accelerate development and help the team get past any technical roadblock • Optimise performance of the deployments and troubleshoot issues along with the team • Setup and deploy development and production environments with appropriate monitoring and alerting • Identify NFRs in the architecture and choose the right technology to suffice • Represent company and its technical expertise in customer interactions at different levels including CxOs • Design, debate and Review architectures across the organisation • Work along with the team, promoting and educating architecture, its best practices and standards. • Closely work with the business team - balancing the timeline with the deliverables

About the role

• Do High and low level technical designs for projects in different technical areas like, real time analytics, data warehousing, data lakes. • Build and deploy cloud native solutions on AWS • Have expertise in deployment automation and ML workflows • Have extensive technical expertise in AWS Big data Stack, distributed computing using technologies like Spark, Storm, Flink and schema design for Data Warehouses using column oriented DWH like Redshift • Optimise performance of the deployed solution in terms of Processing Time, Query Runtimes, Read/Write Performance • Balance cost with the technical solution to give a cost and performance optimised solution • Actively Participate in Requirement Gathering with the Product owner • Guide and Educate the team during the course of the project on different technical aspects • Help the team debug, resolve and correctly estimate the stories • Identify risks and spikes upfront and help the team resolve them before Iteration start • Ensure code and design quality at all levels in the solution by doing regular reviews and inspections • Have decent technical know-how of serverless architectures and frontend technologies • Active participation and keen interest in growing in the technical space • Have excellent written and oral communication skills Added bonuses you have... • Knowledge of GCP/Azure • Knowledge of SQL • Knowledge of any other language apart from python - Java or Scala

About you

We are Recruitment and Consulting Company - to know more about us visit our website - https://instatalentrecruit.com/