Big Data Lead

Job responsibilities: Implementation of integration mechanisms with different data sources Implementation of scripts for automation of repetitive tasks Effective unit testing of code with code coverage tools Follow coding standards Follow guidelines for SQL joins, indexes while designing queries Participate in code/design reviews Data analysis to identify correctness of data Identifying and defining data models for effective storage of data Identify and implement data transformation rules Creating required design documentation for mapping, transformation and integration Installation of Hadoop, debug task failures Creating dashboard using tools like Qlikview, Tableau etc Performance tuning e.g. slowing running tasks, slow running queries, high memory usage Participate in internal trainings related to organization or for acquiring new technical knowledge Evaluation and performance of data engineering tasks & other advanced analytics related task Participating in architectural reviews and discussions Job Requirements: Mandatory: 8 - 12 years of IT Experience; 4 - 7 years of experience in Big Data projects; Deep knowledge of Data Lake & DWH approaches and technical architecture; Apache Hadoop technology stack experience (Apache Spark, Hive, Pig, Flume, Sqoop, Kafka, Spark streaming); Cloudera / Hortonworks, MongoDB, Redis deployment experience . Optional: Real-time analytics experience; Decisioning-systems deployment experience as a plus (SAS RTDM / IBM RTDM / Pega ADM or similar); Machine learning algorythms deployment as a plus. Salary: Not Disclosed by Recruiter Industry: IT-Software / Software Services Functional Area: IT Software - Application Programming, Maintenance Role Category: Programming & Design Role: Software Developer Employment Type: Full Time, Permanent


Key Skills
cloudera, hive, bigdata, SAS RTDM, IBM RTDM, Machine Learning, PEGA ADM, Analytics, pig, apache, NLP, DWH, Sqoop, spark, hortonworks, kafka, flume, hdfs, Data Lake, hadoop, big data, mongodb, rtdm

Job Summary

  • Published on: 2020-05-24
  • Salary: Not Disclosed by Recruiter
  • Location: Bengaluru(Dairy Circle)