Big Data Engineer - Architect / Senior Developer/ Designer /consultant
Job Title:Big Data Engineer - Senior Developer/ Senior Designer / Developer / ConsultantJob Location:London - UKSalary per annum:GBP 35,000 - 42,000 (Depending on Experience)UK Work permit/visa will be sponsored by the companyQualification:B.Tech/B.E/M.Tech/M.E/MCA/MSc IT or any equivalent----You Should have:>=5 Years Overall Software Development experience>=2 Years of solid Experience as Big Data EngineerTechnical Skills required:==========================- Strong programming experience with Scala/Python/Java- Strong SQL and data analytical skills- Proficiency in Big data ecosystem frameworks/tools (Must): Hadoop, Spark, PySpark, Spark Streaming, Kafka, Hive etc- Experience with relational SQL and NoSQL databases- Experience building and optimizing 'big data' data pipelines, architectures and data sets- Experience with data ingestion frameworks covering variety of data source types (RDBMS, Files, API calls, Web Services / Message Queues) and nature of data (structured, semi-structured and unstructured)- A background in Data, either Analytics, Engineering or Science- Knowledge of building a scalable and integrated Data Lake for an Enterprise- Experience in building and deploying big data solutions on any Cloud platform AWS, Azure or GCPJob roles and responsibilites:- Build large-scale data processing systems using Hadoop, Spark and Cloud computing technologies- Develops and maintains scalable data pipelines and builds out integrations to support continuing increases in data volume and complexity- Apply complex big data concepts with a focus on collecting, parsing, managing, and analyzing large sets of data to turn information into insights- Leading big data projects using Lambda architecture successfully from scratch to production- Drafting initial design proposals for reviews by team leads and architects, and contributing to detailed technical specifications where appropriate- Delivering solutions within a DevOps environment with a focus on automation of testing and deployment via standardised framework- Diagnosis and resolution of defects found during SIT, QA and UAT test phases- Drive optimization, testing and tooling to improve quality of solutionsFunctional Vertical:- Any Financial Services (Banking/Insurance/Capital Markets)- Telecom /Healthcare/ Retail/ Logistics - Supply Chain- Any Utilities/Energy Sector (Oil & Gas / Power)Nice to have:- Any UK / onsite experience is major plus- Any relavant certifications are added advantageNo.of.positions: 2Job Ref:NC_BD_0520Perks and Benefits35000 - 42000 GBP
Key Skillspython, Azure, scala, data engineer, Big Data, sql, java, gcp, spark, kafka, big data engineer, etl, aws, cloud computing
- Published on: 2020-05-22
- Salary: 35,00,000 - 45,00,000 P.A.
- Location: United Kingdom (U.K)