Java /Scala data engineer

Python, Scala, Java, Telecom domain knowledge, Data-Warehouse/ DataBricks knowledge, NoSQL-JSON-Document store (e.g. MongoDB), Data-Mapper (e.g. Nifi), Data Analytics, Spark, Kafka and Azure technology
Competent Big Data/Databrick engineer , who is independent, results driven and is capable of taking business requirements and building out the technologies to take it to production.
Big Data Engineer with expert level experience in Hadoop ecosystem and real time analytics tools including PySpark/Scala Spark/Hive/Hadoop CLI/MapReduce/ Storm/Kafka/Lambda Architecture/Mongo
Familiar with job scheduling challenges in Hadoop
Experienced in creating and submitting Spark jobs Experience in high performance tuning and scalability
Experience in working on real time stream processing technologies like Spark structured streaming, Kafka Expertise in Python/Spark and their related libraries and frameworks
Experience in building pipeline and efforts involved in deployment
Unix/Linux expertise; comfortable with Linux operating system and Shell Scripting
Experience in Azure cache
Design, Development, Unit and Integration testing of complex data pipelines and to handle data volumes to derive insights
Ability to optimize code to be able to run efficiently with stipulated SLA
Excellent problem solving skills, with attention to detail, focus on quality and timely delivery of assigned tasks
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.