Java, ETL, Bigdata Developer

Design and ImplementationoCreating and implementing data flow solutions using NiFi, including defining data sources, destinations, and transformation processes. Ingestion and TransformationoManaging data ingestion from various sources (e.g., files, databases, APIs) and transforming data into desired formats for downstream consumption. Routing and EnrichmentoConfiguring NiFi to route data to appropriate destinations and enriching data with additional information (e.g., timestamps, location). Scalability and PerformanceoEnsuring data flows are scalable and performant to handle varying data volumes and velocity. NiFi Cluster ManagementoMaintaining and improving NiFi clusters, including configuration, optimization, and troubleshooting. Microservices IntegrationoDeveloping and integrating microservices to support data conditioning, format validation, and transformation processes. Troubleshooting and Issue ResolutionoIdentifying and resolving issues related to data flows, NiFi configurations, and data integration processesTechnical SkillsStrong NiFi Expertise Deep understanding of NiFi architecture, processors, controllers, and data flow management capabilities. Data Integration and ETL Experience with data integration, ETL processes, and data modeling concepts. Programming Languages Proficiency in Java, Python, or other relevant scripting languages. Database and SQL Familiarity with databases, SQL, and data manipulation techniques. Cloud Technologies Experience with cloud platforms (e.g., AWS, Azure, GCP) and their integration with NiFi. Big Data Technologies Knowledge of big data technologies like Kafka.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.