Apache NiFi/ETL Developer

Booz Allen Hamilton Inc. Herndon, VA
Job Description Job Number: R0028536

Apache NiFi/ETL Developer

Key Role:

Work with multiple platforms, architectures, and diverse technologies gathering requirements and design and develop ETL processes to transform information from multiple sources. Work with a team of talented engineers to enhance a highly scalable, fault tolerant, and responsive big data platform with next generation streaming data technologies. Work alongside architects and forward-thinking customer partners by providing services that enable solutions around data collection, aggregation, and enrichment. Perform as a key member of the team responsible for designing and supporting data scientists with their data needs across all solution assets. Help to prove concepts, evaluate technologies, and contribute to ideas that can turn into actionable implementations. Help to transform a Cloud platform from a traditional enterprise data architecture to a streaming architecture based on open source and Hadoop technologies

Basic Qualifications:

* 2+ years of experience with stream processing pipelines, including Kafka, Flume, Apache Storm, Apache Samza, or Apache Spark Streaming.

* 1+ years of experience with real-time data ingestion technologies, including StreamSets and Apache NiFi

* 1 year of experience with XML and JSON and parsing and enriching data in flight and for transport

* Experience with messaging-oriented application stacks, pub-sub architecture, and clustering and brokers, queues, and topics

* Ability to play a technical role as a part of a team, implement solutions based on industry standard architecture patterns, loosely coupled architecture, Web-oriented architecture, and service-oriented architecture

* Ability to obtain a security clearance

* BA or BS degree

Additional Qualifications:

* 1+ years of experience with search-based solutions for real-time indexing, analysis, and visualization, including ElasticSearch, ELK, Splunk, Solr, or others

* Experience with real-time data visualization techniques and enabling live analytics

* Experience with building distributed systems

* Experience with Java and other modern languages, including Scala, R, and Node.js

* Ability to be a real-time thinker who can imagine the future

* Ability to be self-motivated to deep dive into subjects of solution relevance

* Ability to learn whatever is necessary to get job done and attack hard problems with out-of-the-box thinking

* Ability to code and debug and display an engineering background

* Ability to display an aptitude with front-end to design and implement administrative dashboards with substantial independent working abilities

Clearance:

Applicants selected will be subject to a security investigation and may need to meet eligibility requirements for access to classified information.

We're an EOE that empowers our people—no matter their race, color, religion, sex, gender identity, sexual orientation, national origin, disability, or veteran status—to fearlessly drive change.

Similar jobs you might like