Job Description

Responsibilities:

• Designing and implementing large-scale ingest systems in a Big Data environment
• Optimizing all stages of the data lifecycle, from initial planning, to ingest, through final display and beyond
• Designing and implementing data extraction, cleansing, transformation, loading, and replication/distribution
• Developing custom solutions/code to ingest and exploit new and existing data sources
• Developing data profiling, deduping logic, and matching logic for analysis
• Organizing and maintaining data layer documentation, so others are able to understand and use it
• Collaborating with teammates, other service providers, vendors, and users to develop new and more efficient methods
• Effectively articulating the risks and constraints associated with software solutions, based on environment

Experience:

• Strong software development experience, to include significant Java development, data analysis/parsing, and SQL/database experience
• Strong experience with the full data lifecycle, from ingest through display, in a Big Data environment
• Experience developing and performing ETL tasks in Linux and/or Cloud environments
• Strong experience with Java-related technologies, such as JDK, J2EE, EJB, JDBC, and/or Spring, and experience with RESTful APIs

Preferred Qualifications:

• Experience with Hadoop, Hbase, MapReduce
• Experience with Elasticsearch
• Experience working in a mission environment and/or with many different types of data

Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities This employer is required to notify all applicants of their rights pursuant to federal employment laws. For further information, please review the Know Your Rights notice from the Department of Labor.

Job Tags

Similar Jobs