Data Engineer (Skillbridge Intern) - 20558

Job Description

This is an UNPAID internship through the DoD SkillBridge Program for transitioning active-duty US military personnel. DoD SkillBridge Internships are available to help transitioning active-duty military personnel gain real-world experience in the work force sometime during their final 180 days of active-duty service. The intern will actively train on meaningful projects and work closely with a mentor and with senior company leadership. Enlighten Internship programs are focused on placing transitioning military into internships that require KSAs, Education & Military Training similar to their current or previous military jobs; positions that could easily transition over to a full-time regular and permanent job with Enlighten. 

#LI-DW2

Essential Job Responsibilities

The SkillBridge intern will train as a Data Engineer with Enlighten, reporting to a designated Enlighten Supervisor, with the goal of learning Enlighten’s approach to design, build, and optimize Big Data Platform (BDP) systems for data collection, storage, access, and analytics at scale. The intern will be assigned special projects as needed. 

Desired End State (3-4 month target)

• At the end of four months, the intern will be able to understand basic data engineer concepts. Data engineers, as part of enterprise data analytics teams, manage, optimize, oversee, and monitor data retrieval, storage, and distribution throughout the BDP enclaves.

• The intern will develop a good understanding of all critical tasks to successfully conduct data engineer objectives:

  • Data acquisition

  • Develop data set processes (Extract, transform, load (ETL))

  • Use programming language and tools (Java, NiFi, maven, etc)

  • Identify ways to improve data reliability, efficiency, and quality

  • Prepare data for predictive and prescriptive modeling

  • Use data to discover tasks that can be automated

• Enlighten will benefit from the military background of the SkillBridge intern and considers the SkillBridge internship an overall positive experience.

Assumptions/Restrictions

• If candidate is selected and approved, SkillBridge Intern can travel in conjunction with this internship; Enlighten will fund all travel costs.

• SkillBridge Intern will be available during core hours for critical meetings and training.

Training Plan

Phase 1 Basics

• Week 1: In processing, Introductions/office familiarization

• Week 2: Intro to the Big Data Platform (BDP) technologies. Intro to BDP analytics and applications 
• Week 3: Intro to Army and Air Force Cyber data ETL process 

Phase 2 Parser Overview

• Week 4: Data Acquisition, Taxonomy/Schema. Review existing parsers and deployment flows; understand existing transforms available for use in parsers.
• Weeks 5-6: BDP technologies - Kafka and Nifi workflows; Establish a development environment for BDP parser development

Phase 3 Parser Development, Deployment, and Testing

• Weeks 7-8: Modify Kafka and Nifi workflows; modify existing parser schema and transforms to alter ingest pipeline.
• Week 9: Understand how to access logs to identify errors; understand common parser development errors; troubleshoot errors.
• Weeks 10-end: Implement data parsing best practices, building, deploying, and troubleshooting workflows.

Additional Goals

• Project management

Minimum Qualifications

• Active-Duty Military ONLY within final 180 days of active-duty service. 
• Minimum of 5 years relevant data engineering (including experience with Python or Java) experience with Bachelors in related field; 3 years relevant experience with Masters in related field; or High School Diploma or equivalent and 9 years relevant experience.
• Additional experience dependent on Program of Instruction.

Physical Requirements

Physical Requirements will vary and is dependent on the Program of Instruction.