General Electric Staff Data & Information Architect in Evendale, Ohio

Role Summary:

The Staff Data ELT Architect will have an exciting opportunity to work with one of the world’s largest datasets (petabyte range). Big data provides a unique challenge in all aspects of data acquisition, data enrichment, and analytics scheduling and operationalization that drives high-visibility, cross-division Aviation outcomes.

Essential Responsibilities:

  • Architect data ingestion jobs in tools such as Talend, HVR, Sqoop, Kafka, Glue, Kinesis to acquire, stage, and aggregate data in technologies like Aurora, Hive, Spark, HDFS, and Greenplum

  • Design ETL jobs using both built-in Talend components and custom made scripts in Python, Java, and Spark

  • Architect streaming data solutions using Kafka or Kinesis or near real-time using HVR

  • Devise big data ingestion jobs for relational, big data, streaming, IOT, flat file, JSON, API, and many other data sources using Talend, Spark Streaming, and Sqoop

  • Experience with writing SQL that is able to transform, pivot, and stitch big data sets, both relational and non-relational

  • Prove data ingestion ETL flows using message queueing

  • Optimize jobs to reduce memory and storage consumption

  • Operate in Agile framework as the Technical Architect, creating user stories from and tasks from customer requirements to track project progress Qualifications/Requirements: Basic Qualifications;

  • Bachelor’s Degree in Computer Science or in “STEM” Majors (Science, Technology, Engineering and Math) Minimum of 5 years of professional experience in IT

  • Experience with ETL architecture and developing ETL jobs

  • Experience working with databasesAdditional Eligibility Requirements:

  • Legal authorization to work in the U.S. is required. We will not sponsor individuals for employment visas, now or in the future, for this job

  • Must be willing to travel

  • Must be willing to work out of an office located in Evendale, Ohio Desired Characteristics:

  • Experience developing ETL jobs

  • Experience working with Databases

  • Experience in architecture

  • Experience architecting data ingestion design within a production environment

  • Experience performing Talend Data Integration (Including experience implementing integration jobs in a high volume environment)

  • Experience with cloud based native ingestion tools (Glue, Kinesis, Kafka, etc.)

  • Experience working with Hadoop Big Data ecosystems and tools such as Sqoop, Hive, Spark, etc.

  • Excellent written and verbal communication skills, especially with product owners

  • Self-driven to learn new technology and build technical skill sets

  • Experience with Agile project delivery frameworks and participating in Scrum ceremonies

  • Experience with CDC-based enterprise data ingestion technologies (HVR)

  • Hands-on experience with streaming data architecture (Spark Streaming, message queues, etc.)

  • Hands-on proficiency in one or more scripting languages (e.g., Java, Python, Scala, R, Shell scripting)

  • Experience with Hadoop data flow tools such as Sqoop, Flume, and Nifi

  • Experience with Hadoop workflow tools such as Spark and Spark streaming

  • Experience consuming REST and WSDL services

  • Experience working with databases and hands-on proficiency in SQL

  • Familiarity with Greenplum data modeling, or MPP-style data warehouse or PostgreSQL knowledge

  • Perform development and operations duties, sometimes requiring support during off-work hours

  • Expertise with using the Linux command line#DTR About Us: GE (NYSE:GE) drives the world forward by tackling its biggest challenges. By combining world-class engineering with software and analytics, GE helps the world work more efficiently, reliably, and safely. GE people are global, diverse and dedicated, operating with the highest integrity and passion to fulfill GE’s mission and deliver for our customers. www.ge.com GE offers a great work environment, professional development, challenging careers, and competitive compensation. GE is an Equal Opportunity Employer at http://www.ge.com/sites/default/files/15-000845%20EEO%20combined.pdf . Employment decisions are made without regard to race, color, religion, national or ethnic origin, gender (including pregnancy), sexual orientation, gender identity or expression, age, disability, veteran status or any other characteristics protected by law. Locations: United States; Ohio; EvendaleGE will only employ those who are legally authorized to work in the United States for this opening.