General Electric Sr Data Engineer in Bengaluru, India
Job Description Summary
Responsible for designing, developing, testing and implementing data engineering solutions required for deriding digital solutions in Industrial domains – Gas Power. You will be working analyzing and preparing the data needed for data science-based advanced analytical solutions or web applications aimed at digitisation of the business processes areas such as Product engineering, Services management, contract management , supply chain etc. in Manufacturing industry domain. Also responsible for managing and maintaining metadata data structures besides providing necessary support for post-deployment related activities when needed. Accountable to deliver results in a timely manner using agile methodologies.
Roles and Responsibilities
In this role, you should have / will be:
Working knowledge of using Big Data technologies to build data pipelines and curate data by having experience in Relation database such as PostgreSQL, Oracle No-SQL DB, Data Pipeline, Data Ingestion / ETL tools such as Informatica, Talent etc.
Architect and design the Data Layer components of the Digital solutions / Products that team is building in Industrial domain.
Build technical data dictionaries and support business glossaries to analyse the datasets
Perform data profiling and data analysis for source systems, manually maintained data, machine generated data and target data repositories
Build both logical and physical data models for both Online Transaction Processing (OLTP) and Online Analytical Processing (OLAP) solutions
Develop and maintain data mapping specifications based on the results of data analysis and functional requirements
Perform a variety of data loads & data transformations using multiple tools and technologies
Build automated Extract, Transform & Load (ETL) jobs based on data mapping specifications
Maintain metadata structures needed for building reusable Extract, Transform & Load (ETL) components.
Working & Debugging knowledge on J2EE technology stack and enterprise application development on Spring framework by implementing services.
Work internally with different stockholders, data teams, security teams etc for smooth execution of project
Must have good communication skills - both oral and written.
Hands on - strong Experience with Relational databases such as PostgreSQL, Oracle, My SQL etc. No SQL databases such as DynamoDB
Hands-on experience in writing SQL scripts for Oracle, MySQL, PostgreSQL or HiveQL
Hands-on experience in programming languages - Python, Java or Scala
Experience with Big Data / Hadoop / Hive / NoSQL database engines (i.e. Cassandra or HBase)
Understands logical and physical data models, big data storage architecture, data modeling methodologies.
Understands the technology landscape, up to date on current technology trends and new technology, brings new ideas to the team.
Experience of different techniques used for database / application performance tunning
Comfortable writing code in python, shell scripting, sql . Comfortable working on Linux environment
Experience working with AWS cloud data services & knowledge on cloud security – AWS Services like IAM, EC2, ECS, DMS, S3, Redshift, Quicksight, RDS etc
Experience in Data Visualisation tools such as Tableau, Quciksight
Exposure to industry standard data modeling tools (e.g., ERWin, ER Studio, etc.)
Exposure to Extract, Transform & Load (ETL) tools like Informatica or Talend
Exposure to unstructured datasets and ability to handle XML, JSON file formats
Conduct exploratory data analysis and generate visual summaries of data. Identify data quality issues proactively.
Exposure to Machine Learning models / algorithms will be a plus.
Bachelor's Degree in Computer Science or “STEM” Majors (Science, Technology, Engineering and Math) with advanced experience.
Minimum of 5 years of experience in Software Development in Data Engineering pace
Exposure to handling machine or sensor datasets from industrial businesses
Knowledge of for industrial applications in a commercial/finance/industrial/manufacturing settings.
Ability to work effectively with multi-disciplinary teams (e.g., UX, GE Business teams) and understand the inter-dependencies between them.
Ability to showcase teamwork skills to achieve common goals, provide resolutions and share ideas.
Demonstrate the presentation and influencing skills
GE is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, national or ethnic origin, sex, sexual orientation, gender identity or expression, age, disability, protected veteran status or other characteristics protected by law.
*Disclosure of your Gender or Sexual orientation is completely Voluntary and not mandatory.
Relocation Assistance Provided: Yes