Software Engineer in Whitehouse Station, NJ at Chubb Group of Insurance Companies

Date Posted: 12/27/2019

Job Snapshot

Job Description

Azure Data Engineer


Ideal candidate will be a software engineer with a strong hands-on experience of building large-scale cloud based distributed data systems. The Azure Data Engineer will work with the business in understanding data requirements and will serve as a technology & platform expert in designing and building technical solutions focused on Cloud-based Big Data ecosystems such as Azure Data Factory, Kafka, Informatica ICS, Databricks Spark, SQL Data Warehouse, Cosmos DB, .etc. with a focus on understanding data need for data initiatives in building scalable, distributed, and high performance computing cloud based platform solutions on Azure and then be tasked with designing and implementing solutions for data management improvements. You are a self-starter who will lead a team and take ownership of your projects and deliver high-quality data-driven advanced analytics and machine learning applications.  You are adept at solving diverse business problems by utilizing a variety of different tools, strategies, algorithms and programming languages.


Responsibilities

  • Collaborate and work with global data management stakeholders to identify requirements for complex business problems that may be loosely defined.
  • Lead the definition of enterprise data architecture, data lake, data integration, metadata management standards, processes and deliverables.
  • Collaboration with the business, applications owners, solutions architects, and with technical architects to understand the implications of respective data architectures to maximize the value of information across the organization.
  • Work with the database administration/architecture and data analytics teams to help set the enterprise data strategy and standards.
  • Build the enterprise conceptual and logical data models for analytics, operational and data mart structures in accordance to industry best practices models.
  • Identify, evaluate and implement leading edge data management frameworks required to address complex large-scale data challenges.
  • Work within multi-functional agile teams with end-to-end responsibility for product development and delivery
  • Continuedly explore new ways of producing, processing, and analyzing data in order to gain insights.
  • Provide architectural support by building proof of concepts & prototypes.
  • Stay current with emerging technologies and industry trends.

  • Bachelor’s degree in software engineering, computer science, economics or other engineering field

  • Must have Azure Cloud experience is the data platforms, preferably Azure certified as a cloud solution engineer.

  • Hands-on expertise in Azure big data ecosystems Databricks, Azure Data Lake Store, Azure Data Factory, SQL Data Warehouse, Kafka, etc.

  • Experience in designing and leading the conceptual, logical and physical design for distributed databases.

  • Experience in driving meta data architecture and Master Data Management solutions.

  • Experience in performing analysis and design for data management and data driven projects.

  • Excellent data analysis skills using T-SQL on Spark SQL, ANSI SQL etc.

  • Good understanding of R, Python, Jupyter Notebook, RStudio, R Shiny, etc.

  • End-to-end design and build process of Near-Real Time and Batch Data Pipelines

  • Experienced in programming languages such as python, scala, java, clojure or groovy

  • Experienced in operating system command languages such as bash or ksh

  • Experienced in development tools such as git and integrated development environments

  • Familiarity with data science and analytic tool sets such as jupyter hub


Chubb strives to offer a diverse and inclusive and rewarding work environment.  Teamwork and mutual respect are central to how Chubb operates and we believe the best solutions draw upon diverse perspectives, experiences and skills.  We operate in such a way where everyone, regardless of their singular background has the opportunity to contribute to our collective success.