This site uses cookies. To find out more, see our Cookies Policy

Data Engineer in Jersey City, NJ at Chubb Group of Insurance Companies

Date Posted: 6/9/2018

Job Snapshot

Job Description

Ideal candidate will be a software engineer with hands-on experience of building large-scale cloud based distributed data processing systems and applications. You are a self-starter who will take ownership of your projects and deliver high-quality data-driven advanced analytics and machine learning applications.  You are adept at solving diverse business problems by utilizing a variety of different tools, strategies, algorithms and programming languages.



Responsibilities

  • Collaborate and work with stakeholders to identify requirements and expected business outcomes
  • Design, develop, implementation, and continually delivery data pipelines using distributed cloud-based technologies supporting data processing initiatives across batch and streaming datasets
  • Identify, evaluate and implement leading edge data management frameworks required to address complex large-scale data challenges
  • Work within multi-functional agile teams with end-to-end responsibility for product development and delivery
  • Continuedly explore new ways of producing, processing, and analyzing data in order to gain insights
  • Provide architectural support by building proof of concepts & prototypes
  • Stay current with emerging technologies and industry trends


Qualifications, Skills and Experience

  • Bachelor’s degree in software engineering, computer science, economics or other engineering field
  • Proficient in SQL and advanced data manipulation techniques
  • Passion for quality software programming, data analytics and some knowledge of statistics
  • Experienced in parallel, distributed systems such as hadoop and spark
  • Experienced in high volume database technologies such as redshift, cassandra, etc.
  • Experienced in very large data systems performance tuning concepts such as distribution, indexing, compression, clustering, sharding, etc.
  • Experienced in programming languages such as python, scala, java, clojure or groovy
  • Experienced in operating system command languages such as bash or ksh
  • Experienced in development tools such as git and integrated development environments
  • Familiarity with data processing in Amazon, Azure, or other cloud platforms
  • Familiarity with data science and analytic tool sets such as jupyter hub
  • Familiarity with open source search platforms such as solr, tika, etc.
  • Familiarity with JVM technologies such as jetty, tomcat, maven, etc
  • Familiarity with web technologies and frameworks such as node.js, ruby
  • Familiarity with application configuration both off the shelf and open source