Big Data Developer 8/9/2016

Open Systems Technologies Jersey City, NJ

Company
Open Systems Technologies
Job Classification
Full Time
Company Ref #
28635396
AJE Ref #
575828967
Location
Jersey City, NJ
Job Type
Regular

JOB DESCRIPTION

Responsibilities

* Develop in Big Dataarchitecture, Hadoop stack including HDFS cluster, MapReduce, Hive, Kafka, Storm, Heron, Flink, Spark, Elasticsearch/Solr and NoSQL
* Migrate Data from relational databases to Hadoop HDFS
* Hands on development in JAVA / Python
* Assist and support proof of concepts as Big Datatechnology evolves.
* Ensure solutions developed adhere to security and data entitlements
* Translate functional and technical requirements into detail design

Qualifications

* 3years' experience developing in Big Dataarchitecture, Hadoop stack including HDFS cluster, MapReduce, Hive, Kafka, Storm, Heron, Flink, Spark, Elasticsearch/Solr and NoSQL
* 3years' experience in data migration from relational databases to Hadoop HDFS
* 5years Hands on development experience in JAVA / Python
* 5+ years hands-on experience working in traditional RDBMS such as Oracle, DB2, MySQL and/or PostgresSQL.
* 3-5years hands-on experience writing SQL and working in Data Warehouse developing ETL processes
* Hands-on experience writing stream processing pipelines.
* Hands-on experience setting up and tuning Hadoop clusters
* Hand-on experience with iLabs integration and Enterprice Integration Patterns
* Translate, load and present disparate data sets in multiple formats/sources including JSON
* Translate functional and technical requirements into detail design
* Application performance tuning and troubleshooting
* Participate in analysis of data stores and help with data analytics