END DATE October 08, 2016

Big Data Talend Developer

Confidential Company - Saint Paul, MN

This job is no longer active. View similar jobs
View Job Summary View Job Summary
  • Company
    Confidential Company Confidential Company
  • Location
    Saint Paul, MN
  • Job Type
  • Job Classification
    Full Time
  • Experience
    Entry Level (0 - 2 years)
  • Company Ref #
  • AJE Ref #

Job Description

In this role, the selected candidate will be responsible for selecting and integrating any Big Data tools and frameworks required to provide requested capabilities. Job Description :--We are looking for a Big Data Engineer that will work on the collecting, storing, processing, and analyzing of huge sets of data.-The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them.-You will also be responsible for integrating them with the architecture used across the company.Responsibilities :--Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities.-Implementing ETL process.-Strong in using Talend.-Monitoring performance and advising any necessary infrastructure changes.-Defining data retention policies.-Proficient understanding of distributed computing principles.-Management of Hadoop cluster, with all included services.-Ability to solve any ongoing issues with operating the cluster.-Proficiency with Hadoop v2, MapReduce, HDFS.-Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming.-Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala.-Experience with Spark.-Experience with integration of data from multiple data sources.-Experience with NoSQL databases, such as HBase, Cassandra, MongoDB.-Knowledge of various ETL techniques and frameworks, such as Flume.-Experience with various messaging systems, such as Kafka or RabbitMQ.-Good understanding of Lambda Architecture, along with its advantages and drawbacks.-Experience with Cloudera/MapR/Hortonworks.