Similar Jobs

View More

Big Data Talend Developer

This job is no longer active. View similar jobs.

POST DATE 9/8/2016
END DATE 10/8/2016

Confidential Company Saint Paul, MN

Company
Confidential Company
Job Classification
Full Time
Company Ref #
29679727
Location
Saint Paul, MN
Experience
Entry Level (0 - 2 years)
Job Type
Regular
AJE Ref #
576121173

JOB DESCRIPTION

In this role, the selected candidate will be responsible for selecting and integrating any Big Data tools and frameworks required to provide requested capabilities. Job Description :--We are looking for a Big Data Engineer that will work on the collecting, storing, processing, and analyzing of huge sets of data.-The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them.-You will also be responsible for integrating them with the architecture used across the company.Responsibilities :--Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities.-Implementing ETL process.-Strong in using Talend.-Monitoring performance and advising any necessary infrastructure changes.-Defining data retention policies.-Proficient understanding of distributed computing principles.-Management of Hadoop cluster, with all included services.-Ability to solve any ongoing issues with operating the cluster.-Proficiency with Hadoop v2, MapReduce, HDFS.-Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming.-Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala.-Experience with Spark.-Experience with integration of data from multiple data sources.-Experience with NoSQL databases, such as HBase, Cassandra, MongoDB.-Knowledge of various ETL techniques and frameworks, such as Flume.-Experience with various messaging systems, such as Kafka or RabbitMQ.-Good understanding of Lambda Architecture, along with its advantages and drawbacks.-Experience with Cloudera/MapR/Hortonworks.