Hadoop Engineer

andbull;Provide expert level support of the systems and the data pipelines of the hadoop infrastructure.andbull;Provide system hardware architecture and configuration recommendations, perform vendor evaluation and drive system provisioning automation.andbull;Provide engineering and design support for Hadoop build, configuration, monitoring and supportability.andbull;Work with Architecture and Development teams to test and benchmark new versions, patches and software components for functionality and reliability.andbull;Contribute to the selection, prototyping, implementation and support of tools such as capacity planning and system monitoring for large scale data environments.andbull;Review, develop, and implement strategies that preserve the integrity, availability, stability, and scalability of AIS systems and designs, consistent with cost (Capital and Labor) constraints.andbull;Engage with the architecture team to design system and architecture standards to support internal and external development groups.andbull;Work with internal and external technical leaders to develop innovative solutions that meet market needs with respect to functionality, performance, scalability, and reliability, realistic implementation schedules, and adherence to architectural goals and principles.andbull;Review existing software/hardware architecture and identify areas for improvement in the areas of scalability, maintainability, and performance.andbull;Ongoing corrective and preventative maintenance to improve reliability and availability.andbull;Preparation of proposals, reports, architectures, designs, specifications, and operational documentation.andbull;Perform training and be on-call to investigate system failures and assist in restoring functionality.andbull; Fosters relationships of trust, respect, judgments, and maturity with peers, customers, management.

Master level experience with large scale Hadoop environments build and support including thought leadership, design, configuration, installation, capacity planning, capacity management, and performance tuning and monitoring
andbull;Expert level knowledge (hands-on) with the overall hadoop eco-system (HDFS, Map Reduce, Pig/Hive, Skipper, Hbase etc)andbull;Expertise in UNIX architecture, systems administration and UNIX toolsandbull;Knowledge and experience with parallel ETL toolsandbull;Extensive experience in designing and implementing large scale analytics environments with particular attention to maintainability, scalability and high availabilityandbull;Experience with versioning, change control, problem managementandbull;Solid experience with monitoring frameworks, and analyzing production platforms, UNIX servers and mission critical systems with alerting and self healing systemsandbull;Expert level capacity planning and capacity management skillsandbull;Strong presentation and leadership skillsandbull;Solid understanding of how businesses operate and use this context to drive innovation and ethical decision-makingandbull;Proven results oriented engineer with a laser sharp delivery focus.andbull;Sought out as an expert in all aspects of technical field with a solid business contextandbull;Proven customer centricity who can foster effective partnerships with colleagues, customers, managementandbull; Master level problem solving, root cause analysis, and comprehensive and strategic resolution to complex engineering problems