Design technical architecture and develop various Big Data technologies using AWS, Hadoop MapReduce, Pig, Hive, Sqoop and Flume. Work with business users, Oracle database team and system administrators in designing data conversion to HBase. Extract data from MySQL database into HDFS, HIVE and HBase using Sqoop. Orchestrate hundreds of HIVE queries using Oozie workflows and Hadoop Data serialization mechanisms like AVRO. Perform data modeling and connect Cassandra from Spark and save summarized data frame to Cassandra. Design and develop data pipeline for different events of applications data, to filter and load consumer response in AWS S3 bucket into Hive external tables. Implement ETL process using Hive and Pig which includes Python and Java for cleansing the data. Will work in Manchester, CT and/or various client sites throughout the U.S. Must be willing to travel and/or relocate.
Mail Resume to HR Dept., Cyma Systems, Inc., 360 Tolland Turnpike, Suite 2D, Manchester, CT 06042.