Job Details
Position : Big Data Engineer (INDEPENDENT CONTRACTOR)
BIG DATA ENGINEER
Pittsburgh PA
Contract / Contract to Hire
Will Start Remote but Candidate has to live in or relocate to Pittsburgh right away
Responsibilities:
-
Develop scalable streaming solutions based on Apache Spark and Apache Kafka using Scala and Java
-
Design, architect, optimize, and refactor code to maximize performance
-
Write comprehensive automated unit tests
-
Inform and encourage the technical growth of the team
-
Support existing programs and modules from both debugging and enhancement perspectives
-
Participate in code reviews and extensive unit testing
-
Write technical documents as part of established methodology
-
Write functional and technical specification documents and collaborate with systems analysts and product owner to ensure solutions align with business objectives
-
Work closely with Q/A team and internal users
Requirements:
-
Requires a four-year degree in Computer Science/Information Technology, Computer/Electrical Engineering or related discipline
-
At least five years of experience in systems analysis and programming, addressing unique issues of architecture and data management
-
Experience to work at the highest technical level of all phases of systems analysis and programming activity across the full scope of software development cycle
-
Experience with Spark, Scala or similar functional programming language
-
Experience with Hadoop data stores and formats like Hive, HBase, and Parquet
-
REST-based Web service development experience
-
Experience with the JVM
-
Experience with SQL and RDBMS technologies
-
Experience building scalable solutions
-
Experience with automated unit testing
-
Strong written and verbal communication skills
-
Ability to work both independently and as part of a team