Role – Fulltime
About the job
We are currently looking for a successful Big Data Specialist Engineer to join our team.
Your Responsibilities:
- You will have In-depth knowledge of Big Data technologies – Spark, HDFS, Hive, Kudu, Impala
- Solid programming experience in Python, Java, Scala, or other statically typed programming language
- You will design, deliver and run an cloudera based data lake solution
- Experience working with Data Governance tools like Apache Sentry, Kerberos, Atlas, Ranger
- Experience working with streaming data with technologies like Kafka, Spark streaming, Apache
- Demonstrated experience with systems engineering and systems architecture best practices
- Demonstrated experience capturing and processing streaming sensor data
- Experience creating data architectures to enable Artificial Intelligence use cases
Qualification:
- Bachelor’s degree in Engineering, Computer Science, or equivalent
- Minimum 5 years’ experience with Big Data ETL development, Spark preferred
- Minimum 5 years’ experience in Python
- Minimum 5 years’ experience with SQL, multiple RDBMS
- Experience with streaming technologies for Change Data Capture (CDC) from OLTP systems – Kinesis, Debezium and Kafka.
- Develop, implement and optimize streaming, data lake, and analytics big data solutions
- Big Data Certifications
We offer you
- A good salary matching your level of experience, plus a yearly performance appraisal/hike
- A company sponsored visa along with health insurance
- Leave benefits as per UAE labour law
- Annual airline ticket to your home country
- Relocation assistance
- The most up to date hardware and software in order to ensure you complete your job in the best way possible