Java/Spark Big Data Developer @ Comscore (via CC)

The candidate must have:

• Very good understanding of Linux internals (processes/threads, service management, resource allocation)
• Linux as a daily driver of operations
• Good understanding of Spark internals and mechanics
• Knowledge of Iceberg
• 4+ years of commercial experience with Java
• Proven ability to debug JVM/Java (hopefully in Spark ecosystem)
• Ability to design high performance processing pipelines
• Hands-on, proactive approach
• Familiarity with CI/CD pipelines and DevOps practices
• Proficiency in English enables effective communication in an international environment

If you think you’re a good fit, but don’t meet all the qualifications, let’s talk!

Correct Context is looking for a  Java/Spark Big Data Developer for Comscore in Poland and around.

This project is a 6-month engagement with the possibility of extending the cooperation upon its completion.

Comscore is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement.

Comscore leads in measuring and analyzing audiences across diverse digital platforms. Thrive on using cutting-edge technology, play a vital role as a trusted partner delivering accurate data to global businesses, and collaborate with industry leaders like Facebook, Disney, and Amazon. Contribute to empowering businesses in the digital era across media, advertising, e-commerce, and technology sectors.

We offer:

• Real big data projects, petabytes scale
• An international team
• A small, independent team working environment ‍
• Flexible work time ⏰
• Fully remote or in-office work in Wroclaw, Poland
• 18,000 - 25,000 PLN net/month B2B
• Multikafeteria ️
• Private healthcare
• Free parking

The recruitment process for the Java Developer position has following steps :

1. Technical survey ~ 10min
2. Technical screening - 30 min
3. Technical interview - 1h-2h
4. Final Interview - 1h

,[Taking care of our high-volume (tens of billions of events daily), multi-tenant, and distributed data processing pipelines , Develop and maintain Java-based and Spark-based Big Data processing pipelines, ensuring scalability and performance , Work with distributed systems, contributing to the design and implementation of backend solutions , Collaborate with cross-functional teams to integrate different platforms and ensure smooth data flow , Troubleshoot and debug issues to improve overall system stability , Participate in code reviews and offer guidance on best practices , Debug java/aws/airflow pipelines , Help team to produce better solutions (teaching/code reviews/showing directions) , Design high efficient processing pipelines] Requirements: Java, Spark, Big data, Linux Tools: Jira, Confluence, Bitbucked, GIT, Jenkins, Agile, Kanban. Additionally: Small teams, Sport subscription, Flat structure, International projects, Free parking, Free coffee, Modern office, No dress code, Playroom.