Mid Data & Software Engineer
- Salary not listed
- Posted 5 days ago · via SmartRecruiters
Hiring in some regions only
Build scalable data pipelines using Scala, Spark, and cloud-native tech
Design, develop, and maintain large-scale data pipelines using Scala, Spark, and cloud-native technologies. Optimize distributed processing systems and ensure the reliability and performance of petabyte-scale workloads. Work within agile value stream teams, collaborating with global stakeholders to deliver high-quality, business-critical data solutions.
Why This Role?
Directly contribute to Experian Marketing Services' core products
Key Responsibilities
- Design and develop large-scale data pipelines using Scala, Spark, and cloud-native technologies
- Optimize distributed processing systems and ensure the reliability and performance of petabyte-scale workloads
- Collaborate within agile value stream teams to deliver high-quality, business-critical data solutions
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related technical field
- Solid experience in software or data engineering
- Hands-on experience with cloud-native data platforms (AWS, GCP, or Azure)
Required Skills
Indonesia Context
- Working Hours Overlap:
- Flexible — work your own hours
View Original Description from SmartRecruitersShow more
Original description from SmartRecruiters
We are looking for a Software Engineer to design, build, and evolve highly scalable and resilient data platform solutions that power Experian Marketing Services’ core products. In this role, you will work on large-scale, cloud-native data pipelines, optimize distributed processing systems, and ensure the reliability and performance of petabyte-scale workloads. You will operate within agile value stream teams, applying strong engineering practices and collaborating with global stakeholders to deliver high-quality, business-critical data solutions. Your key responsibilities Design, develop, and maintain large-scale data pipelines using Scala, Spark, and cloud-native technologies, ensuring high performance, scalability, and reliability. Solve complex data engineering challenges by designing efficient, resilient distributed systems and optimizing data processing workflows. Contribute to production-grade data platforms, delivering high-quality, tested code and supporting end-to-end feature development. Ensure software quality through clean, testable, and well-documented code, code reviews, and adherence to engineering standards. Collaborate within agile value stream teams, working closely with engineers, product owners, and cross-functional stakeholders to deliver aligned technical solutions. Provide technical guidance to peers, contributing to architecture discussions, code reviews, and promoting best engineering practices. Support release and operational processes, including deployments, monitoring, alerting, and continuous improvement of system reliability. Drive improvements in performance, cost efficiency, and scalability of data processing workloads. What we expect from you Bachelor’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience. Solid experience in software or data engineering. Hands-on experience with cloud-native data platforms (AWS, GCP, or Azure), including services such as S3, Glue, Athena, or equivalent. Strong understanding of distributed systems, resiliency patterns, data partitioning, and efficient data access strategies. Experience designing and operating highly parallelized data workloads. Proficiency with Git-based version control systems (GitHub, Bitbucket, etc.). Familiarity with agile methodologies and collaborative development in multi-team environments. Strong communication skills, with the ability to contribute in technical discussions and support peer development. Advanced English proficiency and availability to travel to São Carlos/SP when needed. Nice to have Experience with DBT or other data transformation frameworks. Knowledge of concurrent and parallel programming patterns. Expertise in building and optimizing large-scale data pipelines using Scala and Apache Spark. Experience with functional programming (Scala) or languages such as Java, Python, or Rust. Familiarity with modern data platform architectures and large-scale data ecosystems. At Serasa Experian, we believe that diversity is essential for a healthier and more innovative work environment, where everyone can share experiences and express their ideas. That’s why we promote several initiatives to support inclusive recruitment and the professional development of our people. We also have our affinity groups, created to empower and support individuals from underrepresented groups: ExperianPride (LGBTQIAPN+ community), Ubuntu (racial equity), Women in Experian (gender equity), Aspire (people with disabilities), and Connecting Generations (generations). Experian Careers - Creating a better tomorrow together Find out what its like to work for Experian by clicking here
Not quite right? Similar roles hiring now
See all 5 similar →Employer hires only in specific regions — check eligibility first
Explore related
Market data & reports
Salary & skill-demand research built from our own listings data.
- Skills Remote Employers Ask For in the AI EraMost-named skills in active listings by kind, AI-named skills and the fastest risers. Weekly data.
- Indonesia IT Jobs vs Global Remote (2026)Primary analysis of 2,049 listings: methodology, classification rules, downloadable datasets.
- AI-Skill Demand: Indonesia vs Global Remote (2026)10,000+ postings, taxonomy-first classifier, Wilson CIs, pre-registered before analysis.
- Remote ≠ Remote: The Skills That Open Global Work to Indonesians (2026)12,891 remote listings: the highest-paid coding skills are the most geo-locked for Indonesia-based applicants. CC BY 4.0 aggregate dataset.
- The Compliance Layer of the AI Hiring Stack (2026)6,349 remote listings: 77.2% never state who may apply. Methodology and a CC BY 4.0 aggregate dataset.
- AI in Job Ads: Indonesia vs Global (2026)Global engineering ads naming AI rose from 3.4% to 23% after ChatGPT; Indonesian ads went from 2.2% to 2.8%. 2027 scenarios and a CC BY 4.0 dataset.
- Future of Jobs Index: every quarterly editionOne index per quarter from global remote and Indonesian job ads. Q4 2026 is the baseline (= 100); later editions are measured against it on the same sources.
- Future of Jobs Index, Q3 2026 (pre-baseline)Global remote and Indonesian job ads by job family: AI-skill demand, remote reach, pay transparency and seniority. Every figure with its sample size. CC BY 4.0 dataset.
- Pandora's Box Ep. 1: AI and Southeast Asian Job Ads (2026)118,545 archived job ads, 2019–2026: web and software developer ads shrank on every board, a phone app became the entry ticket, and a Job X-ray for 17 jobs. CC BY 4.0 datasets.
- Cron vs LLM vs LangGraph vs Agent for Social Posts (2026)A pre-registered test of four ways to turn a blog post into social posts, on two models. Automated checks picked a cron template; the model mattered more than the framework.
- Indonesia Hiring Report: Tech vs Non-TechJob demand by field from aggregate open-job counts — never individual listings.
- Indonesia Salary BenchmarkAggregate salary ranges across roles, with open methodology and dataset.
- Indonesian Remote Work Salary & Demand IndexHow much of the global remote job corpus is open to Indonesia, and what it pays (USD) by role.
- Indonesia Quarterly Labor Market ReportLayoffs, funding, salaries & skills per quarter — open aggregates.
- Remote Market Reports by RoleAuto-generated per role family — skills, seniority, companies, salary.
- Global Remote Salary BenchmarkAnnual salary by role & currency, plus the share of listings open worldwide.
This employer appears to hire only in certain regions.