M08 - Data Engineer

Responsibility The Full Stack Engineer / Data Engineer is responsible for designing, developing, deploying, and maintaining scalable, high-performance, and secure web applications. The role requires expertise in frontend and backend development, cloud technologies, DevOps automation, and application security. Engineers must work in an agile, DevOps-driven environment, ensuring high software quality, security, and maintainability. Be responsible for developing backend APIs & working on databases to support the applications. Experience on data transformation, flow and cleaning Design, develop and deploy databases and datasets with operational data store, data lake and data virtualization. Take full ownership of end-to-end application development, integrating frontend, backend, and cloud infrastructure. Design, develop, and maintain responsive, accessible, and performant web applications. Implement modern frontend architectures, ensuring reusability, scalability, and security. Develop high-performance backend services and APIs, ensuring reliability, security, and observability. Work with Quality Assurance (QA) engineers to ensure automated test coverage and proactively fix bugs and defects. Optimize full-stack CI/CD deployment strategies, ensuring seamless and automated releases. Work with DevOps teams to automate infrastructure provisioning, monitoring, and cloud deployments. Ensure full-stack security, including authentication, authorization, API security, and frontend security best practices. Continuously evaluate and adopt emerging technologies to improve application performance and developer productivity. Manage and resolve day-to-day IT related issues pertaining to application, infrastructure or security, to facilitate smooth running of daily operations Troubleshoot and resolve complex technical issues in low-code applications Educational Background Tertiary education in Computer/Computer Science or Electronics Engineering or Information Technology or equivalent Experience and Skills Needed Proficient in database design and various databases (e.g. SQL, PostgreSQL, AWS S3, Athena, etc). Familiar with W3C Document Object Model and customized web scraping (e.g. BeautifulSoup, react, CasperJS, PhantomJS, Selenium, Nodejs, etc). Comfortable in at least one scripting language (eg. SQL, Python). Proficient in building batch jobs (e.g. AWS Database Migration Services (DMS), Python, AWS Lambda, ECS Container task, Eventbridge, AWS Glue). Knowledge about system design, data structure and algorithms. Relevant working experience as a developer or equivalent in at least 3 Agile/ full project development life cycle and a minimum of 5 years experience in relevant role. Strong proficiency in both frontend and backend development Strong problem-solving skills and able to prioritise and manage multiple tasks Ability to work both independently and as part of a team with professionals at all levels Frontend Technologies: JavaScript and TypeScript. Frontend frameworks such as React.js, Next.js, Vue.js Experience with wireframing and prototyping tools (Figma). Backend Technologies: Node.js RESTful APIs, GraphQL, gRPC, and WebSockets for service communication. Backend Scalability & API Design: Strong experience in API design principles, including REST, GraphQL, gRPC, and WebSockets. Familiarity with backend service scalability strategies (horizontal scaling, autoscaling, load balancing). DevOps, Cloud, and Infrastructure: Experience with CI/CD pipelines (GitHub Actions, GitLab CI, ArgoCD, Jenkins). Cloud solutioning and hand-on experience with AWS Cloud (ECS Fargate containers, API Gateway, RDS PostgreSQL, Networking). Government Commercial Cloud – GCC will be beneficial. Experience with containerization and orchestration (Docker, Kubernetes). Familiarity with Infrastructure as Code (IaC) tools (Terraform, CloudFormation) Security Best Practices: Strong knowledge of frontend security (CSP, CORS, XSS prevention). Able to build Scripts and API Integrations with knowledge of JWT, JWKS, Cognito and Authorisers. Familiarity with cloud security (IAM, Secrets Management, OWASP Top 10). Software Quality & Testing: Experience with unit and integration testing (Jest, Cypress, Playwright, Pact). Backend testing using Postman, Supertest, contract testing. Bonus Experience (Added Advantage): Relevant experience in and knowledge of microservice architecture Experience in working will LLM, e.g. Open AI, Amazon Q, Gemini Familiarity with governance, adoption of digital services in enterprise IT environments. Work experience and strong troubleshooting skills in resolving application, infrastructure (including desktop, server, network) and security related issues