.png)
.png){kind=logo}
Validate end-to-end data flows and risk reporting from source systems into Aurora/PostgreSQL. Test ETL/ELT pipelines, CDC and ingestion scenarios, develop automated tests (Python), execute functional/regression/integration tests, support high-volume EOD validation, log and track defects, and collaborate with engineers and analysts to ensure data accuracy and alignment with business logic.
Job Purpose and Impact
We are building CRR (Corporate Risk Reporting), an enterprise platform delivering critical commodity risk insights. As a QA Engineer, you will be responsible for ensuring the accuracy, reliability, and consistency of data pipelines and risk reporting outputs. You will work closely with data engineers, SQL developers, and Application Developers to validate data flows and ensure alignment with business requirements.
Key Accountabilities
Data & Functional Validation
Pipeline & Ingestion Testing
Test Automation & Execution
Performance & EOD Validation
Defect Management & Collaboration
Qualifications
Required Skills:
Mandatory:
Good to Have:
We are building CRR (Corporate Risk Reporting), an enterprise platform delivering critical commodity risk insights. As a QA Engineer, you will be responsible for ensuring the accuracy, reliability, and consistency of data pipelines and risk reporting outputs. You will work closely with data engineers, SQL developers, and Application Developers to validate data flows and ensure alignment with business requirements.
Key Accountabilities
Data & Functional Validation
- Validate end-to-end data flows from source systems (SAP/ODP, CTRM, pricing) into Aurora/PostgreSQL.
- Perform data validation and reconciliation to ensure accuracy, completeness, and consistency.
- Support validation of risk outputs (positions, exposures, pricing, P&L) against defined business logic
Pipeline & Ingestion Testing
- Test ETL/ELT pipelines for correctness, data integrity, and consistency.
- Validate snapshot and delta ingestion processes, including CDC scenarios.
- Verify handling of edge cases such as data ordering, duplication (idempotency), and recovery.
Test Automation & Execution
- Develop and maintain test cases and automated test scripts for data pipelines and SQL transformations.
- Execute functional, regression, and integration testing across data and reporting layers.
- Contribute to test automation frameworks using Python or similar tools.
Performance & EOD Validation
- Support testing of high-volume data processing, especially end-of-day (EOD) workloads.
- Identify data discrepancies and performance issues during peak processing.
Defect Management & Collaboration
- Log, track, and support resolution of defects and data issues.
- Work closely with engineers and analysts to analyze root causes and validate fixes.
- Participate in test planning, sprint activities, and release validation.
Qualifications
- Minimum requirement of 3 years of relevant work experience, typically reflecting 5+ years in QA/testing for data platforms, ETL pipelines, or analytics systems.
- Proven ability to balance hands-on technical contribution and cross-team influence.
- Strong communication skills with the ability to engage effectively with both technical and business stakeholders.
Required Skills:
Mandatory:
- Strong proficiency in SQL for data validation and analysis.
- Experience with ETL/ELT processes and data pipeline testing.
- Understanding of data quality concepts and validation techniques.
- Familiarity with test automation using Python or similar tools.
- Basic understanding of CDC patterns, schema evolution, and data integrity principles.
Good to Have:
- Experience with AWS data services (Glue, Lambda, Step Functions, DMS).
- Knowledge of PostgreSQL/Aurora databases.
- Exposure to event-driven systems (e.g., Kafka).
- Proficient in containerization and orchestration using Docker and Kubernetes
- Familiarity with financial, trading, or risk management systems
Similar Jobs at Cargill
Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
Design, build, enhance, and support SAP ERP solutions (primarily SD/MM) in a techno-functional role. Develop ABAP RICEF objects, participate in full lifecycle implementations, provide L2/L3 production support, troubleshoot performance issues, and follow ITSM and release/transport processes while collaborating with business stakeholders.
Top Skills:
AbapChange Management)Itsm (Incident ManagementProblem ManagementRicef (Reports Interfaces Conversions Enhancements Forms)Sap AcmSap ErpSap MmSap SdSap Transport/Release Management
Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
The Application Developer supports the integration, implementation, and testing of complex applications, primarily ERP systems, ensuring they align with business objectives while maintaining system stability and user support.
Top Skills:
AbapC#ETLJavaPythonSAP
Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
Design, build, test, monitor, and troubleshoot large-scale integrations using Boomi for UKG Pro WFM. Define data mappings and transformation logic, implement error handling and secure authentication, and partner with global teams to support workforce management implementations and enhancements.
Top Skills:
Api KeysAPIsBoomi AtomsphereOauth2Sap SuccessfactorsUkg BoomiUkg Pro Wfm
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.
