Ness Digital Engineering Logo

Ness Digital Engineering

Flagstar -EDH- Data Engineer (AWS, Snowflake, ETL) - Rajesh Arugollu Replacement

Posted 8 Hours Ago
Be an Early Applicant
Remote
Hiring Remotely in India
Senior level
Remote
Hiring Remotely in India
Senior level
Develop and maintain Python-based data extraction, transformation, integration, and migration pipelines across legacy and modern cloud platforms. Build resilient workflows using AWS and Snowflake, implement testing, governance, monitoring, alerting, CI/CD, and cost optimization, and troubleshoot production issues. Collaborate with architects and analysts, establish data engineering standards, and mentor junior engineers.
The summary above was generated by AI

Sr. Python Data Engineer; Must Have: Strong hands-on Python ETL integration experience. Nice to have - AWS Glue, PySpark, Snowpark

Requirements and Responsibilities

What You’ll Do 
  • Develop Python-based solutions for data extraction, transformation, and integration across multiple systems
  • Work with legacy systems (Data Warehouses, ETL tools, BI tools) to extract and standardize metadata, data assets, code base and migrate to a modern cloud platform.  
  • Build resilient, fault-tolerant data integration and processing workflows
  • Build modular, reusable code.
  • Establish robust orchestration and monitoring using AWS and Snowflake services.
  • Ensure governance, security, and cost efficiency.
  • Implement Data quality checks, Tests in pipelines.
  • Support CI/CD integration for data pipelines and contribute to DevOps practices
  • Implement logging, monitoring, and alerting frameworks.
  • Optimize pipelines for performance and cost.
  • Lead troubleshooting and root cause analysis of production issues.
  • Mentor junior engineers and support knowledge sharing within the team
  • Collaborate with architects, analysts.
  • Drive best practices in data engineering standards.
 
What You’ll Bring 
  • Bachelor’s degree or higher in computer science, Information Technology, or a related field.
  • Minimum 7+ years of relevant experience in data engineering, data integration.
  • Minimum 5+ years of hands-on experience with Python for data engineering, data integration and automation.
  • Strong hands-on experience handling structured and semi-structured data (e.g. JSON,  XML)
  • Strong SQL skills and experience working with large-scale datasets
  • Experience with PySpark/Snowpark is a plus.
  • Experience with AWS services such as Glue, S3, Lambda, and SNS is a plus.
  • Experience working with ETL tools and enterprise data integration platforms (e.g. Informatica, SSIS, DataStage)
  • Strong understanding of data warehousing concepts and practices.
  • Familiarity with CI/CD practices for data pipelines.
  • Experience with Agile/Scrum environments.
  • Experience with Snowflake and dbt in production environments is a plus.
  • Excellent analytical and problem-solving skills.
  • Ability to work independently and guide junior resources.
  • Strong communication skills in English (written and verbal).

Similar Jobs

An Hour Ago
Remote or Hybrid
Senior level
Senior level
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Partners with India sales leadership to improve forecasting, pipeline health, revenue analytics, territory planning, productivity, and operational execution. The role analyzes sales performance, identifies risks and opportunities, drives process and data quality improvements, manages Salesforce reporting and workflows, and delivers executive-ready recommendations. It also supports business reviews, sales system adoption, cross-functional initiatives, and the application of business intelligence, generative AI, and automation to improve operations.
Top Skills: Automation TechnologiesAWSBusiness IntelligenceGenerative AiGCPAzureExcelSalesforce
3 Hours Ago
Remote
Gujarat, IND
Senior level
Senior level
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Supports and sustains factory automation systems, including material handling, robots, conveyors, AGVs, AMRs, and tracking tools. Performs installation, commissioning, testing, troubleshooting, preventive maintenance, root cause analysis, and corrective actions. Participates in automation projects, layout reviews, factory acceptance testing, and system buyoffs. Coordinates with facilities, manufacturing, IT/MES, warehouse, equipment engineering teams, vendors, and OEMs to improve reliability, uptime, quality, and efficiency.
Top Skills: Ai-Enabled Predictive Maintenance ToolsAutomated Guided Vehicles (Agv)Automated Storage And Retrieval Systems (Asrs)Autonomous Mobile Robots (Amr)CobotsControllersConveyorsLiftsManufacturing Execution Systems (Mes)PlcRobotsSensorsServo Drives
3 Hours Ago
Remote
Gujarat, IND
Entry level
Entry level
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Develops and maintains on-the-job training curricula, learning resources, certifications, assessments, and controlled documentation. Coordinates training needs, readiness, compliance, and stakeholder meetings. Analyzes data, creates reports and visualizations, manages program metrics, and leads or supports project planning and execution. Establishes process improvements, monitors effectiveness, maintains documentation standards, and follows safety and quality requirements.
Top Skills: Artificial Intelligence

What you need to know about the Kolkata Tech Scene

When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account