New opportunity

Data Engineer II, DSP Analytics

Amazon · Hyderabad, India

About this role

The DSP Analytics team at Amazon is seeking a Data Engineer II to build next-generation data infrastructure that powers Generative AI applications and automated agents. You will work at the intersection of traditional data engineering and modern AI, collaborating with Data Scientists and Economists to turn research into scalable products. Responsibilities: Lead the design of complex, scalable, and secure data architectures. Drive the implementation of large-scale ETL pipelines using AWS technologies. Identify and resolve system-wide performance bottlenecks. Establish best practices for data governance, security, and operational excellence. Collaborate with cross-functional teams to deliver innovative data solutions. Basic Qualifications: 3+ years of data engineering experience. Bachelor's degree in Computer Science, Engineering, or related fields. Proficiency in at least one modern programming language (Python, Ruby, Golang, Java, C++, C#, or Rust). 2+ years of experience analyzing data with Redshift, Oracle, or NoSQL databases. Demonstrated professional or project experience using Generative AI tools like agentic coding assistants or AI-powered IDEs. Preferred Qualifications: Experience with AWS services including Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM. Experience with non-relational databases (object, document, key-value, graph, or column-family stores). Experience designing or building AI agents or multi-agent solutions for workflow automation. Familiarity with agentic AI patterns such as tool use, function calling, and multi-agent orchestration.

For full details about this role, click “Apply on company site” to view the employer’s original posting.

Skills for this role

Data EngineeringData ModelingData WarehousingETL PipelinesPythonRubyGolangJavaC++C#RustRedshiftOracleNoSQLGenerative AIAI AgentsAWSAWS GlueEMRKinesisFireHoseLambdaIAM

Your skill match

Checking your profile…

YOUR NEXT STEP

Get interview-ready for this role

A focused preparation guide, built around this job’s responsibilities and requirements.

✦ AI-generated guide
Preparation suggestions, not the employer’s actual interview questions. Always check the original posting for current requirements.
01

Understand the role

What matters most

  • Architecting Scalable Data Infrastructure for GenAI

    The role requires designing complex, secure, and scalable data architectures that specifically support Generative AI applications and automated agents. You must demonstrate the ability to bridge traditional data engineering with modern AI requirements, ensuring that data pipelines are robust enough to feed AI models and research-driven products.

  • Operationalizing AI-Driven Automation

    Beyond standard ETL, you are expected to build agents that automate the data operations lifecycle. This involves implementing agentic AI patterns such as tool use, function calling, and multi-agent orchestration to streamline engineering workflows and improve system reliability.

  • Driving Operational Excellence and Governance

    You must establish and enforce best practices for data governance, security, and auditability. This includes identifying system-wide performance bottlenecks and ensuring that all data solutions remain maintainable and accessible across the organization while adhering to AWS security standards.

Likely challenges to think through

  • Integrating Traditional ETL with Agentic AI Patterns

    A significant challenge is the technical shift from deterministic ETL pipelines to non-deterministic agentic workflows. Prepare by articulating how you handle the unpredictability of AI-driven outputs while maintaining the strict data quality and auditability standards required in a production environment.

  • Balancing Rapid AI Innovation with System Stability

    Collaborating with Data Scientists and Economists often involves high-velocity experimentation. The challenge is to support this agility without compromising the performance or security of core data infrastructure. Prepare by discussing your strategies for modular design and rigorous testing in hybrid AI/Data environments.

03

Practice your answers

Technical practice

Designing Scalable Data Architectures for GenAI

What to coverDiscuss how you would design a data architecture to support Generative AI applications. Focus on the trade-offs between batch and real-time processing, data lineage, and how to ensure the infrastructure remains scalable and secure as model requirements evolve.

Optimizing ETL Pipelines on AWS

What to coverExplain your approach to identifying and resolving performance bottlenecks in large-scale ETL pipelines using AWS services like Glue or EMR. Mention specific strategies such as partitioning, file format optimization, and resource allocation to improve throughput and reduce latency.

Implementing Agentic AI Patterns

What to coverDescribe your experience with agentic AI patterns such as tool use, function calling, or multi-agent orchestration. Explain how you have integrated these patterns into data engineering workflows to automate tasks or improve data accessibility.

Data Modeling for Diverse Storage Systems

What to coverCompare and contrast data modeling strategies for relational databases like Redshift versus non-relational stores like document or graph databases. Discuss when to choose one over the other based on query patterns, data structure, and scalability needs.

Data Governance and Security Standards

What to coverHow do you establish and maintain data governance and security best practices in a large organization? Address the use of IAM roles, data encryption, and ensuring that data solutions remain auditable and compliant with organizational standards.

Integrating Generative AI Tools in Development

What to coverProvide examples of how you have used AI-powered IDEs or agentic coding assistants to improve your own productivity or code quality. Suggestion: Be prepared to discuss specific instances where these tools helped you debug complex logic or generate boilerplate code efficiently.

Handling Real-time Data Streams

What to coverExplain how you would architect a solution using Kinesis or Firehose to ingest and process real-time data. Discuss how to handle backpressure, ensure data consistency, and integrate these streams into downstream analytical platforms.

Collaborating with Data Scientists and Economists

What to coverDescribe your process for translating research requirements from Data Scientists into scalable production data products. Focus on how you manage expectations, define data contracts, and iterate on infrastructure to support experimental models.

Behavioural practice

Driving Operational Excellence

What to coverDescribe a situation where you identified a significant system-wide performance issue and took the lead to resolve it. Use the STAR method to explain the problem, the specific actions you took to diagnose and fix it, and the measurable impact on system reliability or performance.

Navigating Cross-Functional Collaboration

What to coverTell me about a time you had to collaborate with non-engineering stakeholders to deliver a complex data solution. Explain how you communicated technical constraints and trade-offs to ensure the final product met both business objectives and technical standards.

Adapting to New Technologies

What to coverGive an example of a time you had to quickly learn and implement a new technology or tool to solve a project challenge. Detail your learning process and how you successfully integrated the new tool into your existing workflow.

Managing Technical Debt vs. Innovation

What to coverDescribe a scenario where you had to balance the need for rapid innovation with the necessity of maintaining high-quality, maintainable code. How did you decide what to prioritize and how did you communicate this to your team or leadership?

02

Sharpen your knowledge

Topics to prepare

  • Agentic AI Patterns and Orchestration

    The role requires familiarity with tool use, function calling, and multi-agent orchestration to automate data operations. Exercise: Review documentation on how LLMs interact with external APIs via function calling and design a conceptual architecture for an agent that triggers an AWS Lambda function based on a data quality alert.

  • Scalable Data Architecture for GenAI

    The position involves building infrastructure for Generative AI applications. Exercise: Research and document the differences between traditional batch-oriented data pipelines and the low-latency requirements of GenAI-powered agents, focusing on how to integrate non-relational data stores with real-time streaming services like Kinesis.

  • Data Governance and Operational Excellence

    Amazon emphasizes auditable, secure, and maintainable solutions. Exercise: Outline a strategy for implementing IAM roles and permissions for a multi-user data environment, ensuring that data access is logged and compliant with security standards.

Skills to revise

  • AWS Data Pipeline Implementation

    Proficiency in AWS Glue, EMR, and Kinesis is preferred. Exercise: Create a mock workflow diagram showing how data flows from an S3 bucket through an AWS Glue ETL job into a Redshift data warehouse, including error handling and monitoring steps.

  • Generative AI Tooling Proficiency

    The role requires demonstrated use of AI-powered IDEs or coding assistants. Exercise: Practice using an AI coding assistant to refactor a legacy Python script into a more modular, testable format, specifically focusing on improving performance and readability.

  • Non-Relational Database Design

    Experience with document, key-value, or graph stores is required. Exercise: Compare the schema design requirements for a document store versus a relational database for a specific use case, such as storing metadata for AI-generated artifacts.

04

Your preparation checklist

  • Architect a Scalable Data Pipeline for GenAI

    Prepare a technical walkthrough of a large-scale ETL pipeline you have built using AWS services like Redshift, S3, or Glue. Focus on how you handled performance bottlenecks and ensured data security, as these are core requirements for the DSP Analytics team.

  • Demonstrate Agentic AI Implementation

    Prepare a project summary where you utilized Generative AI tools or built an AI agent to automate a data engineering workflow. Be ready to discuss your experience with agentic patterns such as tool use, function calling, or multi-agent orchestration.

  • Review AWS Data Governance and Security

    Refresh your knowledge on AWS IAM roles, permissions, and data governance best practices. Prepare to explain how you have implemented auditable and maintainable data solutions in a professional environment.

  • Prepare for Cross-Functional Collaboration Scenarios

    Draft examples of how you have worked with Data Scientists or Economists to translate research into production-ready data products. Focus on your communication style and how you align technical infrastructure with business objectives.

  • Formulate Strategic Questions for the Team

    Prepare questions regarding the current data infrastructure challenges within the DSP program, how the team balances traditional data engineering with new GenAI initiatives, and how they measure operational excellence for their automated agents.

AI-generated from the job information · Prepared Oct 30, 2026 (UTC)Useful preparation, not a guarantee of eligibility or an offer.

Availability has not yet been verified. Status can change after a check; confirm on the employer’s website. Report an issue · Our checking policy

KEEP EXPLORING

Similar AI jobs

Related skills and specializations in India. Matched to this role, not your profile.

Explore more jobs
Finding similar opportunities…