IDC: Hiring- Senior Prompt Engineer / AI Specialist / Technical Analyst – LLM & AI Platforms- New York, NY

Hi,

Please find below the requirement of Senior Prompt Engineer / AI Specialist / Technical Analyst – LLM & AI Platforms- New York, NY – Hybrid

Client Round F2F Must

Job Title

Senior Prompt Engineer / AI Specialist / Technical Analyst – LLM & AI Platforms

Location

New York, NY – Hybrid
Work Model: 3–5 days per week in the office

Experience

10 to 12 years of relevant professional experience across Artificial Intelligence, Machine Learning, Data Science, and/or Full-Stack Application Development.

Position Overview

We are seeking a highly skilled Senior Prompt Engineer / AI Specialist / Technical Analyst to support enterprise-scale Generative AI and Large Language Model (LLM) initiatives, including Service Assist AI and Agent Desktop solutions.

The ideal candidate will have strong hands-on experience in prompt engineering, LLM integration, AI workflow design, Python development, and full-stack application development. This individual will work with multiple AI/LLM platforms, including OpenAI and other enterprise LLM providers, and will be responsible for translating complex business requirements into secure, scalable, and production-ready AI solutions.

The candidate should possess a strong foundation in Data Science and Machine Learning, combined with practical software engineering skills and experience working in the Banking, Financial Services, or Wealth Management domain.

Key Responsibilities

Design, develop, test, and optimize prompts for enterprise LLM and Generative AI applications.
Integrate OpenAI and other enterprise LLM platforms through APIs and SDKs.
Develop AI-powered workflows, services, and applications using Python.
Design and implement LLM-based solutions for conversational AI, Agent Assist, Service Assist, and Agent Desktop use cases.
Translate business and functional requirements into scalable AI/ML solutions.
Develop and integrate REST APIs and AI services with enterprise applications.
Collaborate with Data Scientists, ML Engineers, Software Engineers, Product Managers, and business stakeholders.
Evaluate LLM performance, response quality, accuracy, latency, and cost.
Perform experimentation and model/prompt evaluation to continuously improve AI solutions.
Develop full-stack components and user experiences using Angular, TypeScript, HTML, and CSS.
Implement AI workflows incorporating embeddings, vector search, and Retrieval-Augmented Generation (RAG).
Apply appropriate security, privacy, governance, and responsible AI practices.
Identify and mitigate risks such as hallucinations, prompt injection, data leakage, and inappropriate model responses.
Support deployment, monitoring, troubleshooting, and optimization of AI solutions in enterprise environments.
Ensure solutions comply with organizational standards for security, risk, governance, and data protection.

Required Qualifications

8–10 years of professional experience in AI, Data Science, Machine Learning, Software Engineering, Full-Stack Development, or related fields.
Strong hands-on experience with Generative AI, LLMs, and Prompt Engineering.
Proven experience integrating OpenAI and other LLM/AI platforms through APIs.
Strong proficiency in Python for AI workflows, backend services, automation, and data processing.
Solid understanding of Data Science and Machine Learning fundamentals, including:
- Model evaluation
- Feature engineering
- Experimentation
- Data analysis
- Model performance metrics
Strong full-stack development experience with:
- Angular
- TypeScript
- HTML
- CSS
- REST APIs
Experience designing and implementing enterprise-grade AI applications and workflows.
Strong analytical, problem-solving, communication, and stakeholder-management skills.
Mandatory experience in Core Banking, Financial Services, Banking, or Wealth Management.